diff --git a/main/.doctrees/environment.pickle b/main/.doctrees/environment.pickle index 293edb584..c4454e91a 100644 Binary files a/main/.doctrees/environment.pickle and b/main/.doctrees/environment.pickle differ diff --git a/main/.doctrees/tests/eval.doctree b/main/.doctrees/tests/eval.doctree index 8877dcc3b..5f7e753f4 100644 Binary files a/main/.doctrees/tests/eval.doctree and b/main/.doctrees/tests/eval.doctree differ diff --git a/main/_modules/gsplat/cuda/_torch_impl.html b/main/_modules/gsplat/cuda/_torch_impl.html index 2cb202337..6981353f0 100644 --- a/main/_modules/gsplat/cuda/_torch_impl.html +++ b/main/_modules/gsplat/cuda/_torch_impl.html @@ -4,7 +4,7 @@ - + gsplat.cuda._torch_impl - gsplat documentation diff --git a/main/_modules/gsplat/cuda/_wrapper.html b/main/_modules/gsplat/cuda/_wrapper.html index 1bf3d0acf..5b95f3205 100644 --- a/main/_modules/gsplat/cuda/_wrapper.html +++ b/main/_modules/gsplat/cuda/_wrapper.html @@ -4,7 +4,7 @@ - + gsplat.cuda._wrapper - gsplat documentation diff --git a/main/_modules/gsplat/rendering.html b/main/_modules/gsplat/rendering.html index 55dd64713..bd6f38e2a 100644 --- a/main/_modules/gsplat/rendering.html +++ b/main/_modules/gsplat/rendering.html @@ -4,7 +4,7 @@ - + gsplat.rendering - gsplat documentation diff --git a/main/_modules/gsplat/strategy/default.html b/main/_modules/gsplat/strategy/default.html index 1451fabda..5d52b2060 100644 --- a/main/_modules/gsplat/strategy/default.html +++ b/main/_modules/gsplat/strategy/default.html @@ -4,7 +4,7 @@ - + gsplat.strategy.default - gsplat documentation diff --git a/main/_modules/gsplat/strategy/mcmc.html b/main/_modules/gsplat/strategy/mcmc.html index c96e68a18..d504457f6 100644 --- a/main/_modules/gsplat/strategy/mcmc.html +++ b/main/_modules/gsplat/strategy/mcmc.html @@ -4,7 +4,7 @@ - + gsplat.strategy.mcmc - gsplat documentation diff --git a/main/_modules/index.html b/main/_modules/index.html index 8aafdf39e..bf9fdbf2b 100644 --- a/main/_modules/index.html +++ b/main/_modules/index.html @@ -4,7 +4,7 @@ - + Overview: module code - gsplat documentation diff --git a/main/_sources/tests/eval.rst.txt b/main/_sources/tests/eval.rst.txt index c8ba2f2e7..e5c0c5576 100644 --- a/main/_sources/tests/eval.rst.txt +++ b/main/_sources/tests/eval.rst.txt @@ -21,6 +21,32 @@ exactly the same performance on PSNR, SSIM, LPIPS, and converged number of Gauss Powered by `gsplat`'s efficient CUDA implementation, the training takes up to **4x less GPU memory** with up to **15% less time** to finish than the official implementation. +Feature Ablation +---------------------------------------------- +Evaluation of features provided in `gsplat` on Mip-NeRF (averaged over 7 scenes). We ablate `gsplat` with default settings, with absgrad and mcmc densification strategies, and antialiased mode. +Absgrad method uses `--grow_grad2d 0.0006` config. These results are obtained with an A100. + ++-----------------------------+-------+-------+-------+----------+---------+------------+ +| | PSNR | SSIM | LPIPS | Num GSs | Mem (GB)| Time (min) | ++=============================+=======+=======+=======+==========+=========+============+ +| gsplat (default settings) | 29.00 | 0.87 | 0.14 | 3237318 | 5.62 | 19.39 | ++-----------------------------+-------+-------+-------+----------+---------+------------+ +| absgrad | 29.11 | 0.88 | 0.12 | 2465986 | 4.40 | 18.10 | ++-----------------------------+-------+-------+-------+----------+---------+------------+ +| antialiased | 29.03 | 0.87 | 0.14 | 3377807 | 5.87 | 19.52 | ++-----------------------------+-------+-------+-------+----------+---------+------------+ +| mcmc (1 mill) | 29.18 | 0.87 | 0.14 | 1000000 | 1.98 | 15.42 | ++-----------------------------+-------+-------+-------+----------+---------+------------+ +| mcmc (2 mill) | 29.53 | 0.88 | 0.13 | 2000000 | 3.43 | 21.79 | ++-----------------------------+-------+-------+-------+----------+---------+------------+ +| mcmc (3 mill) | 29.65 | 0.89 | 0.12 | 3000000 | 4.99 | 27.63 | ++-----------------------------+-------+-------+-------+----------+---------+------------+ +| absgrad & antialiased | 29.14 | 0.88 | 0.13 | 2563156 | 4.57 | 18.43 | ++-----------------------------+-------+-------+-------+----------+---------+------------+ +| mcmc & antialiased | 29.23 | 0.87 | 0.14 | 1000000 | 2.00 | 15.75 | ++-----------------------------+-------+-------+-------+----------+---------+------------+ + + Trains Faster with Less GPU Memory ---------------------------------------------- diff --git a/main/apis/rasterization.html b/main/apis/rasterization.html index 68a24f96a..b7ad6b7e2 100644 --- a/main/apis/rasterization.html +++ b/main/apis/rasterization.html @@ -5,7 +5,7 @@ - + Rasterization - gsplat documentation diff --git a/main/apis/strategy.html b/main/apis/strategy.html index 1bb4fa6fc..7b52f0e92 100644 --- a/main/apis/strategy.html +++ b/main/apis/strategy.html @@ -5,7 +5,7 @@ - + Densification Strategy - gsplat documentation diff --git a/main/apis/utils.html b/main/apis/utils.html index 784931e75..2520ff010 100644 --- a/main/apis/utils.html +++ b/main/apis/utils.html @@ -5,7 +5,7 @@ - + Utils - gsplat documentation diff --git a/main/conventions/data_conventions.html b/main/conventions/data_conventions.html index 90e99ffe3..adf855886 100644 --- a/main/conventions/data_conventions.html +++ b/main/conventions/data_conventions.html @@ -5,7 +5,7 @@ - + Data Conventions - gsplat documentation diff --git a/main/examples/colmap.html b/main/examples/colmap.html index e04c4d59b..84f0f59cf 100644 --- a/main/examples/colmap.html +++ b/main/examples/colmap.html @@ -5,7 +5,7 @@ - + Fit a COLMAP Capture - gsplat documentation diff --git a/main/examples/image.html b/main/examples/image.html index 3c15835d8..4723366fa 100644 --- a/main/examples/image.html +++ b/main/examples/image.html @@ -5,7 +5,7 @@ - + Fit a Single Image - gsplat documentation diff --git a/main/examples/large_scale.html b/main/examples/large_scale.html index 3440b9981..5c116adfd 100644 --- a/main/examples/large_scale.html +++ b/main/examples/large_scale.html @@ -5,7 +5,7 @@ - + Render a Large Scene - gsplat documentation diff --git a/main/genindex.html b/main/genindex.html index 0953abc3f..c53010e01 100644 --- a/main/genindex.html +++ b/main/genindex.html @@ -4,7 +4,7 @@ - Index - gsplat documentation + Index - gsplat documentation diff --git a/main/index.html b/main/index.html index c29ec49f8..13af770dd 100644 --- a/main/index.html +++ b/main/index.html @@ -5,7 +5,7 @@ - + gsplat documentation diff --git a/main/migration/migration_inria.html b/main/migration/migration_inria.html index 0842a5850..21204d380 100644 --- a/main/migration/migration_inria.html +++ b/main/migration/migration_inria.html @@ -5,7 +5,7 @@ - + Migrate from diff-gaussian-rasterization - gsplat documentation diff --git a/main/migration/migration_legacy.html b/main/migration/migration_legacy.html index 9d57b7777..3308fb5a1 100644 --- a/main/migration/migration_legacy.html +++ b/main/migration/migration_legacy.html @@ -5,7 +5,7 @@ - + Migrate from gsplat v0.1.11 - gsplat documentation diff --git a/main/search.html b/main/search.html index 6de66cc1a..3b81c1c14 100644 --- a/main/search.html +++ b/main/search.html @@ -5,7 +5,7 @@ - + Search - gsplat documentation diff --git a/main/searchindex.js b/main/searchindex.js index da50aabaf..2196889f0 100644 --- a/main/searchindex.js +++ b/main/searchindex.js @@ -1 +1 @@ -Search.setIndex({"alltitles": {"Basic Usage": [[9, "basic-usage"]], "Citations": [[7, "citations"]], "Color as Spherical Harmonics": [[9, "color-as-spherical-harmonics"]], "Contributing": [[7, "contributing"]], "Conventions": [[7, null]], "Data Conventions": [[3, null]], "Densification Strategy": [[1, null]], "Depth Rendering": [[9, "depth-rendering"]], "Evaluation": [[10, null]], "Examples": [[7, null]], "Fit a COLMAP Capture": [[4, null]], "Fit a Single Image": [[5, null]], "Installation": [[7, "installation"]], "Links": [[7, "links"]], "Migrate from diff-gaussian-rasterization": [[8, null]], "Migrate from gsplat v0.1.11": [[9, null]], "Migration": [[7, null]], "Overview": [[7, "overview"]], "Performance on Mip-NeRF 360 Captures (Averaged Over 7 Scenes)": [[10, "id1"]], "Profiling": [[11, null]], "Python API": [[7, null]], "Rasterization": [[0, null]], "Render Feature Maps: 32 Channel": [[11, "render-feature-maps-32-channel"]], "Render RGB Images": [[11, "render-rgb-images"]], "Render a Large Scene": [[6, null], [11, "render-a-large-scene"]], "Reproduced Metrics": [[10, "reproduced-metrics"]], "Rotation Convention": [[3, "rotation-convention"]], "Testing and verifying CUDA implementations": [[12, "testing-and-verifying-cuda-implementations"]], "Tests": [[7, null], [12, null]], "Trains Faster with Less GPU Memory": [[10, "trains-faster-with-less-gpu-memory"]], "Utils": [[2, null]], "View Matrix": [[3, "view-matrix"]], "gsplat": [[7, null]]}, "docnames": ["apis/rasterization", "apis/strategy", "apis/utils", "conventions/data_conventions", "examples/colmap", "examples/image", "examples/large_scale", "index", "migration/migration_inria", "migration/migration_legacy", "tests/eval", "tests/profile", "tests/tests"], "envversion": {"sphinx": 62, "sphinx.domains.c": 3, "sphinx.domains.changeset": 1, "sphinx.domains.citation": 1, "sphinx.domains.cpp": 9, "sphinx.domains.index": 1, "sphinx.domains.javascript": 3, "sphinx.domains.math": 2, "sphinx.domains.python": 4, "sphinx.domains.rst": 2, "sphinx.domains.std": 2, "sphinx.ext.intersphinx": 1, "sphinx.ext.viewcode": 1, "sphinxcontrib.bibtex": 9}, "filenames": ["apis/rasterization.rst", "apis/strategy.rst", "apis/utils.rst", "conventions/data_conventions.rst", "examples/colmap.rst", "examples/image.rst", "examples/large_scale.rst", "index.rst", "migration/migration_inria.rst", "migration/migration_legacy.rst", "tests/eval.rst", "tests/profile.rst", "tests/tests.rst"], "indexentries": {"accumulate() (in module gsplat)": [[2, "gsplat.accumulate", false]], "check_sanity() (defaultstrategy method)": [[1, "gsplat.DefaultStrategy.check_sanity", false]], "check_sanity() (mcmcstrategy method)": [[1, "gsplat.MCMCStrategy.check_sanity", false]], "defaultstrategy (class in gsplat)": [[1, "gsplat.DefaultStrategy", false]], "fully_fused_projection() (in module gsplat)": [[2, "gsplat.fully_fused_projection", false]], "initialize_state() (defaultstrategy method)": [[1, "gsplat.DefaultStrategy.initialize_state", false]], "initialize_state() (mcmcstrategy method)": [[1, "gsplat.MCMCStrategy.initialize_state", false]], "isect_offset_encode() (in module gsplat)": [[2, "gsplat.isect_offset_encode", false]], "isect_tiles() (in module gsplat)": [[2, "gsplat.isect_tiles", false]], "mcmcstrategy (class in gsplat)": [[1, "gsplat.MCMCStrategy", false]], "persp_proj() (in module gsplat)": [[2, "gsplat.persp_proj", false]], "quat_scale_to_covar_preci() (in module gsplat)": [[2, "gsplat.quat_scale_to_covar_preci", false]], "rasterization() (in module gsplat)": [[0, "gsplat.rasterization", false]], "rasterization_inria_wrapper() (in module gsplat)": [[2, "gsplat.rasterization_inria_wrapper", false]], "rasterization_legacy_wrapper() (in module gsplat)": [[2, "gsplat.rasterization_legacy_wrapper", false]], "rasterize_to_indices_in_range() (in module gsplat)": [[2, "gsplat.rasterize_to_indices_in_range", false]], "rasterize_to_pixels() (in module gsplat)": [[2, "gsplat.rasterize_to_pixels", false]], "spherical_harmonics() (in module gsplat)": [[2, "gsplat.spherical_harmonics", false]], "step_post_backward() (defaultstrategy method)": [[1, "gsplat.DefaultStrategy.step_post_backward", false]], "step_post_backward() (mcmcstrategy method)": [[1, "gsplat.MCMCStrategy.step_post_backward", false]], "step_pre_backward() (defaultstrategy method)": [[1, "gsplat.DefaultStrategy.step_pre_backward", false]], "world_to_cam() (in module gsplat)": [[2, "gsplat.world_to_cam", false]]}, "objects": {"gsplat": [[1, 0, 1, "", "DefaultStrategy"], [1, 0, 1, "", "MCMCStrategy"], [2, 2, 1, "", "accumulate"], [2, 2, 1, "", "fully_fused_projection"], [2, 2, 1, "", "isect_offset_encode"], [2, 2, 1, "", "isect_tiles"], [2, 2, 1, "", "persp_proj"], [2, 2, 1, "", "quat_scale_to_covar_preci"], [0, 2, 1, "", "rasterization"], [2, 2, 1, "", "rasterization_inria_wrapper"], [2, 2, 1, "", "rasterization_legacy_wrapper"], [2, 2, 1, "", "rasterize_to_indices_in_range"], [2, 2, 1, "", "rasterize_to_pixels"], [2, 2, 1, "", "spherical_harmonics"], [2, 2, 1, "", "world_to_cam"]], "gsplat.DefaultStrategy": [[1, 1, 1, "", "check_sanity"], [1, 1, 1, "", "initialize_state"], [1, 1, 1, "", "step_post_backward"], [1, 1, 1, "", "step_pre_backward"]], "gsplat.MCMCStrategy": [[1, 1, 1, "", "check_sanity"], [1, 1, 1, "", "initialize_state"], [1, 1, 1, "", "step_post_backward"]]}, "objnames": {"0": ["py", "class", "Python class"], "1": ["py", "method", "Python method"], "2": ["py", "function", "Python function"]}, "objtypes": {"0": "py:class", "1": "py:method", "2": "py:function"}, "terms": {"": [0, 2, 6, 10], "0": [0, 1, 2, 7, 8, 9, 10, 11], "00": 11, "0002": 1, "0008": 1, "005": 1, "01": [0, 1, 2], "01m": 10, "02": 10, "02m": 10, "04": 10, "05": [1, 11], "06": 10, "06109": 1, "06m": 10, "07": 10, "075": 10, "078": 10, "08": [10, 11], "094": 10, "096": 10, "1": [0, 1, 2, 3, 7, 10, 11], "10": [9, 10, 11], "100": [0, 1, 2, 8], "1000": 1, "1000000": 1, "10000000000": [0, 2], "107m": 11, "11": [7, 8, 10, 11], "11gb": 8, "11m": 10, "12": 11, "123": 10, "124": 11, "125": 10, "127": 10, "128": 1, "129": 11, "13": 10, "130": 10, "132": [10, 11], "133": 10, "135": 10, "138": 10, "14": [10, 11], "1422": 10, "15": [1, 7, 10], "150": 0, "15000": 1, "153": 10, "154": 10, "155": 10, "1552": 10, "157": [10, 11], "15_000": 1, "16": [0, 2, 10], "160": 11, "162": 10, "1621": 10, "163": 8, "164": [10, 11], "166": 8, "168": [10, 11], "16m": 10, "17": [10, 11], "1708": 10, "171": 11, "172": 10, "1725": 10, "177": 10, "1773": 10, "17m": 10, "18": [8, 11], "19": 10, "19m": 10, "1_000_000": 1, "1e": [1, 9], "1e10": [0, 2], "2": [0, 2, 3, 9, 10, 11], "20": [8, 10], "200": 0, "2000": 5, "202": 10, "2020": 10, "2023": 7, "204": 10, "206": 10, "207": 10, "21": [10, 11], "2144": 10, "217": 10, "219": 10, "21m": 10, "22": 10, "2299": 10, "23": [10, 11], "2366": 10, "24": 11, "2404": 1, "24gb": 11, "24m": 10, "25": [1, 10, 11], "25000": 1, "253": 10, "254": 10, "256": 5, "25_000": 1, "25m": 10, "26": [8, 10], "26m": 10, "27": 10, "28": [10, 11], "29": 10, "2964": 10, "2980": 10, "299": 10, "2d": [0, 1, 2], "3": [0, 1, 2, 3, 6, 9, 10, 11], "30": 10, "300": 0, "3000": 1, "301": 10, "3013": 10, "304": 10, "3092": 10, "30k": 10, "30m": 6, "31": [10, 11], "318": 10, "319": 10, "32": [0, 2, 10], "321": 10, "324": 10, "329": 10, "33": 10, "336": 10, "33m": 10, "34": 11, "340": 10, "35": 11, "35m49": 10, "36": [10, 11], "360": 7, "360_v2": [4, 6], "364": 10, "36546ce": 10, "37": 11, "37m13": 10, "38": 11, "389": 10, "39": 11, "398": 8, "3d": [0, 1, 3, 4, 7], "3dg": [1, 6], "3gb": 10, "3x3": 3, "4": [0, 1, 2, 4, 6, 9, 10, 11], "40": 11, "41": 11, "415": 10, "42": 11, "427": 10, "43": 11, "436": 10, "44": 11, "45": 11, "46": 11, "47": [10, 11], "48": 11, "482": 8, "48m": 10, "49m": 11, "4m05": 10, "4x": [7, 10], "5": [6, 10, 11], "50": 10, "500": 1, "500000": 1, "52": 11, "53": [10, 11], "55m": 10, "56": 10, "57": 10, "57m": 10, "58": 10, "59": [10, 11], "59m": 10, "5e5": 1, "5m35": 10, "6": [2, 10, 11], "61": [10, 11], "62": [10, 11], "62m": 10, "63m": 10, "64": [1, 2, 10], "66": [10, 11], "662": 10, "668": 10, "67": 11, "6acdce4": 10, "7": 11, "70": 10, "71": 10, "71m": 10, "720": 10, "721": 10, "73": 10, "75": 10, "75m": 10, "763": 10, "764": 10, "768": 10, "771": 10, "78gb": 8, "78m": 10, "79": 10, "79m": 10, "7k": 10, "8": [8, 10, 11], "81m": 10, "82": 10, "8237": 8, "824": 10, "829": 10, "82m": 10, "83": 11, "831": 10, "833": 10, "8366": 8, "84": 11, "84m": 10, "86": [10, 11], "863": 10, "865": 10, "870": 10, "877": 10, "878": 10, "88": [10, 11], "89": 10, "893": 10, "8ea2ea3": 11, "9": [8, 10, 11], "902": 10, "906": 10, "907": 10, "91": 11, "918": 10, "921": 10, "922": 10, "925": 10, "926": 10, "93": 10, "941": 10, "95": 10, "97": 11, "99": 10, "9x9": 6, "A": [0, 1, 2], "And": [7, 11], "But": [0, 2, 11], "For": [0, 1, 6, 8], "If": [0, 1, 2, 9, 11], "In": [0, 1, 2, 8, 9], "It": [0, 1, 2, 4, 7, 11], "Near": 2, "No": 2, "On": [1, 8], "Or": 6, "The": [0, 1, 2, 4, 5, 6, 9, 10, 11, 12], "Then": 0, "These": 2, "To": 7, "With": 6, "_": [3, 9], "aalto": 7, "abl": 4, "abov": [1, 11], "absg": [0, 1], "absgrad": [0, 1, 2, 7], "absolut": [0, 1], "abstract": 1, "acceler": 7, "access": [0, 9], "accquir": 2, "accumul": [0, 2, 9], "accumulated_depth": 9, "achiev": 9, "acm": 7, "activ": [0, 9], "ad": [0, 2], "adam": 1, "addit": 11, "addition": 8, "advisor": 7, "affect": 11, "after": [1, 11], "agre": 12, "ai": 7, "alia": 0, "alias": [2, 7], "align": [8, 9], "all": [0, 2], "alloc": 11, "allow": [0, 4, 5, 6], "along": [1, 11], "alpah": 2, "alpha": [0, 2, 9], "also": [0, 1, 4, 5, 7, 8, 11, 12], "amazon": 7, "amount": [9, 11], "an": [0, 1, 2, 7], "angjoo": 7, "ani": [1, 7, 12], "annot": 2, "anti": [2, 7], "antialias": [0, 2], "api": [6, 8, 9], "appli": [0, 6], "approxim": 0, "ar": [0, 1, 2, 6, 7, 8, 9, 10, 11, 12], "arbitrari": 1, "argument": [0, 9, 11], "arxiv": 1, "assertionerror": 1, "attribut": [1, 2, 11], "autograd": 2, "automat": [6, 9, 12], "avail": [7, 9], "averag": 1, "awai": [0, 6], "backend": [2, 6, 7, 8, 11], "background": [0, 2, 9], "backpropag": 2, "backward": [0, 1, 2, 11], "band": [0, 9], "base": [0, 1, 2, 4, 8], "bash": 10, "basic": [2, 5], "batch": [0, 2, 7, 8, 11], "batch_siz": 11, "befor": [1, 9, 11], "begin": [0, 3], "below": [0, 1, 2, 5, 9], "benchmark": 10, "berkelei": 7, "bernhard": 7, "besid": 1, "better": [1, 4, 8], "between": [0, 2, 8, 11], "bicycl": 10, "bind": 7, "bit": 2, "block_width": 9, "blow": 6, "bmatrix": [0, 3], "bonsai": 10, "bool": [0, 1, 2], "boolen": 2, "born": 7, "both": 0, "bound": 0, "branch": 12, "brent": 7, "browser": 4, "bug": 7, "bwd": 11, "c": [0, 2], "calc_compens": 2, "calcul": 11, "calibr": 1, "call": [1, 2, 9], "callback": 1, "cam": [0, 3], "camera": [0, 2, 3, 6, 11], "camera_id": [0, 2], "camtoworld": 9, "can": [0, 1, 2, 5, 6, 7, 9, 10], "cap_max": 1, "capabl": 7, "captur": 7, "care": 11, "carlo": 1, "case": [0, 2, 9, 11], "cd": 10, "center": [0, 3], "chain": 1, "chang": [8, 9], "channel": [0, 2], "channel_chunk": 0, "check": 1, "check_san": 1, "chunk": 0, "ckpt": 6, "ckpt_6999": 6, "clamp_min": 9, "class": 1, "classic": 0, "clip": 0, "clip_thresh": 9, "close": 0, "closer": 9, "code": [6, 8, 9], "coeff": 2, "coeffici": [0, 2, 9], "collect": 2, "colmap": 7, "color": [0, 1, 2], "column": 2, "com": [2, 7], "come": [7, 10], "command": [2, 10], "commit": [8, 10, 11], "compar": 7, "comparis": [2, 4], "compat": 8, "compens": [0, 2], "complet": 0, "composit": [0, 2], "comput": [0, 1, 2], "compute_covar": 2, "compute_preci": 2, "comsum": 2, "condit": 1, "conduct": [10, 11], "configur": 6, "conic": [0, 2, 9], "consum": 0, "consumpt": 11, "contributor": 7, "control": 0, "convens": 0, "convent": 1, "converg": 10, "convers": 9, "convert": [2, 9], "coo": [0, 2, 11], "coordin": 2, "core": 7, "correspond": [1, 2], "could": [0, 2, 9, 11], "counter": 10, "coupl": 9, "covar": 2, "covari": [0, 2], "cuda": [2, 6, 7, 8, 10, 11], "curios": 7, "current": [0, 1, 2, 11], "custom": 5, "cx": 9, "cy": 9, "d": [0, 2, 7, 9], "data": [4, 6, 7, 11], "data_dir": [4, 6], "data_factor": [4, 6], "debug": 2, "default": [0, 1, 2], "defaultstrategi": 1, "defin": [0, 1, 2, 3], "degre": [0, 2], "degrees_to_us": 2, "demonstr": 9, "denot": 11, "densif": 7, "depend": [0, 2], "deprec": 9, "depth": [0, 2, 3, 7], "design": [1, 6, 7], "desir": 2, "det": 0, "detail": [0, 1, 4, 7, 9, 11], "develop": [7, 11], "devic": [0, 9], "diag": 0, "dict": [0, 1, 2], "dict_kei": 0, "dictionari": 0, "diff": [2, 6, 7, 11], "differ": [2, 10, 11], "differenti": [0, 5, 7], "dimension": 3, "dir": 2, "direct": 2, "disabl": 0, "disregard": 6, "distanc": 2, "distribut": 1, "document": 9, "doe": 4, "done": 0, "drettaki": 7, "duplic": 1, "dure": [0, 1, 2], "e": [1, 2, 6, 9], "each": [0, 1, 2, 11], "ed": [0, 9], "effect": [0, 2, 11], "effici": [0, 2, 6, 7, 10, 11], "egienvalu": 0, "either": [1, 2], "element": 2, "els": 0, "empti": 2, "enabl": [1, 2, 7], "encod": 2, "end": [0, 2, 3], "enjoi": 9, "ensur": 1, "eps2d": [0, 2], "epsilon": [0, 2], "equal": 0, "equat": 0, "equip": 7, "equival": 9, "especi": 0, "essenti": 2, "etc": [1, 7, 8], "evalu": [4, 7, 11], "even": 7, "everi": 1, "exact": 4, "exactli": [1, 10], "exampl": [0, 1, 2, 4, 5, 6, 8, 10], "exclud": 11, "exclus": 2, "execut": 1, "exist": 2, "expand": 7, "expect": [0, 1, 2, 9], "expected_depth": 9, "experiment": 1, "explain": 3, "explicitli": 9, "expos": 2, "extra": [1, 7], "extrem": [0, 7], "ey": 0, "f_": 0, "factor": [0, 2], "fals": [0, 1, 2, 11], "far": [0, 2, 6], "far_plan": [0, 2], "fast": 0, "faster": [0, 7], "featur": [0, 1, 2, 7], "features1": 1, "features2": 1, "feedback": 7, "few": 11, "field": [0, 1, 7], "file": 5, "fine": [0, 1], "finish": 10, "first": [0, 6], "fit": 7, "flag": 5, "flatten": 2, "flatten_id": [0, 2], "flattend": 2, "float": [0, 1, 2], "focal": 0, "folder": 12, "follow": [0, 1, 2, 4, 7], "footprint": [0, 4, 7], "fork": [8, 10], "format": [1, 2], "forward": [1, 11], "found": [0, 6], "four": 3, "fp": 11, "fr": 7, "frac": 0, "frame": 3, "free": [0, 8], "from": [1, 2, 6, 7, 10], "frustum": [2, 11], "full": 2, "full_eval_m360": 10, "fulli": [2, 8], "fully_fused_project": [2, 9], "function": [0, 1, 2, 8, 9, 11], "fungraph": 7, "further": 11, "fuse": 2, "futur": 9, "fwd": 11, "fx": 9, "fy": 9, "g": [0, 1, 2, 6, 9], "garden": [4, 6, 10], "gaussian": [0, 1, 2, 4, 5, 6, 7, 10, 11], "gaussian_id": [0, 2], "gb": [10, 11], "georg": 7, "georgio": 7, "get": [0, 5, 7, 8], "git": 7, "github": [2, 7, 12], "given": 0, "glob_scal": 9, "global": 2, "go": 0, "gpu": [2, 6, 11], "grad": 11, "gradient": [0, 1, 2, 7, 8, 11], "graphdeco": 2, "graphic": 7, "greatest": [7, 9], "greatli": 11, "grid": 6, "group": 0, "grow": 7, "grow_grad2d": 1, "grow_scale2d": 1, "grow_scale3d": 1, "gsplat": [1, 2, 6, 8, 10, 11], "gss": [1, 10], "guassian": 1, "ha": [1, 2, 11], "hand": 0, "handl": 9, "happen": 0, "harmon": 2, "have": [1, 2, 4], "height": [0, 2, 5, 9], "help": [0, 7, 9], "here": [3, 6, 9, 10, 11], "heurist": 1, "high": 1, "higher": 1, "highli": 1, "hler": 7, "how": 1, "http": [2, 7], "huge": 9, "i": [0, 1, 2, 3, 6, 7, 8, 9, 10, 11], "id": 2, "idea": 2, "ignor": 2, "imag": [0, 1, 2, 7, 10], "image_fit": 5, "image_height": 2, "image_width": 2, "img_height": 9, "img_path": 5, "img_width": 9, "impact": 11, "implement": [0, 1, 2, 4, 7, 10], "import": [1, 9, 10], "improv": [7, 8], "includ": [7, 8, 9, 11, 12], "inclus": 2, "increas": 0, "indic": 2, "info": 1, "inform": [1, 2], "initi": 1, "initialize_st": 1, "inplac": 1, "input": [0, 2, 11], "inria": [2, 6, 7, 10, 11], "inspir": 7, "instal": 2, "instead": 1, "insteal": 6, "int": [0, 1, 2, 9], "int32": 2, "int64": 2, "integ": 2, "intermedi": [0, 9], "intermid": 11, "intermidi": 2, "intern": 2, "intersect": 2, "intrins": [0, 2], "introduc": [1, 11], "invalid": 2, "invers": 2, "isect_id": [0, 2], "isect_offset": [0, 2], "isect_offset_encod": 2, "isect_til": 2, "iter": [0, 1, 2], "its": 2, "j": 0, "jacobian": 0, "jianbo": 7, "juli": 7, "justin": 7, "k": [0, 1, 2, 9], "kanazawa": 7, "kei": [0, 1], "kerbl": 7, "kernel": 2, "kerr": 7, "kind": 7, "kitchen": 10, "kopana": 7, "kwarg": 2, "larg": [0, 1, 2, 7], "larger": [0, 7, 8], "last": 0, "latest": [7, 9], "layout": [0, 2, 11], "lead": [0, 1, 7], "learn": 1, "learnabl": 1, "learnedperceptualimagepatchsimilar": 10, "least": 1, "left": 3, "legaci": 11, "leimk": 7, "length": 0, "leq": 0, "less": [7, 8], "li": 7, "librari": 7, "licens": 2, "like": 1, "line": 8, "list": [2, 7], "liter": 0, "locat": 1, "logic": [1, 4], "look": 9, "loop": 1, "loopli": 0, "loss": 1, "low": [1, 6], "lower": 1, "lpip": [8, 10], "lpipspytorch": 10, "lr": 1, "luma": 7, "m": 2, "made": 7, "magic": 6, "magnitud": 7, "main": [6, 11, 12], "major": [2, 9], "make": 0, "mani": 7, "map": [2, 3, 9], "markov": 1, "mask": 2, "mathbb": 0, "mathbf": 0, "mathcal": 0, "matia": 7, "matric": [0, 2], "matrix": 0, "matthew": 7, "max_memory_alloc": 11, "maximum": [1, 2], "mcmc": 1, "mcmcstrategi": 1, "mean": [0, 1, 2, 9], "means2d": [0, 2, 9], "means3d": 9, "mem": [10, 11], "memori": [0, 2, 4, 6, 7, 8, 11], "met": 1, "meta": [0, 9], "metric": 4, "might": [0, 6], "mimic": 6, "min_opac": 1, "mind": [6, 7, 11], "minim": [0, 8], "mip": [0, 7], "mode": 0, "model": [4, 6], "moment": 0, "mont": 1, "more": [0, 2, 4, 7, 8, 11], "most": 11, "mu": 0, "much": [2, 4, 8], "n": [0, 1, 2, 7, 9, 11], "n_camera": 2, "n_isect": 2, "nativ": 12, "nd": 2, "near_plan": [0, 2, 9], "need": [2, 9], "nerf": 7, "nerfacc": 2, "nerfstudio": [6, 7], "nerfview": 4, "new": [1, 2, 7, 9], "next": 2, "nn": 1, "nnz": 2, "nois": 1, "noise_lr": 1, "none": [0, 2, 9], "normal": [0, 1, 2], "note": [0, 6, 8, 9, 10, 11], "notic": 8, "novel": 4, "num_point": 5, "num_tiles_hit": 9, "number": [0, 1, 2, 10], "numer": [2, 11], "nvidia": [10, 11], "o": 0, "off": [0, 8, 11], "offer": 7, "offici": [4, 7, 8, 10], "offset": 2, "old": [2, 9], "one": [0, 1, 2, 5], "ones": 12, "onli": [0, 1, 2, 9, 11], "oom": 11, "opac": [0, 1, 2, 9], "open": 7, "oper": 11, "optim": [0, 1, 11], "option": 2, "origin": [1, 2, 10], "other": 0, "otherwis": 2, "our": [1, 2, 3, 6, 8, 10, 12], "out": 1, "output": [0, 2], "outsid": 2, "overhead": 11, "own": [2, 5], "p": 1, "pack": [0, 1, 2, 11], "packag": 2, "page": 0, "pair": 2, "pan": 7, "paper": [0, 1, 4, 7, 10], "param": 1, "param_group": 1, "paramet": [0, 1, 2], "parameterdict": 1, "parametr": 0, "part": 11, "pass": [0, 1, 2, 9], "path": 5, "path_to_img": 5, "peopl": 7, "per": 2, "perform": [2, 8, 11], "period": 1, "persp_proj": 2, "perspect": [0, 2], "perturb": 1, "pip": [2, 7], "pixel": [0, 2, 6], "pixel_id": 2, "place": 1, "plane": [0, 1, 2], "playground": 2, "pleas": 2, "point": 3, "portion": [0, 11], "posit": 1, "post": [0, 1], "potenti": 7, "power": [4, 10], "practic": 0, "pre": 1, "precis": 2, "present": 1, "prevent": 0, "print": [0, 1], "process": [1, 2, 4, 5, 11], "profil": [0, 7], "project": [0, 2, 6, 7, 9], "project_gaussian": 9, "propos": 0, "provid": [0, 2, 5, 8, 9, 11, 12], "prune": 1, "prune_opa": 1, "prune_scale2d": 1, "prune_scale3d": 1, "psnr": [8, 10], "pt": 6, "pull": 12, "pure": 2, "purpos": 2, "py": [4, 5, 6, 10, 11, 12], "pypi": 7, "python": [4, 5, 6, 10, 11], "pytorch": [2, 12], "q": [0, 3], "quat": [0, 1, 2, 9], "quat_scale_to_covar_preci": 2, "quaternion": [0, 2], "r": [0, 3], "radianc": [1, 7], "radii": [0, 2, 9], "radiu": [0, 2, 6], "radius_clip": [0, 2, 6], "rais": 1, "ran": 12, "rand": 0, "randn": 0, "random": 5, "rang": 1, "range_end": 2, "range_start": 2, "rare": 0, "raster": [1, 2, 5, 6, 7, 9, 11], "rasterization_inria_wrapp": [2, 8], "rasterization_legacy_wrapp": [2, 9], "rasterize_gaussian": 9, "rasterize_mod": 0, "rasterize_to_indices_in_rang": 2, "rasterize_to_pixel": 2, "rate": 1, "real": [1, 4, 6, 7], "realli": 2, "recommend": [1, 11], "recov": [0, 1], "reduc": 11, "reduct": 8, "refer": 3, "refin": 1, "refine_everi": 1, "refine_scale2d_stop_it": 1, "refine_start_it": 1, "refine_stop_it": 1, "rein": 1, "rel": [3, 11], "relat": 1, "releas": 9, "reli": 2, "remov": 9, "render": [0, 1, 2, 4, 7], "render_alpha": [0, 1], "render_color": 0, "render_imag": 1, "render_mod": [0, 9], "reparametr": 0, "replac": 8, "replic": 6, "repo": [3, 7, 10], "report": [7, 10], "repositori": [7, 12], "repres": [0, 2, 3], "reproduc": 4, "request": 12, "requir": [0, 1, 2, 6], "reset": 1, "reset_everi": 1, "resolut": [1, 6], "respect": [0, 2], "result": [0, 1, 4, 5, 6, 9, 11], "result_dir": [4, 6], "return": [0, 1, 2], "return_alpha": 9, "revis": 1, "revised_opac": 1, "rgb": [0, 9], "rgbd": 9, "rho": 0, "right": 3, "room": 10, "rotat": 0, "row": 2, "rss": 0, "rtx": [10, 11], "ruilong": 7, "run": [1, 4, 5], "runtim": [0, 11], "sam": 7, "same": [1, 4, 10], "samp": 1, "sampl": 1, "saniti": 1, "save": 0, "save_img": 5, "scale": [0, 1, 2, 9], "scene": [0, 1, 7, 8], "scene_grid": [6, 11], "scene_scal": 1, "script": [4, 5, 10, 12], "see": [0, 4, 7, 11], "seen": 0, "serv": 2, "set": [0, 1, 2, 5, 11], "sh": [0, 9, 10], "sh_coeff": 9, "sh_degre": [0, 2, 9], "shanghaitech": 7, "shape": [0, 2], "should": [0, 1, 2, 11], "shown": 0, "siggraph": 7, "sigma": 0, "signific": 8, "significantli": 11, "similar": [5, 6], "simpl": 6, "simple_train": [4, 6, 10], "simple_view": 6, "simpli": [4, 5], "simplifi": 9, "simplli": 0, "singl": [7, 9], "size": [0, 2, 11], "skip": [0, 2], "slightli": [0, 8], "slow": [0, 6], "slower": [0, 2], "small": [0, 1, 6, 11], "smaller": [0, 2], "so": [1, 2, 3, 6, 9], "softwar": 7, "some": [2, 3, 8], "sort": [0, 2], "sourc": [0, 1, 2, 3, 7], "space": 2, "spars": [0, 2, 7, 8, 11], "sparse_grad": [0, 2, 11], "sparseadam": [0, 11], "specif": 1, "speed": [0, 4, 8, 11], "speedup": 8, "spheric": 2, "spherical_harmon": [2, 9], "splat": [0, 1, 4, 7, 8, 10], "split": [0, 1], "sqrt": 0, "squeez": 9, "ssim": [8, 10], "stabil": 2, "standalon": 10, "start": [1, 2], "state": 1, "step": [1, 2], "step_post_backward": 1, "step_pre_backward": 1, "still": [6, 9], "stop": 1, "store": 0, "str": 1, "strategi": 7, "strategy_st": 1, "stump": 10, "suitabl": 6, "sum_i": 0, "support": [0, 1, 2, 4, 7, 8, 11], "switch": 6, "synthesi": 4, "system": 2, "t": 0, "t_": 0, "tag": 4, "take": [9, 10], "tancik": 7, "team": 7, "techniqu": 7, "teleport": 1, "tensor": [0, 1, 2, 9, 11], "test": [0, 5], "test_bas": 12, "text": 0, "textit": 0, "than": [0, 2, 7, 8, 10], "thei": [0, 9, 12], "thi": [0, 1, 2, 4, 6, 7, 8, 9, 10, 11], "thoma": 7, "threshold": [0, 6], "tile": [0, 2], "tile_height": [0, 2], "tile_id": 2, "tile_s": [0, 2, 9], "tile_width": [0, 2], "tiles_per_gauss": 0, "time": [0, 1, 4, 6, 7, 8, 10], "titan": [10, 11], "togeth": 11, "too": 0, "top": [1, 8, 9], "torch": [0, 1, 9, 11], "torchmetr": 10, "total": [0, 6], "trade": [0, 8, 11], "train": [0, 1, 4, 5, 6, 7, 8, 11], "transact": 7, "transform": [0, 2, 3], "transmitt": 2, "triangl": 2, "triangular": 2, "trick": 6, "triu": 2, "true": [0, 1, 2, 9, 11], "try": 7, "tupl": [0, 2], "turkulainen": 7, "type": [0, 2], "typic": 1, "typing_extens": 0, "uc": 7, "under": [4, 5, 6], "understand": 7, "unit": [0, 2], "univers": 7, "unord": 7, "up": [0, 6, 7, 10], "updat": 1, "upper": 2, "url": 7, "us": [0, 1, 2, 3, 5, 9, 10, 11], "usag": 11, "user": [1, 9], "usual": [0, 11], "util": 7, "v0": [7, 11], "v1": [7, 8, 9, 11], "valid": [1, 2], "valu": [0, 1, 2], "variabl": 2, "variou": 3, "ve": 7, "vector": [0, 3], "verbos": 1, "veri": 6, "verifi": 4, "version": 2, "via": [0, 9], "vicki": 7, "video": 4, "view": [0, 2, 4, 6], "viewdir": 9, "viewer": [4, 6], "viewmat": [0, 2, 9], "viser": 4, "w": [0, 3], "w2c": 3, "w_i": 0, "wa": 7, "wai": 11, "want": 9, "warn": [0, 6], "we": [0, 1, 2, 3, 4, 6, 7, 8, 9, 11], "welcom": 7, "well": 1, "wersion": 10, "what": 10, "when": [0, 2, 11], "where": [0, 3], "whether": [0, 1, 2], "which": [0, 1, 2, 6, 7, 10, 11], "while": [6, 11], "width": [0, 2, 5, 9], "within": [0, 10], "wonder": 7, "work": [0, 1], "workflow": [1, 9], "world": [0, 2, 3], "world_to_cam": 2, "would": [2, 11], "wrapper": [2, 8, 9], "wxyz": 0, "x": [0, 3, 10, 11], "xc": 2, "xt": 2, "xy": 9, "y": [0, 3], "ye": 7, "yi": 7, "you": [4, 5, 9], "your": [4, 5, 6], "z": [0, 2, 3], "z_": 3, "z_i": 0, "zero": 2, "zhuoyang": 7, "\u00fc": 7}, "titles": ["Rasterization", "Densification Strategy", "Utils", "Data Conventions", "Fit a COLMAP Capture", "Fit a Single Image", "Render a Large Scene", "gsplat", "Migrate from diff-gaussian-rasterization", "Migrate from gsplat v0.1.11", "Evaluation", "Profiling", "Tests"], "titleterms": {"1": 9, "11": 9, "32": 11, "360": 10, "7": 10, "api": 7, "averag": 10, "basic": 9, "captur": [4, 10], "channel": 11, "citat": 7, "colmap": 4, "color": 9, "contribut": 7, "convent": [3, 7], "cuda": 12, "data": 3, "densif": 1, "depth": 9, "diff": 8, "evalu": 10, "exampl": 7, "faster": 10, "featur": 11, "fit": [4, 5], "from": [8, 9], "gaussian": 8, "gpu": 10, "gsplat": [7, 9], "harmon": 9, "imag": [5, 11], "implement": 12, "instal": 7, "larg": [6, 11], "less": 10, "link": 7, "map": 11, "matrix": 3, "memori": 10, "metric": 10, "migrat": [7, 8, 9], "mip": 10, "nerf": 10, "over": 10, "overview": 7, "perform": 10, "profil": 11, "python": 7, "raster": [0, 8], "render": [6, 9, 11], "reproduc": 10, "rgb": 11, "rotat": 3, "scene": [6, 10, 11], "singl": 5, "spheric": 9, "strategi": 1, "test": [7, 12], "train": 10, "usag": 9, "util": 2, "v0": 9, "verifi": 12, "view": 3}}) \ No newline at end of file +Search.setIndex({"alltitles": {"Basic Usage": [[9, "basic-usage"]], "Citations": [[7, "citations"]], "Color as Spherical Harmonics": [[9, "color-as-spherical-harmonics"]], "Contributing": [[7, "contributing"]], "Conventions": [[7, null]], "Data Conventions": [[3, null]], "Densification Strategy": [[1, null]], "Depth Rendering": [[9, "depth-rendering"]], "Evaluation": [[10, null]], "Examples": [[7, null]], "Feature Ablation": [[10, "feature-ablation"]], "Fit a COLMAP Capture": [[4, null]], "Fit a Single Image": [[5, null]], "Installation": [[7, "installation"]], "Links": [[7, "links"]], "Migrate from diff-gaussian-rasterization": [[8, null]], "Migrate from gsplat v0.1.11": [[9, null]], "Migration": [[7, null]], "Overview": [[7, "overview"]], "Performance on Mip-NeRF 360 Captures (Averaged Over 7 Scenes)": [[10, "id1"]], "Profiling": [[11, null]], "Python API": [[7, null]], "Rasterization": [[0, null]], "Render Feature Maps: 32 Channel": [[11, "render-feature-maps-32-channel"]], "Render RGB Images": [[11, "render-rgb-images"]], "Render a Large Scene": [[6, null], [11, "render-a-large-scene"]], "Reproduced Metrics": [[10, "reproduced-metrics"]], "Rotation Convention": [[3, "rotation-convention"]], "Testing and verifying CUDA implementations": [[12, "testing-and-verifying-cuda-implementations"]], "Tests": [[7, null], [12, null]], "Trains Faster with Less GPU Memory": [[10, "trains-faster-with-less-gpu-memory"]], "Utils": [[2, null]], "View Matrix": [[3, "view-matrix"]], "gsplat": [[7, null]]}, "docnames": ["apis/rasterization", "apis/strategy", "apis/utils", "conventions/data_conventions", "examples/colmap", "examples/image", "examples/large_scale", "index", "migration/migration_inria", "migration/migration_legacy", "tests/eval", "tests/profile", "tests/tests"], "envversion": {"sphinx": 62, "sphinx.domains.c": 3, "sphinx.domains.changeset": 1, "sphinx.domains.citation": 1, "sphinx.domains.cpp": 9, "sphinx.domains.index": 1, "sphinx.domains.javascript": 3, "sphinx.domains.math": 2, "sphinx.domains.python": 4, "sphinx.domains.rst": 2, "sphinx.domains.std": 2, "sphinx.ext.intersphinx": 1, "sphinx.ext.viewcode": 1, "sphinxcontrib.bibtex": 9}, "filenames": ["apis/rasterization.rst", "apis/strategy.rst", "apis/utils.rst", "conventions/data_conventions.rst", "examples/colmap.rst", "examples/image.rst", "examples/large_scale.rst", "index.rst", "migration/migration_inria.rst", "migration/migration_legacy.rst", "tests/eval.rst", "tests/profile.rst", "tests/tests.rst"], "indexentries": {"accumulate() (in module gsplat)": [[2, "gsplat.accumulate", false]], "check_sanity() (defaultstrategy method)": [[1, "gsplat.DefaultStrategy.check_sanity", false]], "check_sanity() (mcmcstrategy method)": [[1, "gsplat.MCMCStrategy.check_sanity", false]], "defaultstrategy (class in gsplat)": [[1, "gsplat.DefaultStrategy", false]], "fully_fused_projection() (in module gsplat)": [[2, "gsplat.fully_fused_projection", false]], "initialize_state() (defaultstrategy method)": [[1, "gsplat.DefaultStrategy.initialize_state", false]], "initialize_state() (mcmcstrategy method)": [[1, "gsplat.MCMCStrategy.initialize_state", false]], "isect_offset_encode() (in module gsplat)": [[2, "gsplat.isect_offset_encode", false]], "isect_tiles() (in module gsplat)": [[2, "gsplat.isect_tiles", false]], "mcmcstrategy (class in gsplat)": [[1, "gsplat.MCMCStrategy", false]], "persp_proj() (in module gsplat)": [[2, "gsplat.persp_proj", false]], "quat_scale_to_covar_preci() (in module gsplat)": [[2, "gsplat.quat_scale_to_covar_preci", false]], "rasterization() (in module gsplat)": [[0, "gsplat.rasterization", false]], "rasterization_inria_wrapper() (in module gsplat)": [[2, "gsplat.rasterization_inria_wrapper", false]], "rasterization_legacy_wrapper() (in module gsplat)": [[2, "gsplat.rasterization_legacy_wrapper", false]], "rasterize_to_indices_in_range() (in module gsplat)": [[2, "gsplat.rasterize_to_indices_in_range", false]], "rasterize_to_pixels() (in module gsplat)": [[2, "gsplat.rasterize_to_pixels", false]], "spherical_harmonics() (in module gsplat)": [[2, "gsplat.spherical_harmonics", false]], "step_post_backward() (defaultstrategy method)": [[1, "gsplat.DefaultStrategy.step_post_backward", false]], "step_post_backward() (mcmcstrategy method)": [[1, "gsplat.MCMCStrategy.step_post_backward", false]], "step_pre_backward() (defaultstrategy method)": [[1, "gsplat.DefaultStrategy.step_pre_backward", false]], "world_to_cam() (in module gsplat)": [[2, "gsplat.world_to_cam", false]]}, "objects": {"gsplat": [[1, 0, 1, "", "DefaultStrategy"], [1, 0, 1, "", "MCMCStrategy"], [2, 2, 1, "", "accumulate"], [2, 2, 1, "", "fully_fused_projection"], [2, 2, 1, "", "isect_offset_encode"], [2, 2, 1, "", "isect_tiles"], [2, 2, 1, "", "persp_proj"], [2, 2, 1, "", "quat_scale_to_covar_preci"], [0, 2, 1, "", "rasterization"], [2, 2, 1, "", "rasterization_inria_wrapper"], [2, 2, 1, "", "rasterization_legacy_wrapper"], [2, 2, 1, "", "rasterize_to_indices_in_range"], [2, 2, 1, "", "rasterize_to_pixels"], [2, 2, 1, "", "spherical_harmonics"], [2, 2, 1, "", "world_to_cam"]], "gsplat.DefaultStrategy": [[1, 1, 1, "", "check_sanity"], [1, 1, 1, "", "initialize_state"], [1, 1, 1, "", "step_post_backward"], [1, 1, 1, "", "step_pre_backward"]], "gsplat.MCMCStrategy": [[1, 1, 1, "", "check_sanity"], [1, 1, 1, "", "initialize_state"], [1, 1, 1, "", "step_post_backward"]]}, "objnames": {"0": ["py", "class", "Python class"], "1": ["py", "method", "Python method"], "2": ["py", "function", "Python function"]}, "objtypes": {"0": "py:class", "1": "py:method", "2": "py:function"}, "terms": {"": [0, 2, 6, 10], "0": [0, 1, 2, 7, 8, 9, 10, 11], "00": [10, 11], "0002": 1, "0006": 10, "0008": 1, "005": 1, "01": [0, 1, 2], "01m": 10, "02": 10, "02m": 10, "03": 10, "04": 10, "05": [1, 11], "06": 10, "06109": 1, "06m": 10, "07": 10, "075": 10, "078": 10, "08": [10, 11], "094": 10, "096": 10, "1": [0, 1, 2, 3, 7, 10, 11], "10": [9, 10, 11], "100": [0, 1, 2, 8], "1000": 1, "1000000": [1, 10], "10000000000": [0, 2], "107m": 11, "11": [7, 8, 10, 11], "11gb": 8, "11m": 10, "12": [10, 11], "123": 10, "124": 11, "125": 10, "127": 10, "128": 1, "129": 11, "13": 10, "130": 10, "132": [10, 11], "133": 10, "135": 10, "138": 10, "14": [10, 11], "1422": 10, "15": [1, 7, 10], "150": 0, "15000": 1, "153": 10, "154": 10, "155": 10, "1552": 10, "157": [10, 11], "15_000": 1, "16": [0, 2, 10], "160": 11, "162": 10, "1621": 10, "163": 8, "164": [10, 11], "166": 8, "168": [10, 11], "16m": 10, "17": [10, 11], "1708": 10, "171": 11, "172": 10, "1725": 10, "177": 10, "1773": 10, "17m": 10, "18": [8, 10, 11], "19": 10, "19m": 10, "1_000_000": 1, "1e": [1, 9], "1e10": [0, 2], "2": [0, 2, 3, 9, 10, 11], "20": [8, 10], "200": 0, "2000": 5, "2000000": 10, "202": 10, "2020": 10, "2023": 7, "204": 10, "206": 10, "207": 10, "21": [10, 11], "2144": 10, "217": 10, "219": 10, "21m": 10, "22": 10, "2299": 10, "23": [10, 11], "2366": 10, "24": 11, "2404": 1, "2465986": 10, "24gb": 11, "24m": 10, "25": [1, 10, 11], "25000": 1, "253": 10, "254": 10, "256": 5, "2563156": 10, "25_000": 1, "25m": 10, "26": [8, 10], "26m": 10, "27": 10, "28": [10, 11], "29": 10, "2964": 10, "2980": 10, "299": 10, "2d": [0, 1, 2], "3": [0, 1, 2, 3, 6, 9, 10, 11], "30": 10, "300": 0, "3000": 1, "3000000": 10, "301": 10, "3013": 10, "304": 10, "3092": 10, "30k": 10, "30m": 6, "31": [10, 11], "318": 10, "319": 10, "32": [0, 2, 10], "321": 10, "3237318": 10, "324": 10, "329": 10, "33": 10, "336": 10, "3377807": 10, "33m": 10, "34": 11, "340": 10, "35": 11, "35m49": 10, "36": [10, 11], "360": 7, "360_v2": [4, 6], "364": 10, "36546ce": 10, "37": 11, "37m13": 10, "38": 11, "389": 10, "39": [10, 11], "398": 8, "3d": [0, 1, 3, 4, 7], "3dg": [1, 6], "3gb": 10, "3x3": 3, "4": [0, 1, 2, 4, 6, 9, 10, 11], "40": [10, 11], "41": 11, "415": 10, "42": [10, 11], "427": 10, "43": [10, 11], "436": 10, "44": 11, "45": 11, "46": 11, "47": [10, 11], "48": 11, "482": 8, "48m": 10, "49m": 11, "4m05": 10, "4x": [7, 10], "5": [6, 10, 11], "50": 10, "500": 1, "500000": 1, "52": [10, 11], "53": [10, 11], "55m": 10, "56": 10, "57": 10, "57m": 10, "58": 10, "59": [10, 11], "59m": 10, "5e5": 1, "5m35": 10, "6": [2, 10, 11], "61": [10, 11], "62": [10, 11], "62m": 10, "63": 10, "63m": 10, "64": [1, 2, 10], "65": 10, "66": [10, 11], "662": 10, "668": 10, "67": 11, "6acdce4": 10, "7": 11, "70": 10, "71": 10, "71m": 10, "720": 10, "721": 10, "73": 10, "75": 10, "75m": 10, "763": 10, "764": 10, "768": 10, "771": 10, "78gb": 8, "78m": 10, "79": 10, "79m": 10, "7k": 10, "8": [8, 10, 11], "81m": 10, "82": 10, "8237": 8, "824": 10, "829": 10, "82m": 10, "83": 11, "831": 10, "833": 10, "8366": 8, "84": 11, "84m": 10, "86": [10, 11], "863": 10, "865": 10, "87": 10, "870": 10, "877": 10, "878": 10, "88": [10, 11], "89": 10, "893": 10, "8ea2ea3": 11, "9": [8, 10, 11], "902": 10, "906": 10, "907": 10, "91": 11, "918": 10, "921": 10, "922": 10, "925": 10, "926": 10, "93": 10, "941": 10, "95": 10, "97": 11, "98": 10, "99": 10, "9x9": 6, "A": [0, 1, 2], "And": [7, 11], "But": [0, 2, 11], "For": [0, 1, 6, 8], "If": [0, 1, 2, 9, 11], "In": [0, 1, 2, 8, 9], "It": [0, 1, 2, 4, 7, 11], "Near": 2, "No": 2, "On": [1, 8], "Or": 6, "The": [0, 1, 2, 4, 5, 6, 9, 10, 11, 12], "Then": 0, "These": [2, 10], "To": 7, "With": 6, "_": [3, 9], "a100": 10, "aalto": 7, "abl": 4, "abov": [1, 11], "absg": [0, 1], "absgrad": [0, 1, 2, 7, 10], "absolut": [0, 1], "abstract": 1, "acceler": 7, "access": [0, 9], "accquir": 2, "accumul": [0, 2, 9], "accumulated_depth": 9, "achiev": 9, "acm": 7, "activ": [0, 9], "ad": [0, 2], "adam": 1, "addit": 11, "addition": 8, "advisor": 7, "affect": 11, "after": [1, 11], "agre": 12, "ai": 7, "alia": 0, "alias": [2, 7], "align": [8, 9], "all": [0, 2], "alloc": 11, "allow": [0, 4, 5, 6], "along": [1, 11], "alpah": 2, "alpha": [0, 2, 9], "also": [0, 1, 4, 5, 7, 8, 11, 12], "amazon": 7, "amount": [9, 11], "an": [0, 1, 2, 7, 10], "angjoo": 7, "ani": [1, 7, 12], "annot": 2, "anti": [2, 7], "antialias": [0, 2, 10], "api": [6, 8, 9], "appli": [0, 6], "approxim": 0, "ar": [0, 1, 2, 6, 7, 8, 9, 10, 11, 12], "arbitrari": 1, "argument": [0, 9, 11], "arxiv": 1, "assertionerror": 1, "attribut": [1, 2, 11], "autograd": 2, "automat": [6, 9, 12], "avail": [7, 9], "averag": 1, "awai": [0, 6], "backend": [2, 6, 7, 8, 11], "background": [0, 2, 9], "backpropag": 2, "backward": [0, 1, 2, 11], "band": [0, 9], "base": [0, 1, 2, 4, 8], "bash": 10, "basic": [2, 5], "batch": [0, 2, 7, 8, 11], "batch_siz": 11, "befor": [1, 9, 11], "begin": [0, 3], "below": [0, 1, 2, 5, 9], "benchmark": 10, "berkelei": 7, "bernhard": 7, "besid": 1, "better": [1, 4, 8], "between": [0, 2, 8, 11], "bicycl": 10, "bind": 7, "bit": 2, "block_width": 9, "blow": 6, "bmatrix": [0, 3], "bonsai": 10, "bool": [0, 1, 2], "boolen": 2, "born": 7, "both": 0, "bound": 0, "branch": 12, "brent": 7, "browser": 4, "bug": 7, "bwd": 11, "c": [0, 2], "calc_compens": 2, "calcul": 11, "calibr": 1, "call": [1, 2, 9], "callback": 1, "cam": [0, 3], "camera": [0, 2, 3, 6, 11], "camera_id": [0, 2], "camtoworld": 9, "can": [0, 1, 2, 5, 6, 7, 9, 10], "cap_max": 1, "capabl": 7, "captur": 7, "care": 11, "carlo": 1, "case": [0, 2, 9, 11], "cd": 10, "center": [0, 3], "chain": 1, "chang": [8, 9], "channel": [0, 2], "channel_chunk": 0, "check": 1, "check_san": 1, "chunk": 0, "ckpt": 6, "ckpt_6999": 6, "clamp_min": 9, "class": 1, "classic": 0, "clip": 0, "clip_thresh": 9, "close": 0, "closer": 9, "code": [6, 8, 9], "coeff": 2, "coeffici": [0, 2, 9], "collect": 2, "colmap": 7, "color": [0, 1, 2], "column": 2, "com": [2, 7], "come": [7, 10], "command": [2, 10], "commit": [8, 10, 11], "compar": 7, "comparis": [2, 4], "compat": 8, "compens": [0, 2], "complet": 0, "composit": [0, 2], "comput": [0, 1, 2], "compute_covar": 2, "compute_preci": 2, "comsum": 2, "condit": 1, "conduct": [10, 11], "config": 10, "configur": 6, "conic": [0, 2, 9], "consum": 0, "consumpt": 11, "contributor": 7, "control": 0, "convens": 0, "convent": 1, "converg": 10, "convers": 9, "convert": [2, 9], "coo": [0, 2, 11], "coordin": 2, "core": 7, "correspond": [1, 2], "could": [0, 2, 9, 11], "counter": 10, "coupl": 9, "covar": 2, "covari": [0, 2], "cuda": [2, 6, 7, 8, 10, 11], "curios": 7, "current": [0, 1, 2, 11], "custom": 5, "cx": 9, "cy": 9, "d": [0, 2, 7, 9], "data": [4, 6, 7, 11], "data_dir": [4, 6], "data_factor": [4, 6], "debug": 2, "default": [0, 1, 2, 10], "defaultstrategi": 1, "defin": [0, 1, 2, 3], "degre": [0, 2], "degrees_to_us": 2, "demonstr": 9, "denot": 11, "densif": [7, 10], "depend": [0, 2], "deprec": 9, "depth": [0, 2, 3, 7], "design": [1, 6, 7], "desir": 2, "det": 0, "detail": [0, 1, 4, 7, 9, 11], "develop": [7, 11], "devic": [0, 9], "diag": 0, "dict": [0, 1, 2], "dict_kei": 0, "dictionari": 0, "diff": [2, 6, 7, 11], "differ": [2, 10, 11], "differenti": [0, 5, 7], "dimension": 3, "dir": 2, "direct": 2, "disabl": 0, "disregard": 6, "distanc": 2, "distribut": 1, "document": 9, "doe": 4, "done": 0, "drettaki": 7, "duplic": 1, "dure": [0, 1, 2], "e": [1, 2, 6, 9], "each": [0, 1, 2, 11], "ed": [0, 9], "effect": [0, 2, 11], "effici": [0, 2, 6, 7, 10, 11], "egienvalu": 0, "either": [1, 2], "element": 2, "els": 0, "empti": 2, "enabl": [1, 2, 7], "encod": 2, "end": [0, 2, 3], "enjoi": 9, "ensur": 1, "eps2d": [0, 2], "epsilon": [0, 2], "equal": 0, "equat": 0, "equip": 7, "equival": 9, "especi": 0, "essenti": 2, "etc": [1, 7, 8], "evalu": [4, 7, 11], "even": 7, "everi": 1, "exact": 4, "exactli": [1, 10], "exampl": [0, 1, 2, 4, 5, 6, 8, 10], "exclud": 11, "exclus": 2, "execut": 1, "exist": 2, "expand": 7, "expect": [0, 1, 2, 9], "expected_depth": 9, "experiment": 1, "explain": 3, "explicitli": 9, "expos": 2, "extra": [1, 7], "extrem": [0, 7], "ey": 0, "f_": 0, "factor": [0, 2], "fals": [0, 1, 2, 11], "far": [0, 2, 6], "far_plan": [0, 2], "fast": 0, "faster": [0, 7], "featur": [0, 1, 2, 7], "features1": 1, "features2": 1, "feedback": 7, "few": 11, "field": [0, 1, 7], "file": 5, "fine": [0, 1], "finish": 10, "first": [0, 6], "fit": 7, "flag": 5, "flatten": 2, "flatten_id": [0, 2], "flattend": 2, "float": [0, 1, 2], "focal": 0, "folder": 12, "follow": [0, 1, 2, 4, 7], "footprint": [0, 4, 7], "fork": [8, 10], "format": [1, 2], "forward": [1, 11], "found": [0, 6], "four": 3, "fp": 11, "fr": 7, "frac": 0, "frame": 3, "free": [0, 8], "from": [1, 2, 6, 7, 10], "frustum": [2, 11], "full": 2, "full_eval_m360": 10, "fulli": [2, 8], "fully_fused_project": [2, 9], "function": [0, 1, 2, 8, 9, 11], "fungraph": 7, "further": 11, "fuse": 2, "futur": 9, "fwd": 11, "fx": 9, "fy": 9, "g": [0, 1, 2, 6, 9], "garden": [4, 6, 10], "gaussian": [0, 1, 2, 4, 5, 6, 7, 10, 11], "gaussian_id": [0, 2], "gb": [10, 11], "georg": 7, "georgio": 7, "get": [0, 5, 7, 8], "git": 7, "github": [2, 7, 12], "given": 0, "glob_scal": 9, "global": 2, "go": 0, "gpu": [2, 6, 11], "grad": 11, "gradient": [0, 1, 2, 7, 8, 11], "graphdeco": 2, "graphic": 7, "greatest": [7, 9], "greatli": 11, "grid": 6, "group": 0, "grow": 7, "grow_grad2d": [1, 10], "grow_scale2d": 1, "grow_scale3d": 1, "gsplat": [1, 2, 6, 8, 10, 11], "gss": [1, 10], "guassian": 1, "ha": [1, 2, 11], "hand": 0, "handl": 9, "happen": 0, "harmon": 2, "have": [1, 2, 4], "height": [0, 2, 5, 9], "help": [0, 7, 9], "here": [3, 6, 9, 10, 11], "heurist": 1, "high": 1, "higher": 1, "highli": 1, "hler": 7, "how": 1, "http": [2, 7], "huge": 9, "i": [0, 1, 2, 3, 6, 7, 8, 9, 10, 11], "id": 2, "idea": 2, "ignor": 2, "imag": [0, 1, 2, 7, 10], "image_fit": 5, "image_height": 2, "image_width": 2, "img_height": 9, "img_path": 5, "img_width": 9, "impact": 11, "implement": [0, 1, 2, 4, 7, 10], "import": [1, 9, 10], "improv": [7, 8], "includ": [7, 8, 9, 11, 12], "inclus": 2, "increas": 0, "indic": 2, "info": 1, "inform": [1, 2], "initi": 1, "initialize_st": 1, "inplac": 1, "input": [0, 2, 11], "inria": [2, 6, 7, 10, 11], "inspir": 7, "instal": 2, "instead": 1, "insteal": 6, "int": [0, 1, 2, 9], "int32": 2, "int64": 2, "integ": 2, "intermedi": [0, 9], "intermid": 11, "intermidi": 2, "intern": 2, "intersect": 2, "intrins": [0, 2], "introduc": [1, 11], "invalid": 2, "invers": 2, "isect_id": [0, 2], "isect_offset": [0, 2], "isect_offset_encod": 2, "isect_til": 2, "iter": [0, 1, 2], "its": 2, "j": 0, "jacobian": 0, "jianbo": 7, "juli": 7, "justin": 7, "k": [0, 1, 2, 9], "kanazawa": 7, "kei": [0, 1], "kerbl": 7, "kernel": 2, "kerr": 7, "kind": 7, "kitchen": 10, "kopana": 7, "kwarg": 2, "larg": [0, 1, 2, 7], "larger": [0, 7, 8], "last": 0, "latest": [7, 9], "layout": [0, 2, 11], "lead": [0, 1, 7], "learn": 1, "learnabl": 1, "learnedperceptualimagepatchsimilar": 10, "least": 1, "left": 3, "legaci": 11, "leimk": 7, "length": 0, "leq": 0, "less": [7, 8], "li": 7, "librari": 7, "licens": 2, "like": 1, "line": 8, "list": [2, 7], "liter": 0, "locat": 1, "logic": [1, 4], "look": 9, "loop": 1, "loopli": 0, "loss": 1, "low": [1, 6], "lower": 1, "lpip": [8, 10], "lpipspytorch": 10, "lr": 1, "luma": 7, "m": 2, "made": 7, "magic": 6, "magnitud": 7, "main": [6, 11, 12], "major": [2, 9], "make": 0, "mani": 7, "map": [2, 3, 9], "markov": 1, "mask": 2, "mathbb": 0, "mathbf": 0, "mathcal": 0, "matia": 7, "matric": [0, 2], "matrix": 0, "matthew": 7, "max_memory_alloc": 11, "maximum": [1, 2], "mcmc": [1, 10], "mcmcstrategi": 1, "mean": [0, 1, 2, 9], "means2d": [0, 2, 9], "means3d": 9, "mem": [10, 11], "memori": [0, 2, 4, 6, 7, 8, 11], "met": 1, "meta": [0, 9], "method": 10, "metric": 4, "might": [0, 6], "mill": 10, "mimic": 6, "min": 10, "min_opac": 1, "mind": [6, 7, 11], "minim": [0, 8], "mip": [0, 7], "mode": [0, 10], "model": [4, 6], "moment": 0, "mont": 1, "more": [0, 2, 4, 7, 8, 11], "most": 11, "mu": 0, "much": [2, 4, 8], "n": [0, 1, 2, 7, 9, 11], "n_camera": 2, "n_isect": 2, "nativ": 12, "nd": 2, "near_plan": [0, 2, 9], "need": [2, 9], "nerf": 7, "nerfacc": 2, "nerfstudio": [6, 7], "nerfview": 4, "new": [1, 2, 7, 9], "next": 2, "nn": 1, "nnz": 2, "nois": 1, "noise_lr": 1, "none": [0, 2, 9], "normal": [0, 1, 2], "note": [0, 6, 8, 9, 10, 11], "notic": 8, "novel": 4, "num": 10, "num_point": 5, "num_tiles_hit": 9, "number": [0, 1, 2, 10], "numer": [2, 11], "nvidia": [10, 11], "o": 0, "obtain": 10, "off": [0, 8, 11], "offer": 7, "offici": [4, 7, 8, 10], "offset": 2, "old": [2, 9], "one": [0, 1, 2, 5], "ones": 12, "onli": [0, 1, 2, 9, 11], "oom": 11, "opac": [0, 1, 2, 9], "open": 7, "oper": 11, "optim": [0, 1, 11], "option": 2, "origin": [1, 2, 10], "other": 0, "otherwis": 2, "our": [1, 2, 3, 6, 8, 10, 12], "out": 1, "output": [0, 2], "outsid": 2, "overhead": 11, "own": [2, 5], "p": 1, "pack": [0, 1, 2, 11], "packag": 2, "page": 0, "pair": 2, "pan": 7, "paper": [0, 1, 4, 7, 10], "param": 1, "param_group": 1, "paramet": [0, 1, 2], "parameterdict": 1, "parametr": 0, "part": 11, "pass": [0, 1, 2, 9], "path": 5, "path_to_img": 5, "peopl": 7, "per": 2, "perform": [2, 8, 11], "period": 1, "persp_proj": 2, "perspect": [0, 2], "perturb": 1, "pip": [2, 7], "pixel": [0, 2, 6], "pixel_id": 2, "place": 1, "plane": [0, 1, 2], "playground": 2, "pleas": 2, "point": 3, "portion": [0, 11], "posit": 1, "post": [0, 1], "potenti": 7, "power": [4, 10], "practic": 0, "pre": 1, "precis": 2, "present": 1, "prevent": 0, "print": [0, 1], "process": [1, 2, 4, 5, 11], "profil": [0, 7], "project": [0, 2, 6, 7, 9], "project_gaussian": 9, "propos": 0, "provid": [0, 2, 5, 8, 9, 10, 11, 12], "prune": 1, "prune_opa": 1, "prune_scale2d": 1, "prune_scale3d": 1, "psnr": [8, 10], "pt": 6, "pull": 12, "pure": 2, "purpos": 2, "py": [4, 5, 6, 10, 11, 12], "pypi": 7, "python": [4, 5, 6, 10, 11], "pytorch": [2, 12], "q": [0, 3], "quat": [0, 1, 2, 9], "quat_scale_to_covar_preci": 2, "quaternion": [0, 2], "r": [0, 3], "radianc": [1, 7], "radii": [0, 2, 9], "radiu": [0, 2, 6], "radius_clip": [0, 2, 6], "rais": 1, "ran": 12, "rand": 0, "randn": 0, "random": 5, "rang": 1, "range_end": 2, "range_start": 2, "rare": 0, "raster": [1, 2, 5, 6, 7, 9, 11], "rasterization_inria_wrapp": [2, 8], "rasterization_legacy_wrapp": [2, 9], "rasterize_gaussian": 9, "rasterize_mod": 0, "rasterize_to_indices_in_rang": 2, "rasterize_to_pixel": 2, "rate": 1, "real": [1, 4, 6, 7], "realli": 2, "recommend": [1, 11], "recov": [0, 1], "reduc": 11, "reduct": 8, "refer": 3, "refin": 1, "refine_everi": 1, "refine_scale2d_stop_it": 1, "refine_start_it": 1, "refine_stop_it": 1, "rein": 1, "rel": [3, 11], "relat": 1, "releas": 9, "reli": 2, "remov": 9, "render": [0, 1, 2, 4, 7], "render_alpha": [0, 1], "render_color": 0, "render_imag": 1, "render_mod": [0, 9], "reparametr": 0, "replac": 8, "replic": 6, "repo": [3, 7, 10], "report": [7, 10], "repositori": [7, 12], "repres": [0, 2, 3], "reproduc": 4, "request": 12, "requir": [0, 1, 2, 6], "reset": 1, "reset_everi": 1, "resolut": [1, 6], "respect": [0, 2], "result": [0, 1, 4, 5, 6, 9, 10, 11], "result_dir": [4, 6], "return": [0, 1, 2], "return_alpha": 9, "revis": 1, "revised_opac": 1, "rgb": [0, 9], "rgbd": 9, "rho": 0, "right": 3, "room": 10, "rotat": 0, "row": 2, "rss": 0, "rtx": [10, 11], "ruilong": 7, "run": [1, 4, 5], "runtim": [0, 11], "sam": 7, "same": [1, 4, 10], "samp": 1, "sampl": 1, "saniti": 1, "save": 0, "save_img": 5, "scale": [0, 1, 2, 9], "scene": [0, 1, 7, 8], "scene_grid": [6, 11], "scene_scal": 1, "script": [4, 5, 10, 12], "see": [0, 4, 7, 11], "seen": 0, "serv": 2, "set": [0, 1, 2, 5, 10, 11], "sh": [0, 9, 10], "sh_coeff": 9, "sh_degre": [0, 2, 9], "shanghaitech": 7, "shape": [0, 2], "should": [0, 1, 2, 11], "shown": 0, "siggraph": 7, "sigma": 0, "signific": 8, "significantli": 11, "similar": [5, 6], "simpl": 6, "simple_train": [4, 6, 10], "simple_view": 6, "simpli": [4, 5], "simplifi": 9, "simplli": 0, "singl": [7, 9], "size": [0, 2, 11], "skip": [0, 2], "slightli": [0, 8], "slow": [0, 6], "slower": [0, 2], "small": [0, 1, 6, 11], "smaller": [0, 2], "so": [1, 2, 3, 6, 9], "softwar": 7, "some": [2, 3, 8], "sort": [0, 2], "sourc": [0, 1, 2, 3, 7], "space": 2, "spars": [0, 2, 7, 8, 11], "sparse_grad": [0, 2, 11], "sparseadam": [0, 11], "specif": 1, "speed": [0, 4, 8, 11], "speedup": 8, "spheric": 2, "spherical_harmon": [2, 9], "splat": [0, 1, 4, 7, 8, 10], "split": [0, 1], "sqrt": 0, "squeez": 9, "ssim": [8, 10], "stabil": 2, "standalon": 10, "start": [1, 2], "state": 1, "step": [1, 2], "step_post_backward": 1, "step_pre_backward": 1, "still": [6, 9], "stop": 1, "store": 0, "str": 1, "strategi": [7, 10], "strategy_st": 1, "stump": 10, "suitabl": 6, "sum_i": 0, "support": [0, 1, 2, 4, 7, 8, 11], "switch": 6, "synthesi": 4, "system": 2, "t": 0, "t_": 0, "tag": 4, "take": [9, 10], "tancik": 7, "team": 7, "techniqu": 7, "teleport": 1, "tensor": [0, 1, 2, 9, 11], "test": [0, 5], "test_bas": 12, "text": 0, "textit": 0, "than": [0, 2, 7, 8, 10], "thei": [0, 9, 12], "thi": [0, 1, 2, 4, 6, 7, 8, 9, 10, 11], "thoma": 7, "threshold": [0, 6], "tile": [0, 2], "tile_height": [0, 2], "tile_id": 2, "tile_s": [0, 2, 9], "tile_width": [0, 2], "tiles_per_gauss": 0, "time": [0, 1, 4, 6, 7, 8, 10], "titan": [10, 11], "togeth": 11, "too": 0, "top": [1, 8, 9], "torch": [0, 1, 9, 11], "torchmetr": 10, "total": [0, 6], "trade": [0, 8, 11], "train": [0, 1, 4, 5, 6, 7, 8, 11], "transact": 7, "transform": [0, 2, 3], "transmitt": 2, "triangl": 2, "triangular": 2, "trick": 6, "triu": 2, "true": [0, 1, 2, 9, 11], "try": 7, "tupl": [0, 2], "turkulainen": 7, "type": [0, 2], "typic": 1, "typing_extens": 0, "uc": 7, "under": [4, 5, 6], "understand": 7, "unit": [0, 2], "univers": 7, "unord": 7, "up": [0, 6, 7, 10], "updat": 1, "upper": 2, "url": 7, "us": [0, 1, 2, 3, 5, 9, 10, 11], "usag": 11, "user": [1, 9], "usual": [0, 11], "util": 7, "v0": [7, 11], "v1": [7, 8, 9, 11], "valid": [1, 2], "valu": [0, 1, 2], "variabl": 2, "variou": 3, "ve": 7, "vector": [0, 3], "verbos": 1, "veri": 6, "verifi": 4, "version": 2, "via": [0, 9], "vicki": 7, "video": 4, "view": [0, 2, 4, 6], "viewdir": 9, "viewer": [4, 6], "viewmat": [0, 2, 9], "viser": 4, "w": [0, 3], "w2c": 3, "w_i": 0, "wa": 7, "wai": 11, "want": 9, "warn": [0, 6], "we": [0, 1, 2, 3, 4, 6, 7, 8, 9, 10, 11], "welcom": 7, "well": 1, "wersion": 10, "what": 10, "when": [0, 2, 11], "where": [0, 3], "whether": [0, 1, 2], "which": [0, 1, 2, 6, 7, 10, 11], "while": [6, 11], "width": [0, 2, 5, 9], "within": [0, 10], "wonder": 7, "work": [0, 1], "workflow": [1, 9], "world": [0, 2, 3], "world_to_cam": 2, "would": [2, 11], "wrapper": [2, 8, 9], "wxyz": 0, "x": [0, 3, 10, 11], "xc": 2, "xt": 2, "xy": 9, "y": [0, 3], "ye": 7, "yi": 7, "you": [4, 5, 9], "your": [4, 5, 6], "z": [0, 2, 3], "z_": 3, "z_i": 0, "zero": 2, "zhuoyang": 7, "\u00fc": 7}, "titles": ["Rasterization", "Densification Strategy", "Utils", "Data Conventions", "Fit a COLMAP Capture", "Fit a Single Image", "Render a Large Scene", "gsplat", "Migrate from diff-gaussian-rasterization", "Migrate from gsplat v0.1.11", "Evaluation", "Profiling", "Tests"], "titleterms": {"1": 9, "11": 9, "32": 11, "360": 10, "7": 10, "ablat": 10, "api": 7, "averag": 10, "basic": 9, "captur": [4, 10], "channel": 11, "citat": 7, "colmap": 4, "color": 9, "contribut": 7, "convent": [3, 7], "cuda": 12, "data": 3, "densif": 1, "depth": 9, "diff": 8, "evalu": 10, "exampl": 7, "faster": 10, "featur": [10, 11], "fit": [4, 5], "from": [8, 9], "gaussian": 8, "gpu": 10, "gsplat": [7, 9], "harmon": 9, "imag": [5, 11], "implement": 12, "instal": 7, "larg": [6, 11], "less": 10, "link": 7, "map": 11, "matrix": 3, "memori": 10, "metric": 10, "migrat": [7, 8, 9], "mip": 10, "nerf": 10, "over": 10, "overview": 7, "perform": 10, "profil": 11, "python": 7, "raster": [0, 8], "render": [6, 9, 11], "reproduc": 10, "rgb": 11, "rotat": 3, "scene": [6, 10, 11], "singl": 5, "spheric": 9, "strategi": 1, "test": [7, 12], "train": 10, "usag": 9, "util": 2, "v0": 9, "verifi": 12, "view": 3}}) \ No newline at end of file diff --git a/main/tests/eval.html b/main/tests/eval.html index e17140d1d..c8e4f7ed6 100644 --- a/main/tests/eval.html +++ b/main/tests/eval.html @@ -5,7 +5,7 @@ - + Evaluation - gsplat documentation @@ -366,6 +366,91 @@

Evaluation +

Feature Ablation

+

Evaluation of features provided in gsplat on Mip-NeRF (averaged over 7 scenes). We ablate gsplat with default settings, with absgrad and mcmc densification strategies, and antialiased mode. +Absgrad method uses –grow_grad2d 0.0006 config. These results are obtained with an A100.

+
+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

PSNR

SSIM

LPIPS

Num GSs

Mem (GB)

Time (min)

gsplat (default settings)

29.00

0.87

0.14

3237318

5.62

19.39

absgrad

29.11

0.88

0.12

2465986

4.40

18.10

antialiased

29.03

0.87

0.14

3377807

5.87

19.52

mcmc (1 mill)

29.18

0.87

0.14

1000000

1.98

15.42

mcmc (2 mill)

29.53

0.88

0.13

2000000

3.43

21.79

mcmc (3 mill)

29.65

0.89

0.12

3000000

4.99

27.63

absgrad & antialiased

29.14

0.88

0.13

2563156

4.57

18.43

mcmc & antialiased

29.23

0.87

0.14

1000000

2.00

15.75

+
+

Trains Faster with Less GPU Memory

@@ -759,6 +844,7 @@

Reproduced Metrics
  • Evaluation diff --git a/main/tests/profile.html b/main/tests/profile.html index 5250f1174..e207c3995 100644 --- a/main/tests/profile.html +++ b/main/tests/profile.html @@ -5,7 +5,7 @@ - + Profiling - gsplat documentation diff --git a/main/tests/tests.html b/main/tests/tests.html index f20bbd9dc..00d9fa30b 100644 --- a/main/tests/tests.html +++ b/main/tests/tests.html @@ -5,7 +5,7 @@ - + Tests - gsplat documentation