Skip to content

Commit

Permalink
add instant_splat example (#7751)
Browse files Browse the repository at this point in the history
  • Loading branch information
pablovela5620 authored Oct 16, 2024
1 parent 522997c commit 900cb93
Show file tree
Hide file tree
Showing 2 changed files with 25 additions and 0 deletions.
1 change: 1 addition & 0 deletions examples/manifest.toml
Original file line number Diff line number Diff line change
Expand Up @@ -100,6 +100,7 @@ examples = [
"differentiable_blocks_world",
"stereo_vision_slam",
"glomap",
"instant_splat",
"signed_distance_fields",
"raw_mesh",
]
Expand Down
24 changes: 24 additions & 0 deletions examples/python/instant_splat/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
<!--[metadata]
title = "InstantSplat"
tags = ["2D", "3D", "HuggingFace", "Pinhole camera", "Point cloud"]
source = "https://github.com/pablovela5620/InstantSplat"
thumbnail = "https://static.rerun.io/final_instantsplat/e488f427179b0f439e60b6a0c29440fc836860dd/480w.png"
thumbnail_dimensions = [480, 268]
-->


https://vimeo.com/1019845514?loop=1&autopause=0&background=1&muted=1&ratio=2802:1790

## Background
InstantSplat is a sparse-view, SfM-free framework for large-scale scene reconstruction method using Gaussian Splatting. It allows for extremely fast reconstruction by using Dust3r, a multiview stereo network, to initialize camera poses and dense point cloud for all training views. To enhance pose accuracy and tune scene parameters a gradient-based joint optimization framework from self-supervision is used. By employing this simplified framework, InstantSplat achieves a substantial reduction in training time, from hours to mere seconds, and demonstrates robust performance across various numbers of views in diverse datasets

## Run the code
This is an external example. Check the [repository](https://github.com/pablovela5620/InstantSplat) for more information.

You can try the example on HuggingFace space [here](https://huggingface.co/spaces/pablovela5620/instant-splat).

It is highly recommended to run this example locally by cloning the above repo and running (make sure you have [Pixi](https://pixi.sh/latest/#installation) installed):
```
git clone https://github.com/pablovela5620/InstantSplat.git
pixi run app
```

0 comments on commit 900cb93

Please sign in to comment.