WorldMirror 2.0 lets you construct 3D from image/video assets
HY-World 2.0 and WorldMirror 2.0
WorldMirror 2.0 is 1/2 of the recently released HY-World2.0 world generation model framework, which consists of world generation AND world reconstruction.
WorldMirror is the "reconstruction" part.
World Mirror lets you upload a video/image set to get a 3D splat/cloud/mesh/depth in one go.
The official gradio app when launched in low vram mode lets you play with the demos with around 8~10GB VRAM (Might be possible to go lower if you only use small number of source frames but i haven't tried)
FAQ: Can I actually generate the world in realtime?
No. In case you're wondering if you can actually control the world---short answer: Not yet. So none of what you see below are possible yet.
HY-World 2.0 consists of:
- World generation
- World reconstruction
WorldMirror is the reconstruction part of HY-World. So no, you can't control stuff and generate the world in realtime just yet. They will need to release the rest of the HY-World 2.0.
What CAN it do?
Turn a video or image collection into 3D. some more examples
Usage Tips
To optimize VRAM usage, don't overdo the source frames. 4–10 works fine, sometimes even 2. What matters most is that the samples collectively cover all viewing angles, not the frame count.