princeton-vl/infinigen: Infinite Photorealistic Worlds using Procedural Generation

dash

| Website

| Intro Video

| Papers

| Documentation

| Complimented

First, follow our Installation Instructions.

See instructions and example commands for Infinigen-Indoors in HelloRoom.md

See instructions and example commands for Infinigen-Nature at HelloWorld.md

If you use Infinigen in your work, please refer to our academic papers:

Alexander Raisrick*,
Lahav Lipson*,
Zeyu Ma* (*equal contributions, alphabetical order)
Lingjie Mei,
Mingzhe Wang,
Yiming Zuo,
Karhan Kayan,
Hongyu Wen,
After Han,
Yihan Wang,
Alejandro Newell,
Hi Law,
Ankit Goyal,
Kaiyu Yang,
Jia Deng
Conference on Computer Vision and Pattern Recognition (CVPR) 2023

@inproceedings{infinigen2023infinite,
  title={Infinite Photorealistic Worlds Using Procedural Generation},
  author={Raistrick, Alexander and Lipson, Lahav and Ma, Zeyu and Mei, Lingjie and Wang, Mingzhe and Zuo, Yiming and Kayan, Karhan and Wen, Hongyu and Han, Beining and Wang, Yihan and Newell, Alejandro and Law, Hei and Goyal, Ankit and Yang, Kaiyu and Deng, Jia},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  pages={12630--12641},
  year={2023}
}

Alexander Raisrick*,
Lingjie Mei*,
Karhan Kayan*, (*equal contribution, random order)
David Yan,
Yiming Zuo,
After Han,
Hongyu Wen,
Meenal Parakh,
Stamatis Alexandropoulos,
Lahav Lipson,
Zeyu Ma,
Jia Deng
Conference on Computer Vision and Pattern Recognition (CVPR) 2024

@inproceedings{infinigen2024indoors,
    author    = {Raistrick, Alexander and Mei, Lingjie and Kayan, Karhan and Yan, David and Zuo, Yiming and Han, Beining and Wen, Hongyu and Parakh, Meenal and Alexandropoulos, Stamatis and Lipson, Lahav and Ma, Zeyu and Deng, Jia},
    title     = {Infinigen Indoors: Photorealistic Indoor Scenes using Procedural Generation},
    booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    month     = {June},
    year      = {2024},
    pages     = {21783-21794}
}

Please see our project roadmap and follow us on https://twitter.com/PrincetonVL for updates.

We welcome contributions! You can contribute in many ways:

• Commit the code to this repository – We welcome code contributions. More instructions coming soon.
• Contribute to procedural generators – infinigen/nodes/node_transpiler/dev_script.py provides artist-friendly conversion tools Blender Nodes in python code. Instructions and instructions are coming soon.
• Contribute to pre-generated data – Anyone can contribute their computing power to create data and share it with the community. Please stay tuned for a repository of pre-generated data.

Please post this repository’s Github Issues page for help. Please run your command on --debugand let us know:

• What is your computer setup, including OS version, CPU, RAM, GPU(s) and any drivers?
• What version of the code are you using (link to a commit hash), and what if any changes have you made (new configs, code edits)
• What is the exact command you ran?
• What are the output logs of the command you ran?
  • When used manage_jobsSee outputs/MYJOB/MYSEED/logs/ to find the right one.
  • What exactly is wrong with python and stacktrace, if possible?

Infinigen would not be possible without the incredible work of Blender Foundation and it’s open-source contributors. Infinigen uses many open source projects, with special thanks to Land-Lab, BlenderProc Blender-FLIP-Fluids and Blender-Differential-Growth.

We are thankful Thomas Kole for providing a procedure cloud.

We have learned a lot from online tutorials on
Andrew Price,
Artisans of Vaul,
Not Good Normal,
Blender Tutorial Channel,
blenderbitesize,
The mixture,
Bradley Animation,
CGCookie,
CGRogue,
Creative Shrimp,
CrowdRender,
Dr. Blender,
HEY Pictures,
Ian Hubert,
The Binge,
Lance Phan,
MaxEdge,
mr. Cheebs,
PixelicaCG,
Polyfjord,
Robbie Tilton,
Ryan King Art,
Sam Bowman and
yogigraphics. These tutorials provided procedural generators for our early experiments and served as inspiration for our own implementations in the official Infinigen release. They are identified in file header comments where applicable.

Infinigen has improved significantly since the version described in our CVPR paper. It now features some procedural code obtained from the internet under CC-0 licenses, marked with code comments where possible – no such code exists in the system for the CVPR version.