返回排行榜

Stability-AI/stable-virtual-camera

Pythonstable-virtual-camera.github.io

Stable Virtual Camera: Generative View Synthesis with Diffusion Models

diffusion-modelimage-to-videonovel-view-synthesisstable-virtual-camera
Star 增长趋势
Star
1.6k
Forks
122
周增长
Issues
22
1.2k1.4k1.6k
2025年3月2025年8月2026年2月2026年7月
制品库PyPIpip install stable-virtual-camera
README

Teaser

teaser_page1

Overview

Stable Virtual Camera (SEVA) is a generalist diffusion model for Novel View Synthesis (NVS), generating 3D consistent novel views of a scene, given any number of input views and target cameras.

:tada: News

  • June 2025 - Release v1.1 model checkpoint.
  • March 2025 - Stable Virtual Camera is out everywhere.

:gear: Versions

Model Version #Parameter Resolution Download Link Update Notes
1.1 1.3B 576P 🤗 Huggingface Fixing known issues of foreground objects sometimes being detached from the background in v1.0
1.0 1.3B 576P 🤗 Huggingface Initial release

You can specify the version via, for example, load_model(..., model_version=1.1) in the script.

:wrench: Installation

git clone --recursive https://github.com/Stability-AI/stable-virtual-camera
cd stable-virtual-camera
pip install -e .

Please note that you will need python>=3.10 and torch>=2.6.0.

Check INSTALL.md for other dependencies if you want to use our demos or develop from this repo. For windows users, please use WSL as flash attention isn't supported on native Windows yet.

:open_book: Usage

You need to properly authenticate with Hugging Face to download our model weights. Once set up, our code will handle it automatically at your first run. You can authenticate by running

# This will prompt you to enter your Hugging Face credentials.
huggingface-cli login

Once authenticated, go to our model card here and enter your information for access.

We provide two demos for you to interact with Stable Virtual Camera.

:rocket: Gradio demo

This gradio demo is a GUI interface that requires no expert knowledge, suitable for general users. Simply run

python demo_gr.py

For a more detailed guide, follow GR_USAGE.md.

:computer: CLI demo

This cli demo allows you to pass in more options and control the model in a fine-grained way, suitable for power users and academic researchers. An example command line looks as simple as

python demo.py --data_path <data_path> [additional arguments]

For a more detailed guide, follow CLI_USAGE.md.

For users interested in benchmarking NVS models using command lines, check benchmark containing the details about scenes, splits, and input/target views we reported in the paper.

:question: Q&A

:books: Citing

If you find this repository useful, please consider giving a star :star: and citation.

@article{zhou2025stable,
    title={Stable Virtual Camera: Generative View Synthesis with Diffusion Models},
    author={Jensen (Jinghao) Zhou and Hang Gao and Vikram Voleti and Aaryaman Vasishta and Chun-Han Yao and Mark Boss and
    Philip Torr and Christian Rupprecht and Varun Jampani
    },
    journal={arXiv preprint arXiv:2503.14489},
    year={2025}
}
相关仓库
MoonInTheRiver/DiffSinger

DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanism (SVS & TTS); AAAI 2022; Official code

PythonPyPIMIT Licensetext-to-speechdiffusion-speedup
4.8k825
Alpha-VLLM/Lumina-T2X

Lumina-T2X is a unified framework for Text to Any Modality Generation

PythonPyPIMIT Licenseaigctransformer
2.2k95
wangkai930418/awesome-diffusion-categorized

collection of diffusion model papers categorized by their subareas

diffusionstable-diffusion
2.2k102
PKU-YuanGroup/Helios

Helios: Real Real-Time Long Video Generation Model

PythonPyPIApache License 2.0accelerationdiffusion
pku-yuangroup.github.io/Helios-Page
2k158
Janspiry/Palette-Image-to-Image-Diffusion-Models

Unofficial implementation of Palette: Image-to-Image Diffusion Models by Pytorch

PythonPyPIMIT Licenseddpmimage-restoration
1.8k239
opendilab/awesome-diffusion-model-in-rl

A curated list of Diffusion Model in RL resources (continually updated)

Apache License 2.0deep-reinforcement-learningdiffusion-model
1.6k78
thu-ml/prolificdreamer

ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation (NeurIPS 2023 Spotlight)

PythonPyPIApache License 2.0diffusion-modeldreamfusion
ml.cs.tsinghua.edu.cn/prolificdreamer/
1.6k43
wenhaochai/StableVideo

[ICCV 2023] StableVideo: Text-driven Consistency-aware Diffusion Video Editing

PythonPyPIApache License 2.0aigccomputer-vision
rese1f.github.io/StableVideo/
1.4k88
rese1f/StableVideo

[ICCV 2023] StableVideo: Text-driven Consistency-aware Diffusion Video Editing

PythonPyPIApache License 2.0aigccomputer-vision
rese1f.github.io/StableVideo/
1.4k89
shivammehta25/Matcha-TTS

[ICASSP 2024] 🍵 Matcha-TTS: A fast TTS architecture with conditional flow matching

Jupyter NotebookMIT Licensedeep-learningflow-matching
shivammehta25.github.io/Matcha-TTS/
1.3k212
thu-ml/Motus

Official code of Motus: A Unified Latent Action World Model

PythonPyPIApache License 2.0roboticsworld-model
motus-robotics.github.io/motus
1.2k70