TC4D: Trajectory-Conditioned Text-to-4D Generation

Sherwin Bahmani*1,2,3   Xian Liu*4   Wang Yifan*5   Ivan Skorokhodov3   Victor Rong1,2   Ziwei Liu6   Xihui Liu7 
Jeong Joon Park8   Sergey Tulyakov3   Gordon Wetzstein5   Andrea Tagliasacchi1,9,10   David B. Lindell1,2  
1University of Toronto 2Vector Institute 3Snap Inc. 4CUHK 5Stanford University 6NTU 7HKU 8University of Michigan 9SFU 10Google DeepMind
* equal contribution

ECCV 2024

Paper Code Project

Comparisons with DreamGaussian4D and 4D-fy

DreamGaussian4D + Trajectory

4D-fy + Trajectory

Ours

a sheep running
a camel walking
an astronaut riding a horse
a hippo walking

Citation

@article{bah2024tc4d,
  author = {Bahmani, Sherwin and Liu, Xian and Yifan, Wang and Skorokhodov, Ivan and Rong, Victor and Liu, Ziwei and Liu, Xihui and Park, Jeong Joon and Tulyakov, Sergey and Wetzstein, Gordon and Tagliasacchi, Andrea and Lindell, David B.},
  title = {TC4D: Trajectory-Conditioned Text-to-4D Generation},
  journal = {arXiv},
  year = {2024},
}