Lixin Xue

I am a PhD student at ETH Zürich, advised by Prof. Otmar Hilliges, Prof. Dimitris Tzionas, and Prof. Marc Pollefeys. Before my PhD, I received my master's degree from ETH Zürich and my bachelor's degree from Beihang University.

Along the way, I was lucky to work with Dr. Alejandro Blumentals and Dr. Slawomir Bak at Apple, Dr. Paulo Gotardo and Dr. Derek Bradley at DisneyResearch|Studios, Prof. Hao Su at UCSD, and Dr. Zhirong Wu at Microsoft Research Asia.

My research goal is to digitize how humans interact with the 3D world from everyday videos, with applications from AR/VR to robot learning. My PhD focuses on 4D reconstruction of humans, objects, and scenes from monocular videos, and more recently on generative 3D.

I am on the job market for full-time industry positions. Feel free to reach out!

Email  /  Google Scholar  /  CV  /  GitHub  /  LinkedIn  /  X

profile photo
Publications
RHINO teaser RHINO: Reconstructing Human Interactions with Novel Objects from Monocular Videos
Lixin Xue, Chengwei Zheng, Georgios Paschalidis, Chen Guo, Manuel Kaufmann, Juan Zarate, Dimitrios Tzionas
CVPR 2026
project page / paper / video / code

RHINO reconstructs the human, the manipulated object, and the scene in 4D within a common world frame from a moving monocular camera.

GauSTAR: Gaussian Surface Tracking and Reconstruction
Chengwei Zheng, Lixin Xue, Juan Zarate, Jie Song
CVPR 2025
project page / paper / video / code

GauSTAR binds Gaussians to mesh faces to achieve photorealistic rendering, accurate surface reconstruction, and reliable 3D tracking of dynamic scenes, even when their topology changes.

ODHSR: Online Dense 3D Reconstruction of Humans and Scenes from Monocular Videos
Zetong Zhang, Manuel Kaufmann, Lixin Xue, Jie Song, Martin R. Oswald
CVPR 2025
project page / paper / video

ODHSR jointly tracks the camera and human pose and reconstructs both the human and the scene with 3D Gaussians, online from a single monocular video.

HSR: Holistic 3D Human-Scene Reconstruction from Monocular Videos
Lixin Xue, Chen Guo, Chengwei Zheng, Fangjinhua Wang, Tianjian Jiang, Hsuan-I Ho, Manuel Kaufmann, Jie Song, Otmar Hilliges
ECCV 2024
project page / paper / video / code / data

HSR jointly reconstructs the dynamic human and the static scene as neural implicit surfaces from a monocular RGB video.

Learning Locally Editable Virtual Humans
Hsuan-I Ho, Lixin Xue, Jie Song, Otmar Hilliges
CVPR 2023
project page / paper / video / code / data

A hybrid representation that stores local geometry and texture features on the vertices of a skinned body model, enabling neural avatars that are fully editable and customizable.

Projects
SfM disambiguation result
SfM disambiguation input
Disambiguation in Structure-from-Motion
Supervised by Dr. Paul‑Edouard Sarlin, Dr. Mihai Dusmanu, and Prof. Marc Pollefeys
Semester Project in Computer Vision and Geometry Group
code

Makes COLMAP robust to repeated and symmetric structures by filtering out wrong matches with two disambiguation methods.

FRNN nearest neighbor search visualization Fixed Radius Nearest Neighbor Search
Supervised by Dr. Yifan Wang, Prof. Cengiz Öztireli, and Prof. Olga Sorkine-Hornung
Semester Project in Interactive Geometry Lab
code / slides

A CUDA fixed-radius nearest neighbor search with a pytorch3d.ops.knn_points-style interface, over 10× faster than existing GPU KNN implementations.



Website template credits to Jon Barron