Single Image Reconstruction

This project aims to do the semantic labelling and 3D reconstruction from a single outdoor RGB image. To address this problem, we first calibrate the camera in every image from detected vanishing points. Then we parse the scene with attributed grammar and do the 3D reconstruction with the geometry constraints betweene points, lines and planes.

Collaborator: Joey C. Yu , Xiaobai Liu

Multi-view Tracking

This project aims to address a multi-object tracking problem using a few cameras. Traditional tracking problem focuses on only single view, so the tracking id may vary when objects overlap or disappear for a while. However multiview tracking can solve above problems and increase tracking accuracy by tracking objects in a 3D background.

Collaborator: Yuanlu Xu , Xiaobai Liu


  • Jointly Recognizing Object Fluents and Tasks in Egocentric Videos [ pdf ][ bibtex ][Datasets(coming soon)]
    Yang Liu*, Ping Wei*, Songchun Zhu
    International Conference on Computer Vision (ICCV), Venice, Italy, Octobor, 2017.

  • Composing Hierarchical Structures for Multi-view Multi-object Tracking [ pdf ]
    Yuanlu Xu, Xiaobai Liu, Yang Liu, Songchun Zhu
    IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, June, 2016.

  • Who Influenced You? Predicting Retweet via Social Influence Locality [ pdf ]
    Jing Zhang, Jie Tang, Juanzi Li, Yang Liu, Chunxiao Xing
    ACM Transactions on Knowledge Discovery from Data (TKDD), Volume 9, Issue 3, 2015, Article No. 25.