Link to my Lab publication page

  1. Configurable 3D Scene Synthesis and 2D Image Rendering with Per-Pixel Ground Truth using Stochastic Grammars [pdf]
    Chenfanfu Jiang, Siyuan Qi, Yixin Zhu, Siyuan Huang, Jenny Lin, Lap-Fai Yu, Demetri Terzopoulos, and Song-Chun Zhu
    International Journal of Computer Vision (accepted, to appear), 2018.

  2. A Tale of Three Probabilistic Families: Discriminative, Descriptive and Generative Models [pdf]
    Yingnian Wu, Ruiqi Gao, Tian Han and Song-Chun Zhu
    Quarterly of Applied Math. (to appear), 2018.

  3. Building a Telescope to Look Into High-dimensional Image Spaces [pdf]
    Mitch Hill, Eric Nijkamp and Song-Chun Zhu
    Quarterly of Applied Math. (to appear), 2018. arXiv1803.01043

  4. Perception of Human Interaction Based on Motion Trajectories: From Aerial Videos to Decontextualized Animations [pdf]
    T.M. Shu, Y.J. Peng, L.F. Fan, H.J. Lu, and S.C. Zhu
    Topics in Cognitive Science, 10 (1): 225–241, 2018.

  5. Visual Interpretability for Deep Learning: a Survey [pdf]
    Q.S. Zhang and S.C. Zhu
    Frontiers of Information Technology & Electronic Engineering Vol. 19, No.1, 27-39, 2018. arXiv: 1802.00614.

  6. Sparse and Deep Generalizations of the FRAME Model [pdf]
    Y. N. Wu, J. Xie, Y. Lu, and S.C. Zhu
    --- Annals of Mathematical Science and Applications, Vol.3, no. 1, 211-254, 2018.

  7. Learning and Inferring “Dark Matter” and Predicting Human Intents and Trajectories in Videos [pdf] [web]
    D. Xie, T. Shu, S. Todorovic and S.C. Zhu
    --- IEEE Trans on Pattern Analysis and Machine Intelligence, (accepted), arXiv: 1606.07827: (short version appeared in ICCV2013).

  8. Attribute And-Or Grammar for Joint Parsing of Human Pose, Parts and Attributes [pdf] [web]
    S. Park, B. X. Nie, and S.C. Zhu
    --- IEEE Trans on Pattern Analysis and Machine Intelligence, (accepted), arXiv: 1605.02112: (short version appeared in ICCV2015).

  9. Single-View 3D Scene Reconstruction and Parsing by Attribute Grammar [pdf]
    X.B. Liu, Y.B. Zhao, and S.C. Zhu
    --- IEEE Trans on Pattern Analysis and Machine Intelligence, 40(3):710-725, 2018.

  10. Online Object Tracking, Learning and Parsing with And-Or Graphs [pdf] [web]
    T.F. Wu, Y. Lu, and S.C. Zhu
    --- IEEE Trans on Pattern Analysis and Machine Intelligence, 39(12): 2465-2480, 2017.

  11. The Martian: Examining Human Physical Judgments across Virtual Gravity Fields[pdf][web]
    T. Ye*, S. Qi*, J. Kubricht, Y.X. Zhu, H.J. Lu, S.-C. Zhu
    IEEE Trans. Visualization and Computer Graphics, 23(4): 1399-1408, 2017.

  12. Modeling 4D Human-Object Interactions for Joint Event Segmentation, Recognition, and Object Localization [pdf] [web]
    P. Wei, Y.B. Zhao, N.N. Zheng and S.C. Zhu
    --- IEEE Trans on Pattern Analysis and Machine Intelligence, Vol.39, No. 6, 1165-1179, 2017.

  13. Joint Image-Text News Topic Detection and Tracking by Multimodal Topic And-Or Graph [pdf][web]
    W. Li, J. Joo, H. Qi, and S.C. Zhu
    --- IEEE Trans on Multimedia, 19(2):367-381, 2017.

  14. Integrating Function, Geometry, Appearance for Scene Parsing [pdf] [web]
    --- Y. Zhao and S.C. Zhu
    --- Int'l Journal of Computer Vision (Accepted, short version appeared in CVPR 2013)

  15. Learning And-Or Models to Represent Context and Occlusion for Car Detection and Viewpoint Estimation [pdf] [web]
    --- T.F. Wu, B. Li and S.C. Zhu
    --- IEEE Trans on Pattern Analysis and Machine Intelligence, vol. 38, issue no. 9: 1829-1843, 2016.

  16. Inducing Wavelets into Random Fields via Generative Boosting [pdf][web]
    --- J. Xie, Y. Lu, S.C. Zhu, and Y.N. Wu, 
    --- Applied and Computational Harmonic Analysis, Vol. 41, Issue 1, pp4–25, July, 2016.

  17. Learning Perceptual Causality from Video [pdf]
    --- A. Fire and S.C. Zhu
    --- ACM Trans. on Intelligent Systems and Technology, 7(2): 23, January, 2016. (Special Issue on Causal Discovery and Inference)

  18. A Reconfigurable Tangram Model for Scene Representation and Categorization [pdf]
    --- J. Zhu, T.F Wu, S.C. Zhu, X.K. Yang, and W.J. Zhang
    --- IEEE Trans on Image Processing, 25(1): 150-166, January, 2016.

  19. Learning Hierarchical Space Tiling for Scene Modeling, Parsing and Attribute Tagging [pdf][web]
    --- S. Wang, Y.Z. Wang, and S.C. Zhu
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 37, no. 12 2478-2491, 2015.

  20. Video Primal Sketch : A Unified Middel Level Representation of video [pdf][web]
    --- Z. Han, Z. Xu, and S.C. Zhu
    --- Journal of Mathematical Imaging and Vision, 53(2): 151-170, 2015.

  21. Learning Sparse FRAME Models for Natural Image Patterns [pdf] [web]
    --- J. Xie, W. Hu, S.C. Zhu and Y.N. Wu
    --- Int'l Journal of Computer Vision, 112(2): 221-238, 2015.

  22. Learning 3D Object Templates by Quantizing Geometry and Appearance Spaces [pdf] [web]
    --- W. Hu and S.C. Zhu
    --- IEEE Trans on Pattern Analysis and Machine Intelligence, Vol.37, No. 6, 1190-1205, 2015.

  23. Scene Understanding by Reasoning Stability and Safety [pdf] [web]
    --- B. Zheng, Y. Zhao, J. Yu, K. Ikeuchi, and S.C. Zhu
    --- Int'l Journal of Computer Vision, vol. 112, no. 2, pp221-238, 2015

  24. Learning Near-Optimal Cost-Sensitive Decision Policy for Object Detection [pdf][web]
    --- T.F. Wu and S.C. Zhu
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 37, no. 5, pp 1013-1027, 2015.

  25. Joint Video and Text Parsing for Understanding Events and Answering Queries
    --- K. Tu, M. Meng, M. W. Lee, T.E. Choi, and S.C. Zhu
    --- IEEE MultiMedia Vol.21, no.2, pp.42-70, 2014. [pdf] [web]

  26. Unsupervised Learning of Compositional Sparse Code for Natural Image Representation
    --- Y. Hong, Z.Z. Si, W.Z Hu, S.C. Zhu and Y.N. Wu
    --- Quarterly of Applied Mathematics, 72, 373-406, 2014. [pdf] [web with data and code]

  27. Animated Pose Templates for Modeling and Detecting Human Actions
    --- B. Yao, B. Nie, Z. Liu, and S.C. Zhu
    --- IEEE Trans on Pattern Analysis and Machine Intelligence, Vol. 36, no.3, 436-452, 2014. [pdf] [web]

  28. Video Event Parsing and Learning with Goal and Intent Prediction
    --- M.T. Pei, Z.Z. Si, B. Yao, and S.C. Zhu
    --- Computer Vision and Image Understanding, vol. 117, no. 10, pp 1369-1383, 2013 [pdf] [web with data and code]

  29. Learning And-Or Templates for Object Recognition and Detection
    --- Z. Si and S.C. Zhu
    --- IEEE Trans on Pattern Analysis and Machine Intelligence, vol. 35, no.9, 2189-2205, 2013 [pdf] [web with data and code]

  30. Abstract Painting with Interactive Control of Perceptual Entropy
    --- M.T. Zhao and S.C. Zhu
    --- ACM Trans on Applied Perception, Vol.10, No.1, Febuary, 2013. [pdf] [web][reprint]

  31. Video Stylization: Painterly Rendering and Optimization with Content Extraction
    --- L. Lin, K. Zeng, Y.Z. Wang, Y.-Q. Xu, S.-C. Zhu
    --- IEEE Transactions on Circuits and Systems for Video Technology, vol.23, no4, pp577-590, 2013 . [pdf][web]

  32. Background Modeling by Subspace Learning on Spatio-temporal Patches
    --- Y.D. Zhao, H. F. Gong, Y. Jia, and S.C. Zhu
    --- Pattern Recognition Letter, Vol.33, 1134-1147, 2012. [pdf]

  33. Intrackability : Characterizing Video Statistics and Pursuing Video Representations
    --- H.F. Gong and S.C. Zhu
    ---Int'l Journal of Computer Vision, vol 97, no.3, pp255-275, 2012 [pdf] [web]

  34. Learning Hybrid image Template (HiT) by Information Projection
    --- Z. Si and S.C. Zhu
    ---IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 34, no.7, pp1354-1367, 2012. [pdf] [web with data and code ]

  35. A Numeric Study of the Bottom-up and Top-down Inference Processes in And-Or Graphs
    --- T.F. Wu and S.C. Zhu
    --- Int'l Journal of Computer Vision, vol. 93, no 2, p226-252, June 2011. [pdf] [web]

  36. C4 : Computing Multiple Solutions in Graphical Models by Cluster Sampling
    --- J. Porway and S.C. Zhu
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.33, no.9, 1713-1727, 2011 [pdf][reprint] [web page ]

  37. A Compositional and Dynamic Model for Face Aging
    --- J.L. Suo, S.C. Zhu, S. Shan, and X. Chen
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 32, no. 3, pp 385-401, March 2010. [pdf][reprint][web]

  38. Layered Graph Matching by Composite Cluster Sampling
    --- L. Lin, X.B. Liu and S.C. Zhu
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.32, no. 8. pp 1426-1442, August, 2010. [pdf][reprint]

  39. Hierarchical and Contextual Model for Aerial Image Understanding
    --- J. Porway, Q.C. Wang, and S.C. Zhu
    --- Int'l Journal of Computer Vision, vol.88, no.2, pp 254-283, 2010 [pdf][reprint] [web]

  40. I2T: Image Parsing to Text Description
    --- Z.Y. Yao, X. Yang, L. Lin, M. W. Lee, and S.C. Zhu
    --- Proceedings of IEEE, Vol 98, no.8,, pp 1485-1508, August, 2010. [pdf] [web]

  41. Learning Active Basis Models by EM-Type Algorithms [pdf]
    --- Z. Si, H. Gong, S.C. Zhu, and Y.N. Wu
    --- Statistical Science , Vol. 25, No. 4, 458-475, 2010.

  42. Learning Active Basis Model for Object Detection and Recognition
    ---Y.N. Wu, Z.Z. Si, H.F. Gong, and S.C. Zhu
    --- Int'l Journal of Computer Vision, Vol.90, no.2, pp 198-235, 2010 [pdf][reprint] [web with data and code]

  43. Bottom-up/Top-down Image Parsing with Attribute Graph Grammar
    --- F. Han and S.C. Zhu
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence , vol.31, no.1, pp 59-73, Jan. 2009 [pdf] [reprint]

  44. From Image Parsing to Painterly Rendering
    --- K. Zeng, M.T. Zhao, C. Xiong, and S.C. Zhu
    --- ACM Trans. on Graphics, vol. 29, no.1, Dec. 2009. [reprint] [web page]

  45. Learning Explicit and Implicit Visual Manifolds by Information Projection
    ---S.C. Zhu, K. Shi, and Z.Z. Si
    --- Pattern Recognition Letter (invited paper for the Aggarwal Lecture), August 2009. [pdf] [reprint]

  46. From Information Scaling of Natural Images to Regimes of Statistical Models
    --- Y.N. Wu, C.E. Guo, and S.C. Zhu
    --- Quarterly of Applied Mathematics, vol. 66, no. 1, 81-122, 2008. [preprint.pdf]

  47. A Composite Template for Human Face Modeling and Sketch
    --- Z.J. Xu, H. Chen, S.C. Zhu, and J. Luo
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.30, no.6, 955-969, 2008. [pdf] [reprint.pdf] [web page]

  48. Perceptual Scale Space and Its Applications
    --- Y.Z. Wang and S.C. Zhu
    --- Int'l Journal of Computer Vision, vol. 80, no.1, pp143-165, Oct, 2008. [pdf] [reprint] [web page]

  49. Primal Sketch: Integrating Texture and Structure
    --- C.E. Guo, S.C. Zhu and Y.N. Wu
    --- Computer Vision and Image Understanding, vol. 106, issue 1, 5-19, April, 2007 [pdf] [reprint.pdf][web page]

  50. Generalizing Swendsen-Wang for Image Analysis
    --- A. Barbu and S.C. Zhu
    --- Journal of Computational and Graphical Statistics, vol. 16, no. 4, 877-900, 2007 [Long_survey.pdf] [reprint.pdf]

  51. A Two-Level Generative Model for Cloth Representation and Shape-From-Shading
    --- F. Han and S.C. Zhu
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.29, no.7, pp 1230-1243, July 2007 [pdf]

  52. Parsing Images into Regions, Curves, and Curve Groups
    ---Z.W. Tu and S.C. Zhu,
    --- Int'l Journal of Computer Vision, 69(2), 223-249, August, 2006. [pdf] [reprint.pdf] [web page]

  53. First-hitting-time Analysis of Independence Metropolis Sampler.
    --- R. Maciuca and S.C. Zhu,
    ----Journal of Theoretical Probability, 2006 [pdf] [reprint pdf]. A version published at SCTV03 for Vision audience [pdf]

  54. A Stochastic Grammar of Images
    --- S.C. Zhu and D. Mumford
    --- Foundations and Trends in Computer Graphics and Vision, Vol.2, No.4, pp 259-362, 2006. [pdf] [reprint pdf]

  55. A Genrative Sketch Model for Human Hair Analysis and Synthesis
    --- H. Chen and S.C. Zhu
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.28, no.7, 1025-1040, July, 2006. [pdf] [reprint.pdf]

  56. What are Textons?
    --- S.C. Zhu, C. E. Guo, Y.Z. Wang, and Z.J. Xu
    --- Int'l J. of Computer Vision, vol.62(1/2), 121-143, April/May, 2005. [pdf] [reprint pdf] [web page]

  57. Image parsing: unifying segmentation, detection and recognition
    --- Z.W. Tu, X.R. Chen, A.L. Yuille, and S.C. Zhu,
    --- Int'l J. of Computer Vision, 63(2), 113-140, 2005. [pdf] [reprint pdf] [web page]

  58. Generalizing Swendsen-Wang to Sampling Arbitrary Posterior Probabilities
    --- A. Barbu and S.C. Zhu,
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.27, no.8, 1239-1253, 2005. [pdf] [reprint pdf] [web page]

  59. Analysis and Synthesis of Textured Motion: Particles and Waves,
    --- Y.Z. Wang and S.C. Zhu,
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 26, no. 10, pp 1348-1363, Oct, 2004. [pdf] [reprint pdf] [web page]

  60. Range Image Segmentation by an Effective Jump-Diffusion Method,
    --- F. Han, Z. W. Tu, and S.C. Zhu,
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 26, no. 9, pp 1138-1153, Sept, 2004. [pdf] [reprint pdf] [web page]

  61. Statistical Edge Detection: Learning and Evaluating Edge Cues,
    --- S. Kinishi, A. L. Yuille, J. M. Coughlan, and S. C. Zhu,
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.25, no.1, pp 57-74 January, 2003. [reprint pdf]

  62. Modeling Visual Patterns by Integrating Descriptive and Generative Models,
    --- C. E Guo, S.C. Zhu, and Y. N. Wu,
    ---International Journal of Computer Vision, 53(1), 5-29, 2003. [reprint pdf] [web page]

  63. Statistical Modeling and Conceptualization of Visual Patterns,
    --- S.C. Zhu,
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 25, no.6, pp. 691-712, 2003. [pdf][reprint pdf]

  64. On advances in statistical modeling of natural images [pdf]
    --- A. Srivastava, A.B. Lee, E.P. Simoncelli, and S.C. Zhu
    --- J. of Math Imaging and Vision, 18(1), 17-33, 2003.

  65. Image Segmentation by Data-Driven Markov Chain Monte Carlo,
    --- Z.W. Tu and S.C. Zhu,
    --- IEEE Trans on Pattern Analysis and Machine Intelligence, vol.24, no.5, pp. 657-673, May, 2002. [reprint pdf] [web page]

  66. Learning in Gibbsian Feilds: How Accurate and How Fast can It Be?"
    --- S. C. Zhu and X. W. Liu,
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.24, no.7, pp. 1001-1006, July, 2002. [reprint pdf]

  67. Order Parameter for Detecting Target Curves in Images: How does High Level Knowledge Helps?
    --- A. L. Yuille, J. M. Coughlan, Y. N. Wu, and S. C. Zhu,
    --- International Journal of Computer Vision, vol. 41, No. 1/2, pp.9-33, January, 2001.[reprint pdf] [web page]

  68. Exploring Texture Enesmbles by Efficient Markov Chain Monte Carlo --- Toward a "trichromacy" theory of texture,
    --- S. C. Zhu, X. W. Liu and Y. N. Wu,
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 22, No.6, pp 554-569, June, 2000. [reprint pdf] [web page]

  69. Equivalence of Julesz Ensemble and FRAME models
    --- Y. N. Wu, S. C. Zhu and X. W. Liu,
    ---International Journal of Computer Vision, 38(3), 247-265, July, 2000. [reprint pdf] [web page]

  70. Stochastic Jump-Diffusion process for computing Medial Axes in Markov Random Fields
    --- S. C. Zhu,
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 21, No.11, pp1158-1169, Nov, 1999. [reprint pdf]

  71. Embedding Gestalt Laws in Markov Random Fields -- A theory for shape modeling and perceptual organization,
    --- S. C. Zhu,
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol. 21, No.11, pp1170-1187, Nov, 1999. [reprint pdf] [web page]

  72. FRAME: Filters, Random field And Maximum Entropy: --- Towards a Unified Theory for Texture Modeling,
    --- S. C. Zhu, Y. N. Wu and D.B. Mumford,
    --- International Journal of Computer Vision, 27(2) pp.1-20, March/April. 1998. [reprint pdf] [tutotial on texture]

  73. Prior Learning and Gibbs Reaction-Diffusion,
    --- S. C. Zhu and D.B. Mumford,
    --- IEEE Trans. on Pattern Analysis and Machine Intelligence, vol.19, no.11, pp1236-1250, Nov. 1997. [reprint pdf] [web page]

  74. Minimax Entropy Principle and Its Applications to Texture Modeling
    --- S. C. Zhu, Y.N. Wu and D.B. Mumford,
    --- Neural Computation Vol. 9, no 8, pp 1627-1660, Nov. 1997. [pdf] [web page]

  75. FORMS: A Flexible Object Recognition and Modeling System,
    --- S. C. Zhu and A. L.Yuille,
    --- International Journal of Computer Vision, Vol.20, No.3, pp.187-212, 1996. [reprint pdf] [web page]

  76. Region Competition: Unifying Snake/balloon, Region Growing and Bayes/MDL/Energy for multi-band Image Segmentation.
    --- S. C. Zhu and A.L Yuille,
    --- IEEE Trans.on Pattern Analysis and Machine Intelligence, vol.18, no.9, pp.884-900, Sept. 1996. [reprint pdf] [web page]

  77. Ph.D Thesis : Statistical and Computational Theories for Image Segmentation, Texture Modeling, and Object Recognition,
    --- Song Chun Zhu, Harvard University, January, 1996.

© S.-C. Zhu