I am a Research Scientist at Adobe Research. I got my PhD from Columbia University and BEng from HKUST.
I am interested in audiovisual cross-modal media synthesis using tools from computer vision, graphics, deep learning, and HCI. More broadly, I am interested in novel creative authoring/editing applications for everyone. My past research and engineering has been recognized by an Adobe MAX Sneaks Demo (2019), an ACM UIST Best Paper Award (2017), an Adobe Research Fellowship (2017), a NVIDIA PhD Fellowship Finalist (2017), a Shapeways Educational Grant (2016), and an HKUST academic achievement medal (2013). I have served as international program committee members for Eurographics 2020, Graphics Interface 2020, and ACM Multimedia 2019, and as reviewers for various academic conferences including SIGGRAPH, CVPR, ICCV, UIST, CHI, etc.
I’m always looking for interns and collaborators to work on research projects leading to publications/patents/product features. Please feel free to reach out to learn more.
Scene-Aware Audio Rendering via Deep Acoustic Analysis
IEEE VR 2020 (Journal Track) -- conditionally accepted
Zhenyu Tang, Nicholas J. Bryan, Dingzeyu Li, Timothy R. Langlois, Dinesh Manocha
[arxiv] [project page] [video] [code coming soon]
AirCode: Unobtrusive Physical Tags for Digital Fabrication
Dingzeyu Li, Avinash S. Nair, Shree K. Nayar, Changxi Zheng
Best Paper Award
[pdf] [low-res] [video] [slides] [talk] [code] [project page]
Interacting with Acoustic Simulation and Fabrication
UIST 2017 Doctoral Symposium
Expediting Precomputation for Reduced Deformable Simulation
Yin Yang, Dingzeyu Li, Weiwei Xu, Yuan Tian, Changxi Zheng
SIGGRAPH Asia 2015
[pdf] [low-res] [video] [project page]
Patents, Product Tech Transfers, Demos
Project Sweet Talk: Audio Driven Facial Animation from Single Image
Adobe MAX Sneaks Demo 2019
[video] [TechCrunch] [Adobe blog]
Presenter: Dingzeyu Li
Collaborators: Yang Zhou, Jose Echevarria, Eli Shechtman
Rendering Scene-Aware Audio Using Neural Network-Based Acoustic Analysis
Patent Filed (Pending), 2019
Zhenyu Tang, Dingzeyu Li, Nicholas J. Bryan, Timothy R. Langlois
Robust Noise-Resilient Automatic Lipsync and Interactive Adjustment
Shipped in Adobe Character Animator 2019 [Release Note]
Physics-Aware 3D Shape Drop to Ground
Shipped in Adobe Dimension 2019
The following is a list of research and personal projects that I have open sourced.