| Hao Li | |
| Native Name: | 黎顥 |
| Citizenship: | German |
| Fields: | Computer Graphics, Computer Vision |
| Alma Mater: | ETH Zurich (2010) Karlsruhe Institute of Technology (2006) |
| Thesis Title: | Animation Reconstruction of Deformable Surfaces |
| Thesis Year: | 2010 |
| Doctoral Advisor: | Mark Pauly |
| Known For: | Human Digitization, Facial Performance Capture |
| Awards: | TR35 Award ONR YIP |
| Work Institution: | Pinscreen (Founder/CEO) Mohamed bin Zayed University of Artificial Intelligence (Associate Professor) |
Hao Li (born) is a computer scientist, innovator, and entrepreneur from Germany, working in the fields of computer graphics and computer vision. He is co-founder and CEO of Pinscreen, Inc, as well as associate professor of computer vision at the Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI).[1] He was previously a Distinguished Fellow at the University of California, Berkeley, an associate professor of computer science[2] at the University of Southern California, and former director of the Vision and Graphics Lab at the USC Institute for Creative Technologies.[3] He was also a visiting professor at Weta Digital and a research lead at Industrial Light & Magic / Lucasfilm.
For his work in non-rigid shape registration, human digitization, and real-time facial performance capture, Li received the TR35 Award in 2013 from the MIT Technology Review.[4] He was named Andrew and Erna Viterbi Early Career Chair in 2015, and was awarded the Google Faculty Research Award and the Okawa Foundation Research Grant the same year. Li won an Office of Naval Research Young Investigator Award in 2018[5] and was named to the DARPA ISAT Study Group in 2019.[6] He is a member of the Global Future Council on Virtual and Augmented Reality of the World Economic Forum.[7]
Li's parents are Taiwanese and lived in Germany as of 2013.[8]
Li went to a French-German high school in Saarbrücken and speaks four languages (English, German, French, and Mandarin Chinese). He obtained his Diplom (eq. M.Sc.) in computer science at the Karlsruhe Institute of Technology (then University of Karlsruhe (TH)) in 2006 and his PhD in computer science at ETH Zurich in 2010. He was a visiting researcher at ENSIMAG in 2003, the National University of Singapore in 2006, Stanford University in 2008, and EPFL in 2010. He was also a postdoctoral fellow at Columbia University and Princeton University between 2011 and 2012.[9]
Li joined Industrial Light & Magic / Lucasfilm in 2012 as a research lead to develop next generation real-time performance capture technologies for virtual production and visual effects. He later joined the computer science department at the University of Southern California as an assistant professor in 2013 and was promoted to associate professor in 2019. In 2014, he spent a summer as a visiting professor at Weta Digital working on facial tracking and hair digitization technologies for the visual effects of Furious 7 and . In 2015, he founded Pinscreen, Inc., an Artificial Intelligence startup that specializes on the creation of photorealistic virtual avatars using advanced machine learning algorithms.[10] In 2016, he was appointed director of the Vision and Graphics Lab at the USC Institute for Creative Technologies and joined the University of California, Berkeley in 2020 as a Distinguished Fellow. In 2022, Li was appointed associate professor of computer vision at the Mohamed Bin Zayed University of Artificial Intelligence in Abu Dhabi to direct a new AI center for Metaverse research.[11]
He has worked on dynamic geometry processing and data-driven techniques for making 3D human digitization and facial animation. During his PhD, Li co-created a real-time and markerless system for performance-driven facial animation based on depth sensors which won the best paper award at the ACM SIGGRAPH / Eurographics Symposium on Computer Animation in 2009.[12] The team later commercialized a variant of this technology as the facial animation software Faceshift[13] (acquired by Apple Inc. in 2015 and incorporated into the iPhone X in 2017[14] [15]). This technique in deformable shape registration is used by the company C-Rad AB and deployed in hospitals for tracking tumors in real-time during radiation therapy. In 2013, he worked on a home scanning system that uses a Kinect to capture people into game characters or realistic miniature versions.[16] This technology was licensed by Artec and released as a free software Shapify.me. In 2014, he was brought on as visiting professor at Weta Digital to build the high-fidelity facial performance capture pipeline for reenacting the deceased actor Paul Walker[17] in the movie Furious 7 (2015).His recent research focuses on combining techniques in Deep Learning and Computer Graphics to facilitate the creation of 3D avatars and to enable true immersive face-to-face communication and telepresence in Virtual Reality.[18] In collaboration with Oculus / Facebook, in 2015 he helped developed a facial performance sensing head-mounted display,[19] which allows users to transfer their facial expressions onto their digital avatars while being immersed in a virtual environment. In the same year, he founded the company Pinscreen, Inc.[20] in Los Angeles, which introduced a technology that can generate realistic 3D avatars of a person including the hair from a single photograph.[21] They also work on deep neural networks that can infer photorealistic faces[22] and expressions,[23] which has been showcased at the Annual Meeting of the New Champions 2019 of the World Economic Forum in Dalian.
Due to the ease of generating and manipulating digital faces, Hao has been raising public awareness about the threat of manipulated videos such as deepfakes.[24] [25] In 2019, Hao and media forensics expert, Hany Farid, from the University of California, Berkeley, released a research paper outlining a new method for spotting deepfakes by analyzing facial expression and movement patterns of a specific person. With the rapid progress in artificial intelligence and computer graphics, Li has predicted that genuine videos and deepfakes will become indistinguishable in as soon as 6 to 12 months, as of September 2019.[26] In January 2020, Li spoke at the World Economic Forum Annual Meeting 2020 in Davos about deepfakes[27] and how they could pose a danger to society. Li and his team at Pinscreen, Inc. also demonstrated a real-time deepfake technology[28] at the annual meeting, where the faces of celebrities are superimposed onto the participants' face.
In 2020, Li and his team developed a volumetric human teleportation system which can digitize an entire human body in 3D from a single webcam and stream the content in real-time. The technology uses 3D deep learning to infer a complete textured model of a person using a single view. The team presented the work at ECCV 2020 and demonstrated the system live at the ACM SIGGRAPH's Real-Time Live! show, where they won the "Best in Show" award.[29] [30]
For his work on visual effects, Hao has been credited in several motion pictures, including Blade Runner 2049 (2017), Valerian and the City of a Thousand Planets (2017), Furious 7 (2015), (2014), and Noah (2014). He also appeared as himself in various documentaries on artificial intelligence and deepfakes, including Buzzfeed's Follow This in 2018, CBC's The Fifth Estate in 2018, and iHuman[34] in 2019. In 2022, Hao and his company, Pinscreen, were featured in an episode of the documentary series, Amazon re:MARS Luminaries.[35]