| Faceware Technologies | |
| Former Name: | Image Metrics |
| Industry: | Entertainment, software development |
| Founded: | 2012 |
| Products: | Facial Animation and Motion Capture (MoCap) Technology |
Faceware Technologies is a facial animation and motion capture development company in America. The company was established under Image Metrics and became its own company at the beginning of 2012.
Faceware produces software used to capture an actor's performance and transfer it onto an animated character, as well as the hardware needed to capture the performances. The software line includes Faceware Analyzer, Faceware Retargeter, and Faceware Live.
Faceware software is used by film studios and video game developers including Rockstar Games, Bungie, Cloud Imperium Games, and 2K in games such as Grand Theft Auto V, Destiny, Star Citizen, and .[1] [2]
Through its application in the video game industry, Faceware won the Develop Award while it was still part of Image Metrics for Technical Innovation in 2008.[3] It won the Develop Award again for Creative Contribution: Visuals in 2014.[4] Faceware received Best of Show recognition at the Game Developers Conference 2011 in San Francisco[5] as well as Computer Graphics World's Silver Edge Award at SIGGRAPH 2014[6] and 2016.[7] Faceware won the XDS Gary Award in 2016 for its contributions to the Faceware-EA presentation at the 2016 XDS Summit.
Image Metrics, founded in 2000, is a provider of facial animation and motion capture technology within the video game and entertainment industries.[8] [9] In 2008, Image Metrics offered a beta version of its facial animation technology to visual effects and film studios. The technology captured an actor's performance on video, analyzed it, and mapped it onto a CG model.[8] [10] The release of the beta allowed studios to incorporate facial animation technology into internal pipelines rather than going to the Image Metrics studio as they had in the past.[10] [11] The first studio to beta test Image Metric's software in 2009 was the visual effects studio Double Negative out of London.[11]
In 2010, Image Metrics launched the facial animation technology platform Faceware. Faceware focused on increasing creative control, efficiency and production speed for animators. The software could be integrated into any pipeline or used with any game engine. Image Metrics provided training to learn the Faceware platform. The first studio to sign on as a Faceware customer was Bungie, which incorporated the software into its in-house production.[12] Image Metrics acquired FacePro in 2010, a company that provided automated lip synchronization which could be altered for accurate results, and Image Metrics integrated the acquired technology into its facial animation software.[13] [14] Also in 2010, Image Metrics bought Character-FX, a character animation company.[15] [16] [17] [18] Character-FX produced tools for use in Autodesk’s Maya and 3DS Max which aid in the creation of character facial rigs using an automated weighting transfer system that rapidly shifts facial features on a character to create lifelike movement.[19] [15] [18]
Image Metrics raised $8 million in funding and went public through a reverse merger in 2010 with International Cellular Industries. Image Metrics became wholly owned by International Cellular industries, which changed its name and took on facial animation technology as its sole line of business.[20] [21] Faceware 3.0 was announced in March 2011. The upgrade included auto-pose, a shared pose database, and curve refinement.[22] Image Metrics led a workshop and presentation about Faceware 3.0 at the CTN Animation Expo 2011 titled "Faceware: Creating an Immersive Experience through Facial Animation."[23] Faceware's technology was displayed at Edinburgh Interactive in August 2011 to show its ability to add player facial animation from a webcam or Kinect sensor into a game in real-time.[24] [25]
Image Metrics sold the Faceware software to its spinoff company, Faceware Technologies, in January 2012.[9] [19] Following the spinoff, Faceware Technologies focused on producing and distributing its technology to professional animators.[9] The technology was tested through Universities, including the University of Portsmouth.[26]
Faceware launched its 3D facial animation tools, software packages Faceware Analyzer, and Faceware Retargeter with the Head-Mounted Camera System (HMCS). Analyzer tracks and processes live footage of an actor and Retargeter transfers that movement onto the face of a computer-generated character. The Head-Mounted Camera System is not required to use the software. Six actors can be captured simultaneously.[27]
Faceware Live was shown for the first time at SIGGRAPH 2013.[28] It was created to enable the real-time capture and retargeting of facial movements. The live capture of facial performance can use any video source to track and translate facial expressions into a set of animation values and transfer the captured data onto a 3D animated character in real time.[29] In 2014, Faceware released Faceware Live 2.0. The update included the option to stream multiple characters simultaneously, instant calibration, improved facial tracking, consistent calibration, and support for high-frame-rate cameras.[30]
In 2015, Faceware launched a plugin for Unreal Engine 4 called Faceware Live. The company co-developed the plugin with Australia-based Opaque Multimedia.[31] It makes motion capture of expressions and other facial movements possible with any video camera through Faceware's markerless 3D facial motion capture software.[32]
In 2016, Faceware announced the launch of Faceware Interactive, which is focused on the development of software and hardware that can be used in the creation of digital characters with whom real people can interact with.[33]
Faceware Technologies partnered with Binari Sonori in 2014 to develop a video-based localization service.[34] [35] Also in 2014, Faceware Technologies entered a global partnership with Vicon, a company focused on motion capture. The partnership would focus on developing new technology to expand into full-body motion capture data. The first step of the integration was to make the Faceware software compatible with Vicon's head rig, Cara, to allow data acquired from Cara to be processed and transferred into Faceware products.[36] [37]
Faceware Technologies has two main aspects of facial animation software.
Faceware Analyzer is a stand-alone single-camera facial tracking software that converts videos of facial motion into files that can be used for Faceware Retargeter. The Lite version of the software can automatically track facial movements which can be applied to 3D models with Faceware Retargeter. The Pro version can perform shot specific custom calibrations, import and export actor data, auto indicate tracking regions, and has server and local licensing options. The data captured by Faceware Analyzer is then processed in Faceware Retargeter.
Faceware Retargeter 4.0 was announced in 2014. Faceware Retargeter uses facial tracking data created in Analyzer to create facial animation in a pose-based workflow. The upgrade has a plug-in for Autodesk animation tools, advanced character expression sets, visual tracking data, shared pose thumbnails, and batch processing. The Lite version of the Retargeter software transfers actor's performances onto animated characters and reduces and smooths key frames. The Pro version includes custom poses, intelligent pose suggestions, shared pose libraries, and the ability to backup and restore jobs.
Faceware Live aims to create natural looking faces and facial expressions in real-time. Any video source can be used with the software's one-button calibration. The captured video is transferred onto a 3D animated character. This process combines image processing and data streaming to translate facial expressions into a set of animation values.[29] [30]
Faceware has hardware options that can be rented or purchased. Available hardware is the entry level GoPro Headcam Kit and the Professional Headcam System. The Indie Facial Mo-cap package includes hardware, a camera and headmount, and the tools to use it.[38]
Faceware's software is used by companies such as Activision-Blizzard, Bethesda, Ubisoft, Electronic Arts, Sony, Cloud Imperium Games, and Microsoft. Rockstar Games used the software in games such as Grand Theft Auto V and Red Dead Redemption and Bungie used Faceware in games including Destiny and . Faceware has also been used in other games like XCOM2, Dying Light: The Following, Hitman, EA Sports UFC 2, Fragments for Microsoft's HoloLens, DOOM, Mirror's Edge Catalyst, Kingsglaive, F1 2016, ReCore,, Mafia III, Call of Duty Infinite Warfare, Killzone:Shadow Fall, NBA 2K10-2K17, Sleeping Dogs, Crysis 2 and 3, Star Citizen, and in movies like The Curious Case of Benjamin Button and Robert Zemeckis's The Walk.[39] [15] [40] [41] [27] [42] [43] [44]