DeepScale explained

DeepScale, Inc.
Fate:Acquired by Tesla, Inc.
Location:Mountain View, California, U.S
Key People:Forrest N. Iandola (CEO)

DeepScale, Inc. was an American technology company headquartered in Mountain View, California, that developed perceptual system technologies for automated vehicles. On October 1, 2019, the company was acquired by Tesla, Inc.[1]

History

DeepScale was co-founded in 2015 by Forrest Iandola and Kurt Keutzer.[2] [3] In 2018, DeepScale raised in Series A funding.[4] In 2018, the firm announced strategic partnerships with automotive suppliers including Visteon and Hella Aglaia Mobile Vision GmbH.[5] [6] On October 1, 2019, the firm was purchased by Tesla, which works on autonomous vehicle technology.[1]

Technology

Prior to the founding of DeepScale, Forrest Iandola and Kurt Keutzer worked together at University of California, Berkeley, on making deep neural networks (DNNs) more efficient.[7] [8] In 2016, shortly after the founding of DeepScale, Iandola, Keutzer, and their collaborators released SqueezeNet, which is a small and energy-efficient DNN for computer vision.[9] [10] [11] By developing smaller DNNs, the firm has been able to run deep learning on scaled-down processing hardware such as smartphones and automotive-grade chips.[12] [13] In 2018, the firm said that its engineering team had moved beyond SqueezeNet and that it had developed even faster and more accurate DNNs for use in commercial products.[14]

Neural architecture search

In recent years, neural architecture search (NAS) has begun to outperform humans at designing DNNs that produce high-accuracy results while running fast.[15] In 2019, DeepScale published a paper called SqueezeNAS, which used supernetwork-based NAS to design a family of fast and accurate DNNs for semantic segmentation of images.[16] The paper claimed that the SqueezeNAS neural networks outperform the speed-accuracy tradeoff curve of Google's MobileNetV3 family of neural network models.[17] While Google used thousands of GPU-days to search for the design of MobileNetV3, DeepScale used just tens of GPU-days to automatically design the DNNs presented in the SqueezeNAS paper.[18]

Product

The firm develops perceptual system software which uses deep neural networks to enable cars to interpret their environment. The software is designed for integration into an open platform, where a wide range of sensors and processors can be used. The software is able to run on a variety of processors, ranging from NVIDIA GPUs to smaller ARM-based processing chips that are designed specifically for the automotive market.

In January 2019, the firm launched an automotive perception software product called "Carver" that uses deep neural networks to perform object detection, lane identification, and drivable area identification. To accomplish this, Carver uses three neural networks which run in parallel. While running in real-time, these three networks perform a total of 0.6 trillion operations per second ("tera-ops/sec").[19] As a point of reference, each of the two redundant chips on the Tesla Full Self-Driving computer system board can perform 36 tera-ops/sec.[20] So 0.6 tera-ops/sec is only 2% of the capacity of each Tesla chip.

Acquisition by Tesla

On October 1, 2019, CNBC reported that Tesla had purchased DeepScale.[1] Fortune stated that "it's apparent that DeepScale's technology will be integrated into Tesla's Autopilot, the self-driving technology the company is currently working on." Further, CNET reported that "DeepScale's approach to autonomy fits the bigger picture that [Tesla CEO Elon] Musk has promoted for a few years now. Rather than relying on LiDAR, Musk has consistently believed cameras, radar and ultrasonic sensors will make up a robust system without other hardware."[21]

References

  1. Web site: Tesla is buying computer vision start-up DeepScale in a quest to create truly driverless cars. Kolodny. Lora. 2019-10-01. CNBC. en. 2019-10-02.
  2. Web site: SqueezeBERT promises faster mobile NLP while maintaining BERT levels of accuracy . 2020-06-23 . Johnson . Khari . VentureBeat.
  3. Web site: Are We Short of Deep Learning Experts? . 2018-04-03 . EE Times.
  4. News: Term Sheet. Marinova. Polina. 2018-04-04. Fortune. 2018-05-22.
  5. News: Visteon Works with DNN Vanguard DeepScale. Yoshida. Junko. 2018-01-09. EE Times. 2018-04-07.
  6. News: Are We Short of Deep Learning Experts?. Yoshida. Junko. 2018-04-03. EE Times. 2018-04-07.
  7. Web site: Faculty Webpage. Keutzer. Kurt. UC Berkeley. 2018-05-22.
  8. Web site: Students. Keutzer. Kurt. UC Berkeley. 2018-05-22.
  9. News: DeepScale on Robo-Car: Fuse Raw Data. Yoshida. Junko. 2017-09-21. EE Times. 2018-05-22.
  10. 1602.07360. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size. Iandola. Forrest N. Han. Song. Moskewicz. Matthew W. Ashraf. Khalid. Dally. William J. Keutzer. Kurt. cs.CV. 2016.
  11. Web site: Tesla Beefs Up Autonomy Effort With DeepScale Acqui-Hire. Niedermeyer. Edward. 2019-10-01. The Drive. live. https://web.archive.org/web/20191002171313/https://www.thedrive.com/tech/30122/tesla-beefs-up-autonomy-effort-with-deepscale-acqui-hire . 2019-10-02 . 2019-11-10.
  12. News: Steve Cohen Buys The Dip In Self-Driving Cars. Shazar. Jon. 2018-04-05. Dealbreaker. 2018-05-22.
  13. News: Why Tesla Quietly Acquired DeepScale, a Machine Learning Startup That's 'Squeezing' A.I.. Reisinger. Don. 2019-10-02. Fortune. 2019-11-25.
  14. Web site: How to become a Full-Stack Deep Learning Engineer (time: 51:30). Silicon Valley Deep Learning Group. 2018-05-22.
  15. Zoph. Barret. Vasudevan. Vijay. Shlens. Jonathon. Le. Quoc V.. 2017-07-21. Learning Transferable Architectures for Scalable Image Recognition. 1707.07012. cs.CV.
  16. 1908.01748. Shaw. Albert. SqueezeNAS: Fast neural architecture search for faster semantic segmentation. Hunter. Daniel. Iandola. Forrest. Sidhu. Sammy. cs.CV. 2019.
  17. 2019-05-06. Searching for MobileNetV3. 1905.02244. cs.CV. Howard. Andrew. Sandler. Mark. Chu. Grace. Chen. Liang-Chieh. Chen. Bo. Tan. Mingxing. Wang. Weijun. Zhu. Yukun. Pang. Ruoming. Vasudevan. Vijay. Le. Quoc V.. Adam. Hartwig.
  18. News: Does Your AI Chip Have Its Own DNN?. Yoshida. Junko. 2019-08-25. EE Times. 2019-09-26.
  19. Web site: DeepScale Announces Carver21: Modular Deep Learning Perception Software for Driver-Assistance. Landen. Ben. 2019-01-25. DeepScale Blog. 2019-02-04.
  20. Web site: Hollister. Sean. 2019-04-22. Tesla's new self-driving chip is here, and this is your best look yet. 2020-08-24. The Verge. en.
  21. Web site: Tesla reportedly buys machine-learning startup DeepScale for self-driving car tech. Szymkowski. Sean. 2019-10-02. CNET. live. https://web.archive.org/web/20191010054339/https://www.cnet.com/roadshow/news/tesla-deepscale-autonomous-self-driving-tech/ . 2019-10-10 . 2019-11-10.