Amazon SageMaker explained
Amazon SageMaker is a cloud-based machine-learning platform that allows the creation, training, and deployment by developers of machine-learning (ML) models on the cloud. It can be used to deploy ML models on embedded systems and edge-devices.[1] [2] The platform was launched in November 2017.
Capabilities
SageMaker enables developers to operate at a number of different levels of abstraction when training and deploying machine learning models. At its highest level of abstraction, SageMaker provides pre-trained ML models that can be deployed as-is.[3] In addition, it offers a number of built-in ML algorithms that developers can train on their own data.
The platform also features managed instances of TensorFlow and Apache MXNet, where developers can create their own ML algorithms from scratch. Regardless of which level of abstraction is used, a developer can connect their SageMaker-enabled ML models to other AWS services, such as the Amazon DynamoDB database for structured data storage,[4] AWS Batch for offline batch processing,[5] or Amazon Kinesis for real-time processing.[6]
Development interfaces
A number of interfaces are available for developers to interact with SageMaker. First, there is a web API that remotely controls a SageMaker server instance.[7] While the web API is agnostic to the programming language used by the developer, Amazon provides SageMaker API bindings for a number of languages, including Python, JavaScript, Ruby, Java, and Go.[8] [9] In addition, SageMaker provides managed Jupyter Notebook instances for interactively programming SageMaker and other applications.[10] [11]
History and features
- 2017-11-29: SageMaker is launched at the AWS re:Invent conference.[12] [13] [14]
- 2018-02-27: Managed TensorFlow and MXNet deep neural network training and inference are now supported within SageMaker.[15] [16]
- 2018-02-28: SageMaker automatically scales model inference to multiple server instances.[17] [18]
- 2018-07-13: Support is added for recurrent neural network training, word2vec training, multi-class linear learner training, and distributed deep neural network training in Chainer with Layer-wise Adaptive Rate Scaling (LARS).[19] [20]
- 2018-07-17: AWS Batch Transform enables high-throughput non-real-time machine learning inference in SageMaker.[21] [22]
- 2018-11-08: Support for training and inference of Object2Vec word embeddings.[23] [24]
- 2018-11-27: SageMaker Ground Truth "makes it much easier for developers to label their data using human annotators through Mechanical Turk, third-party vendors, or their own employees."[25]
- 2018-11-28: SageMaker Reinforcement Learning (RL) "enables developers and data scientists to quickly and easily develop reinforcement learning models at scale."[26]
- 2018-11-28: SageMaker Neo enables deep neural network models to be deployed from SageMaker to edge-devices such as smartphones and smart cameras.[27]
- 2018-11-29: The AWS Marketplace for SageMaker is launched. The AWS Marketplace enables 3rd-party developers to buy and sell machine learning models that can be trained and deployed in SageMaker.[28]
- 2019-01-27: SageMaker Neo is released as open-source software.[29]
Notable Customers
- NASCAR is using SageMaker to train deep neural networks on 70 years of video data.[30]
- Carsales.com uses SageMaker to train and deploy machine learning models to analyze and approve automotive classified ad listings.[31]
- Avis Budget Group and Slalom Consulting are using SageMaker to develop "a practical on-site solution that could address the over and under utilization of cars in real-time using an optimization engine built in Amazon SageMaker."[32]
- Volkswagen Group uses SageMaker to develop and deploy machine learning in its manufacturing plants.[33]
- Peak and Footasylum use SageMaker in a recommendation engine for footwear.[34]
Awards
In 2019, CIOL named SageMaker one of the "5 Best Machine Learning Platforms For Developers," alongside IBM Watson, Microsoft Azure Machine Learning, Apache PredictionIO, and AiONE.[35]
See also
References
- News: With These New Additions, AWS SageMaker is Starting to Look More Real for Data Scientists. Rodriguez. Jesus. 2018-11-30. Towards Data Science. 2019-06-09.
- News: How AI is helping Amazon become a trillion-dollar company. Terdiman. Daniel. 2018-10-05. Fast Company. 2019-06-09.
- News: Deploy trained Keras or TensorFlow models using Amazon SageMaker. Ponnapalli. Priya. 2019-01-30. AWS. 2019-06-09.
- News: Evaluate when to use added AWS Step Functions actions. Marquez. Ernesto. TechTarget. 2019-06-09.
- News: AWS Step Functions Adds Eight More Service Integrations. 2018-11-29. AWS. 2019-06-09.
- News: Deploy Amazon SageMaker and a Data Lake on AWS for Predictive Data Science with New Quick Start. 2018-08-15. AWS. 2019-06-09.
- News: Call an Amazon SageMaker model endpoint using Amazon API Gateway and AWS Lambda. Olsen. Rumi. 2018-07-19. AWS. 2019-06-09.
- Web site: Amazon SageMaker developer resources. AWS. 2019-06-09.
- News: Amazon updates SageMaker with new built-in algorithms and Git integration. Wiggers. Kyle. 2018-11-21. 2019-06-09.
- Web site: Use Notebook Instances. AWS. 2019-06-09.
- News: Here Come The Notebooks. Gift. Noah. 2018-08-17. Forbes. 2019-06-09.
- News: AWS releases SageMaker to make it easier to build and deploy machine learning models. Miller. Ron. 2017-11-29. TechCrunch. 2019-06-09.
- News: Introducing Amazon SageMaker. 2017-11-29. AWS. 2019-06-09.
- News: AWS Takes the 'Muck' Out of ML with SageMaker. Woodie. Alex. 2017-11-29. datanami. 2019-06-09.
- News: Amazon SageMaker now supports TensorFlow 1.5, Apache MXNet 1.0, and CUDA 9 for P3 Instance Optimization. 2018-02-27. AWS. 2019-06-09.
- News: How to jump start your deep learning skills using Apache MXNet. Roumeliotis. Rachel. 2018-03-07. O'Reilly. 2019-06-09.
- News: Auto Scaling in Amazon SageMaker is now Available. 2018-02-28. AWS. 2019-06-09.
- News: Amazon Sagemaker Now Uses Auto-scaling. 2018-03-24. Polar Seven. 2019-06-09.
- News: Amazon SageMaker Announces Several Enhancements to Built-in Algorithms and Frameworks. 2018-07-13. AWS. 2019-06-09.
- News: Amazon Updates SageMaker ML Platform Algorithms, Frameworks. Nagel. Becky. 2018-07-16. Pure AI. 2019-06-09.
- News: Amazon SageMaker Now Supports High Throughput Batch Transform Jobs for Non-Real Time Inferencing. 2018-07-17. AWS. 2019-06-09.
- News: Making the most of your Machine Learning budget on Amazon SageMaker. Simon. Julien. 2019-01-24. Medium. 2019-06-09.
- News: Introduction to Amazon SageMaker Object2Vec. 2018-11-08. AWS. 2019-06-09.
- News: Amazon SageMaker Now Supports Object2Vec and IP Insights Built-in Algorithms. 2018-11-19. AWS. 2019-06-09.
- News: Introducing Amazon SageMaker Ground Truth - Build Highly Accurate Training Datasets Using Machine Learning. 2018-11-28. AWS. 2019-06-09.
- News: Introducing Reinforcement Learning Support with Amazon SageMaker RL. 2018-11-28. AWS. 2019-06-09.
- News: Introducing Amazon SageMaker Neo - Train Once, Run Anywhere with up to 2x in Performance Improvement. 2018-11-28. AWS. 2019-06-09.
- News: AWS goes deep and wide with machine learning services and capabilities. Robuck. Mike. 2018-11-29. FierceTelecom. 2019-06-09.
- News: Amazon Open Sources SageMaker Neo To Run Machine Learning Models At The Edge. Janakiram. MSV. 2019-01-27. Forbes. 2019-06-09.
- News: NASCAR to migrate 18 petabytes of video archives to AWS. Digman. Larry. 2019-06-04. ZDNet. 2019-06-09.
- News: Carsales builds Tessa AI to check vehicle ads. Crozier. Ry. 2019-05-02. IT News. 2019-06-09.
- News: Avis Budget Group and Slalom Further Digitize the Car Rental Process with Machine Learning on AWS. 2019-05-31. AWS. 2019-06-09.
- News: Volkswagen and AWS Join Forces to Transform Automotive Manufacturing. 2019-05-24. Metrology News. 2019-06-09. 2020-10-28. https://web.archive.org/web/20201028173020/https://metrology.news/volkswagen-and-aws-join-forces-to-transform-automotive-manufacturing/. dead.
- News: Footasylum steps up artificial intelligence to drive customer centricity. Mari. Angelica. 2019-05-14. Computer Weekly. 2019-06-09.
- News: 5 Best Machine Learning Platforms For Developers. Pandey. Ashok. 2019-02-21. CIOL. 2019-06-09.