Amazon ElastiCache explained

Amazon ElastiCache
Developer:Amazon.com
Released:.[1]
Language:English
Genre:Cloud Storage

Amazon ElastiCache is a fully managed in-memory data store and cache service by Amazon Web Services (AWS). The service improves the performance of web applications by retrieving information from managed in-memory caches, instead of relying entirely on slower disk-based databases. ElastiCache supports two open-source in-memory caching engines: Memcached and Redis (also called "ElastiCache for Redis").[2]

As a web service running in the computing cloud, Amazon ElastiCache is designed to simplify the setup, operation, and scaling of memcached and Redis deployments. Complex administration processes like patching software, backing up and restoring data sets and dynamically adding or removing capabilities are managed automatically. Scaling ElastiCache resources can be performed by a single API call.[3]

Amazon ElastiCache was first released on August 22, 2011,[4] supporting memcached. This was followed by support for reserved instances on April 5, 2012[5] and Redis on September 4, 2013.[6]

Uses

As a managed database service with multiple supported engines, Amazon ElastiCache has a wide range of uses, including

Performance acceleration

Database limitations are often a bottleneck for application performance. By placing Amazon ElastiCache between an application and its database tier, database operations can be accelerated.[7]

Cost reduction

Using ElastiCache for database performance acceleration can significantly reduce the infrastructure needed to support the database. In many cases, the cost savings outweigh the cache costs. Expedia was able to use ElastiCache to reduce provisioned DynamoDB capacity by 90%, reducing total database cost by 6x.[8] [9]

Processing time series data

Using the Redis engine, ElastiCache can rapidly process time-series data, quickly selecting newest or oldest records or events within range of a point-in-time.[10]

Leaderboards

Leaderboards are an effective way to show a user quickly where they currently stand within a gamified system. For systems with large numbers of gamers, calculating and publishing player ranks can be challenging. Using Amazon ElastiCache with the Redis engine can enable high-speed at scale for leaderboards.[11]

Rate limitation

Some APIs only allow a limited number of requests per time period. Amazon ElastiCache for Redis engine can use incremental counters and other tools to throttle API access to meet restrictions.[12]

Atomic counter

Programs can use incremental counters to limit allowed quantities, such as the maximum number of students enrolled in a course or ensuring a game has at least 2 but not more than 8 players. Using counters can create a race condition where an operation is allowed because a counter was not updated promptly. Using the ElastiCache for Redis atomic counter functions, where a single operation both checks and increments the counter's value, prevents race conditions.[13]

Chat rooms and message boards

ElastiCache for Redis supports publish-subscribe patterns, which enable the creation of chat rooms and message boards where messages are automatically distributed to interested users.[14]

Deployment options

Amazon ElastiCache can use on-demand cache nodes or reserved cache nodes.

On-demand nodes provide cache capacity by the hour, with resources in the AWS cloud assigned when a cache node is provisioned. An on-demand node can be removed from service by its owner at any time. Each month, the owner will be billed for the hours used.[15]

Reserved nodes require a 1-year or 3-year commitment, which dedicates cache resources to the owner. The hourly cost of reserved nodes is significantly lower than the hourly cost of on-demand nodes.[16]

Performance

An efficient cache can significantly increase application's performance and user navigation speed. Amazon CloudWatch exposes ElastiCache performance metrics that can be tracked.[17]

Key performance metrics

Metric collection

Many ElastiCache metrics can be collected from AWS via CloudWatch or directly from the cache engine, whether Redis or Memcached, with a monitoring tool integrating with it:[18]

Using the online management console is the simplest way to monitor ElastiCache with CloudWatch. It allows to set up basic automated alerts and to get a visual picture of recent changes in individual metrics.

Metrics related to ElastiCache can also be retrieved using command lines. It can be used for spot checks and ad hoc investigations.

The third way to collect ElastiCache metrics is via a dedicated monitoring tool integrating with Amazon CloudWatch.

Notable customers

Users of Amazon ElastiCache include Airbnb,[19] Expedia,[20] Zynga,[21] Tinder,[22] FanDuel,[23] and Mapbox[24]

Limitations

As an AWS service, ElastiCache is designed to be accessed exclusively from within AWS, though it is possible to connect the service to applications and databases that are not hosted by AWS.[25]

Alternatives

Other vendors provide cloud data cache services comparable to Amazon ElastiCache, including Azure Cache for Redis, Redis Ltd (company behind open source Redis and Redis Enterprise), Redis To Go, IBM Compose, Oracle Application Container Cloud Service, and Rackspace ObjectRocket.

Notes and References

  1. Web site: Amazon ElastiCache – Distributed In-Memory Caching. 22 August 2011. Amazon Web Services.
  2. Web site: ElastiCache for Redis. Amazon Web Services. 2016-08-29.
  3. Web site: Scaling. AWS ElastiCache Documentation. 2016-07-08.
  4. Web site: Amazon ElastiCache – Distributed In-Memory Caching. amazon.com. 22 August 2011. 2016-07-08.
  5. Web site: Reserved Cache Nodes for Amazon ElastiCache. amazon.com. 5 April 2012. 2016-07-08.
  6. Web site: Amazon ElastiCache – Now With a Dash of Redis. amazon.com. 4 September 2013. 2016-07-08.
  7. Web site: Use Memcached to improve database performance. CloudVPS. 2016-07-08. https://web.archive.org/web/20160713023747/http://www.cloudvps.com/community/knowledge-base/use-memcached-to-improve-database-performance. 2016-07-13. dead.
  8. Web site: Customer Testimonials. amazon.com. 2016-07-08.
  9. Web site: AWS Building Scalable Applications on AWS NoSQL Services. youtube.com. 2016-07-08.
  10. Web site: Using Redis as a Time Series Database: Why and How. InfoQueue. 2016-07-08.
  11. Web site: USING REDIS TO BUILD YOUR GAME LEADERBOARD. Social Point. 2016-07-08. 2018-09-14. https://web.archive.org/web/20180914135719/http://www.socialpoint.es/blog/using-redis-to-build-your-game-leaderboard/. dead.
  12. Web site: DOWN BOY: HOW TO EASILY THROTTLE REQUESTS TO AN API USING REDIS. Collective Idea. 30 November 2012 . 2016-07-08.
  13. Web site: An Atomic Rant. Nate Wigel vs Technology. 18 February 2010. 2016-07-08.
  14. Web site: Create a Simple Chat Room with Redis Pubsub. Program Every Day. 2016-07-08. https://web.archive.org/web/20160721013351/http://programeveryday.com/post/create-a-simple-chat-room-with-redis-pubsub/. 2016-07-21. dead.
  15. Web site: Amazon ElastiCache Pricing. amazon.com. 2016-07-08.
  16. Web site: ElastiCache Reserved Cache Nodes. amazon.com. 2016-07-08.
  17. Web site: Monitoring ElastiCache performance metrics with Redis or Memcached. 10 December 2015. 2016-10-24.
  18. Web site: Collecting ElastiCache metrics + its Redis/Memcached metrics. 10 December 2015. 2016-10-24.
  19. Web site: Airbnb Case Study. amazon.com. 2016-07-08.
  20. Web site: Building Scalable Applications on AWS NoSQL Services. youtube.com. 2016-07-08.
  21. Web site: AWS Case Study: Zynga. amazon.com. 2016-07-08.
  22. Web site: Building resiliency at scale at Tinder with Amazon ElastiCache. amazon.com. 2024-03-28.
  23. Web site: FanDuel Case Study. amazon.com. 2016-07-08.
  24. Web site: Building Scalable Applications on AWS NoSQL Services. youtube.com. 2016-07-08.
  25. Web site: Accessing ElastiCache Resources from Outside AWS. AWS Documentation. 2016-07-08.