Companies using AWS cloud.
1.NETFLIX
Netflix is the world’s leading internet television network, with more than 100 million members worldwide enjoying 125 million hours of TV shows and movies each day, including original series, documentaries, and feature films. Members can watch as much as they want, anytime, anywhere, on nearly any Internet-connected screen.
Amazon Kinesis Data Streams processes multiple terabytes of log data each day, yet events show up in our analytics in seconds. We can discover and respond to issues in real time, ensuring high availability and a great customer experience.” …………………John Bennett
Senior Software Engineer, Netflix
Application Monitoring on a Massive Scale
Netflix uses Amazon Web Services (AWS) for nearly all its computing and storage needs, including databases, analytics, recommendation engines, video transcoding, and more — hundreds of functions that in total use more than 100,000 server instances on AWS.
This results in an extremely complex and dynamic networking environment where applications are constantly communicating inside AWS and across the Internet. Monitoring and optimizing its network is critical for Netflix to continue improving customer experience, increasing efficiency, and reducing costs. In particular, Netflix needed a solution for ingesting, augmenting, and analyzing the multiple terabytes of data its network generates daily in the form of virtual private cloud (VPC) flow logs. This would enable Netflix to identify performance-improvement opportunities, such as identifying apps that are communicating across regions and collocating them. The company would also be able to increase uptime by quickly detecting and mitigating application downtime.
Each log record carries information about the communications between two IP addresses. However, in a dynamic environment like the one at Netflix, where an IP address can float between applications from day to day or even minute to minute, IP addresses alone don’t have much meaning. “The data sources we had before we took on this initiative were one sided,” says John Bennett, senior software engineer at Netflix. “We’d know an application was connecting to others, but we didn’t know both sides of the conversation and how to optimize those communications or the placement of the applications on the network.”
Netflix set out to establish a new data source that could give it more insight into communication among applications and regions by combining VPC flow logs with application metadata.
Centralizing Flow Logs Using Amazon Kinesis Data Streams
From the outset, AWS enabled Netflix to experiment with different approaches to analyzing its network data. “Early in the design process, the flexibility to try different ways of processing the data was important,” says Bennett. “We experimented with multiple designs and used many AWS products to get here.”
The solution Netflix ultimately deployed — known internally as Dredge — centralizes flow logs using Amazon Kinesis Data Streams. The application reads the data from Amazon Kinesis Data Streams in real time and enriches IP addresses with application metadata to provide a full picture of the networking environment. “Usually, we would put the data into a database, which would build an index to enable faster querying,” says Bennett. “Dredge joins the flow logs with application metadata as it streams and indexes it without using a database, which eliminates a lot of the complexity.”
The enriched data lands in an open-source analytics application called Druid. Netflix uses the OLAP querying functionality of Druid to quickly slice data into regions, availability zones, and time windows to visualize it and gain insight into how the network is behaving and performing.
AWS was the logical choice for Dredge in part because the data was already resident in the AWS Cloud. “It would have been daunting to publish, stream, and consume that much information from an external system such as Kafka,” says Bennett. “It took just a few API calls to centralize multiple terabytes of flow logs into Amazon Kinesis Data Streams. Now we can focus on getting insights from the data rather than simply getting access to it.”
The scalability of Amazon Kinesis Data Streams was a good fit for the Dredge application because of the cyclical and elastic nature of network usage at Netflix. “When it comes to our networking data, it’s more cost efficient to be able to scale up and down, which is not as easy to do with alternatives to Amazon Kinesis Data Streams,” says Bennett.
Architecture Diagram
Improving Customer Experience with Real-Time Network Monitoring
Netflix’s Amazon Kinesis Data Streams-based solution has proven to be highly scalable, each day processing billions of traffic flows. Typically, about 1,000 Amazon Kinesis shards work in parallel to process the data stream. “Amazon Kinesis Data Streams processes multiple terabytes of log data each day, yet events show up in our analytics in seconds,” says Bennett. “We can discover and respond to issues in real time, ensuring high availability and a great customer experience.”
Netflix is now able to identify new ways to optimize its applications, whether that means moving an application from one region to another or changing to a more appropriate network protocol for a specific type of traffic. “Our solution built on Amazon Kinesis enables us to identify ways to increase efficiency, reduce costs, and improve resiliency for the best customer experience,” says Bennett.
Although a streaming data solution is not new to the IT industry, it is an innovation in the networking space. “Netflix is heavily invested in AWS in part because it abstracts the underlying network, so we don’t have to deal with switches and routers,” says Bennett. “We’re monitoring, analyzing, and optimizing at a higher level of the stack — in ways we would never even consider if we were running our own data centers.”
About Company Name
Netflix is the world’s leading internet television network, with more than 100 million members in more than 190 countries enjoying 125 million hours of TV shows and movies each day.
Benefits of AWS
- Processes and enriches multiple terabytes each day, representing billions of events, with sub-second response times for analytics queries
- Highly cost efficient compared to competing solutions
- Freedom to experiment with system architecture to arrive at the most effective solution
- Data ingestion initiated with just a few simple API calls
- Highly elastic solution with close to 1,000 Amazon Kinesis shards working in parallel
AWS Services Used By Netflix
Amazon Kinesis Data Streams
Amazon Kinesis Data Streams (KDS) is a massively scalable and durable real-time data streaming service.
2. Coca-Cola
Coca-Cola Migrates to AWS to Achieve 40% Operational Savings
The Coca-Cola Company — with more than 500 brands sold in over 207 countries — runs hundreds of marketing promotions every year. During Super Bowl XLVII, The Coca-Cola Company ran an ad that encouraged audience members to vote online for their favorite commercial ending. At the time, the company’s environment was on premises, and the massive spike of traffic to the site caused delays and a poor user experience. According to Michael Connor, digital marketing platform architect at Coca-Cola North America, this event triggered an internal push to move to the public cloud with Amazon Web Services (AWS).
In this replay from re:Invent 2014, Connor walks through how The Coca-Cola Company migrated to AWS to reduce costs and increase operational efficiencies. Moving to a DevOps model, The Coca-Cola Company leveraged AWS Elastic Beanstalk to enable its creative agencies to more efficiently deploy applications. The company also used AWS Auto Scaling to optimize performance and costs with its applications, allowing them responding better to sudden influxes of site traffic. By migrating to AWS, The Coca-Cola Company achieved 40 percent operational savings, coupled with an 80 percent reduction in IT help desk tickets due to added automation.
Watch the video below and learn more at AWS for Consumer Packaged Goods. click here
3.AirBnb
Online travel marketplace Airbnb supports hundreds of critical services on its platform, making it essential to maintain a reliable source control infrastructure. The company uses GitHub Enterprise for both source control and management of its continuous integration/continuous delivery (CI/CD) processes. Airbnb has more than 1,000 engineers, who execute more than 100,000 continuous integration jobs on an average working day. GitHub Enterprise provides the engineers with a single source of truth for all code repositories.
However, source control infrastructure had become an operational headache due to the system’s scaling issues. In the previous system, each mirror instance pulled changes from GitHub Enterprise. This became challenging to maintain because the mirrors could get out of sync with each other. The system did not scale with Airbnb’s increasing Git traffic and hindered the team from focusing on higher-level problem solving and implementing new features.
Airbnb sought a solution it could use to re-architect the source code infrastructure with a simpler storage layer. The system needed to update in seconds and read traffic needed to scale.
Benefits:
- Uses single file system to sync GitHub repositories
- Keeps Git mirrors in sync by using a shared file system that allows scaling of CI/CD processes
- Ensures no repository changes are lost during syncing using event-driven queuing approach
- Allows engineers to focus on building system features instead of worrying about scaling
AWS service used:
3.SAMSUNG:
Samsung Electronic Printing is a division of the Seoul-based conglomerate. The division decided to deploy its new Samsung Printing Apps Center app store on AWS instead of using a traditional IT environment, enabling mobile users anywhere to download apps that help them print remotely from their devices. By using AWS, the division was able to deploy its Printing Apps Center on time and has the scalability to handle periods when downloads cause traffic spikes. vedio link click here
4. OLX
OLX Autos Delivers a Seamless Online Marketplace by Running Containers on AWS
2020
Empowering People with Innovative Services
OLX Autos has a mission to empower people to upgrade their lives through its online marketplace of services and used products that deliver superior customer value. As part of the OLX Group, which operates more than 20 brands across 30 countries, OLX Autos combines the agility of a startup with the maturity of a global entity. With a mission to shape the future of trade, OLX Autos is passionate about the use of cutting-edge technology to enhance the customer experience.
India is among the top growth markets for OLX Autos globally. The company has a highly innovative technology team running its Panamera classifieds marketplace, which is active in 12 countries, on the Amazon Web Services (AWS) Cloud. To unlock maximum value for its users, OLX Autos is committed to investing in its people and the latest technology.
“Using AWS has kept our environment running in a stable manner in the most cost-optimized way.”
Abhishek Tomar
Infrastructure Head, OLX Autos
Modernizing Complex Architecture
In 2018, OLX Autos experienced an outage on its site when its internal certificates for OpenShift containerization software expired. The business was using OpenShift version 3.5 to manage its infrastructure and to deploy applications on its site running in Docker containers. As part of the company’s commitment to support customers with a smooth experience, engineers quickly identified the issue and rolled out new certificates immediately. However, they had to invest a significant amount of time to restore the website. The team concluded that their staging environment was unstable due to issues with the control panel on OpenShift and began seeking ways to modernize their technology stack.
Abhishek Tomar, infrastructure head at OLX Autos, says, “Buyers and sellers could not search, see new ads, or create new listings during the outage. We realized that even if we experienced just one crash a year, it would still be better to offload the control and management plane to AWS. Our customers were not able to access our marketplace in the several hours that were spent resolving the issue, resulting in customer dissatisfaction.”
OLX Autos engineers needed to rapidly upgrade the site’s architecture and decided to perform a proof of concept for hosting a self-managed Kubernetes cluster versus using Amazon Elastic Kubernetes Service (Amazon EKS). “We decided on Amazon EKS because it was more flexible than the OpenShift cluster,” says Nikhil Sharma, the chapter lead site reliability engineer (SRE) at OLX Autos who led the migration.
Seamlessly Migrating 124 Microservices
OLX Autos initiated a discussion with the AWS team a year before beginning the migration. “First, we reached out to AWS Enterprise Support for advice on the best migration strategy,” says Sharma. OLX Autos was simultaneously upgrading its operating system, Kubernetes, and Docker versions, and the complexity of its OpenShift architecture in addition to the software version limitations made the migration particularly challenging. The OLX Autos SRE team planned the migration strategy and started moving their staging environment to AWS in January 2020. “We got immediate support from AWS to resolve any issues in the staging environment, which helped us migrate smoothly to a production environment,” Sharma says.
The AWS team presented a roadmap for potential new Panamera features using Amazon EKS in addition to other AWS services. OLX Autos then started building an Amazon EKS cluster and migrating selected workloads from OpenShift, with the rollout completed in just a few weeks. OLX Autos has now migrated all 124 of its microservices to Amazon EKS, which has improved efficiency and scalability while unlocking cost savings.
Gaining Productivity
Since the migration, OLX Autos infrastructure teams are now better placed to meet key internal product development deadlines. The business was initially using the Puppet configuration tool to manage its OpenShift software. Engineers needed to rely on their Puppet skill sets and spent three to four days a month rolling out and monitoring important updates to the OLX Autos infrastructure.
With the AWS migration, the company has removed Puppet from its architecture and offloaded container management to AWS. By running on Amazon EKS, the OLX Autos website benefits from improved performance and scalability, and engineers can reallocate their time to higher value-added tasks.
Scaling in Minutes and Improving Uptime
When OLX Autos was running an old version of OpenShift, the company experienced issues with autoscaling, which caused interruptions to its applications. “Now with Amazon EKS, our Amazon Elastic Compute Cloud (Amazon EC2) Fleet gets autoscaled in a couple of minutes whenever any marketing campaigns cause a surge or a sudden spike in traffic. If online traffic drops, the fleet gets scaled down — something we were not able to do smoothly before with OpenShift,” says Tomar.
OLX Autos has also offloaded the critical task of administering Secure Sockets Layer (SSL)/Transport Layer Security (TLS) certificates to AWS Certificate Manager. Previously, teams had to manually procure and deploy new certificates each year, but with AWS, new certificates are deployed with a few simple API calls. “It’s a relief that AWS will now be taking care of that,” says Tomar. “We don’t have to invest a single minute in checking and updating certificates, which could impact key timelines for our business.”
Unlocking Savings with Reserved Instances
OLX Autos had booked a number of Amazon EC2 Reserved Instances for type C5 instances but was unable to use them with the older version of OpenShift. “Because of this migration and the version upgrade, we migrated all our C4 instances to C5 and could leverage Reserved Instances pricing. That has ultimately saved us 33 percent of compute costs,” says Tomar.
OLX Autos has also benefited from the AWS container network interface (CNI) plug-in, which was blocked with its previous OpenShift configuration. The CNI plug-in has not only improved application latency, but OLX Autos also expects to save at least 10 percent on its overall monthly AWS bill with more efficient applications. Tomar says, “Using AWS has kept our environment running in a stable manner in the most cost-optimized way.”
About OLX Autos
OLX Autos runs India’s leading consumer-to-consumer marketplace, Panamera, for pre-owned cars and motorbikes, mobile phones, household items, jobs, and real estate. Part of the OLX Group, the Panamera online trading marketplace is active in 12 countries.
Benefits of AWS
- Autoscales architecture during surges in visitor traffic
- Saves 33% on compute costs
- Improves application latency
- Facilitates smooth migration of 124 microservices into production
- Gains 3–4 days a month by eliminating software monitoring and maintenance
- Reallocates IT team to value-added innovation tasks
AWS Services Used
Amazon Elastic Kubernetes Service
Amazon Elastic Kubernetes Service (Amazon EKS) is a fully managed Kubernetes service. Customers such as Intel, Snap, Intuit, GoDaddy, and Autodesk trust EKS to run their most sensitive and mission critical applications because of its security, reliability, and scalability.
Amazon EC2 Reserved Instances
Amazon EC2 Reserved Instances (RI) provide a significant discount (up to 72%) compared to On-Demand pricing and provide a capacity reservation when used in a specific Availability Zone.
AWS Certificate Manager
AWS Certificate Manager is a service that lets you easily provision, manage, and deploy public and private Secure Sockets Layer/Transport Layer Security (SSL/TLS) certificates for use with AWS services and your internal connected resources.
AWS Enterprise Support
AWS Enterprise Support provides you with concierge-like service where the main focus is helping you achieve your outcomes and find success in the cloud.
5.MPL
“AWS has been by our side throughout our entire growth journey, from debugging to stabilizing and optimizing to now expanding our product.”
Mukta Aphale
Vice President, Reliability and Engineering, MPL
A Fast-Growing Mobile Gaming Market
With the proliferation of smartphones and affordable mobile data plans in India, mobile gaming is quickly becoming a common pastime. According to Kantar IMRB, India currently ranks fifth among the world’s top mobile gaming markets. Bangalore-based Mobile Premier League (MPL) is one of the biggest and fastest-growing players, offering more than 40 games via its eSports platform. All games, including fantasy sports or the country’s favorite, Rummy, can be played for cash prizes. The MPL mobile app launched in September 2018 and acquired 10 million users within three months, which met the company’s one-year subscriber goal.
Today, MPL has more than 40 million subscribers, making up 14 percent of the total mobile gaming market in India, according to the 2019 report “The Power of Mobile Gaming in India.”
Small Team for Big Jobs
The startup launched on the Amazon Web Services (AWS) Cloud because many of its DevOps engineers had experience on the platform, which accelerated time-to-market. Scalability and automation were also a priority for MPL’s AWS Cloud infrastructure. The startup began with Amazon Aurora as its primary database, using Amazon Relational Database Service (Amazon RDS) to automate administrative tasks such as provisioning and backups. However, as its dataset grew — particularly its volume of unstructured data — MPL found that Amazon DynamoDB NoSQL database service worked better for gaming use cases because it offered low-latency data access and easy horizontal scaling.
Amazon DynamoDB can efficiently handle volume, velocity, and veracity for the data-heavy workloads typical of gaming companies. Additionally, the database automatically scales capacity to maintain performance during peak periods such as nationwide sporting events, when online traffic for MPL’s fantasy games can spike to 2.5 million hits per minute. Such automation is key in MPL’s architecture and resource planning.
Despite being a year and a half into operations, MPL’s DevOps engineering team have never had to expand since launch. “Our team of 12 engineers manages DevOps, reliability engineering, and 24/7 monitoring,” says Mukta Aphale, vice president of Reliability Engineering at MPL. “We don’t need a big team to run all our applications on AWS.” Its DevOps engineers currently use a microservices architecture for development, automating the deployment of more than 50 separate microservices using AWS CodeDeploy and AWS Lambda.
Dedicated Support
With such rapid growth, MPL has relied on support from AWS for debugging and periodic re-architecting to scale. “Nailing down the problem is often the toughest part of debugging, and AWS was always there to help us,” Aphale says. The startup recently subscribed to AWS Enterprise Support to prepare for the launch of a big campaign. Teams appreciate having an AWS technical account manager (TAM) and AWS Infrastructure Event Management (IEM) as part of the support package, with focused planning and ready assistance leading up to and during the launch.
“Having a dedicated TAM and IEM has led to a more detailed review of our architecture and guidance on how to optimize both the user experience and operating costs,” Aphale says. Early on, AWS hosted an AWS Dev Day event, where MPL teams used Amazon Inspector to uncover potential security vulnerabilities in their infrastructure. These vulnerabilities have since been resolved, and MPL has implemented Amazon GuardDuty for ongoing security monitoring.
Performance at Scale
AWS solutions architects held several discussions with MPL and shared the benefits of containerization. Following that, MPL conducted its own evaluation and moved ahead with containerizing its microservices using Kubernetes. The aim of this is twofold: to stabilize application performance at scale and improve operational efficiency. Its engineers use Amazon Elastic Kubernetes Service (Amazon EKS) to run the containers with high availability. “We appreciate being able to control our architecture and decide where and how to automate things. Amazon EKS is much more robust than open source Kubernetes,” Aphale explains.
Implementation of containers is just the first step in MPL’s cost optimization journey. During its first year of operations, the company was focused on scaling and right-sizing its architecture. Now, teams are working on optimizing infrastructure costs and looking to innovate further. Aphale says, “We’re pleasantly surprised with the proactive help from AWS to improve our architecture and save costs.”
Working with their assigned TAM on finding the right instance types for production versus non-production workloads has gone a long way toward reducing costs. In addition, MPL signed up for the AWS Enterprise Discount Program. Since beginning cost optimization exercises, MPL has cut infrastructure costs by 40 percent. “These savings have allowed us to scale our AWS infrastructure to roll out a lot more features and games, which creates a more interesting user experience with features such as audio chat,” Aphale says.
Keeping Customers Happy
A large portion of MPL’s new customer base comes from referrals, so the business focuses heavily on customer satisfaction. For instance, because sub-millisecond latency is critical in gaming to ensure players don’t experience a lag between moves, MPL has been able to maintain an API response time of 30 milliseconds or less since its launch.
In working with AWS to fine-tune its architecture, engineers have also improved the app’s service availability. “Our app uptime has increased significantly to 99.9 percent,” Aphale says. Due to MPL’s confidence in the underlying AWS architecture, the DevOps team is more geared up to take on new challenges. Taking advantage of managed services from AWS and increased automation allow the team to take on development tasks they find interesting and to learn about technology applications such as containers firsthand.
In its road to expansion, MPL launched its gaming platform in Indonesia in July 2019 and is awaiting the launch of AWS data centers in the country by 2022. Aphale concludes, “AWS has been by our side throughout our entire growth journey, from debugging to stabilizing and optimizing to now expanding our product.”
Mobile Premier League (MPL)
MPL is an eSports platform for mobile gaming in India. The company offers more than 40 games, including fantasy sports such as cricket, that can be played for cash prizes. Launched in August 2018, the app now has more than 40 million subscribers, with 100 games played per second.
Benefits of AWS
- Ensures API latency of 30 milliseconds or less
- Maintains application uptime of 99.9%
- Cuts infrastructure costs by 40%
- Provides automation to support growing its business without increasing resources
AWS Services Used
Amazon DynamoDB
Amazon DynamoDB is a key-value and document database that delivers single-digit millisecond performance at any scale. It’s a fully managed, multiregion, multimaster, durable database with built-in security, backup and restore, and in-memory caching for internet-scale applications.
Amazon Elastic Kubernetes Service
Amazon Elastic Kubernetes Service (Amazon EKS) is a fully managed Kubernetes service. Customers such as Intel, Snap, Intuit, GoDaddy, and Autodesk trust EKS to run their most sensitive and mission critical applications because of its security, reliability, and scalability.
Amazon Aurora
Amazon Aurora is a MySQL and PostgreSQL-compatible relational database built for the cloud, that combines the performance and availability of traditional enterprise databases with the simplicity and cost-effectiveness of open source databases.
AWS Enterprise Support
AWS Enterprise Support provides you with concierge-like service where the main focus is helping you achieve your outcomes and find success in the cloud.
