AtScale > Case Studies > Rakuten Accelerates Query Performance and Modernizes Analytics Program with AtScale

Rakuten Accelerates Query Performance and Modernizes Analytics Program with AtScale

AtScale Logo
Company Size
1,000+
Region
  • America
Country
  • United States
Product
  • AtScale
  • Snowflake
  • Tableau
  • Amazon Web Services (AWS)
Tech Stack
  • Hadoop
  • SQL
Implementation Scale
  • Enterprise-wide Deployment
Impact Metrics
  • Cost Savings
  • Productivity Improvements
Technology Category
  • Analytics & Modeling - Big Data Analytics
  • Infrastructure as a Service (IaaS) - Cloud Computing
Applicable Industries
  • E-Commerce
  • Retail
Applicable Functions
  • Business Operation
  • Discrete Manufacturing
Use Cases
  • Inventory Management
  • Predictive Maintenance
  • Supply Chain Visibility
Services
  • Cloud Planning, Design & Implementation Services
  • Data Science Services
About The Customer
Rakuten is a shopping rewards company that leverages data on shopper behavior, pricing, and commissions to create compelling offers for their customers, who receive cash-back incentives from Rakuten. With over 13 million e-commerce customers and partnerships with 70+ businesses, Rakuten depends on sophisticated analytics and data management to maintain a differentiated offering in the highly competitive e-commerce industry. While Rakuten originally consolidated data from multiple siloed systems to a single, on-premises data lake built on Hadoop in 2016, they still faced challenges related to maintaining the environment. The sheer electrical costs of hosting their own internal server farm as well as the expensive hardware required presented obstacles for this fast-growing operation.
The Challenge
Rakuten, a shopping rewards company, had moved from their initial SQL database in 2014 to an AtScale-powered Hadoop solution in 2018. However, this wasn’t sufficient and they soon began to experience a resource crunch based on the sheer size of their database. Rakuten's existing architecture meant that business users didn't have the computing resources necessary to work with large datasets. This led to competition between business units for hard disk access, memory, and CPU time. The internal team was frustrated with the competition for resources, and the operational overhead and associated hardware and electricity costs also meant the solution was no longer cost-efficient. That, coupled with the continuous processing demands on storage infrastructure, forced Rakuten to consider new solutions for their data needs. They knew they needed more processing capability and flexibility to continue serving their customers effectively.
The Solution
AtScale helped Rakuten transition their analytics to the cloud while still retaining all the analytical capabilities they had built, enabling them to deliver consistency for their team. AtScale insulated their Tableau-based reports and dashboards from changes in underlying raw data. While location and schemas changed, the AtScale model was untouched, allowing them to preserve their investment. Once they had moved their data to Snowflake, AtScale was able to help Rakuten better optimize their costs by right-sizing cloud resource consumption based on real-time usage. AtScale also helped smooth out and mitigate user concurrency challenges without requiring additional compute resources and leveraged intelligent aggregates to accelerate query performance while keeping cloud costs down.
Operational Impact
  • By moving from an on-premises Hadoop data warehouse to Snowflake’s elastic, scalable resource model, Rakuten gained additional computing power. This enabled them to maintain responsiveness to queries during peak demand periods, while only paying for what they used.
  • Now Rakuten can maintain flexibility to compensate for crunches, without paying excessively for operational or server overhead.
  • Because AtScale allowed Rakuten to move from Hadoop to Snowflake seamlessly, the team can now access their data faster and with more consistency.
  • With the same data analytics tools in place before and after the migration, Rakuten didn’t need to retrain their team to adopt any new tools or working methods.
Quantitative Benefit
  • As high-demand queries were shifted to Snowflake, there was an immediate 30% drop in load on the on-premises computing cluster.
  • Rakuten ran a test of 10 terabytes of data with and without AtScale and discovered that AtScale ran the process 14x faster and at 4x less cost.

Case Study missing?

Start adding your own!

Register with your work email and create a new case study profile for your business.

Add New Record

Related Case Studies.

Contact us

Let's talk!
* Required
* Required
* Required
* Invalid email address
By submitting this form, you agree that IoT ONE may contact you with insights and marketing messaging.
No thanks, I don't want to receive any marketing emails from IoT ONE.
Submit

Thank you for your message!
We will contact you soon.