
2
THE NEED FOR CHANGE
Legacy data warehouses are based on technology that is, at its core, decades old. They were designed
in a me when data was simpler, and the number of people in an organizaon with the need or desire
to access the database were few. As analycs has become a company-wide pracce, and a larger
volume of more diverse data is collected, the data warehouse has become the biggest roadblock
that people are facing in their path to insight. To meet the demands and opportunies of today and
tomorrow, data warehouses will need to fundamentally change.
WHITEPAPER
Data is becoming more diverse. It used to
be that data came primarily from internal
sources (e.g. transaconal, ERP, and CRM
systems) in structured forms at a predictable
rate and volume. Today, in addion to
tradional sources, data is being generated
by a by diverse and rapidly changing set
of sources, including applicaon logs, web
interacons, mobile devices, and more.
That data frequently arrives in exible semi-
structured formats such as JSON or Avro, at
highly variable rates and volumes.
Data is being used dierently. Data used to
ow through complex ETL pipelines into a
data warehouse, where reporng queries
ran periodically to update xed dashboards
and reports. That process oen took days.
Today, a wide array of analysts need to
explore and experiment with data as quickly
as possible, without knowing in advance
where they might nd value in it. A growing
number of applicaons need immediate
access to data in order to support new and
exisng business processes.
Technology has evolved. There are
technologies available today, like the
cloud, that were not even conceived of
when convenonal data warehouses were
designed. As such, they weren’t designed to
take advantage of the unlimited scale and
convenience of the cloud.
Purchasing has evolved. With the diverse
and ever changing workload of the modern
data warehouse, many organizaons would
prefer to pay for their data infrastructure
and soware as a subscripon, instead of
a permanent (and large) one-me capital
outlay.
“Today’s data warehouses are based on
technology that is decades old. To meet the
demands and opportunies of today, data
warehouses have to fundamentally change.”
— Je Shukis, VP Engineering and Tech Ops, VoiceBase
评论