In the previous post, we discussed typical use cases for percentiles and the advantages of percentile estimates. In this post, we illustrate how to model percentile estimates with AtScale and use them from Tableau.
A new and powerful method of computing percentile estimates on Big Data is now available to you! By combining the well known t-Digest algorithm with AtScale’s semantic layer and smart aggregation features AtScale addresses gaps in both the Business Intelligence and Big Data landscapes. Most BI tools have features to compute and display various percentiles (i.e. medians, interquartile ranges, etc), but they move data for processing which dramatically limits the size of the analysis. The Hadoop-based SQL engines (Hive, Impala, Spark) can compute approximate percentiles on large datasets, however these expensive calculations are not aggregated and reused to answer similar queries. AtScale offers robust percentile estimates that work with AtScale’s semantic layer and aggregate tables to provide fast, accurate, and reusable percentile estimates.
In this three-part blog series we discuss the benefits of percentile estimates and how to compute them in a Big Data environment. Subscribe today to learn the best practices of percentile estimation on Big Data and more. Let's dive right in!
Did you know that 9 out of 10 companies are only able to analyze less than half of the data they collect? In fact, 45% of these companies analyze less than one quarter of this data . Why is that? The answer is simple. We are generating more data than ever, 44 zettabytes by the year 2020 to be precise. What does this mean for you? A great data lake filled with extremely valuable potential to make better decisions for your company. Remember what Sherlock Holmes once said: “I can’t build bricks without clay!” We need data to answer complex questions.
President’s day is the perfect opportunity to explore, honor and remember the legacy of Washington, Lincoln and other presidents. It is also a great day for all those who are looking for a good sale at their favorite retail or online store. What does this mean? Hundreds of millions of sales transactions will generate enormous amount of financial and inventory data will be generated on this one day.
It seems like only yesterday that we all gathered for the Strata New York Conference. And yet here we are, March is around the corner, and Strata San Jose is just a month away. Historically, Strata San Jose has roughly 5000 attendees while Strata New York averages closer to 7000 attendees. As one of the largest Hadoop conference in the US, Strata sessions focus on using data for competitive advantage. Strata Conference is also an opportunity to hear real life stories from enterprises who have been there, have the scars, and wrote the book. Strata is the ideal place to understand trends in the big data world. If you missed it, here are the [trends from 2017].
To learn from successful from Cloudera customers on how they succeed in BI on Big Data, check out this best practices webinar
The annual Gartner Data & Analytics Summit is just around the corner. As in past years, we are all anticipating the overwhelming sessions and agenda throughout this exciting week. This time in Grapevine, Texas (again)! In between sessions, catch a breath of fresh air and check out the exhibit hall to collect a bag of goodies to bring home. While T-shirts always make good pajamas, we may also wonder which sessions and vendors we should not miss. With all of the sessions available at the Summit, here are our suggestion on the ones you don’t want to miss!
Data, Data, Data! All the facts, numbers, and everything in between that, when collected, can be analyzed and decisions made based upon them. Can’t live with it! Can’t live without it! This year over $14 billion will be spent globally on flowers, chocolate, and jewelry on Valentine’s Day alone. According to CIO Research, big data analytics investments are expected to be close to $187 billion. We are definitely investing more on data than expensive chocolates! The big question is, are your data investments nurturing your relationship with data the same way a bouquet of flowers and a box of chocolates can nurture your relationships?
Does your decision-making process need an overhaul? In 2015, over 60% of the decisions made by companies were still based on ‘intuition’ or ‘experience’ of their executive team. With the rise of big data, it is imperative that we make use of such a valuable asset to make fact-based decisions and not just provide an opinion. This means that we need to become data-driven, of course this is easier said than done. It requires more than investing on the latest data and analytics software; it also requires cultural and organizational change.
Learn how industry leaders do it, register for our Best Practices Webinar!
The AtScale Enterprise Data Visionary Award program recognizes the leading enterprises that have reached exceptional productivity levels by modernizing their Big Data Analytics environment. Customers were evaluated based on ingenuity, innovation, business value and impact of their AtScale implementation.
We want to congratulate the 2018 AtScale Visionary Award Winners! Read on to learn more about how these industry leaders used AtScale to become trend-setters in the Big Data world.
We’ve put January back in cold storage! Don’t be frozen out of the month’s Big Data stories though! Catch up on January’s Big Data BIG news...