<img height="1" width="1" style="display:none;" alt="" src="https://dc.ads.linkedin.com/collect/?pid=24166&amp;fmt=gif">

AtScale Blog

Has Spark Killed Hadoop?!

Posted by on
Find me on:


One of the "buzziest" subjects of conversation in the Big Data scene this past year has been Spark.  The powerful open source processing engine developed in 2009 has gotten some great traction and many have covered the stories of community adoption and growth.  

As one would expect though, some of the buzz spun out of control, so much, some went on to write that "Hadoop was dead" or that "Spark would eventually replace Hadoop".  

Such reports are misinformed, overly sensational and inaccurate.  If you have a few minutes, I propose you watch the below 2 minute video on the key role that Spark plays and its relationship with Hadoop.  In this interview, we talk about security, speed and other key items that make Hadoop relevant to business users.  

For a deeper understanding on the topic, check out the great piece that our VP of Product Management, Josh Klahr, authored for ReadWrite last week.  My favorite passage is below (the full piece is here):

"We need to stop playing Spark and Hadoop off each other and understand how they will coexist.  Hadoop will continue to be used as a platform for scale-out data storage, parallel processing, and clustered workload management.  Spark will continue to be used for both batch-oriented and interactive scale-out data-processing needs."

Wistia video thumbnail - Spark_Security

Thanks for reporting a problem. We'll attach technical data about this session to help us figure out the issue. Which of these best describes the problem?

Any other details or context?


If you are interested in finding out more, we've recently published a set of key resources that will help you think through this situation and hopefully help you find a solution that suits your needs 

Still believe it's too good to be true?  Schedule a demo here and we'll show you! 

Topics: Hadoop, Tableau, Business Intelligence, spark

Learn about BI & Hadoop

The AtScale Blog is the one-stop shop for cutting edge news and insights about BI on Hadoop and all things AtScale.

Subscribe to Email Updates

Recent Posts