Rethinking Big Data Application Management
BALA VENKATRAO, VP PRODUCTS
A recurring theme over the last few years has been that Big Data technologies are fading away. What is thriving are Big Data Applications, from ETL pipelines, Analytics to ML products, that leverage the Big Data Stack (Hadoop, Spark, Kafka, Cassandra, Elasticsearch etc.) to build meaningful solutions with business impact.
However, as we transition to this “application” view of Big Data, we still seem stuck in the old ways of managing the systems that support these applications. While we absolutely need system management tools to setup and monitor these platforms, we need to re-think how we manage applications more holistically and address their business requirements (SLA Management, MTTR, DevOps productivity etc.). We call this new paradigm “DataOps”.
Introducing Unravel, a novel way of enabling “DataOps” to effectively manage Big Data applications. By smartly leveraging data from across the stack (applications, platforms and infrastructure) and leveraging modern data science and machine learning principles, we provide a guided path to address issues related to performance, failures and resource utilization for your Big Data Application. It’s AI for Application Management. You have to try it to believe it!
I was recently at a networking event where I presented an analogy to what we do at Unravel that resonated very well with the audience:
Big Data Infrastructure and Applications are complex. It is like putting an airplane together — think of the core body of the plane as “HDFS”, the wings like “Kafka”, and the engines like “Spark” and “Hive”. Each of these airplane components have monitoring and management associated with them, but what brings all of this together is the “avionics” that is co-ordinating the various aspects of the airplane and many times guiding it in an “auto pilot” mode. Unravel’s vision is to be the “avionics” for your Big Data Applications, so you can successfully complete your journey from “Data to Insights”.
We will be showcasing our product at the Strata+ Hadoop World NY 2016 Conference next week (Sept 27–29) at the Cloudera Partner Pavilion (We are now Cloudera Certified!). So if you are attending the event, please stop by our booth K9 or you can reach us at anytime at www.preview.unraveldata.com
Bala Venkatrao is currently VP, Products at Unravel Data, a start-up that is pioneering Full-Stack Performance Intelligence for DataOps. Bala’s prior experience includes working in product management/strategy roles at Elastic, Cloudera and CA Technologies. Bala was an early employee at Cloudera where he was involved in a wide array of activities including Product Management, Marketing, Partnership Development and Customer Advocacy.
* Image from http://gizmodo.com/absolutely-everything-you-ever-wanted-to-know-about-air-1677766628