NoSQL and Hadoop Databases Cross the Tipping Point

My first blog about NoSQL and Hadoop data management was entitled Skating to Where the Puck is Going, because at the time all indications were that neither NoSQL nor Hadoop had yet penetrated the mainstream enterprise market. Instead, they were seen as interesting technologies and potential alternatives to monolithic legacy databases like Oracle, but definitely not ready for business-critical workloads.

I wrote that blog less than two years ago and it’s been exciting and gratifying to see how quickly NoSQL and Hadoop database deployments have evolved and moved out of the sandbox to become critical pillars of organizations’ IT strategy. In this blog I’ll discuss what’s changed, how the market is responding, and what all this means for NoSQL and Hadoop in 2019.

What’s Changed?

There are several primary factors driving the rapid adoption of NoSQL and Hadoop databases within the enterprise:

  • Digital Transformation – unless you’ve had your head in the sand these past two years, you understand that every organization is on a digital transformation journey. In order to remain competitive and thrive in the digital economy, organizations must find ways to harness the value of their data, leading to major advances in databases, analytics, AI, and ML technologies.
  • Multi-Cloud – according to recent research, 85% of organizations are now running multi-cloud infrastructure with applications and data spread across on-premises and multiple clouds. Long gone are the days of application ‘lift-and-shift’ to the cloud. Organizations have recognized that in order to harness the value of the cloud they must move to micro-services based architectures for which NoSQL and Hadoop databases are ideally suited.
  • Agility & Cost – Hadoop and NoSQL databases, in many cases open-source, enable a far more cost-effective and agile deployment model than traditional monolithic relational databases.

Analysts Viewpoint

The rapid proliferation of Hadoop and NoSQL databases has also been validated by recent research.

According to Enterprise Strategy Group research:

  • 38% of organizations report that they have between 25 and 100 unique database instances, while another 20% have over 100.
  • NoSQL databases are now the norm, with 78% of organizations reporting in 2017 that they were using a NoSQL database, while another 18% reported having plans for or being interested in using one within the following year. That’s 96% of organizations using NoSQL today!
  • Despite post-hype pessimism, Hadoop is still widely used, with 50% of organizations leveraging the technology.

Gartner Research also weighed in on the topic with the recent release of its Market Share Analysis: Data Center Backup and Recovery Software, Worldwide, 2017, stating in its recommendations to vendors:

“Technology product managers… must… provide solutions that… incorporate data management, workload migration and DR orchestration functionality.” Additionally, they must…”Partner with vendors that are driving high-growth and emerging workload deployment paradigms, including… big data distributed databases.”

Media Spotlight

The tech and business press have also increasingly shone a light on the mainstreaming of NoSQL and Hadoop, and as importantly the associated challenges of managing those environments.

In a recent Forbes article, Justin Warren commented on how organizations recognize the business criticality of modern data platforms, stating, “We can tell that NoSQL databases are being used to house important data because people are now getting concerned about backing them up.”

Zeus Kerravala wrote a great piece in Network World talking about the issue of mass data fragmentation, stating, “It is not uncommon to have four to five separate backup solutions from different vendors to handle different workloads such as virtual, physical, database, and cloud.” The proliferation of NoSQL and Hadoop simply adds to this challenge.

Data Management Vendor Response

2018 has also seen considerable activity on the vendor front. While most data management vendors talk a good game, when it comes to Hadoop and NoSQL two vendors in particular made significant investments, notably:

  • Rubrik’s Acquisition of Datos IO – in March, Rubrik, a Silicon Valley data management unicorn purchased the privately held Datos IO. At the time of acquisition, Bipul Sinha, co-founder and CEO of Rubrik stated, “As enterprises adopt NoSQL cloud databases to undertake digital transformation and AI initiatives, the need to manage and recover applications and data is becoming top of mind. We are excited to have Datos IO join the Rubrik family to accelerate innovation in how enterprises manage and recover this modern application stack.”
  • Veritas Announces 8.1.2 – just recently, Veritas, the market share leader in data management for traditional workloads, announced NetBackup 8.1.2 showcasing its new support for NoSQL and Hadoop. According to Veritas CRO Scott Genereux, “60% to 70% of our largest customers are creating new database applications on NoSQL… it’s MongoDB, it’s Cassandra.” Additionally, “Hadoop… that used to be a sandbox, a playground, but those applications have gotten to be important.”

Both of these moves have helped shine an even brighter spotlight on the proliferation of Hadoop and NoSQL and the need to provide data management solutions for those workloads.

Breakthrough Year for Imanis Data

Against that backdrop, it’s not surprising that we at Imanis Data – the only independent startup focused specifically on NoSQL and Hadoop data management – have had a whirlwind year, including:

  • Series B Funding – in March we raised $13.5M in funding, enabling us to aggressively invest in sales and go-to-market activities to support market demand for our solution.
  • Ex-Datos IO CMO joins Imanis Data – in May yours truly joined Imanis Data as Chief Marketing Officer. Simply put, the opportunity to continue growing the Hadoop and NoSQL data management market was too exciting to pass up.
  • Introduction of Industry-First Product Capabilities, including:
    • SmartPoliciesTM which deliver industry-first autonomous, machine learning-powered backup, taking away the guess work and overhead associated with traditional backup methods.
    • ThreatSenseTM Intelligence Augmentation, which adds a human feedback loop to machine learning-powered anomaly detection for applications including ransomware prevention.
    • Automated any-point-in-time recovery (APITR) for NoSQL that delivers complete recovery flexibility for multiple NoSQL databases.
  • Enterprise Adoption – we won the trust of major enterprise accounts across numerous industry verticals and our H2 revenue is forecast to grow 500% over H1.
  • Industry Recognition – throughout the year we received strong recognition, notably:
    • Chris Mellor, from The Register, commenting on our product launch, said, “Having backup software set up its own schedules based on input RPO values isn’t a new idea, but having it done with machine learning is.”
    • Network World recently named Imanis Data one of the Top 10 Business Continuity Startups to Watch.
    • Database Trends & Analytics (DBTA) recently included Imanis Data in its list of DBTA Trend-Setting Products for 2019.

It’s been an incredible year, and it’s not over yet!

2019 Prediction

With this proliferation comes the reality that organizations must be empowered with the same caliber of data management tools for use cases including backup, recovery, archiving, migration, and test/dev amongst others, that they have grown accustomed to with their traditional relational databases.

If 2018 was the year we reached the tipping point of mainstream acceptance of Hadoop and NoSQL for business-critical applications, then 2019 will most certainly be the year in which global enterprises will deploy enterprise data management for Hadoop and NoSQL, to protect and manage these massive (and growing) workloads. Organizations must be empowered with the same caliber of data management tools for use cases including backup, recovery, archiving, migration, and test/dev amongst others, that they have grown accustomed to with their traditional relational databases. Of course, that’s what we do, but that’s a topic for another blog!

For today, we here at Imanis Data are grateful to serve an incredible customer base and we could not be more excited about the year ahead.

Sign Up To Receive Imanis Data Updates

Take the Next Step

Put Imanis Data to work for all your data management needs.