Cloudera, the hybrid data company, announced today that Cloudera Observability is now generally available for all customers using Cloudera Data Platform (CDP) on public or private cloud environments. The solution delivers new capabilities to the open data lakehouse implemented with CDP providing actionable insights for data, applications, and infrastructure components to optimize costs, automatically resolve issues, and improve performance. Financial governance and FinOps enable cost management across CDP to avoid budget overruns and allow capacity projections for planning purposes. The announcement was made at the analyst event The Six Five Summit, which takes place June 6-8, 2023.”
“One of the biggest challenges for companies today when managing workloads operating in the cloud is to get a global view of spending on infrastructure and services,” said Rob Bearden, chief executive officer of Cloudera. “With Cloudera Observability customers get unprecedented visibility into workload and resource utilization to better control and automatically manage budget overruns, and improve performance.”
“In today’s hybrid and multi-cloud environments, where enterprise data is spread across various departments and cost centers, it becomes increasingly challenging to manage cloud consumption and troubleshoot issues across different infrastructures. To counter this challenge, the rapidly evolving Indian tech industry is witnessing an increased adoption of Observability,” said Piyush Agarwal, SE Leader, Cloudera. We are delighted to announce the general availability of Cloudera Observability for our customers using Cloudera Data Platform (CDP) on public and private clouds. With its robust capabilities, derived from Cloudera’s 15 years of experience in product engineering and professional services, this observability solution empowers users to monitor, understand, and optimize their CDP deployments with unparalleled ease and confidence.”
Hybrid and multi-cloud environments are the new de facto standard. With enterprise data stored both on premises and potentially across multiple public clouds, it becomes difficult to track and manage cloud consumption across various departments and cost centers, keep the platform stable and controlled, and troubleshoot issues across these different infrastructures.
Cloudera Observability addresses these challenges. Building on the company’s experience with hybrid data solutions, Cloudera Observability empowers customers to monitor, understand, and optimize their CDP deployments. Customers also benefit from customizable automatic actions and pre-built actions to raise alerts, proactively avoid issues, and optimize workloads.
“Many companies struggle with their cloud costs and unlocking continuous value from cloud investments,” said Nitish Mittal, Partner at Everest Group. “Cloudera’s approach towards metadata gives CDP users a way to manage their cloud costs, including identifying rogue users, coordinating workloads for optimal cost and flagging potential resource overruns. This increasingly will become crucial for enterprises looking to manage their data on cloud estates effectively.”
For an existing customer, Cloudera Observability was able to help identify a rogue user who started sending millions of unnecessary queries, which severely impacted performance for essential workloads. Without going back and forth several times to gather information on the case, Cloudera’s support team had all the insights into the customer environment necessary to identify the root cause of the issue. As a result, the first response to the customer identified the root cause and provided the resolution. Cloudera Observability went right to insights, within minutes. Expedited support eliminates multiple interactions, getting to issue resolution faster and reducing operational overhead.
Cloudera Observability is available at no additional cost as part of applicable subscriptions to CDP and helps optimize the most frequently used data engines, including Hive, Impala and Spark for data engineering workloads. Cloudera Observability Premium adds high value capabilities, including custom auto-actions, deeper insights and richer automated troubleshooting. Support for new data engines and other platform components will be added over time.
Cloudera Observability is interoperable with Apache Iceberg, which is a key building block of Cloudera’s open data lakehouse delivered via CDP. It is a high-performance open table format for large analytic tables that brings reliability to big data, while making it possible for multiple compute engines to work concurrently.
Cloudera’s open data lakehouse helps organizations run quick analytics on all data – structured and unstructured – at massive scale. It eliminates data silos and allows data teams to collaborate on the same data with the tools of their choice on any public cloud and private cloud. Cloudera Observability enables a more cost-effective outcome across the full range of CDP’s functions, resulting in an enhanced experience for enterprise users. This becomes increasingly important as companies level up their data management in support of foundational data for large language models and other AI initiatives across hybrid and multi-cloud environments.