Using VMware vROPs to Gain Deep Visibility into Hadoop Clusters

by bluemedora_editor on January 12, 2017

Because of its flexibility, scalability, resiliency, and power, Apache Hadoop is the big data solution of choice for many organizations of all sizes. However, one of the challenges that users face comes with visibility.

The size and organization of the distributed database makes it difficult — if not impossible — to get the insight necessary to understand how your Hadoop clusters are performing. And because of that, if issues do arise, it can be challenging at best to pinpoint where they are coming from, whether from other areas of the IT stack or from Hadoop itself.

Whether you are running Hadoop on VMware or bare metal, Blue Medora has a new solution to give you the visibility that you need to gain insight into your Hadoop clusters. With the Blue Medora Apache Hadoop Management Pack for vRealize Operations, clearly understand the capacity and health of a HDFS cluster, and ensure the memory and CPU devoted to clusters are optimally allocated. And if you are planning that virtual migration, you can use the management pack to quantify the real resource needs of your cluster.

Key Performance Metrics

With the Blue Medora Management Pack, users get insight into the health and capacity of HDFS NameNodes and DataNodes, as well as the health, capacity and performance for YARN ResourceManagers and NodeManagers.

Apache Hadoop Health Investigation Dashboard from Blue Medora

Figure 1: Use the Apache Hadoop Health Investigation for a quick view of key metrics to drill down to performance problems.

Access over 400 metrics, including system CPU load, used physical memory, bytes and capacity used. In addition, the management pack incorporates key metrics for containers and applications so you garner true visibility into resources associated with Hadoop.

Capacity Definitions

Metrics are one piece of the Hadoop monitoring puzzle. Take it to the next level with capacity definitions — which provide health and utilization breakdowns so you clearly understand how clusters are being used and where you may be able to improve performance.

Capacity badge from the Apache Hadoop Management Pack from Blue Medora

Figure 2: Capacity badges provide quick insight into the health and utilization breakdowns of your Hadoop clusters.

Go beyond seeing a green indication that all systems go, and dive deeper to ensure you don’t overload particular Hadoop clusters — reducing mean-time-to-innocence and improving troubleshooting across the IT stack.

Dashboards and Reports

With a series of out-of-the-box dashboards and reports within the Blue Medora Hadoop Management Pack, see key metrics in at-a-glance heatmaps and graphs to quickly evaluate performance issues.

Apache Hadoop YARN Overview Dashboard from Blue Medora

Figure 3: The Apache Hadoop YARN Overview Dashboard enables you to dive deeper into key YARN metrics.

In all, there are six dashboards available within the management pack, which is complemented by three reports, including the Hadoop HDFS Capacity and Health, and the Hadoop YARN Utilization and Health.

How to Get the Hadoop Management Pack

The Blue Medora Hadoop Management Pack is now available. To learn more about the management pack for vRealize Operations or download a free trial, please visit the True Visibility Suite for VMware vRealize Operations page on Blue Medora’s website. 

Get started

Try BindPlane for free. No credit card required.

Sign up
True Visibility
BindPlane for VMware vRealize Operations

True Visibility allows cloud management teams to use VMware vRealize’s powerful machine learning and capacity planning engine across their entire hybrid cloud environment.

Azure Monitor...everything
BindPlane for Microsoft Azure Monitor

Make Azure Monitor your first-pane-of-glass across your entire multi-cloud, multi-database or hybrid platform environment.

Thank you for contacting us. Your information was received. We'll be in touch shortly.