Hadoop MapReduce Performance Monitoring & Management

Operational Excellence for Your Hadoop MapReduce Applications

Enterprises deploying MapReduce jobs into production for continuous execution have limited operational visibility into MapReduce job performance. DRIVEN lets you manage, monitor and orchestrate your MapReduce processes and simplifies the day to day management of these pipelines.

DRIVEN is built on a robust, enterprise scalable, operational metadata repository. It captures rich operational metadata and provides enterprises the controls for managing all the business critical MapReduce processes, tracking dependencies and organizational ownership. DRIVEN also provides execution history so that enterprises can understand developing patterns, the potential impact of these, as well as usage reporting for capacity planning, chargebacks or compliance audits.

Hadoop MapReduce performance management

DRIVEN Key Capabilities

A

Real-Time Operational Visibility

  • See how your Hadoop MapReduce applications really behave at runtime
A
  • Real-time monitoring of MapReduce performance with workflow visualization
A
  • Rich performance metrics provide deep insights into potential performance optimizations
A
  • Easily correlate application performance anomalies with other simultaneous events in the cluster to identify resource constraints and application bottlenecks
A
  • Create and share custom views so everyone is working from the same operational data when troubleshooting problems

Proactive Monitoring and Debugging

  • Rapidly pinpoint the root cause of MApReduce performance issues without wading through dozens of log files
    • A
  • Configure notifications of job failures to be received via email or integrate alerting into existing support systems like HipChat or Jira
    • A
  • Visualize where errors occurred to quickly debug a problematic application processes or quickly find which steps could be better optimized
    • A
  • With 1-click of a button, surface the stacktrace to pinpoint the root cause of a failure
DRIVEN's DAG View
DRIVEN's App View

Deep Operational Analytics for Your Hadoop MapReduce Jobs

  • Gain insights into your test, pre-production or production MapReduce jobs including average duration, mean time to failure, effective parallelism, and much more
A
  • Powerful search means you can search on almost anything, such as MapReduce app name, by Job tracker IDs, by table names, etc. and it’s simple and fast
A
  • A built-in, scalable metadata repository enables you to analyze current application performance and execution behavior compared to historic performance

Manage The Business Of Big Data Operations

  • Integrate DRIVEN alerts and notification into your support/ticketing systems and leverage existing processes
A
  • Policy and Enforcement: Filter on operational criteria to allow administrators to easily manage and enforce policies
A
  • Resource Management and Usage Reporting: Organize and segment your Hadoop MapReduce jobs based on any user defined metadata, such as a team, division, organization, or application name. This is great for general resource management as well as reporting for chargebacks
A
  • Improve general resource management as well as reporting for chargebacks
MapReduce Performance Monitoring