How can we write the Reducer inputs ie key and List of Values to a log file

Rao

I want to check if Reducer is getting Key and List of Values by writing those values to log file for debug purpose.

MapReduce MapReduce Examples

Dec 25 2014 12:28 PM

1 Answer(s)

DeZyre Support

hi Rao,

You can create your own "counters" within the code and these counters can be used for debugging purposes.

Thanks

Dec 26 2014 08:47 AM

Relevant Projects

Explore features of Spark SQL in practice on Spark 2.0

The goal of this spark project for students is to explore the features of Spark SQL in practice on the latest version of Spark i.e. Spark 2.0.

Design a Hadoop Architecture

Learn to design Hadoop Architecture and understand how to store data using data acquisition tools in Hadoop.

Learn to prepare data for your next machine learning project

Text data requires special preparation before you can start using it for any machine learning project.In this ML project, you will learn about applying Machine Learning models to create classifiers and learn how to make sense of textual data.

Data Science Project in Python on BigMart Sales Prediction

The goal of this data science project is to build a predictive model and find out the sales of each product at a given Big Mart store.

Spark Project-Analysis and Visualization on Yelp Dataset

The goal of this Spark project is to analyze business reviews from Yelp dataset and ingest the final output of data processing in Elastic Search.Also, use the visualisation tool in the ELK stack to visualize various kinds of ad-hoc reports from the data.