**Assignment Module 3 Nasdaq Data Set Output ** | DeZyre

Assignment Module 3 Nasdaq Data Set Output

0

Edgar

Hadoop has one standard output only?
and the most important file is part-00000 on every hadoop output which has the results?

Where can I find the physical location of the output file?

cloudera@localhost nasdaq]$ hadoop fs -ls /nasdaq/output/
Found 3 items
-rw-r--r-- 3 cloudera supergroup 0 2014-08-04 15:58 /nasdaq/output/_SUCCESS
drwxr-xr-x - cloudera supergroup 0 2014-08-04 15:54 /nasdaq/output/_logs
-rw-r--r-- 3 cloudera supergroup 4546 2014-08-04 15:57 /nasdaq/output/part-00000
[cloudera@localhost nasdaq]$ hadoop fs -cat /nasdaq/output/part-00000

Hadoop Cloudera

Aug 05 2014 04:41 AM

2 Answer(s)

0

Baskaran

Greetings.

part-00000 is the output. It is not a directory. _logs is a folder which has the execution log details.On the successful completion of a job, the MapReduce runtime creates a _SUCCESS file which may be useful for applications that need to see if a result set is complete just by inspecting HDFS.

Aug 05 2014 05:31 AM

0

Baskaran

-00001 will be the next no based on the no of reducers.

Aug 05 2014 06:29 AM

Relevant Projects

Big Data Project Data Science Project on Wine Quality Prediction in R

Data Science Project on Wine Quality Prediction in R

In this R data science project, we will explore wine dataset to assess red wine quality. The objective of this data science project is to explore which chemical properties will influence the quality of red wines.

Big Data Project Time Series Forecasting with LSTM Neural Network Python

Time Series Forecasting with LSTM Neural Network Python

Deep Learning Project- Learn to apply deep learning paradigm to forecast univariate time series data.

Big Data Project Zillow’s Home Value Prediction (Zestimate)

Zillow’s Home Value Prediction (Zestimate)

Data Science Project in R -Build a machine learning algorithm to predict the future sale prices of homes.

Big Data Project Machine Learning project for Retail Price Optimization

Machine Learning project for Retail Price Optimization

In this machine learning pricing project, we implement a retail price optimization algorithm using regression trees. This is one of the first steps to building a dynamic pricing model.

Big Data Project Build an Image Classifier for Plant Species Identification

Build an Image Classifier for Plant Species Identification

In this machine learning project, we will use binary leaf images and extracted features, including shape, margin, and texture to accurately identify plant species using different benchmark classification techniques.

Big Data Project Data Mining Project on Yelp Dataset using Hadoop Hive

Data Mining Project on Yelp Dataset using Hadoop Hive

Use the Hadoop ecosystem to glean valuable insights from the Yelp dataset. You will be analyzing the different patterns that can be found in the Yelp data set, to come up with various approaches in solving a business problem.

Big Data Project Credit Card Fraud Detection as a Classification Problem

Credit Card Fraud Detection as a Classification Problem

In this data science project, we will predict the credit card fraud in the transactional dataset using some of the predictive models.

Big Data Project Music Recommendation System Project using Python and R

Music Recommendation System Project using Python and R

Machine Learning Project - Work with KKBOX's Music Recommendation System dataset to build the best music recommendation engine.

Big Data Project Web Server Log Processing using Hadoop

Web Server Log Processing using Hadoop

In this hadoop project, you will be using a sample application log file from an application server to a demonstrated scaled-down server log processing pipeline.

Big Data Project Walmart Sales Forecasting Data Science Project

Walmart Sales Forecasting Data Science Project

Data Science Project in R-Predict the sales for each department using historical markdown data from the Walmart dataset containing data of 45 Walmart stores.

Related Questions

Related Blogs