1-844-696-6465 (US)        +91 77600 44484        help@dezyre.com

map reduce to work on hdfs input/output files



0
I could run my deZyre Modul3 Assignment 1. But it works only when data is local. When i give the path to the hdfc copy of the input data i get exception
"Input path does not exist:
file:/user/cloudera/input/as1/NASDAQ_daily_prices_A.csv"

Which is probably correct because I can't access this file using normal ls command, only the hadoop fs -ls can show it.

Looks like something needs to be changed in the program to make it access the hdfc data? If that's the case what code changes are required?



2 Answer(s)


0

Working now. Had to export the project as jar file and ran the program using hadoop jar command something like this:
hadoop jar /home/cloudera/assignmnets/M3_A1_Nasdaq.jar Nadaq_A1 /user/cloudera/input/as1/NASDAQ_daily_prices_A.csv /user/cloudera/output/as1

Note: User had to be 'cloudera' to avoid permission issue




0

Good that you figured out the error Sushil.

Thanks

Your Answer

Click on this code-snippet-icon icon to add code snippet.

Upload Files (Maximum image file size - 1.5 MB, other file size - 10 MB, total size - not more than 50 MB)

Email
Password