Using Java on a local machine with a virtual instance of hadoop



0
I am using putty to access a remote instance of hadoop (amazon). how will I utilize local java applications in that environment?

2 Answer(s)


0

Raymond, the below steps should be good enough to move files/Jars etc. from your local machine to dezyre ubuntu instance.

1) develop you Map Reduce programs in Local environment
2) Make a JAR of the program(s) that you want to submit to Hadoop Cluster
3) use WINSCP(Use .ppk file, hostname, username(ec2-user) or any File transfer tool like sFTP to transfer the JAR from Step2 which is in your localmachine to dezyre Amazon Instance.
4) Use copyFromLocal command on amazon instance to move JAR to hdfs desired location.


0

hi Raymond,

you can use Winscp application to transfer files from local machine to Amazon servers. Winscp can be downloaded from http://winscp.net/eng/download.php.

Thanks

Your Answer

Click on this code-snippet-icon icon to add code snippet.

Upload Files (Maximum image file size - 1.5 MB, other file size - 10 MB, total size - not more than 50 MB)

Email
Password