Use case for Sqoop & Flume exporting data from HDFS to other systems



0
We understand that Flume is used to import and export semi structured data from/to HDFS and Sqoop for importing and exporting structured data from/to HDFS to RDBMS. Exporting to HDFS useful for building analytics but would like to understand the use cases for exporting data from HDFS to RDBMS or other semi structured systems.

1 Answer(s)


0

Hi Santhosh

There can be many use cases where you would want to export data from HDFS back into RDBMS.

One thing to remember is Hadoop is used for performing offline analysis of data. So once you perform that analysis using MapReduce or Pig or Hive - you might want to store the results of that analysis into RDBMS so its accessible in real time over the web.

For example many companies analyse their weblogs using either MapReduce,Pig or Hive and export the summary of the weblog data into an RDBMS.

Hope this helps

Your Answer

Click on this code-snippet-icon icon to add code snippet.

Upload Files (Maximum image file size - 1.5 MB, other file size - 10 MB, total size - not more than 50 MB)

Email
Password