Real time implementation in PIG


1 Answer(s)


Hi Manoj,

You can use the HDFS for storage, it is capable of Handling huge amount of data.

You can also use the Teradata Connector for Hadoop (TDCH) which is a map-reduce application that supports high-performance parallel bi-directional data movement between Teradata systems and various Hadoop ecosystem components.

Checked the following links for more depth details about working scenario with hadoop components:

Hortonwork - https://community.hortonworks.com/articles/6161/hdfs-to-teradata-example.html

IBM - https://www.ibm.com/support/knowledgecenter/SSPT3X_4.0.0/com.ibm.swg.im.infosphere.biginsights.import.doc/doc/data_warehouse_teradata-import.html

You can also refer the attached document.

Thanks.