Map Reduce Programing using Talend Open Studio for Big Data
Hi,
I am currently using Talend Open Studio for Big Data version 5.3.1 , I want to write some map reduce programs and not pig jobs. Is there any drag and drop component available for map reduce
Regards,
Bhagwant Bhobe
Hi,
Developing native M/R job is possible using our Enterprise product but the functionnality is not available in Talend Open Studio for Big Data.
In Talend Open Studio for Big Data, you can use Pig, Hive or Sqoop to match your requirements.
Regards,
Rémy.
Hi
Here is the list of components that are available as M/R in v5.3.1:
tAggregateRow
tConvertType
tDenormalize
tFilterColumns
tFilterRow
tHBaseInput
tHBaseOutput
tHDFSInput
tHDFSOutput
tJDBCInput
tJDBCOutput
tMap
tNormalize
tReplace
tReplicate
tSchemaComplianceCheck
tSortRow
tUniqRow
tStandardizeRow
There will be more for 5.4. We will try to have this list available more easily in our KB.
HTH