topic Re: TOS V6.4.1 - Hadoop MapReduce in Talend Studio

TOS V6.4.1 - Hadoop MapReduce

Anonymous — Sat, 16 Nov 2024 08:35:14 GMT

Hi.

I am now studying about the MR option in TOS BD. I want to know what components in TOS BD can actually use the computing power of the Hadoop MapReduce.

I think all the tPig and tHive and tSqoop components are powered by MR, right?

How about tMap or tJavaRow or tSetGlobalVariable when running on Hadoop?

Also, when designing a MR job, should I just create the job as usual (just right click and select "Create job") or do I need to create a MR job with other special methods?

Thank you and have a nice day.

Re: TOS V6.4.1 - Hadoop MapReduce

Anonymous — Thu, 08 Mar 2018 03:09:25 GMT

You need to create a "Big Data Batch" job instead of a "Standard" job. When you do, the Palette will show you the available components.

Re: TOS V6.4.1 - Hadoop MapReduce

Anonymous — Thu, 08 Mar 2018 04:26:20 GMT

Thanks for the reply. So where can I create the "Big Data Batch" job in TOS BD? I cannot find such option by right clicking "Job Designs"...

Re: TOS V6.4.1 - Hadoop MapReduce

Anonymous — Thu, 08 Mar 2018 18:06:59 GMT

Here's a screenshot of my Talend Studio. It's right under "Standard".

Capture.PNG

Re: TOS V6.4.1 - Hadoop MapReduce

Anonymous — Fri, 09 Mar 2018 01:06:41 GMT

Sorry, which version of Talend Open Studio are you using?

Thanks.

Re: TOS V6.4.1 - Hadoop MapReduce

Anonymous — Tue, 13 Mar 2018 08:54:21 GMT

Hello,

Talend big data batch job will be available in talend subscription solution not open source.

Please have a look at online bigdata product matrix page:https://www.talend.com/products/big-data/big-data-compare-all/?_ga=2.261728269.1883876491.1520819993-1718331454.1508119343

Best regards

Sabrina