topic Talend Bigdata job Performance issue in Talend Studio

Talend Bigdata job Performance issue

mshafeeq — Fri, 15 Nov 2024 21:58:03 GMT

Hello ALl,

i have a performance issue in this posted job design , job took almost one hour to extract data from verticaDB 15 mins data only and create file on hdfs

source query designed to extract only 15 mins data , is there is anyway to enhance the performance of the job ?

Re: Talend Bigdata job Performance issue

Anonymous — Thu, 23 Mar 2023 04:19:25 GMT

Hello,

We see there is a tMap component in your workflow. Could you please show us the screenshot of mapper editor?

Did you launch routines in your tMap? If so is it complex?

Best regards

Sabrina

Re: Talend Bigdata job Performance issue

mshafeeq — Thu, 23 Mar 2023 07:28:29 GMT

hello @Xiaodi Shi

it's a direct 1 to 1 mapping without any complexity , i removed it before and same performance