topic Re: SAP TABLE INPUT TO AZURE SYNAPSE(MY SQL SERVER) in Talend Studio

SAP TABLE INPUT TO AZURE SYNAPSE(MY SQL SERVER)

sam473 — Sun, 12 Jul 2020 10:23:43 GMT

Hi ,

When I'm loading data from tsapinput table to azure synapse(SSMS) data loading is very slow , can some one help me its little bit urgent.

I need to perform two operations for the first time it should load bulk
after that it should perform insert and update

Any suggestion on design and components will be highly recommended

Re: SAP TABLE INPUT TO AZURE SYNAPSE(MY SQL SERVER)

Anonymous — Mon, 13 Jul 2020 05:26:52 GMT

Hello,

From your screenshot, here is a tMap component which will consume too much memory. For a large set of data, try to store the data on disk instead of memory on tMap and allocate more memory to execute the job. Let us know if it is OK with you.

Best regards

Sabrina

Re: SAP TABLE INPUT TO AZURE SYNAPSE(MY SQL SERVER)

sam473 — Mon, 13 Jul 2020 11:27:25 GMT

Hi ,

Really thanks for your replay , i am struck disparately need help i want to load my data into azure synapse(sql server) , data getting extraction fast but commit is happening very slow , bulk load not working

Re: SAP TABLE INPUT TO AZURE SYNAPSE(MY SQL SERVER)

sam473 — Tue, 14 Jul 2020 01:20:38 GMT

Hi, after removing tmap component , and try to ingest data commit inside the db happening very slow for tsqldwhoutput, so i tried to ingest data with tsqldwhbulk load but i am facing

Re: SAP TABLE INPUT TO AZURE SYNAPSE(MY SQL SERVER)

sam473 — Tue, 14 Jul 2020 01:23:05 GMT

Re: SAP TABLE INPUT TO AZURE SYNAPSE(MY SQL SERVER)

Prakhar1 — Tue, 14 Jul 2020 06:21:12 GMT

make sure you have all the required access on both the system i.e. reading and writing