topic Re: trest, trestclient, thttprequest differences in Talend Studio

trest, trestclient, thttprequest differences

muralam — Mon, 25 Jun 2018 14:15:09 GMT

Hi Team,

please provide your inputs, what is the exact difference between trest, trestclient, thttprequest using Talend DI to achieve the scenario to read files from http robot and load the data to postgres tables.

trest, trestclient, thttprequest among these which components are feasible to use, or any other suggestions please provide your inputs

Regards,

Meena

Re: trest, trestclient, thttprequest differences

Jesperrekuh — Mon, 25 Jun 2018 16:12:54 GMT

You mean in terms of scraping websites?
Could you please elaborate ... what are you trying to achieve?

Re: trest, trestclient, thttprequest differences

muralam — Tue, 26 Jun 2018 09:30:26 GMT

Hi Dijke,
I have scenario to download files by logging into 3rd party website for example https://www.trans.com/tg/vision and load the data to postgres to achieve this what are the components or approaches suggestible in Talend DI kindly help

Re: trest, trestclient, thttprequest differences

Jesperrekuh — Tue, 26 Jun 2018 10:54:05 GMT

Recommend using tSystem with cUrl , install it on the o.s..
in tSystem call it like this (String[]{"bash","-c", "curl ....commands...... "}
Or if its real scraping (like html data) Selenium with Python.
Store it in a file and then read it with tFileInputDelimited -> tMap -> tPostgresOutput