trest, trestclient, thttprequest differences

[muralam]

Hi Team,

please provide your inputs, what is the exact difference between trest, trestclient, thttprequest using Talend DI to achieve the scenario to read files from http robot and load the data to postgres tables.

 trest, trestclient, thttprequest among these which components are feasible to use, or any other suggestions please provide your inputs

Regards,

Meena

[Jesperrekuh · Accepted solution]

You mean in terms of scraping websites?
Could you please elaborate ... what are you trying to achieve?

[muralam]

Hi Dijke,
I have scenario to download files by logging into 3rd party website for example https://www.trans.com/tg/vision and load the data to postgres to achieve this what are the components or approaches suggestible in Talend DI kindly help

[Jesperrekuh]

Recommend using tSystem with cUrl , install it on the o.s..
in tSystem call it like this (String[]{"bash","-c", "curl ....commands...... "}
Or if its real scraping (like html data) Selenium with Python.
Store it in a file and then read it with tFileInputDelimited -> tMap -> tPostgresOutput