topic Re: Error in tFileFetch "method failed: http/1.1 407 proxy authentication required" when trying to download a file from the Internet. in Data Quality

Error in tFileFetch "method failed: http/1.1 407 proxy authentication required" when trying to download a file from the Internet.

dbaranda — Sat, 16 Nov 2024 04:05:23 GMT

I have TOS 7.2.1 installed in my computer and I´m trying to use tFileFetch in a job to download a CSV file from the internet. I need to go throw a proxy so this is my configuration:

When I run it I get the following error:

I also tried to configure the proxy from the "Preferences" menu option with the same result:

Please advise. I can't figure out any thing else to try. I have seaeched in this web without finding any other possible thing to do. Thanks.

Re: Error in tFileFetch "method failed: http/1.1 407 proxy authentication required" when trying to download a file from the Internet.

Anonymous — Wed, 27 Nov 2019 08:10:13 GMT

Hello,

Does the same URL (used in tFileFetch) work from the browser? No proxy or special certificate is involved?

Could you please try to call it in a tSystem with exactly the same proxy information (host, port, username and password) to see if it works well?

Best regards

Sabrina

Re: Error in tFileFetch "method failed: http/1.1 407 proxy authentication required" when trying to download a file from the Internet.

dbaranda — Wed, 27 Nov 2019 09:49:56 GMT

The url works in Chrome and downloads a file:

https://www.stats.govt.nz/assets/Uploads/Annual-enterprise-survey/Annual-enterprise-survey-2018-financial-year-provisional/Download-data/annual-enterprise-survey-2018-financial-year-provisional-csv.csv

I have tried to run it with tSystem as you suggested. This is the command:

"wget https://www.stats.govt.nz/assets/Uploads/Annual-enterprise-survey/Annual-enterprise-survey-2018-financial-year-provisional/Download-data/annual-enterprise-survey-2018-financial-year-provisional-csv.csv -e use_proxy=yes -e https_proxy=http://proxyma.corp.iberdrola.com:8080 --proxy-user=XXXXXX--proxy-password=******!"

It does NOT work. The error is:

xception in component tSystem_1 (Prueba_3)
java.io.IOException: Cannot run program "wget": CreateProcess error=2, El sistema no puede encontrar el archivo especificado
at java.lang.ProcessBuilder.start(Unknown Source)
at java.lang.Runtime.exec(Unknown Source)
at java.lang.Runtime.exec(Unknown Source)
at java.lang.Runtime.exec(Unknown Source)
at local_project.prueba_3_0_1.Prueba_3.tSystem_1Process(Prueba_3.java:319)
at local_project.prueba_3_0_1.Prueba_3.runJobInTOS(Prueba_3.java:655)
at local_project.prueba_3_0_1.Prueba_3.main(Prueba_3.java:505)

Re: Error in tFileFetch "method failed: http/1.1 407 proxy authentication required" when trying to download a file from the Internet.

dbaranda — Thu, 28 Nov 2019 13:09:24 GMT

I did manage to run it with tSystem as you suggested. It reads the proxy information and works just fine.

I still can´t make it worjk form TFileFetch. Please advice.