topic Re: Error load the data from Oracle DB Tables into Amazon S3 in Talend Studio

Error load the data from Oracle DB Tables into Amazon S3

Anonymous — Sat, 16 Nov 2024 11:15:52 GMT

I am new in talend and use version Free 30-day Trial of Talend Enterprise Data Integration 5.6.1.
I need to load the data from Oracle DB Tables into Amazon S3. I use a proxy to connect to the network,
so I set my proxy in the "Network Connections" panel (in "Preferences") and ts3Connecction is OK.
But, when i execute job, the process don't upload the delimited file.
See below my log
Thank you very much for your help
Starting job CargaS3 at 11:46 07/04/2015.
connecting to socket on port 3978
connected
: com.amazonaws.http.AmazonHttpClient - Configuring Proxy. Proxy Host: proxy.miproxy.es Proxy Port: 8080
null
: org.apache.http.client.protocol.RequestProxyAuthentication - NEGOTIATE authentication error: Invalid name provided (Mechanism level: Cannot locate default realm)
disconnected
Job CargaS3 ended at 11:46 07/04/2015.

Re: Error load the data from Oracle DB Tables into Amazon S3

Anonymous — Tue, 07 Apr 2015 14:32:58 GMT

Is your tS3Put configured to use your tS3Connection?

Re: Error load the data from Oracle DB Tables into Amazon S3

Anonymous — Tue, 07 Apr 2015 14:41:07 GMT

Yes,

Re: Error load the data from Oracle DB Tables into Amazon S3

Anonymous — Wed, 08 Apr 2015 11:42:49 GMT

Hi,
Could you please check out "Die on error" option on tS3put component to see if there is any more error info printed on console? Can you connect to S3 successfully by client without using Talend tool? The network is Ok with you?
Best regards
Sabrina

Re: Error load the data from Oracle DB Tables into Amazon S3

Anonymous — Thu, 09 Apr 2015 09:49:51 GMT

Hi Sabrina,
This is error info printed on console.
Yes, I connect to S3 successfully by S3 Browser.
The network is OK.
Thanks you
Starting job CargaS3 at 10:56 09/04/2015.
connecting to socket on port 3665
connected
: com.amazonaws.http.AmazonHttpClient - Configuring Proxy. Proxy Host: proxy.miproxy.es Proxy Port: 8080
Exception in component tS3Put_1
java.lang.NullPointerException
    at org.apache.http.impl.auth.NTLMEngineImpl.stripDotSuffix(NTLMEngineImpl.java:175)
    at org.apache.http.impl.auth.NTLMEngineImpl.convertHost(NTLMEngineImpl.java:183)
    at org.apache.http.impl.auth.NTLMEngineImpl.access$400(NTLMEngineImpl.java:45)
    at org.apache.http.impl.auth.NTLMEngineImpl$Type1Message.<init>(NTLMEngineImpl.java:764)
    at org.apache.http.impl.auth.NTLMEngineImpl.getType1Message(NTLMEngineImpl.java:128)
    at org.apache.http.impl.auth.NTLMEngineImpl.generateType1Msg(NTLMEngineImpl.java:1298)
    at org.apache.http.impl.auth.NTLMScheme.authenticate(NTLMScheme.java:125)
    at org.apache.http.impl.auth.AuthSchemeBase.authenticate(AuthSchemeBase.java:135)
    at org.apache.http.client.protocol.RequestAuthenticationBase.authenticate(RequestAuthenticationBase.java:125)
    at org.apache.http.client.protocol.RequestAuthenticationBase.process(RequestAuthenticationBase.java:83)
    at org.apache.http.client.protocol.RequestProxyAuthentication.process(RequestProxyAuthentication.java:89)
: org.apache.http.client.protocol.RequestProxyAuthentication - NEGOTIATE authentication error: Invalid name provided (Mechanism level: Cannot locate default realm)
    at org.apache.http.protocol.ImmutableHttpProcessor.process(ImmutableHttpProcessor.java:109)
    at org.apache.http.protocol.HttpRequestExecutor.preProcess(HttpRequestExecutor.java:176)
    at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:515)
    at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
    at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
    at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
    at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:318)
    at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:202)
    at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3037)
    at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1217)
    at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1073)
    at pilotoenel.cargas3_0_1.CargaS3.tS3Put_1Process(CargaS3.java:2773)
    at pilotoenel.cargas3_0_1.CargaS3.tS3Connection_1Process(CargaS3.java:2694)
    at pilotoenel.cargas3_0_1.CargaS3.tOracleInput_1Process(CargaS3.java:2543)
    at pilotoenel.cargas3_0_1.CargaS3.runJobInTOS(CargaS3.java:5559)
    at pilotoenel.cargas3_0_1.CargaS3.main(CargaS3.java:5409)
disconnected
Job CargaS3 ended at 10:56 09/04/2015.

Re: Error load the data from Oracle DB Tables into Amazon S3

Anonymous — Thu, 09 Apr 2015 12:51:18 GMT

Hi rosade,
Could you please use an absolute path(such as;D:/file..) instead of variable"((String)globalMap.get("tFileOutputDelimited_1_FILE_NAME"))" in ttS3Put component to see if it is working?
Best regards
Sabrina

Re: Error load the data from Oracle DB Tables into Amazon S3

Anonymous — Thu, 09 Apr 2015 13:38:57 GMT

Hi Sabrina, thank you, i changed, but the error reappeared.

Starting job CargaS3 at 14:42 09/04/2015.
connecting to socket on port 3566
connected
: com.amazonaws.http.AmazonHttpClient - Configuring Proxy. Proxy Host: proxy.miproxy.es Proxy Port: 8080
Exception in component tS3Put_1
java.lang.NullPointerException
    at org.apache.http.impl.auth.NTLMEngineImpl.stripDotSuffix(NTLMEngineImpl.java:175)
    at org.apache.http.impl.auth.NTLMEngineImpl.convertHost(NTLMEngineImpl.java:183)
    at org.apache.http.impl.auth.NTLMEngineImpl.access$400(NTLMEngineImpl.java:45)
    at org.apache.http.impl.auth.NTLMEngineImpl$Type1Message.<init>(NTLMEngineImpl.java:764)
    at org.apache.http.impl.auth.NTLMEngineImpl.getType1Message(NTLMEngineImpl.java:128)
    at org.apache.http.impl.auth.NTLMEngineImpl.generateType1Msg(NTLMEngineImpl.java:1298)
    at org.apache.http.impl.auth.NTLMScheme.authenticate(NTLMScheme.java:125)
    at org.apache.http.impl.auth.AuthSchemeBase.authenticate(AuthSchemeBase.java:135)
    at org.apache.http.client.protocol.RequestAuthenticationBase.authenticate(RequestAuthenticationBase.java:125)
    at org.apache.http.client.protocol.RequestAuthenticationBase.process(RequestAuthenticationBase.java:83)
    at org.apache.http.client.protocol.RequestProxyAuthentication.process(RequestProxyAuthentication.java:89)
: org.apache.http.client.protocol.RequestProxyAuthentication - NEGOTIATE authentication error: Invalid name provided (Mechanism level: Cannot locate default realm)
    at org.apache.http.protocol.ImmutableHttpProcessor.process(ImmutableHttpProcessor.java:109)
    at org.apache.http.protocol.HttpRequestExecutor.preProcess(HttpRequestExecutor.java:176)
    at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:515)
    at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
    at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
    at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:784)
    at com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:318)
    at com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:202)
    at com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3037)
    at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1217)
    at com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1073)
    at pilotoenel.cargas3_0_1.CargaS3.tS3Put_1Process(CargaS3.java:2774)
    at pilotoenel.cargas3_0_1.CargaS3.tS3Connection_1Process(CargaS3.java:2694)
    at pilotoenel.cargas3_0_1.CargaS3.tOracleInput_1Process(CargaS3.java:2543)
    at pilotoenel.cargas3_0_1.CargaS3.runJobInTOS(CargaS3.java:5560)
    at pilotoenel.cargas3_0_1.CargaS3.main(CargaS3.java:5410)
disconnected
Job CargaS3 ended at 14:42 09/04/2015.

Re: Error load the data from Oracle DB Tables into Amazon S3

Anonymous — Mon, 13 Apr 2015 09:40:52 GMT

Hi rosade,

I need to load the data from Oracle DB Tables into Amazon S3. I use a proxy to connect to the network,
so I set my proxy in the "Network Connections" panel (in "Preferences") and ts3Connecction is OK.

Make sure your network is OK. Can you send an email in studio successfully under your proxy?
Have you tried to use tS3Put only to see if it can put file into Amazon S3?
The work flow should be: toracleinput-->tfileoutput-->OnsubjobOK-->tS3put.
Best regards
Sabrina