Unable to connect to Google Storage

[Anonymous]

Hi,
I am trying to establish a Google Storage connection with a tGSConnection component and facing the following issue :

Exception in component tGSConnection_1
org.jets3t.service.ServiceException: Request Error: storage.googleapis.com
	at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRequest(RestStorageService.java:563)
	at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRequest(RestStorageService.java:264)
	at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRestGet(RestStorageService.java:964)
	at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRestGet(RestStorageService.java:936)
	at org.jets3t.service.impl.rest.httpclient.RestStorageService.getAccountOwnerImpl(RestStorageService.java:1363)
	at org.jets3t.service.StorageService.getAccountOwner(StorageService.java:608)
	at demo.demobigquery_output_0_1.demoBigQuery_output.tGSConnection_1Process(demoBigQuery_output.java:312)
	at demo.demobigquery_output_0_1.demoBigQuery_output.runJobInTOS(demoBigQuery_output.java:565)
	at demo.demobigquery_output_0_1.demoBigQuery_output.main(demoBigQuery_output.java:422)
Caused by: java.net.UnknownHostException: storage.googleapis.com
[statistics] disconnected
	at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
	at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
	at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
	at java.net.InetAddress.getAllByName0(InetAddress.java:1276)
	at java.net.InetAddress.getAllByName(InetAddress.java:1192)
	at java.net.InetAddress.getAllByName(InetAddress.java:1126)
	at org.apache.http.impl.conn.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:45)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.resolveHostname(DefaultClientConnectionOperator.java:278)
	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:162)
	at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:151)
	at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:125)
	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:640)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:479)
	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:906)
	at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:805)
	at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRequest(RestStorageService.java:319)
	... 8 more

I am behind a corporate proxy, and have also tried the tSetProxy component... But I still have the same error messsage : org.jets3t.service.ServiceException: Request Error: storage.googleapis.com

Any solution to make it happen ?
Thanks in advance.

[Anonymous]

Hi,
Is your internet connectivity Ok with you?
Best regards
Sabrina

[Anonymous]

Hi,
Yes my internet connectivity is OK. The only restriction is that I am behind a corporate proxy.

What do you think I should do ?

Thanks

[Karthik_Kommarraju]

Were you able to find solution for this? @Mouhamed Lamine Loume​ 

[Anonymous]

Hello,

Are you getting the same issue when you are behind a corporate proxy?

Could you please indicate on which talend build version you got this issue?

Best regards

Sabrina

[Karthik_Kommarraju]

Hi Xdhsi,

Thanks for the reply. I am using Talend 7.31, and I am pretty new to Talend. I am having this error while connecting to GCS. I used access key and secret key.

Does talend need any additional libraries to connect to GCS.

Exception in component tGSConnection_1 (Excel_test)

org.jets3t.service.ServiceException: Service Error Message. -- ResponseCode: 400, ResponseStatus: Bad Request, XML Error Message: <?xml version='1.0' encoding='UTF-8'?><Error><Code>InvalidArgument</Code><Message>Invalid argument.</Message></Error>

at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRequest(RestStorageService.java:400)

at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRequest(RestStorageService.java:264)

at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRestGet(RestStorageService.java:964)

at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRestGet(RestStorageService.java:936)

at org.jets3t.service.impl.rest.httpclient.RestStorageService.getAccountOwnerImpl(RestStorageService.java:1363)

at org.jets3t.service.StorageService.getAccountOwner(StorageService.java:608)

at dev.excel_test_0_1.Excel_test.tGSConnection_1Process(Excel_test.java:323)

at dev.excel_test_0_1.Excel_test.runJobInTOS(Excel_test.java:604)

at dev.excel_test_0_1.Excel_test.main(Excel_test.java:453)

[Anonymous]

Hello,

Please let us know if this article helps

https://community.talend.com/s/article/Error-when-using-tGSConnection-to-connect-to-Google-Storage-u...

Best regards

Sabrina

[Karthik_Kommarraju]

Hi,

I tried the above URL, but no luck and also tried

https://community.talend.com/s/article/How-to-access-a-proxy-when-using-Google-Storage-components-r8...

But this time I have getting a different error. Can you please let me know what it could be?

What would be the proxy server name and proxy port for the GCS. It may fix the issue.

Thanks in Advance. It is tough to find an answer for this.

@Mohit Gupta​  Please help here, if you can.

Exception in component tGSConnection_1 (Excel_test)

org.jets3t.service.ServiceException: Request Error: Connection timed out: connect

at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRequest(RestStorageService.java:563)

at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRequest(RestStorageService.java:264)

at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRestGet(RestStorageService.java:964)

at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRestGet(RestStorageService.java:936)

at org.jets3t.service.impl.rest.httpclient.RestStorageService.getAccountOwnerImpl(RestStorageService.java:1363)

at org.jets3t.service.StorageService.getAccountOwner(StorageService.java:608)

at dev.excel_test_0_1.Excel_test.tGSConnection_1Process(Excel_test.java:470)

at dev.excel_test_0_1.Excel_test.tLibraryLoad_1Process(Excel_test.java:392)

at dev.excel_test_0_1.Excel_test.runJobInTOS(Excel_test.java:751)

at dev.excel_test_0_1.Excel_test.main(Excel_test.java:600)

Caused by: java.net.ConnectException: Connection timed out: connect

at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method)

at java.net.DualStackPlainSocketImpl.socketConnect(Unknown Source)

at java.net.AbstractPlainSocketImpl.doConnect(Unknown Source)

at java.net.AbstractPlainSocketImpl.connectToAddress(Unknown Source)

at java.net.AbstractPlainSocketImpl.connect(Unknown Source)

at java.net.PlainSocketImpl.connect(Unknown Source)

at java.net.SocksSocketImpl.connect(Unknown Source)

at java.net.Socket.connect(Unknown Source)

at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:121)

at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)

at org.apache.http.impl.conn.AbstractPoolEntry.open(AbstractPoolEntry.java:144)

at org.apache.http.impl.conn.AbstractPooledConnAdapter.open(AbstractPooledConnAdapter.java:134)

at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:610)

at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:445)

at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:835)

at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)

at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)

at org.jets3t.service.impl.rest.httpclient.RestStorageService.performRequest(RestStorageService.java:319)

... 9 more

[Anonymous]

Hello,

Are you able to connect to Google Storage successfully by client without using Talend tool?

Best regards

Sabrina