topic Re: Support for AWS Athena in Talend Studio

Support for AWS Athena

stucas — Sat, 16 Nov 2024 01:19:32 GMT

Following the direction in Talend help, I can connect to AWS Athena and run queries.

https://help.talend.com/reader/36FNvH4mND6uL3cKKzTU~w/2xTGZdvfowaLAOwQTtkNmA

A few concerns that I hope someone may be able to answer:

There is a conflict using both Talend's S3 components and the Simba driver in the same job with the AWS Basic Credentials signing. Is a way round this other than using child jobs (independant java processes)?
Is the driver supported and maintained and if (1) above is an issue - to whom should I address my concerns, Simba, Talend, AWS? I would be loathe to put an unsupported driver into a production environment.
No matter how I configure log4j I cannot get an appender working for this component - is this because of a mismatch between log4j and log4j2? I have seen an unanswered forum question already related to this.

log4j:WARN No appenders could be found for logger (com.simba.athena.amazonaws.AmazonWebServiceClient).

log4j:WARN Please initialize the log4j system properly.

log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

Apologies if these seem trivial, but I do not have a Java background.

Many thanks for any suggestions

Stuart

Re: Support for AWS Athena

Anonymous — Mon, 19 Oct 2020 03:20:13 GMT

Hello,

When you get the issue about log4j conflict with Athena JDBC driver

use AthenaJDBC41-1.1.0.jar, please see https://docs.aws.amazon.com/athena/latest/ug/connect-with-previous-jdbc.html

and adjust url a little :"jdbc:awsathena://athena.us-west-2.amazonaws.com:443?s3_staging_dir=s3://aws-athena-query-results-062519970039-us-west-2/"

change the "443;s3" to "443?s3".

https://docs.aws.amazon.com/athena/latest/ug/connect-with-jdbc.html

Best regards

Sabrina

Re: Support for AWS Athena

stucas — Thu, 29 Oct 2020 11:52:36 GMT

Thanks - will try that.

Any idea on logging part of the question?

Re: Support for AWS Athena

Anonymous — Tue, 03 Nov 2020 04:46:33 GMT

Hello,

This feature is available in talend subscription solution.

From Studio, on the menu bar, select File > Edit Project Properties > Log4j > then select the Activate log4j in components check box to enabled the log4j option in your studio.

Let us know if you can do it.

Best regards

Sabrina