Support for AWS Athena

[stucas]

Hi

Following the direction in Talend help, I can connect to AWS Athena and run queries.

https://help.talend.com/reader/36FNvH4mND6uL3cKKzTU~w/2xTGZdvfowaLAOwQTtkNmA

A few concerns that I hope someone may be able to answer:

1. There is a conflict using both Talend's S3 components and the Simba driver in the same job with the AWS Basic Credentials signing. Is a way round this other than using child jobs (independant java processes)?
2. Is the driver supported and maintained and if (1) above is an issue - to whom should I address my concerns, Simba, Talend, AWS? I would be loathe to put an unsupported driver into a production environment.
3. No matter how I configure log4j I cannot get an appender working for this component - is this because of a mismatch between log4j and log4j2? I have seen an unanswered forum question already related to this.

log4j:WARN No appenders could be found for logger (com.simba.athena.amazonaws.AmazonWebServiceClient).

log4j:WARN Please initialize the log4j system properly.

log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.

Apologies if these seem trivial, but I do not have a Java background.

Many thanks for any suggestions

Stuart

[Anonymous · Accepted solution]

Hello,

When you get the issue about log4j conflict with Athena JDBC driver

use AthenaJDBC41-1.1.0.jar, please see https://docs.aws.amazon.com/athena/latest/ug/connect-with-previous-jdbc.html

and adjust url a little :"jdbc:awsathena://athena.us-west-2.amazonaws.com:443?s3_staging_dir=s3://aws-athena-query-results-062519970039-us-west-2/"

change the "443;s3" to "443?s3".

https://docs.aws.amazon.com/athena/latest/ug/connect-with-jdbc.html

Best regards

Sabrina

[stucas]

Thanks - will try that.

Any idea on logging part of the question?

[Anonymous]

Hello,

This feature is available in talend subscription solution.

From Studio, on the menu bar, select File > Edit Project Properties > Log4j > then select the Activate log4j in components check box to enabled the log4j option in your studio.

Let us know if you can do it.

Best regards

Sabrina