topic Re: Iceberg table with s3 in Talend Studio

Iceberg table with s3

MBourassa1682971203 — Thu, 13 Mar 2025 12:53:37 GMT

Hi,

Is there a way to write a iceberg table in s3 directly like I can do with a tdeltalakeoutput with the use of "Define a storage configuration component" related to a ts3conguration in a spark batch job ?

I use talend studio R2024-07.

Thank you

Re: Iceberg table with s3

MBourassa1682971203 — Thu, 13 Mar 2025 14:12:19 GMT

I found how to, you must add spark configs "spark.hadoop.fs.s3a....." and in the ticebergoutput, put s3a:// fallow by s3 path, without forget to create the catalogue by the same way.

Re: Iceberg table with s3

MBourassa1682971203 — Thu, 13 Mar 2025 14:48:26 GMT

A ts3configuration must be there without configuration.