topic Re: problem with tFileOutputParquet in Data Quality

problem with tFileOutputParquet

ffanali0804 — Fri, 15 Nov 2024 22:02:35 GMT

Hello everyone,

we have a huge problem with tFileOutputParquet component.

When the component write a Datetime field change the time respect the source data.

For example the source data have "2023-03-03 10:00" instead the parquet file have

"2023-03-03 08:00".

Investigating a little further, I discovered that the component automatically sets the parquert property isAdjustedUTC to true and cannot be changed in any way...

Do you know if there is a way to solve this big bug?

Thank you

Federico

Re: problem with tFileOutputParquet

Anonymous — Mon, 06 Mar 2023 11:41:13 GMT

Which version of Talend Studio are you using? I check the source code of tFileOutputParquet component in v8.0.1 and i don't see this property.

Regards

Shong

Re: problem with tFileOutputParquet

ffanali0804 — Mon, 06 Mar 2023 12:01:43 GMT

hi @Shicong Hong

I'm using Talend Cloud Data Integration Version: 8.0.1, Build id: R2022-10

Talend support confirmed me that there is this property set and at this moment there isn't any solution to change it.

The support is TDI-47310

For us is very important resolve this issue because we have all our dashboard with wrong dates.

thanks

federico

Re: problem with tFileOutputParquet

Anonymous — Mon, 06 Mar 2023 12:22:04 GMT

OK, this is a new feature request. You can vote the issue and watch it.

Re: problem with tFileOutputParquet

ffanali0804 — Mon, 06 Mar 2023 13:07:43 GMT

in the mean time do you know an alternative solution to resolve this issue?

thanks

Re: problem with tFileOutputParquet

Anonymous — Mon, 06 Mar 2023 13:25:45 GMT

You can have a try to set the timezone to your local timezone, eg:

add a tJava component in the beginning of job, and write this code:

java.util.TimeZone.setDefault(java.util.TimeZone.getTimeZone("America/Los_Angeles"));

If it doesn't work, we need the component update from R&D team.

Regards

Shong