topic Re: Talend and BigQuery interaction with data types during transformation in Talend Studio

Talend and BigQuery interaction with data types during transformation

MrunalP — Fri, 15 Nov 2024 21:13:55 GMT

Address an issue related to Talend's interaction with BigQuery data types during the transformation process. It appears that when retrieving the schema using

tBigQueryInput

, the column data type, which is originally a timestamp in BigQuery, is being interpreted as a string in Talend. Consequently, the data loaded into the target table via

tBigQueryOutput

is displaying timestamp values as string literals (e.g., "1693570564.907").

Re: Talend and BigQuery interaction with data types during transformation

Anonymous — Mon, 27 Nov 2023 01:06:29 GMT

Hello,

Could you please clarify in which Talend version/edition you are? We will appreciate it a lot if you could post some trouble screenshots on community.

Best regards

Sabrina

Re: Talend and BigQuery interaction with data types during transformation

MrunalP — Mon, 27 Nov 2023 07:02:48 GMT

Talend Version :Patch_20211223_TPS-5053_v1 (8.0.1)

Attachments

1)Error

2) Table in BigQuery as input

3)Schema of tBigQuery input and output

4) Table in BigQuery as Output

Re: Talend and BigQuery interaction with data types during transformation

MrunalP — Mon, 27 Nov 2023 07:31:00 GMT

I tried different ways with SQL instructions (parse_date...), or with tJava, or with tMap to transform the fields in the correct format.

Re: Talend and BigQuery interaction with data types during transformation

Anonymous — Wed, 29 Nov 2023 08:00:01 GMT

Hi Mruna1P,

This error indicates that the tBigQueryInput component is trying to read numeric data, but it encountered a string，so go check which field contains these string value. ID or Price field?

Regards

Shong