Talend and BigQuery interaction with data types during transformation

[MrunalP]

Address an issue related to Talend's interaction with BigQuery data types during the transformation process. It appears that when retrieving the schema using

tBigQueryInput

, the column data type, which is originally a timestamp in BigQuery, is being interpreted as a string in Talend. Consequently, the data loaded into the target table via

tBigQueryOutput

is displaying timestamp values as string literals (e.g., "1693570564.907").

[Anonymous]

Hello,

Could you please  clarify in which Talend version/edition you are? We will appreciate it a lot if you could post some trouble screenshots on community.

Best regards

Sabrina

[MrunalP]

Talend Version :Patch_20211223_TPS-5053_v1 (8.0.1)

Attachments

1)Error

2) Table in BigQuery as input

3)Schema of tBigQuery input and output

4) Table in BigQuery as Output

[MrunalP]

I tried different ways with SQL instructions (parse_date...), or with tJava, or with tMap to transform the fields in the correct format.

[Anonymous]

Hi Mruna1P,

This error indicates that the tBigQueryInput component is trying to read numeric data, but it encountered a string，so go check which field contains these string value. ID or Price field?

Regards

Shong