topic Loading multiple files to BigQuery using tfileList in Talend Studio

Loading multiple files to BigQuery using tfileList

Anonymous — Sat, 16 Nov 2024 11:36:40 GMT

Hi,
I Have few txt files in a folder having different schemas, I am using tfilelist component to load all the files in the Google BigQuery using tBigQueryOutput component.
How can i define schema for this component as it does not support dynamic schema?
I have schema for all the files in the repository.
Is there any way to do it?

Re: Loading multiple files to BigQuery using tfileList

Anonymous — Fri, 20 Jun 2014 09:44:15 GMT

Hi,
Could you load multiple files with different schema structure into tFileOutputDelimited first then migrating data from one .csv file(tFileInputFullRow) to tBigQueryOutput component?
Best regards
Sabrina

Re: Loading multiple files to BigQuery using tfileList

Anonymous — Tue, 24 Jun 2014 09:27:37 GMT

Hi Sabrina,
Thanks for the reply will definitely try the same

Re: Loading multiple files to BigQuery using tfileList

Anonymous — Tue, 24 Jun 2014 09:36:10 GMT

Hi,

Feel free to let me know if it is OK with you.
Best regards
Sabrina