topic Re: Loading FlatFiles in Talend Studio

Loading FlatFiles

Deley18_ — Sat, 16 Nov 2024 08:58:38 GMT

Hi, Please I am trying to load a FlatFile from a local drive using ( tFileInputDelimited to a tBigQueryOutPutBulk), But The number of rows transferred is lesser than the number in the input file

Basic flow

the data is separated with ; (semicolon) and the Text qualifier is "", example of a row will be like "16711";"20160101";"Oct 28 2017 9:32AM"

The Input is using this Definition is as below

Below is the component setting

The only thing I read on the talend help page is that if any of the columns is non nullable then , the row will be removed if null, but in my schema definition I made sure all the columns is nullable for the InputFile and the tBigQueryOutPutBulk, Please can anyone advice or point to anywhere I can check. I am using the open studio and new to talend. Thanks

Re: Loading FlatFiles

TRF — Wed, 06 Dec 2017 17:42:22 GMT

Hi,
Any message on the console?
Are sure all the records match with the schema defined for the input file?

Re: Loading FlatFiles

Deley18_ — Sun, 10 Dec 2017 10:24:58 GMT

Thanks , it had to do with the schema, some of the values of the incoming data do not match, that was why it was omitting the row, I made everything into string and it passed. for the time

Re: Loading FlatFiles

TRF — Sun, 10 Dec 2017 11:55:02 GMT

Don't forget to mark your case as solved.

Kudos also accepted!