Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Qlik Open Lakehouse is Now Generally Available! Discover the key highlights and partner resources here.
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

Compare incoming csv fike's schema and add the missing columns with respect to reference schema

Hi Folks,

 

I have a requirement in which a reference schema will be there, like : Column A,B,C,D,E,F.

in Day1 : the incoming csv file contains Column A,B,D,F

So, I have to detect the missing columns(i.e : Column C,E) and ingest these 2 columns in the incoming csv file and make a new CSV file with columns A,B,C,D,E,F.

Having null values for Column C,E.

 

Please suggest me a way to achieve this in Talend.

Thanks in advance 0683p000009MACn.png

 

Regards

Subhadeep

 

Labels (2)
3 Replies
fdenis
Master
Master

hi, what is your mission?
adding columns or inserting data into a db?
adding columns:
1 read first line as raw then normalise then compare to template.
2 fill each line with neaded null value.

inserting data into a db:
insert each line into a temp table then use store proc to read header and generate corresponding insert.

Anonymous
Not applicable
Author

Hi,

My input is :

Col ACol CCol DCol F
1111
1111
1111

 

My Output should be :

Col ACol BCol CCol DCol ECol F
1 11 1
1 11 1
1 11 1

 

Thanks in advance

 

fdenis
Master
Master

are your input file in a fix format?