topic How to Load a CSV file based upon the metadata and different structure in the File. in Talend Studio

How to Load a CSV file based upon the metadata and different structure in the File.

Anonymous — Mon, 03 Dec 2018 00:44:52 GMT

I have 138000 files I need to load with the following structure. The first column I have added as an explanation of what are the contents of reach line.

Line 1 Drives values to be loaded from Lines of Atom 1 to Atom 19 (Child Table)

Line 2: Its data needs to go into Parent Table

Frequencies need to into Parent Table

Last 2 lines need to go into Parent and Child Tables.

Any idea how to do this?

Explanation

To see the whole post, download it here

Re: How to Load a CSV file based upon the metadata and different structure in the File.

vapukov — Mon, 03 Dec 2018 19:03:06 GMT

as variant, split job for 3 step

1) read file (no header) - read only 1 line, store number to variable

2) read file, skip 1 line, read number of lines stored in variable on step 1 (LIMIT)

3) read file, skip 1+ variable lines (header == 1+ variable), limit = 2

Re: How to Load a CSV file based upon the metadata and different structure in the File.

Anonymous — Fri, 07 Dec 2018 05:10:31 GMT

Do I have to write code for it or can it be done by gui?

Re: How to Load a CSV file based upon the metadata and different structure in the File.

vapukov — Fri, 07 Dec 2018 05:16:44 GMT

if all files have the same structure (number of columns)

all possible to do with standard components:

tFileInputDelimited

tFlowToIterate

tMap

etc

if not - it more complicated

Re: How to Load a CSV file based upon the metadata and different structure in the File.

Anonymous — Fri, 07 Dec 2018 05:41:56 GMT

All files are the same. Can you give me a fwe more details on these steps please? It will help me shorten my learning curve.

Thanks!