topic Re: CSV file to MySQL using Dynamic Schema in Talend Studio

CSV file to MySQL using Dynamic Schema

alaynae02 — Sat, 16 Nov 2024 02:57:25 GMT

Hello Talend Community,

I'm trying to load a csv file without a header to an existing table in MySQL using the dynamic schema. It needs to be done with a dynamic schema because the job needs to accommodate csv files for several tables. All files have the same number of columns as tables, but they do not have headers.

The job is like this:

tFileInputDelimited_1 -> tMap_1 -> tDBOutput_1

Schema in tFileInputDelimited is

I keep getting the following error:

Unknown column '10103554' in 'field list'

10103554 is the value of the first column of the first record.

Do you perhaps know what I'm doing wrong?

Also, the option is to copy from one table to another, but column names are different and I keep getting the same error.

Unknown column 'customer_id' in 'field list' because in the target that col is named cust_id.

Re: CSV file to MySQL using Dynamic Schema

manodwhb — Wed, 18 Mar 2020 03:38:58 GMT

Hi, you have multiple files and same structures who you need to load into one table?

Re: CSV file to MySQL using Dynamic Schema

alaynae02 — Wed, 18 Mar 2020 07:58:25 GMT

No, I have one file per table.

File1 populates table1. File1 has 22 columns and no header, Table1 has 22 columns with appropriate data types.

File2 populates table2. File2 has 60 columns and no header, Table2 has 60 columns with appropriate data types.

etc.