Dynamic Schema for tFileInputDelimited and tOracleOutput

[Anonymous]

Hi ,

We have requirement where we need to load data from input file and load into Oracle table.However input file schema should not be hard coded.By using tfilelist system should pick file one by one and according to data file structure ,system should create dynamic schema for tFileInputDelimited and tOracleOutput components and load data into mapped tables.

As the no of input files is more (around 300 +) and each file may have different structure.Thus it is not possible to create schema for each file.

We are looking for an appropriate solution  and  for tFileInputDelimited and tOracleOutput  to read data dynamically and insert into tables.

Thanks

Regards,

Vivek

[Anonymous]

Same graph is working when we use static schema (defined all 99 columns and their data type in design time) type... 

So look like the problem with dynamic schema type.

[fdenis]

so try dynamics adding column by column.
a data type or a data may lock the process.
when I do so I prefer to creat table in a first job to format column name and to set all as string. in a second time load data and then check and format data on db side.

[Anonymous]

Can you please elaborate more.. or possible to put graph image.

That will us to understand and implement properly.

Thanks for your prompt response.

Regards,

Vivek

[fdenis]

create one job executing a create table using tfilelist tfile input (read only 1 line) tmap or tjava to create sql create query (define all columns as string) and tOraclerow to execute query.
I'm used to use sys table to check tables and columns name and type and update them using alter table.
In a second time fill table with data. tfilelist toracleoutput

[Anonymous]

is there any other way to achieve this in Talend ?

---

@fdenis wrote:
create one job executing a create table using tfilelist tfile input (read only 1 line) tmap or tjava to create sql create query (define all columns as string) and tOraclerow to execute query.
I'm used to use sys table to check tables and columns name and type and update them using alter table.
In a second time fill table with data. tfilelist toracleoutput

---

---

@fdenis wrote:
create one job executing a create table using tfilelist tfile input (read only 1 line) tmap or tjava to create sql create query (define all columns as string) and tOraclerow to execute query.
I'm used to use sys table to check tables and columns name and type and update them using alter table.
In a second time fill table with data. tfilelist toracleoutput

---