Dynamic Schema for tFileInputDelimited and tOracleOutput

[Anonymous]

Hi ,

We have requirement where we need to load data from input file and load into Oracle table.However input file schema should not be hard coded.By using tfilelist system should pick file one by one and according to data file structure ,system should create dynamic schema for tFileInputDelimited and tOracleOutput components and load data into mapped tables.

As the no of input files is more (around 300 +) and each file may have different structure.Thus it is not possible to create schema for each file.

We are looking for an appropriate solution  and  for tFileInputDelimited and tOracleOutput  to read data dynamically and insert into tables.

Thanks

Regards,

Vivek

[fdenis · Accepted solution]

if you are not on the free version you can use dynamic as row type. This type replace all columns and keep the type.

[Anonymous]

I got following error when i used tinputfiledelimited and toracleoutput components with 'Dynamic' schema type.

My Graph design : tinputfiledelimited   -> tOracleOutput 

Exception in component tOracleOutput_1
java.sql.SQLException: Missing IN or OUT parameter at index:: 96
at oracle.jdbc.driver.OraclePreparedStatement.processCompletedBindRow(OraclePreparedStatement.java:1821)
at oracle.jdbc.driver.OraclePreparedStatement.addBatch(OraclePreparedStatement.java:10010)
at oracle.jdbc.driver.OraclePreparedStatementWrapper.addBatch(OraclePreparedStatementWrapper.java:1358)
at artemis_dev.transt_stg_load_param_0_1.Transt_Stg_Load_Param$1tAsyncIn_tOracleOutput_1_ParallelThread.run(Transt_Stg_Load_Param.java:2801)

[fdenis]

You are using stored procédure!
ones you have db trigger with trouble.
or you are not ussing the good component .
to use store proc use tOracleRow

[Anonymous]

Oracleoutput is used to insert data into oracle table.We would like to make a graph which will read data from file and inserting into oracle table with dynamic schema.

[fdenis]

try to insert into a new table.

[Anonymous]

Didn't work diff options....Giving background of this issue again.Can anybody please suggest how to achieve this in Talend.

Hi ,

We have requirement where we need to load data from different input files and load into Oracle tables.As input files structures are different for each files thus schema cannot be hardcoded.By using tfilelist system should pick file one by one and according to data file structure ,system should create dynamic schema for tFileInputDelimited and tOracleOutput components and load data into mapped tables.

As the no of input files is more (around 300 +) and each file will have different structure.Thus it is not possible to create schema for each file.

We are looking for an appropriate solution and for tFileInputDelimited and tOracleOutput to read data dynamically and insert into tables.

We tried tinputfiledelimited (to read file) and toracleoutput (to load data into oracle table) components with 'Dynamic' schema type.

My Graph design : tinputfiledelimited -> tOracleOutput

However we got below exception

Exception in component tOracleOutput_1
java.sql.SQLException: Missing IN or OUT parameter at index:: 96
at oracle.jdbc.driver.OraclePreparedStatement.processCompletedBindRow(OraclePreparedStatement.java:1821)
at oracle.jdbc.driver.OraclePreparedStatement.addBatch(OraclePreparedStatement.java:10010)
at oracle.jdbc.driver.OraclePreparedStatementWrapper.addBatch(OraclePreparedStatementWrapper.java:1358)
at artemis_dev.transt_stg_load_param_0_1.Transt_Stg_Load_Param$1tAsyncIn_tOracleOutput_1_ParallelThread.run(Transt_Stg_Load_Param.java:2801)

Thanks

Regards,

Vivek

[fdenis]

it's an oracle prolem try to create and insert data into table with the same user.
check global and table triggers
missing in out parameter is an package or procedure error.
good luck,

[Anonymous]

But we are able to insert record from Oracle side.

[fdenis]

are you using same user/pwd?
is there db triggers?
is there table triggers?
is there package procedures or functions?
are they all compilled?
try to insert one line from a new talend job. recreating connection.