topic Re: Loading data in sequence order in Talend Studio

Loading data in sequence order

gadasowmya — Wed, 27 Apr 2016 10:04:02 GMT

hi ,
I am loading 10 rows in to Db with sequence order its loading data and job has ran sucessfully,
If I have ran d job again job is running but the data is loading with 1st sequence I want continuoes sequence(i.e from 11th). how can i get it??
Please tell how can I retrive this.

Re: Loading data in sequence order

Anonymous — Wed, 27 Apr 2016 10:48:38 GMT

Drive your sequence from the database and not Talend if it is possible. Either use a database sequence, LAST_INSERT_ID() for MYSQL, an autoincrement column or create a function to retrieve the last ID from a table and use that plus 1.

Re: Loading data in sequence order

Anonymous — Wed, 27 Apr 2016 10:50:22 GMT

If I understand you correctly, you need some form on change data capture on your source database.
When you say sequence, is there a column with a sequentially allocated sequence?
If so, just record the last sequence processed.
Or you can use triggers to identify changed data, or use system create/modified timestamps...and so on...

Re: Loading data in sequence order

gadasowmya — Wed, 27 Apr 2016 13:04:13 GMT

I have two columns id,name I used sequence for id and generated 10 records using trowgenerator and inserted in MysqlDB(no primary key) again i have run that job again,the records are inserting from '1' I want to get it inserted it from '11' so how many times if i run the job it should insert sequentially.how can I??

Re: Loading data in sequence order

Anonymous — Fri, 29 Apr 2016 08:57:21 GMT

In this case you need to store the last sequence number used so that you can start your sequencing from last+1

Re: Loading data in sequence order

Anonymous — Fri, 29 Apr 2016 14:06:16 GMT

Hi,

If you have a sequence on the ID column, you can try this :

I used this for Oracle

thanks,
Amine

Re: Loading data in sequence order

gadasowmya — Wed, 18 May 2016 15:14:19 GMT

I tried its not working