Hi,
I'm using tMysqlInput to input data from a remote server. I delete the imported rows in parallel. The input rate of tMysqlInput is around 5 rows/s. Can i increase its performance so that it input fast? the 'enable stream' option is checked. any idea?
regards.
Hi
Notice "Action on data" of tMysqlOutput. Check "Delete" here.
The following image will help you.
tMysqlOutput can insert, update and delete records.
Don't forget to check "Use an existing connection".
Regards,
Pedro
Hi Link tMysqlInput with tJavaRow. Does it speed up this time? What's the rate? I guess maybe tMysqlInput is not the bottleneck of your job. A screenshot of the job is preferred. Regards, Pedro
Hi Please do as i said. Link tMysqlInput with tJavaRow. Does it speed up this time? What's the rate? By using this way, you can find the bottleneck. Wait for your feedback. Regards, Pedro
Hi Put tMysqlCommit under tMysqlInput. tMysqlConnection | OnSubjobOk | tMysqlInput ---tmap---tFileOutputDelimited--tMysqlRow | OnSubjobOK | tMysqlCommit Regards, Pedro
Hi, using tMysqlConnection | OnSubjobOk | tMysqlInput ---tmap---tFileOutputDelimited--tMysqlRow | OnSubjobOK | tMysqlCommit now rows/s are around 10 per second. so should i use tMysqlRow or tJavaRow?
Hi, My initial design was causing error where i used tMysqlCommit under tMysqlRow and unchecked 'enable stream'. I checked it and it worked fine. i have about 200 thousand rows.
Hi Please show me the settings of tMysqlInput and the sql of tMysqlRow. Screenshots are preferred. Then i can know what you want to do with tMysqlRow. Regards, Pedro
Hi
Try to remove tMysqlRow and check the speed this time.
What we do now is to find bottleneck.
If you remove tMysqlRow, the rate increases.
We can make sure that there must be something wrong with the sql in tMysqlRow.
Regards,
Pedro