[resolved] tMysqlInput performance enhancement

[Anonymous]

Hi,
I'm using tMysqlInput to input data from a remote server. I delete the imported rows in parallel. The input rate of tMysqlInput is around 5 rows/s. Can i increase its performance so that it input fast? the 'enable stream' option is checked. any idea?
regards.

[Anonymous]

Hi
Link tMysqlInput with tJavaRow. Does it speed up this time? What's the rate?
I guess maybe tMysqlInput is not the bottleneck of your job.
A screenshot of the job is preferred.
Regards,
Pedro

[Anonymous]

Hi pedro,
can you explain please?
Attached is the job image, any suggestions?

[Anonymous]

Hi
Please do as i said. Link tMysqlInput with tJavaRow. Does it speed up this time? What's the rate?
By using this way, you can find the bottleneck.
Wait for your feedback.
Regards,
Pedro

[Anonymous]

Hi
Put tMysqlCommit under tMysqlInput.
tMysqlConnection
|
OnSubjobOk
|
tMysqlInput ---tmap---tFileOutputDelimited--tMysqlRow
|
OnSubjobOK
|
tMysqlCommit
Regards,
Pedro

[Anonymous]

Hi,
using
tMysqlConnection
|
OnSubjobOk
|
tMysqlInput ---tmap---tFileOutputDelimited--tMysqlRow
|
OnSubjobOK
|
tMysqlCommit
now rows/s are around 10 per second. so should i use tMysqlRow or tJavaRow?

[Anonymous]

Hi
Why do you check 'enable stream' here?
How many rows do you need to load?
Regards,
Pedro

[Anonymous]

Hi,
My initial design was causing error where i used tMysqlCommit under tMysqlRow and unchecked 'enable stream'. I checked it and it worked fine.
i have about 200 thousand rows.

[Anonymous]

Hi
Please show me the settings of tMysqlInput and the sql of tMysqlRow.
Screenshots are preferred.
Then i can know what you want to do with tMysqlRow.
Regards,
Pedro

[Anonymous]

Hi
Try to remove tMysqlRow and check the speed this time.
What we do now is to find bottleneck.
If you remove tMysqlRow, the rate increases.
We can make sure that there must be something wrong with the sql in tMysqlRow.
Regards,
Pedro