Do not input private or sensitive data. View Qlik Privacy & Cookie Policy.
Skip to main content

Announcements
Discover how organizations are unlocking new revenue streams: Watch here
cancel
Showing results for 
Search instead for 
Did you mean: 
Anonymous
Not applicable

[resolved] tMysqlInput performance enhancement

Hi,
I'm using tMysqlInput to input data from a remote server. I delete the imported rows in parallel. The input rate of tMysqlInput is around 5 rows/s. Can i increase its performance so that it input fast? the 'enable stream' option is checked. any idea?
regards.
Labels (2)
18 Replies
Anonymous
Not applicable
Author

Hi,
let me explain you what i'm doing here. I take data from remote server through tMysqlInput, then i output the data into csv file. I delete the copied rows from the source server. tMysqlRow has the query which deletes the copied rows from the source server.
i"ve also attached the images.
Anonymous
Not applicable
Author

Hi,
After removing tMysqlRow, the rows/s jumped to 1000 rows/s. This means that i need to modify the query? its a very simple query though :s
Anonymous
Not applicable
Author

Hi
Try this.
tMysqlConnection
|
OnSubjobOk
|
tMysqlInput ---tmap---tFileOutputDelimited
|
OnSubjobOK
|
tFileInputDelimited--tMysqlRow
|
OnSubjobOk
|
tMysqlCommit
Regards,
Pedro
Anonymous
Not applicable
Author

Hi
I have tested this issue.
Here is conclusion.
Do not use tMysqlRow here.
It is inefficient. Replace it with tMysqlOutput.
You will get perfect performance.
Regards,
Pedro
Anonymous
Not applicable
Author

Hi,
Thank you for your help. just one thing, i want the output in a file and want to delete the copied rows from the source. tMysqlOutput will output in a table. How can i achieve that?
Anonymous
Not applicable
Author

Hi
Notice "Action on data" of tMysqlOutput. Check "Delete" here.
The following image will help you.
tMysqlOutput can insert, update and delete records.
Don't forget to check "Use an existing connection".
Regards,
Pedro
Anonymous
Not applicable
Author

Hi pedro,
you are awesome 0683p000009MACn.png
thanks a million for all the help 0683p000009MACn.png
regards,
Anonymous
Not applicable
Author

Hi,
I am a newbie to Talend. I am running a job to transfer data from SQL server to Excel. I came across the same error. I read through the above post but I am unable to find the check box for 'enable stream'. Would anyone know why? 
Would appreciate any help or thoughts!
Thank you.
Pallak
Anonymous
Not applicable
Author

hi,
in advanced setting of tMysqlInput component.
regards
laurent
0683p000009MEg7.png