topic Re: Records not inserted into mysql table in Talend Studio

Records not inserted into mysql table

Anonymous — Thu, 02 Oct 2014 18:29:02 GMT

Hello all,
Doing a relatively simple move from PostgreSQL into MySQL, though the operation is successful it does not insert any record into the specified MySQL table.
Testing talend as a new ETL tool and i'm still navigating my way around all its' functionality. I'll appreciate any help.
Thank you all.

Re: Records not inserted into mysql table

Anonymous — Thu, 02 Oct 2014 19:46:16 GMT

At first take care the option Die on error is on. Now you can spot probably errors.
Next, if you use a separate tMysqlConnection take care you also use tMysqlCommit triggered with OnSubjobOk starting with the first component in the last writing flow.
For more help, please post a image of your job, so we can spot further possible pitfalls.

Re: Records not inserted into mysql table

Anonymous — Thu, 02 Oct 2014 20:04:00 GMT

I thought i posted this with my original post. Yes the option "die on error" is on.
Many thanks for your time.

Re: Records not inserted into mysql table

Anonymous — Thu, 02 Oct 2014 20:06:01 GMT

Ok, now the image is visible. I take a look at it.
I would say, this is fairly straight forward and should work. Do you see some error messages in the Job console window. I would bet you will see some.

Re: Records not inserted into mysql table

Anonymous — Thu, 02 Oct 2014 21:03:06 GMT

No errors - below is the output from the job console window.
Starting job DataLoadMySQL at 14:01 02/10/2014.
connecting to socket on port 3726
connected
disconnected
Job DataLoadMySQL ended at 14:01 02/10/2014.

Re: Records not inserted into mysql table

Anonymous — Thu, 02 Oct 2014 21:11:55 GMT

GO to the Job view and here to the register Extras&Logs and switch on Log output.
What do you have set as Action on data?

Re: Records not inserted into mysql table

Anonymous — Thu, 02 Oct 2014 21:26:00 GMT

Action on data is set to "insert".. I deleted the table.

Re: Records not inserted into mysql table

Anonymous — Thu, 02 Oct 2014 21:33:06 GMT

The only possible explanation is you have managed to avoid showing log output ;-). Currently I do not have any idea what could be wrong in your job. I would start debugging in such - seldom - case.
I do usually much more complex things with a MySQL database, so I am a bit at loss with your problem. You could post the component settings of the output component, perhaps this brings more light in your issue.

Re: Records not inserted into mysql table

Anonymous — Thu, 02 Oct 2014 21:39:41 GMT

I just posted the component settings of the output component.

Re: Records not inserted into mysql table

Anonymous — Thu, 02 Oct 2014 21:41:01 GMT

Sorry, the resolution of your picture is by far to low to spot anything on it. Please use a bit higher solution.
I see you use an separate connection for the output component and the flow does not trigger anything after it. Please trigger with OnSubjobOk starting from your input component a tMysqlCommit. Now it is clear, you write and write and does nothing with the connection, not commit or close. Of course you will not see any data in your table.
It looks like you have added the connection somewhere on your job without handling the possibility of failure.
I would trigger from the tMysqlConnection with OnSubjobOk your flow (connect the trigger to the start component of your job).
We would have a much quicker solution of your problem if would have posted the whole picture of yur job and not only a snippet.

Re: Records not inserted into mysql table

Anonymous — Thu, 02 Oct 2014 22:01:22 GMT

Beautiful - Many thanks. Works well now, learning curve.
I've moved data into a MongoDB and didn't have to, assumed wrongly.
Thank you again.

Re: Records not inserted into mysql table

Anonymous — Thu, 02 Oct 2014 22:34:20 GMT

Yes the actions in a MongoDB are atomic transactional. Thats because you do not need an explicit commit. But the MySQL usually works transactional. You can configure the tMysqlConnection also als auto commit. In this case you would not need an explicit commit.