rows are missing while loading to mysql

[Anonymous]

Hi,

I was reading a JSON file with 1441 records and tried to load it to MySQL server. After loading, I can see that only 1369 rows are inserted. I checked schema to see whether there is any truncation issue and found no issues. Can anyone help me with this?

[ankit7359]

Hi @amruthqs4talend,

Can you pls check the connection in the sql builder of the tmysqloutputbulkexec component.. and pls check 

append option and action on table and action on data....

Here is the link for output component: https://help.talend.com/reader/hCrOzogIwKfuR3mPf~LydA/7cjWwNfCqPnCvCSyETEpIQ

One of the reason could also be that the after the insertion the commit for them isnt done.

Pls do get back to Community,if necessary.

Thanks,

Ankit.

[Anonymous]

I am using tdboutputbulkexec component and it has "action on table" option, not the "action on data". I am using drop table if exist and create option. 

[ankit7359]

Hi @amruthqs4talend,

Which Talend version are you using ???

I ll try to look from my end. How i can help 

Thanks,

Ankit

[Anonymous]

I am using Talend Open Studio for Data Integration Version: 7.1.1.

Thanks a lot..

[ankit7359]

Hi @amruthqs4talend,

I have a query though, why exactly are you using tlogrow in between json object and output component?

is the schema checked??

I apologise,but i use talend 6.3.2 where i dont have this tdb - component.?

But i will try to look..what can be done.

Thanks,

Ankit.

[Anonymous]

Hi,

Some older community messages suggested the usage of tlogrow. It shows me the records in talend output window and prints 1441 records. 

Thanks,

Amrutha

[sbxr]

Hey Can you check the length of the data field in the output. may be this can help.

[Anonymous]

hi,

I have checked the length of columns and it was same as auto-selected by schema. This was my first guess when things did not work out.

Thanks,

Amrutha

[Anonymous]

Hi,

   Could you please try some basic verifications as stated below?

a) Try to replace the bulk component with tMysqlOutput component with Die on Error option enabled and retaining current schema setup. This will show the error you are facing if its related to schema or data errors.

b) Setup the schema length according to target columns in DB. If necessary, add a schema check component in between.

c) Once these verification are over, replace the output component with Bulk component and run the flow again and see the output.  

Hope it should help to identify the root cause.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved 🙂