I'm hitting an issue when running a bulk import to Marketo using the built in tMarketoBulkExec component. I can't locate documentation saying what fields must not be null. If I run the job locally it will fail sporadically. Does anyone have further insights on using this component?
Exception in component tMarketoBulkExec_1 (ToMarketo)
java.lang.NullPointerException
at org.talend.components.marketo.runtime.client.MarketoBulkExecClient.bulkImport(MarketoBulkExecClient.java:212)
at org.talend.components.marketo.runtime.MarketoBulkExecReader.start(MarketoBulkExecReader.java:76)
at org.talend.codegen.flowvariables.runtime.FlowVariablesReader.start(FlowVariablesReader.java:73)
at marketo_integration.tomarketo_0_5.ToMarketo.tFileList_1Process(ToMarketo.java:15848)
at marketo_integration.tomarketo_0_5.ToMarketo.tCheckpoint_3Process(ToMarketo.java:18837)
at marketo_integration.tomarketo_0_5.ToMarketo.tCheckpoint_2Process(ToMarketo.java:18578)
at marketo_integration.tomarketo_0_5.ToMarketo.tCheckpointStart_1Process(ToMarketo.java:18293)
at marketo_integration.tomarketo_0_5.ToMarketo.runJobInTOS(ToMarketo.java:19461)
at marketo_integration.tomarketo_0_5.ToMarketo.main(ToMarketo.java:19194)
Bulk Marketo Error java.lang.NullPointerException
I've been running this job and monitoring it for the past 4 hours and I did end up making one change. I had one file that was routinely giving me an error, so I split the 30k rows to 1k chunks and loaded each, monitoring the logs folder. I didn't have any errors, but had some warnings tied to a date field.
I saw some Marketo documentation says to pass 'NULL' when you want a null value to be present, which isn't valid for java Date objects. So I now translate from a Date to a String in a tMap variable.
Could you please share the component details screen shots for basic and advanced sections of the component? It will give insight to other community members about possible problems in current setup.
The only chance of Null values here is in file path, schema and password. You seems to have given right password and file path (for cross checking, please print and check).
Could you please check the schema and whether it is matching with input data (like Not null column getting null value scenario).
You bring up a good point @nthampi, in Marketo's field management console, I don't believe I can see which fields are allowed to be null. I do make sure email and a few custom fields are populated so that they're a usable lead, but there doesn't appear to be general rules otherwise.
I've been running this job and monitoring it for the past 4 hours and I did end up making one change. I had one file that was routinely giving me an error, so I split the 30k rows to 1k chunks and loaded each, monitoring the logs folder. I didn't have any errors, but had some warnings tied to a date field.
I saw some Marketo documentation says to pass 'NULL' when you want a null value to be present, which isn't valid for java Date objects. So I now translate from a Date to a String in a tMap variable.
Thanks for the update. Could you please mark the topic as closed so that our fellow Talend community members know that solution is available for this topic?
The jobs ran this morning on the server and experienced the same error in the tMarketoBulkExec component. My changes didn't bring a resolution. Additionally, the logs folder does not contain failures or warnings.
I'm leaning toward the issue being with the tFileOutputDelimited that I'm using to generate the files. Or an interaction between the two?
If I move the first 1000 lines from a file that produces a null error in the marketo component and have the same Talend job import it, it succeeds. Then if I send the other 29000 entries, that file succeeds. The simple action of opening the output file and saving it in VI doesn't resolve the issue.
I've had 3 of 16 files for today fail and have a further 13 to go.
