topic Re: Null exceptions in tMarketoBulkExec in Talend Studio

Null exceptions in tMarketoBulkExec

Ed6 — Mon, 26 Nov 2018 15:43:30 GMT

I'm hitting an issue when running a bulk import to Marketo using the built in tMarketoBulkExec component. I can't locate documentation saying what fields must not be null. If I run the job locally it will fail sporadically. Does anyone have further insights on using this component?

Exception in component tMarketoBulkExec_1 (ToMarketo)
java.lang.NullPointerException
	at org.talend.components.marketo.runtime.client.MarketoBulkExecClient.bulkImport(MarketoBulkExecClient.java:212)
	at org.talend.components.marketo.runtime.MarketoBulkExecReader.start(MarketoBulkExecReader.java:76)
	at org.talend.codegen.flowvariables.runtime.FlowVariablesReader.start(FlowVariablesReader.java:73)
	at marketo_integration.tomarketo_0_5.ToMarketo.tFileList_1Process(ToMarketo.java:15848)
	at marketo_integration.tomarketo_0_5.ToMarketo.tCheckpoint_3Process(ToMarketo.java:18837)
	at marketo_integration.tomarketo_0_5.ToMarketo.tCheckpoint_2Process(ToMarketo.java:18578)
	at marketo_integration.tomarketo_0_5.ToMarketo.tCheckpointStart_1Process(ToMarketo.java:18293)
	at marketo_integration.tomarketo_0_5.ToMarketo.runJobInTOS(ToMarketo.java:19461)
	at marketo_integration.tomarketo_0_5.ToMarketo.main(ToMarketo.java:19194)
Bulk Marketo Error java.lang.NullPointerException

Re: Null exceptions in tMarketoBulkExec

Anonymous — Wed, 28 Nov 2018 07:49:49 GMT

Hi,

Could you please share the component details screen shots for basic and advanced sections of the component? It will give insight to other community members about possible problems in current setup.

Warm Regards,

Nikhil Thampi

Re: Null exceptions in tMarketoBulkExec

Ed6 — Wed, 28 Nov 2018 19:07:11 GMT

Sure, no fancy settings. I upload 25+ files of 30k rows, just to make sure I stay under the endpoint ceiling of 10mb.

Re: Null exceptions in tMarketoBulkExec

Anonymous — Thu, 29 Nov 2018 05:06:39 GMT

Interesting!

The only chance of Null values here is in file path, schema and password. You seems to have given right password and file path (for cross checking, please print and check).

Could you please check the schema and whether it is matching with input data (like Not null column getting null value scenario).

Warm Regards,

Nikhil Thampi

Re: Null exceptions in tMarketoBulkExec

Ed6 — Thu, 29 Nov 2018 18:21:41 GMT

You bring up a good point @nthampi, in Marketo's field management console, I don't believe I can see which fields are allowed to be null. I do make sure email and a few custom fields are populated so that they're a usable lead, but there doesn't appear to be general rules otherwise.

Re: Null exceptions in tMarketoBulkExec

Ed6 — Thu, 29 Nov 2018 20:02:49 GMT

I've been running this job and monitoring it for the past 4 hours and I did end up making one change. I had one file that was routinely giving me an error, so I split the 30k rows to 1k chunks and loaded each, monitoring the logs folder. I didn't have any errors, but had some warnings tied to a date field.

I saw some Marketo documentation says to pass 'NULL' when you want a null value to be present, which isn't valid for java Date objects. So I now translate from a Date to a String in a tMap variable.

(null!=row.DATE)?TalendDate.formatDate("yyyy-MM-dd'T'HH:mm:ss'-05:00'",row.DATE):"NULL"

Your results may vary. Keep in mind I'm formatting the date for central USA.

Re: Null exceptions in tMarketoBulkExec

Anonymous — Fri, 30 Nov 2018 04:36:44 GMT

Hi Ed,

Thanks for the update. Could you please mark the topic as closed so that our fellow Talend community members know that solution is available for this topic?

Warm Regards,

Nikhil Thampi

Re: Null exceptions in tMarketoBulkExec

Ed6 — Fri, 30 Nov 2018 15:10:54 GMT

The jobs ran this morning on the server and experienced the same error in the tMarketoBulkExec component. My changes didn't bring a resolution. Additionally, the logs folder does not contain failures or warnings.

Re: Null exceptions in tMarketoBulkExec

Anonymous — Fri, 30 Nov 2018 15:15:36 GMT

Hi Ed,

Can you try to populate the same data to Marketo manually and see the whether its working fine in that case?

We need to figure it out whether the issue is due to data or component.

Warm Regards,

Nikhil Thampi

Re: Null exceptions in tMarketoBulkExec

Ed6 — Fri, 30 Nov 2018 15:31:26 GMT

I'm leaning toward the issue being with the tFileOutputDelimited that I'm using to generate the files. Or an interaction between the two?

If I move the first 1000 lines from a file that produces a null error in the marketo component and have the same Talend job import it, it succeeds. Then if I send the other 29000 entries, that file succeeds. The simple action of opening the output file and saving it in VI doesn't resolve the issue.

I've had 3 of 16 files for today fail and have a further 13 to go.

Screen Shot 2018-11-30 at 9.26.35 AM.png
Screen Shot 2018-11-30 at 9.26.41 AM.png