topic Re: Handling null values from a date column while passing it to context variable in Talend Studio

Handling null values from a date column while passing it to context variable

DEV4 — Sat, 16 Nov 2024 05:01:08 GMT

Hi All,

I have a scenario where I am passing the max value from a source date column in to a context variable. But because the source date column has nulls in it, Im getting the below warning and this is causing the job to fail at later point of time.

Please help on how to handle nulls.

Below is the message I get when I run the job.

[WARN ]: lmu_data_warehouse.hist_slate_data_ini_latest_0_1.HIST_SLATE_DATA_INI_LATEST - Null value will be used for context parameter max_decision_date: Unparseable date: " "

Thank You

Re: Handling null values from a date column while passing it to context variable

Anonymous — Fri, 09 Aug 2019 18:52:50 GMT

Hi,

Its not an error (I believe its coming from the previous job we had discussed). You can switch off the log4j to off or error mode as shown below to avoid it.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Re: Handling null values from a date column while passing it to context variable

DEV4 — Fri, 09 Aug 2019 19:13:16 GMT

Hi Nikhil,

I followed the changes per your recommendation and still getting the error related to null.

Please find the screenshots below.

Thank You

Re: Handling null values from a date column while passing it to context variable

Anonymous — Fri, 09 Aug 2019 19:16:24 GMT

Hi,

This issue is different. I would recommend you to check the trowgenerator (from previous post) and check whether you have given values for all the areas. It seems you have not given value to one of those steps (most probably line count).

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Re: Handling null values from a date column while passing it to context variable

DEV4 — Fri, 09 Aug 2019 19:23:54 GMT

Hi Nikhil,

Please find the screenshot below from tRowGenerator. I have followed exact same steps as per your previous post.

The only difference is that in the "Number of Rows for RowGenerator" section, I had to type ((Integer_globalMap.get("row5.INTERVAL")) manually as I was not getting the row5.INTERVAL column in the drop down which I used CTRL+SPACE.

Please suggest if Im missing anything.

Thank You

Re: Handling null values from a date column while passing it to context variable

DEV4 — Fri, 09 Aug 2019 19:40:35 GMT

Hi Nikhil,

For the sake of testing I just removed ((Integer)globalMap.get("row5.INTERVAL")) and input 100 over there and the job was running without throwing the error it used to earlier.

This shows there there is something wrong in the way I input the variable there. Please suggest where I went wrong.

The other observation was I killed the job to see how the data was populated to target table so far and observed that all nulls were being populated to the target. Please suggest.

Re: Handling null values from a date column while passing it to context variable

Anonymous — Fri, 09 Aug 2019 19:50:09 GMT

Hi,

Unfortunately I am in the middle of some other investigation. But to help you to progress, I am attaching the job I have created to test for your reference. I have used 7.2 version of Talend to create the job.

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

test.zip

Re: Handling null values from a date column while passing it to context variable

Anonymous — Fri, 09 Aug 2019 19:53:02 GMT

Hi,

Could you please check the schema is present correctly in tHashInput and tFlowtoIterate components? Most probably the interval column might be missing in your job. That is the reason it is not listing in drop down for tFlowtoIterate. It should be something minor. You have the sample job and the hint. I am sure you can crack the issue now 🙂

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Re: Handling null values from a date column while passing it to context variable

DEV4 — Fri, 09 Aug 2019 20:37:59 GMT

Thanks Nikhil. I will look in to the schema if every thing is correct. Im not able to import the file you shared as Im on 7.1.1 version.

Re: Handling null values from a date column while passing it to context variable

DEV4 — Fri, 09 Aug 2019 22:51:10 GMT

Hi Nikhil,

This time I have replicated the same job you provided me in previous post including same sample data.

But im getting the same error on tRowGenerator component. This time I even got the variables in drop down when I used ctrl+space.

Not sure where Im going wrong please help.

Re: Handling null values from a date column while passing it to context variable

Anonymous — Fri, 09 Aug 2019 23:15:12 GMT

Hi,

Ideally the count column should be visible when you give a Control space. Could you please download a free version of 7.2 and use my attached job for reference?

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved

Re: Handling null values from a date column while passing it to context variable

DEV4 — Fri, 09 Aug 2019 23:44:03 GMT

Hi Nikhil,

For some reason after the tconverttype component data was not being processed. I used tlogrow and got no records.

So I converted the data in tmap itself rather than using tconverttype and the rest I followed your steps and acheived my result.

Thank you very very much for your help.

Re: Handling null values from a date column while passing it to context variable

DEV4 — Sat, 10 Aug 2019 00:08:21 GMT

Hi Nikhil,

I did not check "Auto Cast" option in tconverttype earlier and hence that caused the problem.

My bad I over looked your screenshot.

Thanks again

Re: Handling null values from a date column while passing it to context variable

Anonymous — Sat, 10 Aug 2019 01:07:58 GMT

Perfect!

Could you please mark the topic as resolved?

Warm Regards,
Nikhil Thampi

Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved