topic Re: how to filter the column data using Tmap or using any other component.? in Talend Studio

how to filter the column data using Tmap or using any other component.?

amit_n — Sat, 16 Nov 2024 07:04:02 GMT

how to filter the column data using Tmap or using any other component.?

Please find the attached sample screen shot.

How to filter the column which is having InstanceID inside the dimension column. filter the InstabceID based in ID available .

eg: InstanceID = 1ccc219a-db2f-4877-87e0-f19cd8d31420 ---> one file

InstanceId = e339090a-0c18-49de-993f-0c8c3fc57721 ---> to another file.

Re: how to filter the column data using Tmap or using any other component.?

Anonymous — Wed, 12 Dec 2018 10:59:01 GMT

Hi,

The data in that column is in JSON format. Please use tExtractJSONFields component to extract the data to separate columns. Once the data is available for instance ID in separate column, you can filter using expression column in tMap for downstream activities.

Please refer the below link for details about component.

https://help.talend.com/reader/mjoDghHoMPI0yuyZ83a13Q/LcNrhqdlyheCLpwyUwgJQw

If the answer has helped you, could you please mark the topic as resolved? Kudos are also welcome 🙂

Warm Regards,

Nikhil Thampi

Re: how to filter the column data using Tmap or using any other component.?

amit_n — Wed, 12 Dec 2018 11:28:33 GMT

As i m using Talend open source . The dimension column will be keep on changing every time, the columns inside the dimension its not constant. So i have kept it in single column.

after converting the json to csv file these are the columns data has.

I need to filter the dimension column which is having InstanceID based on the ID.

Re: how to filter the column data using Tmap or using any other component.?

Anonymous — Thu, 13 Dec 2018 05:18:13 GMT

Hi,

Could you please provide the sample data in a csv file and file share it to Talend community?

It is very difficult to setup and data from screen shots.

Warm Regards,

Nikhil Thampi

Re: how to filter the column data using Tmap or using any other component.?

amit_n — Thu, 13 Dec 2018 07:54:29 GMT

Could you please share ur mail ID. so can send u the sample file to ur mail.

Re: how to filter the column data using Tmap or using any other component.?

Anonymous — Thu, 13 Dec 2018 07:57:01 GMT

Hi,

Please post it in community as attachment after removing confidential details. The aim of the community is that everyone can learn together. So if the attachment is available in community, it will help everyone to learn 🙂

Warm Regards,

Nikhil Thampi

Re: how to filter the column data using Tmap or using any other component.?

amit_n — Thu, 13 Dec 2018 08:19:32 GMT

Please find the attached sample file for ur reference. We need to filter the column based on InstanceID.

sample_file.xlsx

Re: how to filter the column data using Tmap or using any other component.?

Anonymous — Thu, 13 Dec 2018 09:48:07 GMT

Hi,

Please refer the below job flow for results.

The component screenshots are as below.input excel read

Json extract

remove empty rows

tFlowtoIterate

trowgenerate

output in separate files

Please refer the output files below.

Could you please mark the topic as resolved since solution has been provided? Kudos are also welcome 🙂

Warm Regards,

Nikhil Thampi

Re: how to filter the column data using Tmap or using any other component.?

amit_n — Thu, 13 Dec 2018 10:28:13 GMT

Thank you so much for the solution. I ll implement it in my job. If get any doubt i will reply back.

Re: how to filter the column data using Tmap or using any other component.?

amit_n — Mon, 17 Dec 2018 07:45:01 GMT

Hi Nikhil,

I have one more requirement . I have to split the columns which are inside the column,

I have attached the file. Please let me know how to split property column furthur.

split_property.txt