topic Re: Iterate on a list of values in Talend Studio

Iterate on a list of values

tnewbie — Sat, 16 Nov 2024 04:36:02 GMT

Hello All,

I need to count the number of occurrences of certain predefined strings (but these may increase or decrease so want to make it data driven or file driven) against every line of incoming data (data coming in a file).

To explain further:

For each of this incoming lines of data i have to check the count of certain strings like

"ABC", "XYZ" ,"AAABC","UCAD1","DDEZY"

my incoming data is something like this:

California,ABC,123,Oct23Purview,ABCD,ABC,A,B,XYZ,UCAD1,ABC,DD,UCAD2,UCAD1 ---> line 1
Houston,XYZ,XYZ,Jan21Conclusion,ABC,AB,XYZ,XYZD,ABC,IDE123,IDE870,ABD,UCAD1 --> line 2

Output i am looking for is:

line 1 --ABC =3, XYZ = 1, AAABC=0,UCAD1=1, DDEZY=0

line 2 --ABC=2,XYZ=3 ,AAABC=0 ,UCAD1=1, DDEZY=0

Any thoughts please?

Re: Iterate on a list of values

Anonymous — Mon, 23 Sep 2019 21:06:36 GMT

Use Collections.frequency

String [] strs = new String[] {"ABC", "XYZ" ,"AAABC","UCAD1","DDEZY"};

ArrayList<String> ll = new ArrayList<>();

for (String s : strs){
	ll.add(s + "=" + Collections.frequency(Arrays.asList(row1.data.split(",")),s));
}

System.out.println(String.join(",", ll)); //ABC=3,XYZ=1,AAABC=0,UCAD1=2,DDEZY=0
                                          //ABC=2,XYZ=3,AAABC=0,UCAD1=1,DDEZY=0

Re: Iterate on a list of values

tnewbie — Tue, 24 Sep 2019 01:00:50 GMT

Hello evansdar, can you elaborate a bit, as to how you envision the solution

Re: Iterate on a list of values

tnewbie — Tue, 24 Sep 2019 14:41:37 GMT

Hello All,

Can you throw some light on this simple scenario...I am sure people working in Talend would have come across this situation, please spend a minute to read.

Re: Iterate on a list of values

Anonymous — Tue, 24 Sep 2019 19:53:03 GMT

Not sure what you're expecting here. My code does what you're asking, what more do you need?

Re: Iterate on a list of values

tnewbie — Tue, 24 Sep 2019 23:12:39 GMT

Hello evansdar,

Thanks for the time spent...I am an ETL person and i look for data driven approaches, as such i am not a Java person, so your proposed solution looks little constrained to me because the way you tried to push the strings into an array {"ABC", "XYZ" ,"AAABC","UCAD1","DDEZY"}; will confine the solution if I have to add / remove strings at a later point in time....also being a non-java person i didn't know how to include your code (probably a tjavaflex would have served the purpose, but i am not sure) .

I did move forward with a work around where i had all the strings as separate text files and used a tFileList which can dynamically source these values and play around with a context variable...though i could achieve the result, i am not personally convinced with the approach so was looking around to see if some other brains might have a better solution.

Thanks again

my_solution.png