topic Re: Counting true/false occurences on XML in Talend Studio

Counting true/false occurences on XML

FPouget1651761130 — Thu, 05 May 2022 15:45:58 GMT

Hi,

I need to count specifics occurences on XML ("true" or "false") and get the results in a table

I try using a tXMLMap but so far without success.

Any idea where I can lookinf for?

My XML:

<?xml version="1.0" encoding="UTF-8"?>

</customer>

</customer>

</customer>

</customers>

Wishes result:

| vip | gold|

| 2 | 1 |

Re: Counting true/false occurences on XML

Anonymous — Fri, 06 May 2022 04:48:06 GMT

Using a tFileInputXML to read this XML file and extract vip and gold value, filter the 'true' value on tFilterRow and count it with tAggregateRow.

Please try and let me know if you have any questions.

Regards

Shong

Re: Counting true/false occurences on XML

FPouget1651761130 — Fri, 06 May 2022 10:33:48 GMT

Thanks I have a begin on something now 🙂

It works for the values "gold" and "vip" separately but how to count them together?

I tried to make the filter in a tXMLMap to have on one flow the "gold" values and on the other the "vip"values both followed by a tAggregateRow but then it doesn't seem possible to use a tUnite to group them.

Same with tReplicate ==> tFilterRow ==> tAggregateRow : impossible to use tUnite after ...

How I can proceed?

Re: Counting true/false occurences on XML

Anonymous — Sat, 07 May 2022 03:04:17 GMT

It is impossible to use tUnite after, this is not allowed to do in a cycle flow. As a workaround, you can store the counting result to global variable or context vairalbe on a tJavaRow, and then generate a new row for these two counting result on a tFixedFlowInput in next subjob.

eg:

....AggreGateRow--main--tJavaRow1

|onsubjobok

tFixeFlowInput--main--tLogRow

tJavaRow1:

context.sum_of_glod=input_row.gold

on tFixedFlowInput, define two columns:vip and glod, set their values with corresponding context variable.

Regards

Song

Re: Counting true/false occurences on XML

FPouget1651761130 — Wed, 11 May 2022 07:18:53 GMT

Thanks fot the tips

What I did:

tFileInputXml -> tXMLMap

-> tAggregateRow -> tfileOutputDelimited_1
-> tAggregateRow -> tfileOutputDelimited_2

|onsubjobok

tFileInputDelimited_1 --main--

tMap -> tfileOutputDelimited_3

tFileInputDelimited_2 --Lookup--

Re: Counting true/false occurences on XML

Anonymous — Wed, 11 May 2022 08:14:34 GMT

Thanks for your feedback! Personally, I'd like to store small temporary datasets in memory rather than writing to the filesystem.

Re: Counting true/false occurences on XML

FPouget1651761130 — Wed, 11 May 2022 08:58:50 GMT

my sample is small but my use case is huge 😉

Re: Counting true/false occurences on XML

Anonymous — Wed, 11 May 2022 09:27:03 GMT

This makes sense! In addition, remove the temporary file in the end of job if it isn't used any more; use context variable as file path if the job will be migrated to other environment, so that you can assign a new file path through job executable file if needed.