Drop some XML records from a file

slupdike — Thu, 19 Jul 2018 20:34:40 GMT

Hello, I am trying to use CRC to winnow down an XML file to only records that are new or have changed since the last ingest. I am using tFileInputXML to pull the "primary key" (RefId / attribute) and the top level of the individual XML records. This is workling. I end up with the RefId, a field that holds the entire XML record for that person, and by sending the flow into a tAddCRCRow, a CRC for each record. In the next step, I want to take this file and drop some of the records (based on my CRC processing) and re-assemble the records that are left back into a valid XML file. Basically, if I GET 1000 records, and only 2 have changed since the last time a I ingested these records, i only want to send the 2 changed records on for all of the additional processing. I have tried using the XML output components, but I think because I already have the XML tags in the file, the component can't handle it. Does anyone know if if there is a way to do this, or do I have to break the XML into a flat file, remove the records I want to delete, and re-map everything back into the XML structure. Thanks!

Re: Drop some XML records from a file

Anonymous — Thu, 26 Jul 2018 10:17:58 GMT

Hello,

Could you please elaborate your case with an example with input and expected output values?

Best regards

Sabrina

Re: Drop some XML records from a file

slupdike — Thu, 26 Jul 2018 15:26:40 GMT

I finally got it to work by using treating the XML file as a delimited text file and using tReplace to correct the XML.

Re: Drop some XML records from a file

Anonymous — Fri, 27 Jul 2018 03:30:23 GMT

Hello,

Great you got it to work. Thanks for sharing your solution with us.

Best regards

Sabrina

topic Drop some XML records from a file in Talend Studio

Drop some XML records from a file

Re: Drop some XML records from a file

Re: Drop some XML records from a file

Re: Drop some XML records from a file