Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Hello, I am trying to use CRC to winnow down an XML file to only records that are new or have changed since the last ingest. I am using tFileInputXML to pull the "primary key" (RefId / attribute) and the top level of the individual XML records. This is workling. I end up with the RefId, a field that holds the entire XML record for that person, and by sending the flow into a tAddCRCRow, a CRC for each record. In the next step, I want to take this file and drop some of the records (based on my CRC processing) and re-assemble the records that are left back into a valid XML file. Basically, if I GET 1000 records, and only 2 have changed since the last time a I ingested these records, i only want to send the 2 changed records on for all of the additional processing. I have tried using the XML output components, but I think because I already have the XML tags in the file, the component can't handle it. Does anyone know if if there is a way to do this, or do I have to break the XML into a flat file, remove the records I want to delete, and re-map everything back into the XML structure. Thanks!
I finally got it to work by using treating the XML file as a delimited text file and using tReplace to correct the XML.
Hello,
Could you please elaborate your case with an example with input and expected output values?
Best regards
Sabrina
I finally got it to work by using treating the XML file as a delimited text file and using tReplace to correct the XML.
Hello,
Great you got it to work. Thanks for sharing your solution with us.
Best regards
Sabrina