topic Replacing delimiter on load script in App Development

Replacing delimiter on load script

YanivZi — Thu, 19 Jan 2023 06:46:15 GMT

I have written my load script with delimiter of '%' and start loading the large txt file with many fields (100+). Some fields in the file has '%' inside and it breaks the output data. I have tried to replace the '%' with other chars but there is always some char in the fields that match and breaks the data.

How can I replace the '%' in the load process so that the data output will be correct?

txt file:

1%john%smith

2%je%an%smith

Example of wrong data i get

1	john	smith
2	je
3	an	smith

Desired data:

1	john	smith
2	jean	smith

Re: Replacing delimiter on load script

vinieme12 — Thu, 19 Jan 2023 07:00:50 GMT

I can't think of any logical way to identify which occurrence is garbage and which is not

1) Either have the data cleaned up at source

2) have the delimiter changed in the source file

Re: Replacing delimiter on load script

Mark_Little — Thu, 19 Jan 2023 07:28:42 GMT

As mentioned Qlik is picking up the file correctly. Normally in a delimeted file if the the delimter is with a word it wrap in qoutes i.e. 'Je%an' then it would know to ignore it.

I would say the file is the the issue and need to be corrected.