https://community.qlik.com/t5/Talend-Studio/text-file-import-problems/m-p/2363978#M127780 This isn't exactly what you need, but it should give you the idea. I wrote this tutorial on dealing with dynamic schemas using Talend Open Studio. I believe this method will work for you if you know the column headings you are expecting..... <BR /> <BR /> <A href="http://www.rilhia.com/node/38" rel="nofollow noopener noreferrer">http://www.rilhia.com/node/38</A> Wed, 08 Jul 2015 17:17:09 GMT Anonymous 2015-07-08T17:17:09Z https://community.qlik.com/t5/Talend-Studio/text-file-import-problems/m-p/2363977#M127779 <P>Hi, Help please... I've been trying to get this to work all day!<BR />I need to import an oracle .dat file created using the UTL_FILE functionality within Oracle.<BR />It is a Unicode&nbsp;text file formatted&nbsp;as follows (shortened):<BR /><BR />groupNbr|0100028<BR />language|<BR />extendedRangeProductNumber|<BR />articleLifecycleStatus|60<BR />Maximum Temperature Coefficient|+50ppm/°C<BR />Length|6.5mm<BR />Minimum Temperature Coefficient|-50ppm/°C<BR /><STRONG>EOR</STRONG><BR />groupNbr|0100034<BR />language|en<BR />extendedRangeProductNumber|<BR />articleLifecycleStatus|60<BR />Maximum Temperature Coefficient|+50ppm/°C<BR />Minimum Temperature Coefficient|-50ppm/°C<BR />Length|6.5mm<BR /><STRONG>EOR</STRONG><BR />groupNbr|0100040<BR />language|en<BR />extendedRangeProductNumber|<BR />articleLifecycleStatus|60<BR />Maximum Temperature Coefficient|+50ppm/°C<BR />Minimum Temperature Coefficient|-50ppm/°C<BR />Length|6.5mm<BR /><STRONG>EOR</STRONG><BR /><BR /><BR />The field separator is CRLF ("\r"+"\n") and the row separator is "EOR"+"\r"+"\n".<BR />I will take you through what I have done so far......<BR /><BR />The I can't get the tFileInputDelimited to recognise the end of the record so no records are passed.<BR />I have been able to get tFileInputMSDelimited to work using the same delimiters, and selecting a blank column as the record identifier (so it picks up all records)<BR /><BR />This works, until you realise that the data order is not always the same!! Look at the data above and you will see data 'Length' is in position 6 in the first record and in position 7 in the other two...<BR /><BR />I'm now thinking I need to read this file like a pseudo XML or JSON and use the value pairs to assign the table columns.<BR />Any ideas anyone?<BR /><BR />Bear in mind I need to process 20+ million records!<BR />Many thanks<BR />Ian</P> Wed, 08 Jul 2015 17:01:18 GMT https://community.qlik.com/t5/Talend-Studio/text-file-import-problems/m-p/2363977#M127779 IanM 2015-07-08T17:01:18Z https://community.qlik.com/t5/Talend-Studio/text-file-import-problems/m-p/2363978#M127780 This isn't exactly what you need, but it should give you the idea. I wrote this tutorial on dealing with dynamic schemas using Talend Open Studio. I believe this method will work for you if you know the column headings you are expecting..... <BR /> <BR /> <A href="http://www.rilhia.com/node/38" rel="nofollow noopener noreferrer">http://www.rilhia.com/node/38</A> Wed, 08 Jul 2015 17:17:09 GMT https://community.qlik.com/t5/Talend-Studio/text-file-import-problems/m-p/2363978#M127780 Anonymous 2015-07-08T17:17:09Z