https://community.qlik.com/t5/Talend-Studio/resolved-How-to-log-all-records-in-csv-file-that-generate/m-p/2300348#M72582 Hello Team, <BR /> <BR />I am trying to read csv file and store its content in a database table. <BR />If a line in csv file is not properly formed, it throws an exception. I want to log all these lines in log file and process all the valid records. <BR />Please see attached a snapshot of what I have so far. I use FileInputDelimited to read file content, then I process it line by line using flowToIterate and FixedFlowInput, passing data to tMap and then to database. <BR />To log, I use tLogCatcher component attached to tLogRow. tLogCatcher is configured to catch java exceptions. <BR />I have two problems here. <BR />1. Assuming I have an invalid records in my csv file, error log file will not be created unless I check "Die on error" on the very first component (tFileInputDelimited). When I check "Die on error", log file containing only one error will be created and execution of the job will stop - not the desired scenario. I need to just log this record and keep processing the rest of the file. <BR />2. Even when this one record is created in log file, it does not contain the line from csv file. It only contains java error message. I need to have entire line from csv file that caused this error. I don't see how I can configure tLogRow and tLogCatcher with different schema to log what I need. I can probably get away with tJava components but is this a right way? <BR /> <BR />Your help would be very much appreciated. <BR /> <BR />Svetlana <BR /> <BR /> <span class="lia-inline-image-display-wrapper" image-alt="0683p000009MFtw.png"><img src="https://community.qlik.com/t5/image/serverpage/image-id/144787i146099532F658F3D/image-size/large?v=v2&amp;px=999" role="button" title="0683p000009MFtw.png" alt="0683p000009MFtw.png" /></span> Sat, 16 Nov 2024 10:12:32 GMT Anonymous 2024-11-16T10:12:32Z https://community.qlik.com/t5/Talend-Studio/resolved-How-to-log-all-records-in-csv-file-that-generate/m-p/2300348#M72582 Hello Team, <BR /> <BR />I am trying to read csv file and store its content in a database table. <BR />If a line in csv file is not properly formed, it throws an exception. I want to log all these lines in log file and process all the valid records. <BR />Please see attached a snapshot of what I have so far. I use FileInputDelimited to read file content, then I process it line by line using flowToIterate and FixedFlowInput, passing data to tMap and then to database. <BR />To log, I use tLogCatcher component attached to tLogRow. tLogCatcher is configured to catch java exceptions. <BR />I have two problems here. <BR />1. Assuming I have an invalid records in my csv file, error log file will not be created unless I check "Die on error" on the very first component (tFileInputDelimited). When I check "Die on error", log file containing only one error will be created and execution of the job will stop - not the desired scenario. I need to just log this record and keep processing the rest of the file. <BR />2. Even when this one record is created in log file, it does not contain the line from csv file. It only contains java error message. I need to have entire line from csv file that caused this error. I don't see how I can configure tLogRow and tLogCatcher with different schema to log what I need. I can probably get away with tJava components but is this a right way? <BR /> <BR />Your help would be very much appreciated. <BR /> <BR />Svetlana <BR /> <BR /> <span class="lia-inline-image-display-wrapper" image-alt="0683p000009MFtw.png"><img src="https://community.qlik.com/t5/image/serverpage/image-id/144787i146099532F658F3D/image-size/large?v=v2&amp;px=999" role="button" title="0683p000009MFtw.png" alt="0683p000009MFtw.png" /></span> Sat, 16 Nov 2024 10:12:32 GMT https://community.qlik.com/t5/Talend-Studio/resolved-How-to-log-all-records-in-csv-file-that-generate/m-p/2300348#M72582 Anonymous 2024-11-16T10:12:32Z https://community.qlik.com/t5/Talend-Studio/resolved-How-to-log-all-records-in-csv-file-that-generate/m-p/2300349#M72583 Hi,<BR />We see that this topic has been set as resolved. Feel free to let us know if this issue still repro on your side.<BR />Best regards<BR />Sabrina Tue, 13 Dec 2016 03:45:48 GMT https://community.qlik.com/t5/Talend-Studio/resolved-How-to-log-all-records-in-csv-file-that-generate/m-p/2300349#M72583 Anonymous 2016-12-13T03:45:48Z https://community.qlik.com/t5/Talend-Studio/resolved-How-to-log-all-records-in-csv-file-that-generate/m-p/2300350#M72584 Hi Svetlana, <BR />I am currently developing an ETL job that has the exact requirement that you have mentioned in your original post. <BR />I am eager to know how you managed to log the rows. <BR />Can you please let me know? <BR />Regards, <BR />Ketan Tue, 13 Dec 2016 09:16:46 GMT https://community.qlik.com/t5/Talend-Studio/resolved-How-to-log-all-records-in-csv-file-that-generate/m-p/2300350#M72584 Anonymous 2016-12-13T09:16:46Z