Does loading data from a .csv file put a lock on that file?

[DeeM]

Hi All

At our site we equipment that generates .csv files and I have developed a Qliksense app which loads data from the equipment .csv file.  

On occasion I get reports that the .csv has been corrupted, resulting in lost data.  The engineer responsible for the equipment is querying whether the Qlik App is putting a lock on the file and causing the issue.  As far as I understand the .csv file is generated when the equipment cycle is started and the equipment software writes data to the file until the cycle completes which could take 1 hour.  The Qlik App reads all the .csv files in the folder every 30mins.  

Is it likely that my Qlik App is causing the issue?  Any advise would be appreciated.

[Rohan]

Hi @DeeM ,

Ideally the Original Data Source(ODS) & the Data Source used to fetch data for reporting should be 2 different instances. Where the Reporting Data Source is a Replica of the ODS upto a certain time cut off.

Since you are reading csv files, you can have a batch code to move the latest file to a new folder from where Qlik will fetch data. This way even if Qlik is locking the files while reading it won't hamper your ODS.

Regards,

Rohan.