topic Re: Pulling a data from files in App Development

Pulling a data from files

anagha9489 — Sat, 16 Nov 2024 01:00:08 GMT

Hi Team,

I am using below script for pulling the data from particular path which is having excel files.T he excel files count are increasing day by day and below script is taking more and more time to get just the file details.

FOR Each File in filelist((Path))

FileDetails:
Load FileTime('$(File)') as FileTime,
'$(File)' as PathName
AutoGenerate 1;
Next File;

is there any alternate way to get all the data of excel files.

Re: Pulling a data from files

paulselousyoriz — Fri, 04 Dec 2020 15:48:22 GMT

You need to use a delta or incremental reload here.

For the next time you run the script add a line of code to store the FileDetails table in a qvd after the loop:

Set Path='E:\Test\File_*.qvd';

FOR Each File in filelist((Path))

FileDetails:
Load FileTime('$(File)') as FileTime,
'$(File)' as PathName
AutoGenerate 1;
Next File;

Store FileDetails into ['E:\Test\FD.qvd'] (qvd);"

Then amend the code so you read the qvd in before the loop and then in the loop do a Concatenate Load if a certain condition is met, such as the filetime being greater or equal to today and then at the end do not forget to leave in the new line of code to store the table to the qvd file:

Set Path='E:\Test\DM_*.qvd';

FileDetails:
Load
*
From ['E:\Test\FD.qvd'] (qvd);

FOR Each File in filelist((Path))

If NUM(FILETIME('$(File)')) > Num(Today()) Then

Concatenate(FileDetails)
Load FileTime('$(File)') as FileTime,
'$(File)' as PathName
AutoGenerate 1;
End If

Next File;

Store FileDetails into ['E:\Test\FD.qvd'] (qvd);

Let me know if this solves your problem.

Paul

Re: Pulling a data from files

anagha9489 — Thu, 17 Dec 2020 02:47:41 GMT

Hi ,

This is same what I am doing in the incremental script .But file functions like FileTime('$(File)') is taking time to get the file details. Is there any other way or any command by which i will get full list of files and its details like last modified time.