topic Re: loading multiple csv files issue in App Development

loading multiple csv files issue

random_user_3869 — Thu, 12 May 2022 15:14:45 GMT

Hello i do the following statement,

for each vs_file in FileList('$(vL.DirectoryPath)*.csv')
Temp_Table:
LOAD
*
FROM [$(vs_file)]
(txt, utf8, embedded labels, delimiter is ',', msq, header is 11 lines);

next vs_file

I have a script error saying that the file has not been found.

anyone can help ?

Thanks

Re: loading multiple csv files issue

edwin — Thu, 12 May 2022 15:19:49 GMT

you should use the convention for the folder data connector. what i do is use the folder connector, add a script for just one of the CSV files so you can see the syntax for the data connection. replace the folder name inside the data connection.

then use that convention in your for each code

Re: loading multiple csv files issue

random_user_3869 — Thu, 12 May 2022 15:31:22 GMT

I don't understand what you mean by "use the convention for the folder data connector".

the vL.DirectoryPath = 'lib:.....' so the path i previously use without the variabel to get to the folder.

Sorry my english is not à 100% efficient.

Thank you for your feedback

Re: loading multiple csv files issue

edwin — Thu, 12 May 2022 20:14:57 GMT

we do a lot of guess work here. maybe check the full result f this:

$(vL.DirectoryPath)*.csv

thats my only suggestion

Re: loading multiple csv files issue

edwin — Thu, 12 May 2022 20:19:10 GMT

also per may prior suggestion using the wizrd, add one of the CSV file in your script and then compare with the result of your expression:

$(vL.DirectoryPath)*.csv

Re: loading multiple csv files issue

edwin — Thu, 12 May 2022 20:19:46 GMT

perhaps you are missing a slash or backslash

Re: loading multiple csv files issue

vinieme12 — Fri, 13 May 2022 08:37:14 GMT

please post a screenshot of the message

Re: loading multiple csv files issue

random_user_3869 — Fri, 13 May 2022 08:46:45 GMT

Hello,

The message is in french

basically it says that the file is not found.

it's like it doesnt't recognize the '*' caracter.

To add more information

at the end of my loop i have the following

FROM [$(vs_file)]
(txt, utf8, embedded labels, delimiter is ',', msq, header is 11 lines);

next vs_file

Thank you

Re: loading multiple csv files issue

vinieme12 — Fri, 13 May 2022 08:58:30 GMT

if you just want to load all csv files in a folder you don't need to loop thru each of them

Temp_Table:

Load *

From '$(vL.DirectoryPath)'&'*.csv'

(txt, utf8, embedded labels, delimiter is ',', msq, header is 11 lines);

Re: loading multiple csv files issue

random_user_3869 — Fri, 20 May 2022 15:01:51 GMT

Hello everyone,

sorry i forgot to say that i load the file from a document in a sharepoint folder (connection is working fine)

and i'm using qlik saas:

so basically when i do that it works:

LOAD
Attended,
"User Name (Original Name)",
"First Name",
"Last Name",
Email,
"Country/Region",
Organization,
"Registration Time",
"Approval Status",
"Join Time",
"Leave Time",
"Time in Session (minutes)",
"Type of organisation",
"Which maritime sector are you most interested in?",
Other?,
"Country/Region Name",
"Source Name"
FROM [lib://CMEMS Marketing - Développement:COMPANY SHAREPOINT/Documents partages/qlik/MODataConnexions/cmems/accounting/EventFiles/Zoom-MarineData4Europa_Workshop2-08122019.csv]
(txt, utf8, embedded labels, delimiter is ',', msq, header is 11 lines);

but when i do this

LOAD
*
FROM [lib://CMEMS Marketing - Développement:COMPANY SHAREPOINT/Documents partages/qlik/MODataConnexions/cmems/accounting/EventFiles/Zoom-MarineData4Europa_*.csv]
(txt, utf8, embedded labels, delimiter is ',', msq, header is 11 lines);

it doesn't work anymore.

Is '*' caracter not working iin qlik saas anymore ?

thanks

Re: loading multiple csv files issue

Adinaa — Wed, 13 Mar 2024 09:50:49 GMT

Hello,

I have the same problem.

Did you find the solution to this issue?

Thanks!

Re: loading multiple csv files issue

random_user_3869 — Wed, 13 Mar 2024 10:01:56 GMT

Hello @Adinaa ,

Do your csv files have the same structure (same field, column, headers at the same row level) ?

I think that the error regarding my issue was

FROM [$(vs_file)]
(txt, utf8, embedded labels, delimiter is ',', msq, header is 11 lines);

The header for the csv files were not the same and as a consequence the statement could not work.