Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 
Denis_L
Contributor III
Contributor III

Multiple Excel files load from dropbox in Qlik Sense Business

Hi All,

I am trying to load multiple excel files from dropbox folder on Qlik Sense Business environment.

I tried the following script:

LIB CONNECT TO 'Betting Stats:Dropbox - denis.m.u@gmail.com';

for each file in filelist('lib://Betting Stats:Dropbox - denis.m.u@gmail.com/Football Stats/27122018\*.xlsx')

Test:

load *

from [$(file)](ooxml, embedded labels, table is Match);

next file

 

the load  is working but it does not load any data.

Can you please let me know what I am missing or doing wrong?

Thanks

 

DM
Labels (1)
  • SaaS

1 Solution

Accepted Solutions
stevedark
Partner Ambassador/MVP
Partner Ambassador/MVP

Hi Denis,

I very much doubt it is the DROP TABLE which is causing the problem, rather that you have reached the end of the script.

It is quite safe to comment out that line and not drop the table. It will just be a data island in the data model with a list of files. The table isn't required though, and it is best practice to remove it.

If I had to guess what has gone wrong, it would be that one or more tables in the DropBox folder are not in an identical format. This will mean that when they load rather than concatenating they will load into separate tables in the data model, potentially with many common fields causing a large synthetic key. These will show in yellow text in the load progress dialog.

You can;

- Check the DropBox folder to ensure all files are in an identical format

- Check the filename in the loop to ensure the next file to load is one that matches the format

- List all the fields in the LOAD statement so that any rogue fields are ignored and files with missing fields fail to load (so you can identify and fix/remove them)

- Use the CONCATENATE keyword in front of the LOAD. If you go for this you will need to either do differently on the first iteration of the loop, or create a stub table before the loop so that you are always concatenating.

Or you can do all of these things, just to be sure!

Personally I would list all the fields rather than using a * as a matter of course. This could be enough to either fix or highlight your issue.

If not, please post back any error messages.

View solution in original post

24 Replies
johngouws
Partner - Specialist
Partner - Specialist

Hi Denis.

I am just checking. Does it work when you load a single file?  

johngouws
Partner - Specialist
Partner - Specialist

Hi Denis,
I think you just opened a bit of a hornets nest for me. I currently have a Client who wants to move to QSB. Part of the solution is that they share 'maintained' files with me on a weekly and monthly bases.
The current solution reads in the files as below. This works in QlikView and I just checks it in Sense Desktop, wher it also worked. 

I just checked this is QSB and the error looks like it cannot read wildcards. Cannot find "COMPANY 20*.xlsx". It looks like I will also be looking for a solution! Thanks for raising the issue.

This is my current script'

SET v_MonthlyFiles = [F:\_OneDrive\OneDrive\QlikSense\Data\Monthly Files];

DATA:
LOAD
........
FROM
[$(v_MonthlyFiles)\COMPANY 20*.xlsx]
(ooxml, embedded labels, table is Sheet2);

 

Rodj
Luminary Alumni
Luminary Alumni

It does seem to be the wildcard characters are the issue. I was just trying to use filelist on google drive but it fails to return anything with a wildcard. Naming a single file returns fine.

johngouws
Partner - Specialist
Partner - Specialist

I just tried the below in QSB: When addressing a single file I do get results. When using a wildcard I get no results. There  seems to be a wildcard issue. 

LIB CONNECT TO 'Dropbox';

for each file in filelist('lib://Dropbox/Sense_QVDs/Test/COMPANY 2019-09-25.xlsx') /*Returns results*/
// for each file in filelist('lib://Dropbox/Sense_QVDs/Test/COMPANY*.xlsx') /*NO results*/

DATA:
LOAD
.........
FROM [$(file)]
(ooxml, embedded labels, table is Sheet2);

Denis_L
Contributor III
Contributor III
Author

Thanks everyone for getting back and confirming that there is an issue with the wildcard.

This is unfortunately another limitation in QSB that is causing problems for me and my clients.

Hope Qlik will fix this as soon as possible but as of now there is a lot of disappointment from QSB.  

DM
johngouws
Partner - Specialist
Partner - Specialist

Hi Denis, 

I am not sure if you logged a support call yet. If not, if may be a good idea. 

Regards,

John

Denis_L
Contributor III
Contributor III
Author

HI John,

I will certainly do that.

Thank you for suggestion.

Denis 

DM
johngouws
Partner - Specialist
Partner - Specialist

Good Morning. 

I logged a Support call yesterday and received this reply. 

"Thank you for bringing this problem to our attention. Your issue as described below has been reported to our R&D department with ID QLIK-99500.
I will advise if the issue is confirmed as a defect as well as any other developments in this regard. Please accept my apologies for any inconvenience and let me know if you have any questions.
"

My workaround is to do the combining of the excel files in QV desktop and to STORE the qvd to dropbox. 

I will let you know when I hear back from Support. 

Regards,

John

Denis_L
Contributor III
Contributor III
Author

Thank you John!

I have logged a case as well but have not heard back yet.

Hope they will fix this and other issues with QSB as soon as possible.

DM