Load all files from folder ( FTP and DropBox)

[varmekontrol]

Hi

I am using Qlik sense Cloud to automatically reload data on a daily basis.

The data I would like to load consist of .csv files from one or more folders, so I don´t only want to load 1 file, but sometimes thousands.

Normally I would just make do this.

Load
    data1
    data2
FROM [lib://location-data/*]

But it fails when I am trying to do the same with DropBox

LIB CONNECT TO 'Valuereport (qlikcloud_qlikid)';
Load
    data1
    data2
FROM [lib://Valuereport (qlikcloud_qlikid_varmekontrol)/folder1\location-data\*]

And fails when doing it with FTP (Witch I would prefer)

Load
    data1
    data2
FROM [lib://valuereportsa (qlikcloud_qlikid)]

[marcus_sommer]

I'm not sure about dropbox - the synchronized dropbox folder on your local machine should work as datasource for loading with wildcards but per url I doubt that it will be possible.

By FTP no filefunctions which include wildcards will work else you will always need a absolute path or a batch which fetch the data before you could load them into Qlik. Here an example of it: Re: For Each File in Filelist - FTP load is not working?

- Marcus

[stevedark]

Has anyone got a wildcard working with DropBox in Qlik Sense Business?

For FTP on Enterprise (or Desktop) you can do it via Qlik Web Connectors, by downloading a file list and walking through it. As the Cloud connectors are based on QWC similar should be possible, except the FTP connector is not present yet.

In case it is useful to someone, here is my code for Sense Enterprise with QWC:

// Get a list of files from the FTP server
Temp_Files:
LOAD
Name as ftpName,
Path,
IsDirectory,
CreationTime,
LastWriteTime,
LastAccessTime,
Size
FROM [http://localhost:5555/data?connectorID=FileTransferConnector&table=SFTPListFilesAndFolders&host=$(vServer)&port=22&userName=$(vUserName)&password=$(vPassword)&remoteDirectory=$(vSourceFolder)$(sFolder)%2f&appID=]
(qvx);

STORE Temp_Files INTO [$(vSourceData)tmpFTP$(sFolder)Result.qvd] (qvd);

for iFile = 0 to NoOfRows('Temp_Files') -1

     let vSourceFile = Peek('ftpName', iFile, 'Temp_Files');

Results:
LOAD
1 as FileCount,
'$(vServerName)' as Server,
'$(vSourceFile)' as File,
Status as Status,
FileCount as Count
FROM [http://localhost:5555/data?connectorID=FileTransferConnector&table=SFTPDownload&host=$(vServer)&port=22&userName=$(vUserName)&password=$(vPassword)&passphrase=$(vPassphrase)&remotePath=$(vSourceFolder)$(sFolder)%2f$(vSourceFile)&targetDirectory=$(vFTPOutput)$(sFolder)%2f&appID=]
(qvx);

Hope that helps someone.

[chrisbrain]

Just to confirm, the Dropbox Web Storage Provider does not support wild cards as per the limitations section in the docs:

https://help.qlik.com/en-US/connectors/Subsystems/Web_Storage_Provider_Connectors_help/Content/Conne...

This post might also contain some useful info to people looking at this:

https://community.qlik.com/t5/Qlik-Connectors-Discussions/Wildcard-Load-in-Dropbox-for-Qlik-Sense-Bu...