connection with sharepoint/share drive- appending the data on addition of new file.

[meenakshi_m]

Hello,

once the connection is established with share point and share drive . Can a script be written to schedule to append the data when new file is added in the share drive /share point .

So basically the upload should happen automatically when there is new file in share drive or share point.

[stevedark · Accepted solution]

Hi @meenakshi_m 

You would need to have a process that frequently polls for new data and then appends that to a QVD if found. Out of the box you would need to reload the incrementally loaded QVD after every check - whether it changed or not. This is not ideal.

It should be possible to trigger a load only if new data are found - but this is a chunk of work and is not supported natively by Sense.

A kludgy way of doing it would be to have the incremental part of the load fail if no new data are found and then only have the front end load happen on successful reload of the QVD generator.

This post may give you some further ideas:
https://www.quickintelligence.co.uk/convert-drop-folder-files-qvd/

Steve

[meenakshi_m]

Hi Steve,

Thanks for the solution this worked. But facing issue with Date format on the converted QVD files while evaluating some filters on past data

Have tried date format but is not helping .can you please show where to exactly include the date format in you incremental code.

Appreciate your help!Thanks.

[stevedark]

Hi @meenakshi_m 

Is that a date field within the file you are loading or the date of the files you are loading?

What file format is it that you are loading from SharePoint?

How does the date look in a Filter Pane if you don't do anything to it when you load?

If it looks like a date, but sorts incorrectly and messes up when you try and break it down you probably need to do a date#  on it to convert it to a numeric, and then a date function to format it. This should happen in the load;

DateField as RawDate,
Date(Date#(DateFIeld, 'YYYYMMDD', 'DD MMM YYYY') as Date,

You can then do a preceding load on this to put that date into Months and Year etc.

Hope that helps.

Steve

[meenakshi_m]

hi Steve,

Thanks this has helped.all these works fine when connecting to shared drive.

But how do I set the same code to work on share point.

Could you please help if there is any need change in code which need to be done while connecting to share point.

appreciate your help.

[stevedark]

Hi @meenakshi_m 

Loading from SharePoint is a different topic, and how you go about it depends on what version of Qlik you are using, whether it is Sense on Prem, Sense SaaS or QlikView.

You will probably want to be using a connector which will download a list of files on the SharePoint server into a table. This will take the place of for each vFile in FileList. To enumerate around a table you need to do for iFile = 0 to NoOfRows('TableName') -1 and then use the PEEK function to get all of the values from the table.

For a time it was not possible to load the files directly from SharePoint, but I believe it now is. I've been involved in some threads on this in Community, but I can't seem to find any now. Suggest searching the forums to see if someone has a solution.

Connecting with other cloud file sharing services is not a problem. I've blogged on this here:
https://www.quickintelligence.co.uk/cloud-file-services-qlik-sense/

Hope you can get the SharePoint connection working.

Cheers,
Steve

[meenakshi_m]

Hi Steve

Appreciate your respond on same.Have been trying to find but did not get any satisfactory solution .So the requirement is there are files uploaded in share point 2016 during different days of month .And these files should be updated in my Qlik sense app.

what connector is required to download the list of files on the share point server into a table. How and Where this is done.Could you please provide more details with steps required. Thank you

Meenakshi Mantri

[stevedark]

Sure. Which flavour of Sense are you using? Enterprise, SaaS or Desktop? 

[meenakshi_m]

Hi Steve,

Thanks for your help.This is Enterprise Version.

I am to connect to share point and retrieve 1 XLSX file .I  understand that I need to get the list of files present in share point and then create a loop. But I am not aware on how to get the list of files from share point dynamically.(list should be updated when new file is added)

[meenakshi_m]

Hello Steve dark,

Any luck please.