topic Re: How delete 7,000 files inside SaaS DataFiles Folder in Management & Governance

How delete 7,000 files inside SaaS DataFiles Folder

pedrobergo — Fri, 02 Apr 2021 08:42:53 GMT

Hi,

I generated (for testing purposes) many files inside SaaS DataFiles folder, about 7,000 qvds. I wanna delete them using a batch command or action, but wihtin SaaS only can delete them one-by-one.

How can I delete about 7.000 files from my tenant?

P.S. I seek a solution in QLIK-CLI, but i didn´t found any command to do that.

Tks,

Pedro

Re: How delete 7,000 files inside SaaS DataFiles Folder

Jeffrey_Goldberg — Wed, 11 Nov 2020 00:13:45 GMT

@pedrobergo , I can help you. I will dm you in the morning us east. Please install qlik-cli by following directions on https://qlik.dev.

regards,

@Jeffrey_Goldberg

Re: How delete 7,000 files inside SaaS DataFiles Folder

pedrobergo — Wed, 11 Nov 2020 00:37:01 GMT

Hi @Jeffrey_Goldberg ,

Tks a lot. I consider that i´m have some know-how with qlik-cli, maybe not too much, but i´m already created scripts to upload automcatilly qvf, extensions, publish apps and sheets and create our demo environments.

Following directions on qlik.dev i didn´t found any mention about files manipulation. The 'qlik items ls | ConvertFrom-Json' command just response 'apps' resource-type.

Tks in advance,

Pedro

Re: How delete 7,000 files inside SaaS DataFiles Folder

Levi_Turner — Mon, 16 Nov 2020 21:34:35 GMT

$files = qlik raw get v1/qix-datafiles | ConvertFrom-Json while ($($files.Length) -gt 1) { foreach ($file in $files) { Write-Host "Deleting $($file.name)" qlik raw delete v1/qix-datafiles/$($file.id) | Out-Null } $files = qlik raw get v1/qix-datafiles | ConvertFrom-Json Write-Host 'Next page' }

Assumptions:

The files exist inside of the user's Personal DataFiles
The user wants all files gone

Re: How delete 7,000 files inside SaaS DataFiles Folder

Vincentzjecksen2021 — Mon, 08 Mar 2021 01:47:49 GMT

Hi, I'm new to qlik cli, appreciate it if you can provide the command line that delete specific group of files for instance, need to delete a group of QVD files that start with ABC and dated 3 months and above. Is it possible to do so? thank you.

Re: How delete 7,000 files inside SaaS DataFiles Folder

Dalton_Ruer — Fri, 26 Mar 2021 19:15:46 GMT

I can't give you the script but yes that would be possible. The API for "qix-datafiles" returns the name of the file as well as the createdDate and modifiedDate depending on which you are trying to use.

Re: How delete 7,000 files inside SaaS DataFiles Folder

wwengso314 — Tue, 27 Apr 2021 05:56:25 GMT

Hi, how can I delete the files in shared/managed spaces using qlik cli? Based on the above it is meant for the personal space only.

Re: How delete 7,000 files inside SaaS DataFiles Folder

didierodayo — Sat, 22 May 2021 15:14:27 GMT

Hi Jeffrey,

I have a similar situation with thousands of files I need to cleanup from a shared space. please are you able to share your script.

regards

Didier

Re: How delete 7,000 files inside SaaS DataFiles Folder

roywinkelvicta — Wed, 16 Jun 2021 08:56:44 GMT

Hi Levi,

Do you know where i can find the v1/qix-datafiles endpoint documentation?

thx

Re: How delete 7,000 files inside SaaS DataFiles Folder

pablolabbe — Wed, 23 Jun 2021 12:27:17 GMT

I have the same situation here with hundreds of files on a shared space that I need to delete. How to do it ?

Any thoughts @Levi_Turner , @Jeffrey_Goldberg ?

Thanks !

Re: How delete 7,000 files inside SaaS DataFiles Folder

pedrobergo — Thu, 24 Jun 2021 04:19:34 GMT

Hi @pablolabbe

See my github at https://github.com/pbergo/qlik-saas-utils and use the qlik_saas_delete.ps1 to remove these files.

You can pass the name of Space and file using wildcards to do that.

If you have any doubt, just can call me on WP.

[]

Pedro

Re: How delete 7,000 files inside SaaS DataFiles Folder

pablolabbe — Sat, 26 Jun 2021 20:26:32 GMT

You rock Pedro ! thank you !

Re: How delete 7,000 files inside SaaS DataFiles Folder

didierodayo — Mon, 12 Jul 2021 23:24:17 GMT

Thanks Pedro

Re: How delete 7,000 files inside SaaS DataFiles Folder

julian_rodriguez — Mon, 30 Aug 2021 15:40:57 GMT

Hello, I want to know if there is a command to copy QVD's between tenants or spaces.

Thanks

Re: How delete 7,000 files inside SaaS DataFiles Folder

Peter-Lawlor — Wed, 01 Sep 2021 14:22:09 GMT

As do I - you cannot even delete the space and start over (Not ideal tbh) due to the dependencies.

I tried to doctor the script above, but to no avail. unsure if there is a permissions issue deleting Managed folder files.

Re: How delete 7,000 files inside SaaS DataFiles Folder

pedrobergo — Mon, 06 Sep 2021 12:54:48 GMT

Hi @julian_rodriguez

I suggest you to open a new post that community can answer properly.

[],

Pedro

Re: How delete 7,000 files inside SaaS DataFiles Folder

simonaubert — Fri, 10 Sep 2021 08:45:31 GMT

Hello @pedrobergo

There is an idea to do it through script natively. Maybe that can interest you to vote for
https://community.qlik.com/t5/Suggest-an-Idea/Delete-Files-from-a-lib/idi-p/1689857

Best regards,

Simon

Re: How delete 7,000 files inside SaaS DataFiles Folder

Carl_Hunter — Mon, 01 Nov 2021 20:25:35 GMT

Did this API endpoint for CLI ever get released or documented? Can't see anything on Qlik.Dev 😞 be cool if app automations could do this...

Re: How delete 7,000 files inside SaaS DataFiles Folder

William_Wistam — Thu, 12 Jan 2023 21:04:10 GMT

Hi @Vincentzjecksen2021

For the file name, you can try "findstr -c:ABC".

I slightly modified @Levi_Turner scripts above.

For dated 3 months and above, I am not sure yet, maybe date -gt from createdDate will work but need to parse the date from createdDate.

Hope this help.

$files = qlik raw get v1/qix-datafiles | ConvertFrom-Json | findstr -c:name | findstr -c:ABC while ($($files.Length) -gt 1) { foreach ($file in $files) { Write-Host "Deleting $($file.name)" qlik raw delete v1/qix-datafiles/$($file.id) | Out-Null } $files = qlik raw get v1/qix-datafiles | ConvertFrom-Json Write-Host 'Next page' }

Sample:

id : 9a8f8f48-4574-cba51320a453
name : ABC.qvd
size : 1470407
createdDate : 2022-10-17T04:48:10.964Z
modifiedDate : 2022-10-17T04:48:11.262Z
ownerId : 64226107810cefd90c

Re: How delete 7,000 files inside SaaS DataFiles Folder

William_Wistam — Fri, 13 Jan 2023 16:27:34 GMT

Thank you @pedrobergo. In your github, I see upload and delete files. Is that possible to download files to local computer using these utilities? I spent hours yesterday trying to figure this out. Let me know. Thanks.