Qlik Community

Ask a Question

QlikView App Dev

Discussion Board for collaboration related to QlikView App Development.

Announcements
Our next Qlik Insider session will cover new key capabilities. Join us August 11th REGISTER TODAY
cancel
Showing results for 
Search instead for 
Did you mean: 
jaryszek2
Creator
Creator

Storing into txt - very slow working

Hi I am storing about 1 million records to txt and whole process is very, very long (about + 30 minutes)

Why this is so long?

It is better to store it to csv or maybe some other formats?

Result table i have to link with Access database.

Best Wishes,

Jacek Antek

1 Solution

Accepted Solutions
vkish16161
Creator III
Creator III

You can try this:

1st pass: Try dumping all the data into a QVD first.

2nd pass: Use that QVD as source data and then dump it into txt.

if this is slow : You can try dumping it into .xlsx.

I believe Qlik doesn't allow a dump into an CSV

View solution in original post

6 Replies
jaryszek2
Creator
Creator
Author

Anyone ?

vishsaggi
Champion III
Champion III

Are you storing this into some shared location? How long is it taking when you store this csv or txt onto your local drive did you check?

vkish16161
Creator III
Creator III

You can try this:

1st pass: Try dumping all the data into a QVD first.

2nd pass: Use that QVD as source data and then dump it into txt.

if this is slow : You can try dumping it into .xlsx.

I believe Qlik doesn't allow a dump into an CSV

View solution in original post

rwunderlich
Luminary Alumni
Luminary Alumni

The Store (txt) format is CSV.  Is it any faster if you Store it to a QVD?

-Rob

marcus_sommer
MVP & Luminary
MVP & Luminary

I think if you want to use the output within Access the txt-format will be most suitable. Are you sure that really the storing-process needs so much time or it's more the creation of this table? Further is there enough RAM available if you execute this task? A lack of RAM could decrease the performance quite heavily. Another point is the performance of your storage/network and if this is quite poor it might be useful to store this table at first locally and transferring it afterwards with a triggerred batch-job.

- Marcus

jaryszek2
Creator
Creator
Author

Hi Guys,

sorry for my late answer.

I was abroad with no access to web.

I tried first solutions, so first storing my table into QVD and after that load it from qvd and store it into txt.

All took only 30 second, wow!

I am impressed.

Thank you very much for all your answers!

Best wishes,

Jacek Antek