Storing into txt - very slow working

[Anonymous]

Hi I am storing about 1 million records to txt and whole process is very, very long (about + 30 minutes)

Why this is so long?

It is better to store it to csv or maybe some other formats?

Result table i have to link with Access database.

Best Wishes,

Jacek Antek

[Anonymous]

Anyone ?

[vishsaggi]

Are you storing this into some shared location? How long is it taking when you store this csv or txt onto your local drive did you check?

[vkish16161 · Accepted solution]

You can try this:

1st pass: Try dumping all the data into a QVD first.

2nd pass: Use that QVD as source data and then dump it into txt.

if this is slow : You can try dumping it into .xlsx.

I believe Qlik doesn't allow a dump into an CSV

[rwunderlich]

The Store (txt) format is CSV.  Is it any faster if you Store it to a QVD?

-Rob

[marcus_sommer]

I think if you want to use the output within Access the txt-format will be most suitable. Are you sure that really the storing-process needs so much time or it's more the creation of this table? Further is there enough RAM available if you execute this task? A lack of RAM could decrease the performance quite heavily. Another point is the performance of your storage/network and if this is quite poor it might be useful to store this table at first locally and transferring it afterwards with a triggerred batch-job.

- Marcus

[Anonymous]

Hi Guys,

sorry for my late answer.

I was abroad with no access to web.

I tried first solutions, so first storing my table into QVD and after that load it from qvd and store it into txt.

All took only 30 second, wow!

I am impressed.

Thank you very much for all your answers!

Best wishes,

Jacek Antek