How can i reload data only select product

[Anonymous]

Hi,

Every month I received CSV file ( Large data or crore togther number of line items), when i was reload the data it will take time more than a day ( Very Slow). but i need to reload the data particular product.

If any option is there please suggest me,

[petter]

Even if it is a few tens of millions of rows you must have many columns in the CSV-file if it takes more than a day to load.

If you can't do anything to optimize you Qlik load script you might have to use any of these:

• PowerShell script to read and filter the CSV to get a smaller CSV with the relevant rows:
  • https://stackoverflow.com/questions/16028787/powershell-filter-csv
• Python script to do the same as above
  • https://softwarerecs.stackexchange.com/questions/7463/fastest-python-library-to-read-a-csv-file
• GAwk (awk): specialized text processing tool/language that is included in the Linux subsystem that can be installed on latest Windows versions.
• csvkit: A ready made command line toolkit for CSV (written in Python):
  • https://csvkit.readthedocs.io/en/1.0.3/index.html#
• gocsv: - " - (written in Go) claims to be faster and use less memory than csvkit:
  • https://github.com/DataFoxCo/gocsv
• xsv: - "- (written in Rust):
  • https://github.com/BurntSushi/xsv

[Anonymous]

i have an issue like that

[Frank_Hartmann]

Maybe use "Partial Reload".
This command executes only Load and Select (SQL) statements preceded by a Replace or Add prefix. Other data tables remain unaffected by the command.

hope this helps

[nikhil_deokar]

Hi,

To reload data for specific products use where condition on table while loading data.

for example:

Load 

.....,

....,

From table

Where Match(Product,'abc','xyz','klm');