4 Replies Latest reply: Dec 7, 2012 4:13 AM by Hui Ming Wang RSS

    Filtering QV recrods in memory is slower than loading from file

    Hui Ming Wang

      I have the below code which will

      1. Read a qvd file,
      2. Filter the data and
      3. Store it to another qvd file.

       

      IN_TABLE:
      LOAD *
      FROM [.\INPUT.qvd] (qvd);
      
      OUT_TABLE:
      LOAD *
      Resident IN_TABLE
      WHERE DATA_TYPE_ID=200;
      
      Store OUT_TABLE into [.\OUTPUT.qvd];
      

       

      But during the filtering process (where statment), it scan thur the IN_TABLE very slowly.

       

      Am I doing it wrong?

      Is there any way to speed up the filtering?