11 Replies Latest reply: Jun 18, 2014 10:09 AM by Jacob Kean RSS

    Loading New Data From QVSource

      Hi everyone,

       

      I am trying to reload new data from some connectors (Facebook Fan Page and Twitter) using QVSource.

       

      This is how it goes:

       

      1) First reload, stores stuff into QVDs, good, I create a 'timestamp' field for each table, and set a variable to record the time of the update.

       

      2) Try to reload new data into temp tables, where timestamp > variable. This does not work.

       

      3) Assuming the above worked, I would concat my old QVDs to the new temp tables and store the new temp tables into the QVD.

       

      I have tried setting the since_id parameter in the qvsource url to the variable, but to no success.

       

      Where am I going wrong here?