- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
storing into CSV only as incremental
Hi Everyone,
I made a daily report that i store into a CSV file, at the moment i'm storing complete loads of the data.
i want to store only the increment to the CSV file,
I thought about numbering the records and then making some variable to be the last loaded record
and then the next load will only load the records bigger then that number.
or adding RowNo() (=ID), then making a new variable to be the maximum (last row =MaxID)
and finally storing where ID<(Max(RowNo())-MaxID)
but i was'nt able to translate my idea to a correct syntax
any ideas on how to do it?
Thanks!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi,
how are you defining the incremental load?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Youssef,
Actually, i've tryed to do this without incremental load.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Ok,
when you say: "i want to store only the increment to the CSV file," what is the definition of incremental for you ?
it is every new reload? it is new daily, weekly, monthly data ?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
This is a daily report that takes the data from qvd's that are updated every few hours.
i want to keep sending the report daily, but not the entire report, just the new records that was generated since i last stored the report.
Thanks.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
for example lets say that yesterday the file had 100 rows, and since then another 10 was added,
i want to store into the file only the 10 that was added since last load(when there was 100)
thanks!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi
add reload time
reloadtime() as reloadtimer
in the load script of incremental load
and do a resident load on that table to pull the data which has max(reloadtimer)
like where reloadtimer=max(reloadtimer)
and then store this table in to csv.
done
Anand
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Thanks Anand,
If i do 'where reloadtimer=max(reloadtimer)' this won't give me a single value?