[ClaimsHistory]: first 10000 LOAD [Year], [YearMonth], [Adjuster Checker], [Adj Checker Desc], [Name 1], [Name 1 Qualifier], [Name 2]; SQLSelect [Year], [Month], IF CHAR([Month])= '1' THEN [Year]&'0'&[Month] ELSE [Year]&[Month] as [YearMonth], [Adjuster Checker], [Adj Checker Desc], [Name 1], [Name 1 Qualifier], [Name 2] FROM DataMart.Class."Open_Claims_History"; //Where 'YearMonth' > '$(vLoadDate)'; <------ To be used once I can get the yearmonth working.
1 as junk
resident [ClaimsHistory] Where 'YearMonth' > '$(vLoadDate)';
Thanks Sunil, but the problem is that I need to avoid loading * as there are many millions of rows per year.
I need the YearMonth field to allow me to create an incremental load so that I load everything that is newer than my current qvd data set.
There are 80 fields, many more calculated in this data extract and I am trying to make this as efficient as possible. By only pulling in a months worth of data at a time, I will be retreiving 500,000 rows for every hit, rather than 20 years worth of data each time.