Unlock a world of possibilities! Login now and discover the exclusive benefits awaiting you.
Is there any alternate/optimized way (Maybe Interval match?) to achieve same result. I managed to get the result using below script but reload time is close to 35 minutes.
MainTable : 10 million rows
Table2 : 2.5 million rows
Temp:
Load
AutoNumberhash256([ID1],DATE1) as Key,
[Order number],
DATE1
RESIDENT MainTable
Where match([Status],'QW','PP');
left join (Temp)
Table2:
Load *,
AutoNumberhash256([ID2],DATE2) as Key;
Load
ID2,
DATE(FLOOR(DATE2),'M/D/YYYY') as DATE2,
Price
;
select * from table2;
Autonumbers and preceding loads are slow operations.
How performant are your statements without the join (only the left part, and then only the right part)?
Is this is acceptable, you can also try to store each results in temporarily QVD files, drop the tables and reload them. Sometimes going through intermediate QVDs can help.