Autonumber is consuming a large time to reload

[kishorj1982]

hi,

I am mentioning the script part from the log file,

2020-10-16 18:50:30 1732 LOAD DISTINCT [Date Key],
2020-10-16 18:50:30 1733 AutoNumber ([COPA Document Date], '%Date') as [%Date],
2020-10-16 18:50:30 1734 'Billing Document Date' as [%Date Selection]
2020-10-16 18:50:30 1735 RESIDENT Data
2020-10-16 18:50:30 1736 WHERE QVDsource = 'COPA Sales'
2020-10-16 20:17:52 3 fields found: Date Key, %Date, %Date Selection,

2020-10-16 20:45:20 1894 LOAD DISTINCT [Date Key] as [Date Key Temp3],
2020-10-16 20:45:20 1895 AutoNumber ([Sales Document Item Key], 'Date Key') as [Date Key]
2020-10-16 20:45:20 1896 RESIDENT Data
2020-10-16 20:45:20 1897 WHERE QVDsource = 'COPA Sales'
2020-10-16 21:57:02 2 fields found: Date Key Temp3, Date Key,
2020-10-16 21:57:02 15,498 lines fetched

It seems that the autonumner is consuming a large time to reload. If I can use autonumberhash256 there is no such impact.

Could you please suggest on this.

[forte]

Hi @kishorj1982 

You can use autonumber sentence at the end of you load script. 

Just erase autonumber function call on each load/keyfield

Call always key fields with same pattern, in example [%kMyExampleKeyField]

At the end of load script add next statement:

Autonumber [%k*];

It's Pretty faster and easier to control

Hope it helps

Regards

[kishorj1982]

Can you please share an example for the same? sorry, but I am unable to understand.

[NickD2]

Old thread but what Kishore was saying is that at the end of your script you can autonumber across tables all at once (every palce a field exists) but using something like his example

Autonumber [%k*];

what that line will do is apply the autonumber() to any field that starts with %k with * being the wild card.  It will do it for fields of the same name as their index.  For instance, you have 1 fact with %k fields of %k_date %key_your_massive_ concatenated_key_field    it will take each field and execute the autonumber on that field in all tables it exists then move to the next field and autonumber it .