Problems ussing Mapping and Applymap

[#1]

Hi to all

Im trying to use the Mapping and ApplyMap concepts. But im having problems.

Let me explain the goal that i wanna to achieve:

The main problem its that i have a huge database in terms of quantity of records. around 15 millons per week.

The problem its that i have to find the way to reduce the cost of memory used to load all the records.

So, one options its the mapping way, as i read in others post. If someone have other solutions, please, feel free to tell it.

So. My idea its to bring out those fields that are used to describe something, like type of Call, or Vendor, and so on.

I have not a paralel database with cod and description so, the first thing i do its to create one with a group by command:

ResumenCALLCENTER:

load

  CALLCENTER,

  count(DISTINCT CALLCENTER) as Cuenta

resident Llamados_Tot

group by CALLCENTER;

Then, i try to apply the mapping concept:

MATCHCALLCENTER:

Mapping LOAD

  AutoNumber(CALLCENTER) as Codigo_CALLCENTER,

  CALLCENTER

Resident ResumenCALLCENTER;

I use the autonumber functions because, like i said, i have not a reference database.

After that, i try to apply the applymap concept in load sentence:

LLAMADOS_EXT:

LOAD IDCALL,

     IDCALL_Cont,

     ORIGEN,

    ApplyMap('MATCHCALLCENTER', CALLCENTER, 'SinDatos') AS CALLCENTER,

    vendedor

FROM

E:\Datos\Llamados_Ext_Bim_012013.qvd (qvd);

What im doing in the wron way? If I replace "CALLCENTER" by Codigo_CALLCENTER in the applymap sentence, it doesnt work.

And in this way, it works but returns allways "SinDatos"

Someone can help me?

Thanks. Regards.

[Oleg_Troyansky]

German,

this is a very open question, it would probably require a consulting engagement to review your data model and to find where you can save memory. I teach a whole 2-hour session just on that topic at the Masters Summit event (check it out, by the way).

Looking at your code, I don' believe that applying Mapping to the CALLCENTER field could contribute to memory savings. You should find and download tools like QlikVIew Optimizer, or Document Analyzer from Rob Wunderlich (www.robwunderlich.com) and try to analyze your memory footprint and how it can be reduced.

If you have a specific question on a specific memory-saving technique, I'd be happy to answer it here.

cheers,

Oleg Troyansky

www.masterssummit.com

www.naturalsynergies.com/blog

[#3]

Thanks, but no one of the articules speek about treatment of big cuantyties of datas endeed...

Regards