Set analysis causing out of object memory

[#1]

Good evening, im using a bit of set analysis to identify duplicate records. Prior to the set analysis being used the script runs fine up to this point.

I then use this :-

=If(Count(TOTAL <Payment_Reference_In_CA>CA) > 1,'X')

As soon as I do (looking at task manager) the memory usage goes through the roof until I get out of object memory.

I have 4.7 million lines of data loaded which I dont really need anyway.

Can anyone help me by limiting the load by restricting the data to only load data relating to Payment_Reference_In_CA if it has more than 1 record under field CA.

Thanks.

Paul.

[#2]

Right Field A and B should only have a 1 to 1 relationship I am only wanting to load field A if it has a 1 to 2 relationship

[swuehl]

You can probably create an SQL sub query to delegate the record filtering to the DB, this might be what you are looking for.

The suggested solution above is QV only and should work with any data source.

[#4]

Err I don't have access to SQL in my company, I'd rather try and achieve this in script!

[#5 · Accepted solution]

Sorted it, I just told it to load entries where len>0 there were quite a few entries that were blank therefore useless to me, this then made my script only load what I needed