Text truncated when 'where' clause in load script

[DSRScape]

Hi,

I have an issue with a field (ProjectDescription) being truncated to 255 characters when a 'where' clause is added to the load script. Remove the where clause and I get the expected lengths exceeding 1,000 characters:

Temp_SubDate:
Load
	date(floor(monthend(MaxSubDate)),'yyyy-MM-dd') as MaxSubDate;
SQL SELECT Max(SubDate) as MaxSubDate
    FROM "Big_Data".dbo.DataCollated;

    Let vThisMonth = Peek('MaxSubDate',0);

drop Table Temp_SubDate;

TruncateTest:
LOAD PartnerProjectNumber,
	ProjectName,
	ProjectDescription        // The field being truncated
	;
SELECT PartnerProjectNumber,
	ProjectName,
	ProjectDescription
FROM "Big_Data".dbo.DataCollated
where SubDate = '$(vThisMonth)';

Thank you for looking - hope someone can help!

Many thanks,

David

[Ezirraffner]

Hi David!

Can you give an example of the expected result?

Best regards

Ezir

[DSRScape · Accepted solution]

Hi Ezir,

I'm kicking myself as after spending way too long looking, I've just realised that the issue is in the source data. Records are updated monthly and the previous month has the full text and the latest month is truncated which is obviously what's loaded when the Where clause is added.

Thanks for your time and apologies for wasting it! 🙄

David