resolution on "tuple communication error from Redshift"

[gerrycastellino]

I was runing into the below error when extracting data from amazon redshift tables:

7/28/2016 10:58:12 AM:	Error: SQL##f - SqlState: 08S01, ErrorCode: 26, ErrorMsg: Communication error while getting a tuple;
7/28/2016 10:58:12 AM:	Communication error while getting a tuple
7/28/2016 10:58:12 AM:	General Script Error
7/28/2016 10:58:12 AM:	Execution Failed
7/28/2016 10:58:12 AM:	Execution finished.

I added a counter to the table, and broke up my extracts into chunks to 1M records - this seems to have fixed my problem...

For counter = 0 to 100000000 step 1000000

<connection string>

$(QVDatabaseTable):

SQL SELECT

    "account_uuid",

    "acctflag",

    "parent_customer_size",

    "named_account_flag",

    "site_industry_group_name",

    "site_industry_sub_segment_name",

    "site_industry_segment_name",

    "last_asset_purchasedate"

FROM $(DB).$(DBSchema).$(DatabaseTable) where "row" >= $(counter)+1 and "row" <= $(counter)+1000000;

DISCONNECT;

next;

store $(QVDatabaseTable) into $(vQVDFileName);

DROP tables $(QVDatabaseTable);