resolution on "tuple communication error from Redshift"

gerrycastellino — Thu, 28 Jul 2016 18:27:18 GMT

I was runing into the below error when extracting data from amazon redshift tables:

7/28/2016 10:58:12 AM:	Error: SQL##f - SqlState: 08S01, ErrorCode: 26, ErrorMsg: Communication error while getting a tuple;
7/28/2016 10:58:12 AM:	Communication error while getting a tuple
7/28/2016 10:58:12 AM:	General Script Error
7/28/2016 10:58:12 AM:	Execution Failed
7/28/2016 10:58:12 AM:	Execution finished.

I added a counter to the table, and broke up my extracts into chunks to 1M records - this seems to have fixed my problem...

For counter = 0 to 100000000 step 1000000

$(QVDatabaseTable):

SQL SELECT

"account_uuid",

"acctflag",

"parent_customer_size",

"named_account_flag",

"site_industry_group_name",

"site_industry_sub_segment_name",

"site_industry_segment_name",

"last_asset_purchasedate"

FROM $(DB).$(DBSchema).$(DatabaseTable) where "row" >= $(counter)+1 and "row" <= $(counter)+1000000;

DISCONNECT;

next;

store $(QVDatabaseTable) into $(vQVDFileName);

DROP tables $(QVDatabaseTable);

topic resolution on "tuple communication error from Redshift" in QlikView