I was runing into the below error when extracting data from amazon redshift tables:
| 7/28/2016 10:58:12 AM: | Error: SQL##f - SqlState: 08S01, ErrorCode: 26, ErrorMsg: Communication error while getting a tuple; |
| 7/28/2016 10:58:12 AM: | Communication error while getting a tuple |
| 7/28/2016 10:58:12 AM: | General Script Error |
| 7/28/2016 10:58:12 AM: | Execution Failed |
| 7/28/2016 10:58:12 AM: | Execution finished. |
I added a counter to the table, and broke up my extracts into chunks to 1M records - this seems to have fixed my problem...
For counter = 0 to 100000000 step 1000000
<connection string>
$(QVDatabaseTable):
SQL SELECT
"account_uuid",
"acctflag",
"parent_customer_size",
"named_account_flag",
"site_industry_group_name",
"site_industry_sub_segment_name",
"site_industry_segment_name",
"last_asset_purchasedate"
FROM $(DB).$(DBSchema).$(DatabaseTable) where "row" >= $(counter)+1 and "row" <= $(counter)+1000000;
DISCONNECT;
next;
store $(QVDatabaseTable) into $(vQVDFileName);
DROP tables $(QVDatabaseTable);
