https://community.qlik.com/t5/Official-Support-Articles/Google-BigQuery-connector-error-interacting-with-REST-API/ta-p/1866770 <P>Fetching&nbsp; a very large dataset&nbsp; (&gt; 10 GB)&nbsp; using GoogleBig Query from Qlik OdbcConnectorPackage 6.149 returns:</P> <P>&nbsp;</P> <P class="lia-indent-padding-left-30px"><FONT face="courier new,courier"><SPAN>[Qlik]</SPAN><SPAN>[BigQuery]</SPAN><SPAN>&nbsp;(100) Error interacting with REST API: Response too large to return. Consider specifying a destination table in your job configuration. For more details, see&nbsp;</SPAN><A tabindex="-1" title="https://cloud.google.com/bigquery/troubleshooting-errors" href="https://cloud.google.com/bigquery/troubleshooting-errors" target="_blank" rel="noopener noreferrer" aria-label="Link https://cloud.google.com/bigquery/troubleshooting-errors">https://cloud.google.com/bigquery/troubleshooting-errors</A></FONT></P> <P class="lia-indent-padding-left-30px">&nbsp;</P> <H4><FONT color="#339966"><STRONG>Environment</STRONG></FONT></H4> <UL> <LI>QlikOdbcConnector 6.149&nbsp; (Released Sept 9, 2021)</LI> <LI>QlikView 12.20 and above</LI> </UL> <P>&nbsp;</P> <H3><STRONG><FONT color="#339966">Resolution:</FONT></STRONG></H3> <P>The following configuration is required in the connection for large data sets:</P> <UL> <LI>"Allow Large Result Sets" enabled</LI> <LI>"Dataset Name For Large Results Sets", indicate the name of the temporary table.</LI> <LI>"Language Dialect" set to "Legacy SQL"</LI> </UL> <P>If the driver doesn't show the options, those can be configured in the&nbsp;<SPAN> "Advance Parameters" section</SPAN></P> <PRE>SQLDialect 0 (Legacy SQL)<BR />AllowLargeResults 1 (Enabled)<BR />LargeResultsDataSetID &lt;destination datasetname&gt;</PRE> <P><SPAN>Driver version 6.149 has an option in the UI.</SPAN></P> <P><BR /><SPAN>In 6.149 version, when working with a very large dataset, a temporary destination table is needed within GBQ to stage the data before it is made available to an external application.&nbsp; The 6.149, GoogleBig Query connector exposes the parameters to use for a temporary table. The user will have to manually create a dataset in advance in GBQ when using these parameters (i.e. when it is expected to load large amounts of data).</SPAN></P> <P><STRONG>Steps: (the following are suggested steps. Recommend to consult with internal GBQ admin)</STRONG></P> <OL> <LI><SPAN>Log in to Google Cloud Platform</SPAN></LI> <LI><SPAN>Select the Project ID holding the data to be queried by the connector&nbsp; (logged in use must have write permission)</SPAN></LI> <LI><SPAN>Open the 3-dot menu, select "Create dataset"</SPAN></LI> <LI><SPAN>Insert desired name in the Dataset ID field and create<BR /><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Google Cloud Platform" style="width: 999px;"><img src="https://community.qlik.com/t5/image/serverpage/image-id/67927i221F7625C76CD853/image-size/large?v=v2&amp;px=999" role="button" title="ScreenShotGoogleCloud.png" alt="Google Cloud Platform" /><span class="lia-inline-image-caption" onclick="event.preventDefault();">Google Cloud Platform</span></span><BR /></SPAN></LI> <LI><SPAN>Provide the exact same dataset name in the field "Dataset Name for Large Result sets in the&nbsp; GoogleBig Query Connector Dialog within QlikView (the dataset name is case sensitive)</SPAN></LI> </OL> <P class="lia-indent-padding-left-30px"><SPAN><span class="lia-inline-image-display-wrapper lia-image-align-inline" image-alt="Dataset for Large Result sets.PNG" style="width: 699px;"><img src="https://community.qlik.com/t5/image/serverpage/image-id/67947iC217EA13F5BF3AE1/image-size/large?v=v2&amp;px=999" role="button" title="Dataset for Large Result sets.PNG" alt="Dataset for Large Result sets.PNG" /></span></SPAN></P> <P>Notes:</P> <UL> <LI>Temporary tables for large results will get created during data reloads, within the dataset used in the connection definition, with a unique name based on the date and time it is created</LI> <LI>One dataset can hold many tables.&nbsp; The same dataset can be used in multiple connection definitions, therefore the creation of a dataset can be limited to one per Project.</LI> </UL> <P style="font-style: italic;">The information in this article is provided as-is and to be used at own discretion. Depending on tool(s) used, customization(s), and/or other factors ongoing support on the solution below may not be provided by Qlik Support.</P> <P><A href="https://help.qlik.com/en-US/connectors/Subsystems/ODBC_connector_help/Content/Connectors_ODBC/Introduction/ODBC-connector.htm" target="_blank" rel="noopener">ODBC Connector Package</A></P> <H3><SPAN>Cause&nbsp;</SPAN></H3> <P><SPAN>If a data fetch is larger than 10 GB, Google requires a temporary table.</SPAN></P> <P>&nbsp;</P> <H3 id="toc-hId-876729229"><FONT color="#000000">Related Content:</FONT></H3> <P><A href="https://community.qlik.com/t5/Knowledge/Qlik-Google-BigQuery-Connector-How-to-setup-load-from-Large/ta-p/1937223" target="_self">Qlik Google BigQuery Connector: How to setup load from Large Datasets </A></P> Tue, 09 Aug 2022 19:04:13 GMT Juli_K 2022-08-09T19:04:13Z https://community.qlik.com/t5/Official-Support-Articles/Google-BigQuery-connector-error-interacting-with-REST-API/ta-p/1866770 <P>Fetching very large datasets (&gt; 10 GB)&nbsp; using GoogleBigQuery connector 6.149 with QlikView</P> Tue, 09 Aug 2022 19:04:13 GMT https://community.qlik.com/t5/Official-Support-Articles/Google-BigQuery-connector-error-interacting-with-REST-API/ta-p/1866770 Juli_K 2022-08-09T19:04:13Z