Answer

• Enable Large Result Dataset
  • Check this box to increase the maximum allowed request response (i.e. result) size. By default, BigQuery imposes a maximum response size on all requests (refer to Quotas and limits for specific limit
    values). If you do not enable large result set support, when executing queries, you might experience an error message such as “Response too large to return”.
  • When you check the “Enable Large Result Dataset” button, and specify a name for the “Large Result Dataset” table, all query results are written to and read from that table regardless of the query and its result size. Because of this, the result cache is not available for subsequent queries, and you are billed for every query that you make.

• Enable Storage API (a.k.a. High Throughput API)
  • If you expect your query to return large amounts of data, check this option to enable the connector to handle the result sets more efficiently. This will allow the connector to leverage the BigQuery Storage API, which performs with higher throughput than the BigQuery API. Be aware the BigQuery Storage API must be enabled for the BigQuery project you are querying and pricing for the BigQuery Storage API is different from pricing for the BigQuery API.
  • If this feature is enabled, the connector checks the number of rows in an incoming result set table and the number of pages needed to retrieve all the results. If the number of rows and pages exceeds the threshold defined by the “High Throughput Activation Ratio” and “High Throughput Min Table Size” parameters (see below), the connector switches to using the BigQuery Storage API. If the connector encounters any issues initializing the BigQuery Storage API for retrieval, it falls back to using the BigQuery API, unless there is a permissions issue. To ensure best performance, do not use this feature with a named destination dataset or table.
  • The connector will switch to the High Throughput API to more efficiently transfer the large result set based on the value of the following parameters:

• High Throughput Activation Ratio
  • When the number of pages in the result of your query exceeds this value, and the number of rows in the results exceeds the High Throughput Min Table value, the connector switches to using the BigQuery Storage API instead of the BigQuery API. The default value is 3. The default size of a page is 10,000 rows as determined by the MaxResults driver parameter (the connector does not provide the ability to modify that parameter).

• High Throughput Min Table Size
  • When the number of table rows in the result of your query exceeds this number, and the number of pages in the results exceeds the High Throughput Activation Ratio value, the connector switches to using the BigQuery Storage API instead of the BigQuery API. The default value is 100.

Additional Information