Troubleshooting: BigQuery destination
- BigQuery API error: Access Denied
- BigQuery API error: Not found: Dataset
- BigQuery table shows column names as string_field_0
BigQuery API error: Access Denied
To use BigQuery as a data destination, please add these roles:
- bigquery.dataEditor
- bigquery.jobUser
OR these:
- bigquery.tables.create
- bigquery.tables.updateData
- bigquery.jobs.create
Note, that after changes of roles, you need to generate new JSON key and upload it to Coupler.io as BigQuery destination connection.
BigQuery API error: Not found: Dataset
Coupler.io does not create a dataset in your Google Cloud project. You must specify name of the existing dataset.
BigQuery table shows column names as string_field_0
Couper.io is using BigQuery auto schema detection mechanism. If all columns in your dataset have text values, BigQuery treats first row as values too. In this case it also automatically generates names of all columns as string_field_0, 1, 2 etc:
To avoid such behaviour make sure your source data contain at least one boolean, date/time or integer field. You can add such column in case you are importing data from Google Sheets or Microsoft Excel.
This is how you can use ARRAYFORMULA in Google sheets for that purpose:
Re-run importer in replace mode to update table structure. If you are using append mode you don't need to add such a column during each import as table structure remain the same.