How to configure a data transfer in BigQuery

This guide will give a full walk-through of how to set up a Supermetrics data source to start transferring data into BigQuery. This example uses Facebook Ads as the data source, but the same steps can be used for other data sources that Supermetrics supports.

The written instructions assume you have already enrolled the data source and added it to your BigQuery project. If you haven't done this yet, see First Steps: Getting Supermetrics into your BigQuery project.

Creating the data transfer

1. In BigQuery, go to Data transfers.

2. Click on + CREATE TRANSFER.

3. Under the Source drop-down, select the data source connection you wish to use. For this walk-through, we use Facebook Ads by Supermetrics as the example data source, but you can use any Supermetrics data source for the next steps.

4. Add a meaningful Transfer config name for the transfer.

5. Set up your Scheduling options for when the transfer will run.

  • Select Start now to have the initial transfer start immediately after the configuration is saved.
  • Set Repeats to Daily to have new data added once a day.
  • The Start date and run time is locked with Start now selected.

6. Set the Destination settings.

  • If you have an existing dataset you want to use for the transfer, simply select it from the dropdown. For instructions on creating a new dataset, see Creating a BigQuery dataset for your data transfer.
  • The default refresh window varies per data source. You can also set the amount of days you want to include in each daily data transfer manually.

7. Click on CONNECT SOURCE to proceed.

  • Optionally, you can enable Notification options to get notifications about failures.

8. A pop up will appear asking you to enabled a third party connection. To accept and proceed, click on ACCEPT AGREEMENT.

9. Next, follow the prompts in the Supermetrics window.

  • Sign in with your Google account that has access to your BigQuery project.
  • If you belong to multiple Supermetrics Teams, select the team with your Supermetrics for BigQuery licence. If you don't have a licence yet, a trial licence will be started the first time you create a transfer.

10. Log in to the data source with your account for authorization. In this example, it would be a Facebook user with access to the ad accounts you want to transfer data from.

  • Some data sources may use your browser cookies to log you in automatically. If you don't want to automatically use that account, make sure to log out first in the browser version of the data source platform before proceeding.

11. Define the Transfer settings for the data source. 

  • Select the accounts, views or pages you wish to have as part of the data transfer – you can select more than one account.
  • Fill in any additional settings.

12. Click on Submit to continue.

  • If the data source was successfully connected, a confirmation pop up will open, and you will see the successful connection in the transfer configuration.

13. Click on SAVE to save the transfer. This will also start the initial data transfer.

  • You can watch the progress in the Run History section of the transfer. Depending on the data source and the amount of data, it may take several minutes to complete the initial transfer.
  • You can also follow the progress of all your data transfers in Supermetrics Team Management – see How to monitor your daily data transfers.

Verifying the transferred data

Checking the dataset will now reveal a couple of new tables based on the default schema the data source uses. You can see the table definitions for each source in our documentation. They are usually named with the format Datasource_Type_YYYYMMDD:

  • Datasource is the short-code for the source the data came from: for example FBADS for Facebook Ads.
  • Type is the kind of data it is: campaign, demographics, post, etc.
  • YYYYMMDD is the date the table was transferred into BigQuery. New tables will be added for every day.

You can run a test query against one of the tables to verify there are results. 

1. Select one table under the dataset and then click QUERY TABLE to load that table into the query editor.

2. Create a basic query and run it.

  • Example query and output against the Facebook Ads Campaign table:

Now you're ready to work with the data! The transfer will automatically upload new values per the configuration in the transfer's scheduling options.

What's Next?

Set up a backfill request to add historical data to BigQuery:

Connect your BigQuery data to Google Data Studio and create visualizations and reports with your data:

See what tables are available for different data sources:

Use Supermetrics Team Management to monitor all your daily data transfers:

Need help? Contact Supermetrics Support

Did you find it helpful? Yes No

Send feedback
Sorry we couldn't be helpful. Help us improve this article with your feedback.