JournalRelease NotesSupport
Guides
Log inSign upTalk to Us

Push-to-Warehouse Setup: BigQuery

📘

In this guide, you will be setting up a connection to a data warehouse destination you own. Reach out to your Customer Success Manager or [email protected] to confirm that your Modern Treasury plan includes the Push to Warehouse capability.

Prerequisites

Step 1: Create service account in BigQuery project

  1. In the GCP console, navigate to the IAM & Admin menu.

  1. Click into the Service Accounts tab.

  1. Click Create service account at the top of the menu.

  1. In the first step, name the user and click Create and Continue.

  1. In the second step, grant the user the role BigQuery User.

🚧

Loading data into a dataset that already exists

By default, we will attempt to create a new dataset (with a name you provide) in the BigQuery project. If instead you create the dataset ahead of time, you will need to grant the BigQuery Data Owner role to this Service Account at the dataset level.

  • In BigQuery, click on the existing dataset. In the dataset tab, click Sharing, then Permissions. Click Add Principals. Enter the Service Account name, and add the Role: BigQuery Data Owner

Note that the BigQuery User role is required at the project level regardless of whether or not you intend to use an existing dataset.

  1. In the third and final step, click Done.
  2. Back in the Service accounts menu, click the Actions dropdown next to the newly created service account and click Manage keys.

  1. Click Add key and then Create new key.

  1. Select the JSON Key type and click Create and make note of the key that is generated.

Step 2: Create a staging bucket

  1. Log into the Google Cloud Console and navigate to Cloud Storage. Click Create to create a new bucket.

  1. Choose a name for the bucket. Click Continue. Select a location for the staging bucket. Make a note of both the name and the location (region).

🚧

Choosing a location (region)

The location you choose for your staging bucket must match the location of your destination dataset in BigQuery. When creating your bucket, be sure to choose a region in which BigQuery is supported (see BigQuery regions)

  • If the dataset does not exist yet, the dataset will be created for you in the same region where you created your bucket.
  • If the dataset does exist, the dataset region must match the location you choose for your bucket.
  1. Click continue and select the following options according to your preferences. Once the options have been filled out, click Create.
  2. On the Bucket details page that appears, click the Permissions tab, and then click Add.

  1. In the New principles dropdown, add the Service Account created in Step 1, select the Storage Admin role, and click Save.

Step 3: Find Project ID

  1. Log into the Google Cloud Console and select the projects list dropdown.
  2. Make note of the BigQuery Project ID.

Step 4: Add your destination

  1. Securely share your Project ID, Bucket Name, Bucket Location, Destination Schema Name and Service Account Private Key (.json file) with us to complete the connection.

Updated 14 days ago