Send your BitBrew data to Google Bigtable with our integration. This tutorial will show you how to:
Set up a Bigtable instance (based on the Google tutorial).
Create a service account so that BitBrew can access your Bigtable (based on the Google tutorial).
Link to your Bigtable from the BitBrew Dashboard app.
Set Up a Bigtable Instance
First, you'll need a project if you don't already have one. In the GCP console, click the project menu and in the modal that appears, click New Project.
Enter your project name in the text box and click Create.
Next, create a Cloud Bigtable instance. You'll need the Instance ID later, when you link to your Bigtable from the BitBrew Dashboard.
Important Note on Region/Zone Selection
If you plan to use BigQuery to query data from your Bigtable, you must create your instance in one of the following regions and zones:
Create a Service Account
You need a service account that the BitBrew platform can use to access your Bigtable instance.
First, navigate to the Service Accounts page in the IAM and admin section of the GCP Console. Select your project.
Click Create Service Account. Enter a service account name and select a role for the service account.
Role options for this service account are Bigtable Administrator or Bigtable User.
A Bigtable Administrator role allows you to create a table from the Dashboard app.
A Bigtable User role can only read and write to a pre-existing Bigtable that you've created with the Google command line. If you would like to limit BitBrew's permissions to reading and writing data to existing tables, use the Bigtable User role for the service account.
You'll also need a JSON-formatted private key. When you're creating a service account, check the Furnish a new private key box and ensure that "JSON" is selected. A JSON file will be downloaded to your computer when you click Create.
Link to Your Bigtable from the BitBrew Dashboard
Now that you have a Bigtable instance and service account for BitBrew to use, you need to connect the BitBrew platform to your Bigtable Instance.
First, log in to dashboard.bitbrew.com and select the Destinations nav item. Then select the Bigtable tab, and click the Add Destination button.
On the create page, you'll first need to provide the GCP Service Account Key that you generated earlier. You can either copy the contents from the file that was downloaded to your computer and paste them into the text box, or upload the file by clicking the Import GCP Keyfile button.
Next, input your Bigtable Instance ID and Table Name.
If your service account has the Bigtable Administrator role, and the name you enter for Table Name does not match any existing tables, a new one will be created with that name.
If your service account has a Bigtable User role, you must enter the name of an existing table. The name you input must match exactly.
Finally, provide a name to be used as an identifier within the BitBrew system. We automatically fill in a name based on the Table Name entered in step two, but you can choose any name you wish. Then, click Create Destination.
And that's it! Your Google Bigtable destination is now set up, and you can use it as the destination for the output of any of your BitBrew rules.