Bring your data from BigQuery to your catalog.
BigQuery is Google Cloud’s fully managed, serverless data warehouse that enables super-fast SQL queries using the processing power of Google’s infrastructure. It’s designed for large-scale data analytics and provides tools for data analysis, machine learning, and business intelligence.
In the Sources tab, click on the “Add source” button located on the top right of your screen. Then, select the BigQuery option from the list of connectors.
Click Next and you’ll be prompted to add the connector configurations.
Default configuration
BigQuery Data Viewer
and BigQuery Job User
. For more info on how to create the service account, please check this link.Advanced configuration
It’s a good practice to filter datasets and tables to speed up the discovery and extraction process.
Click Next.
The next step is letting us know which streams you want to bring. You can select entire groups of streams or only a subset of them.
Tip: The stream can be found more easily by typing its name.
Some complex nested types are currently not supported by the connector. If an error pops up during the discovery process, please get in touch with Nekt support.
Describe your data source for easy identification within your organization. You can inform things like what data it brings, to which team it belongs, etc.
To define your Trigger, consider how often you want data to be extracted from this source. This decision usually depends on how frequently you need the new table data updated (every day, once a week, or only at specific times).
Optionally, you can define some additional settings (if available).
Click Next to finalize the setup. Once completed, you’ll receive confirmation that your new source is set up!
You can view your new source on the Sources page. Now, for you to be able to see it on your Catalog, you have to wait for the pipeline to run. You can now monitor it on the Sources page to see its execution and completion. If needed, manually trigger the pipeline by clicking on the refresh icon. Once executed, your new table will appear in the Catalog section.
If you encounter any issues, reach out to us via Slack, and we’ll gladly assist you!