What's New
Release 4.1
Release 4.0
Release 3.9
Release 3.8
Release 3.7
Release 3.6
Release 3.5
Release 3.4
Release 3.3
Release 3.2
Release 3.1
Release 3.0
Release 2.4.1
Release 2.4
Free Cloud Trial
Release 2.3
Release 2.2
Release 2.1
Release 2.0
Release 1.8
Release 1.7
Release 1.6
Release 1.5
Tellius Home
Search (Natural Language)
Search in Tellius
Guide Me
How to Search
Business View List / Columns
Query
Search Result
Discover Insights
Interactions
Chart Operations
Add to Vizpad
Table View
Switch Chart type
Change Chart Config
Apply Filters
Change Formatting
Measure Aggregation - Market Share Change
View Raw Data
Download/ Export
Embed URL
Partial Data for Visualization
Best-fit visual
Add to Vizpad
Adding the chart to a Vizpad
Customize the auto-picked columns
Search Query Inspector
Teach Tellius
History
Guided Search
Add Guided Search Experience
Display Names in the Search Guide
Guided Search
Guided Search Syntax and Attributes
Deep Dive
Maps in Search
Search Keywords
Percentage Queries
Time Period Queries
Year-over-Year Analysis
Additional Filters
Pagination
List View In Search Results
Embed Search
Personalized Search
Search Cheat Sheet
Filters in Help Tellius Learn
Explore (Vizpads)
Dashboards in Tellius
Vizpad Creation
Create Interactive Content
Create Visualization Charts
List of Charts
Common Chart Types
Line Chart
Bar Chart
Pie Chart
Year-over-Year Functionality in Vizpad
Area Chart
Combo Chart
KPI Target Chart
Treemaps
Bubble Chart
Histogram
Heat-Map Charts
Scatter Chart
Other Charts
Cumulative line chart
Cohort Chart
For each chart
Create Visualization Charts
Global Filters
Embedded Filters
Other Content
Creating Interactive Content
Vizpad level Interactions
Viz level Interactions
Discover Insights
Drivers
Discover hidden insights - Genius Insights
How Genius Insights works
Discoveries in Insight
Anomalies on Trend
Interactions
Chart Operations
Embedding Vizpad
Vizpad Consumption
Collection of Interactive Content
Vizpad level Interactions
Global Filter on the fly
Global Resolutions
Refresh
Notifications / Alerts
Share
Download / Export
Unique name for Vizpads
Edit Column Width
Viz level Interactions
Multi-Business View Vizpads
Embedding Viz & Vizpads
Discover (Genius Insights)
Discoveries
What are discoveries
Type of Discoveries in Tellius
Create Discoveries
Kick-off Key Drivers
Edit Insights
Key Driver Insights
Components of Key Drivers
What are Key Drivers
Edit Key Driver Insights
Segment Drivers
Trend Drivers
Trend Insights (Why Insights)
Comparison Insights
Components of Comparison Insights
Create Comparison Insight
What are Comparison Insights
Edit Comparison Insights
Others Actions
Save
Refresh
Share Insights
Download
Adding Insights to Vizpad
Insights Enhancements
Embedding Insight
Impact Calculation for Top Contributors
Marketshare
Live Insights
Predict (Machine Learning)
Machine Learning
AutoML
How to create AutoML models
Leaderboard
Prediction
Others
What is AutoML
Point-n-Click Predict
Feed (Track Metrics)
Assistant (Conversations)
Tellius on Mobile devices
Data (Connect, Transform, Model)
Connectors
Connector Setup
Google BigQuery
Snowflake
Edit Connector
Live Connect
Data Import
Cache
Direct Business View
JDBC connector for PrestoDB
List of Connectors by Type
Tables Connections
Custom SQL
Schedule Connector Refresh
Share Connections
Datasets
Load Datasets
Configure Datasets (Measure/Dimensions)
Transform Datasets
Create Business View
Share Datasets
Copy Datasets
Delete Datasets
Data Prep
Datasets
Data Profiling / Statistics
Transformations
Dataset Transform
Aggregate Transforms
Calculated Columns
SQL Transform
Python Transform
Create Hierarchies
Filter Data
SQL Code Snippets
Multiple Datasets Scripting SQL
Column Transforms
Column Metadata
Column type
Feature type
Aggregation
Data type
Special Types
Synonym
Rename Column
Filter Column
Delete Column
Variable Display Names
Other Functions
Metadata View
Dataset Information
Dataset Preview
Alter Pipeline Stage
Edit / Publish Datasets
Data Pipeline (Visual)
Alerts
Partitioning for JDBC Datasets
Export Dataset
Data Fusion
Schedule Refresh
Business Views
Create Business View
Create Business View
Datasets Preview & List
Add datasets to Model
Joins
Column selection
Column configuration
Primary Date
Geo-tagging state/country/city
Save to Fast Query Engine
Publish
Business View
What is Data Model
BV Visual Representation (Preview)
BV Data Sample
Learnings (from Teach Me)
Custom Calculations (Report-level Calc)
Predictions on BV
BV Refresh
Export/ Download Business View
Share Business View
URL in Business View
Request Edit Access
Projects (Organize Content)
Monitor Tellius
Embedding & White-labelling
Embedding
Embedding URL
Embedding Vizpads
Steps to embed a Vizpad
Apply and delete filters
Vizpad-related actionTypes
Edit, save, and share a Vizpad
Keep, remove, drill sections
Adding a Viz to a Vizpad
Row-level policy filters
Embedding Insights
Embedding Search
APIs
What you should know before embedding
Whitelabelling
Settings
About Tellius
User Profile
Admin Settings
Manage Users
Team (Users)
Details & Role
Create a new user
Edit user details
Assigning the user data to another user
Restricting the dataset for a user
Deleting a user
Assign User Objects
Teammates (Groups)
Authentication & Authorization
Application & Advanced Settings
Data
Machine Learning
Genius Insights
Usage tracking & Support
CDN
Download Business View, Dataset, and Insights for Live BV
Customize Help
Impersonate
Data Size Estimation and Calculation
Miscellaneous Application Settings
Configuration for time/date-related results
Dataflow Access
Enable In-memory operations on Live sources
Language Support
Administration
Setup & Configuration
Installation Guide
Kubernetes Setup
Tellius Architecture
Deployment Architecture
System Requirements
Installation Overview
On-Prem Deployment Instruction Set
AWS Marketplace
Autoscaling
Backup and Restore
Help & Support
FAQ
Data Preparation FAQs
Environment FAQs
Search FAQs
Vizpads FAQs
Security FAQs
Embedding FAQs
Insights FAQs
Help and Support System
Guided Tours
Product Videos
Articles & Docs
Provide Feedback
Connect with Tellius team
Support Process
Notifications
Getting Started Videos
Getting Started
Tellius Connect
Tellius Data Overview Video
Connecting to Flat Files Video
Connecting to Data Sources Video
Live Connections Video
Data Refresh and Scheduling Video
Tellius Prep
Getting Started with Tellius Prep Video
Transformations, Indicators, Signatures, Aggregations and Filters Video
SQL and Python Video
Working with Dates Video
Data Fusion Video
Business View Video
Business Mapping Video
Report Level Calculations Video
Writeback to DB
Natural Language Search
Getting Started with Search Video
How-To Search Video
Customizing Search Results Video
Search Interactions Video
Help Tellius Learn
Explore - Vizpads
Getting Started with Vizpads Video
Creating Vizpads Video
Creating and Configuring Visualizations Video
Viz-Level Interactions Video
Vizpad-Level Interactions Video
Auto Insights
Getting Started with Auto Insights Video
Discovery Insights Video
Segment Insights Video
Trend Insights Video
Comparison Insights Video
Iterate on Insights Video
Tellius Feed Video
Predict - ML Modeling
Getting Started with Predict Video
AutoML Configuration Video
AutoML Leaderboard Video
Point-n-Click Regression Video
Point-n-Click Classification Video
Point-n-Click Clustering Video
Point-n-Click Time Series Video
Point-n-Click PythonML Video
PredictAPI Video
Apply ML Model Video
ML Refresh and Schedule Video
Admin
Best Practices & FAQs
API Documentation
Table of Contents
- All Categories
- Data (Connect, Transform, Model)
- Connectors
- Connector Setup
- Google BigQuery
- Configuring direct connection to Google BigQuery
Configuring direct connection to Google BigQuery
Updated
by Ramya Priya
BigQuery Connector
Google Cloud has released an official version of the Spark BigQuery connector that doesn’t require a GCS bucket to read the data into Tellius.
Instead of using Google Cloud Storage as an intermediary, the data is streamed in parallel using the Storage API from BigQuery via gRPC. Check out https://github.com/GoogleCloudDataproc/spark-bigquery-connector
When a dataset is created from a table, materialized view, or query, the data streams from BigQuery into Tellius without leaving any files or tables in between.
Loading from table
To load the data from a table, the following details are required from the user:
- ProjectID
- Dataset name
- Table name
- Credentials File
Loading from View
By default, BigQuery does not materialize loading data from Views. It is necessary to materialize the View first, by saving the output to a separate table and then loading the data from that table.
The intermediate table is a temporary table with a Time-To-Live (TTL) of 24 hours, and it will be deleted once the TTL ends. The TTL can be set to less than 24 hours. For this integration, it is recommended to build a separate materialization dataset (with full write access to Tellius).
The following details are required from the user:
- ProjectID
- Dataset name
- Table name
- Materialization dataset
- Credentials file
Loading from SQL Query
Loading data from an SQL query is similar to loading data from a View. The results of the query are saved in an intermediate, temporary table, from which the data is loaded.
Live Querying
BigQuery connector cannot be utilized for Live datasets since Tellius runs SQL queries in real-time. After the queries are processed, the results need to be written to a separate table, from which they will be read.
As a result, several temporary tables are created---which degrades the performance of live querying functionality and increases the overall cost to the user.
Solution
The following are the two powerful alternatives for using BigQuery connector with live datasets.
JDBC
- Use a JDBC driver to process the query and stream the results into Tellius.
- It requires only minimal effort to integrate a JDBC driver into Tellius live querying.
- However, Google does not provide an official JDBC driver for BigQuery. There are a few JDBC connections available (as mentioned below), but their licensing is not straightforward and requires explicit approval.
https://www.magnitude.com/drivers/bigquery-odbc-jdbc
https://www.cdata.com/drivers/bigquery/jdbc/
BigQuery Java
BigQuery supports an official Java connector which can be used to run queries on BigQuery and read the results into Tellius.
https://cloud.google.com/bigquery/docs/reference/libraries#client-libraries-install-java
Pre-requisites for configuring BigQuery in Google Cloud
Service Account Creation
- In the Google Cloud console, click on IAM and Admin section on the left pane.
- Choose Service accounts and select the required project.
- Click on + Create service account on the top pane.
- Enter the name, ID, and description of the service account.
- Copy the service account email address (which is of the format <account_name>@<project_name>.iam.gserviceaccount.com)
- Click on Done to create the service account.
Project Level Permissions
The following roles need to be included at the project level:
- BigQuery Read Session User
It is required to read the data in parallel from Google Storage
- BigQuery Job User
It is required to load data from Views or execute live-mode SQL queries directly from BigQuery. It is also required to run jobs where the Views will be materialized to a temporary table by triggering a job and then reading from Google Storage.
- Select the required project.
- Under Actions, click on Manage permissions.
- Click on Grant access.
- Under Add principals, paste the service account email copied from the previous section.
- Under Assign roles, choose the roles: BigQuery Read Session User and BigQuery Job User.
- Click on Save.
- Policy updated toast will be displayed.
Dataset Level Permissions
- The role BigQuery Data Viewer should be assigned to the service account of the Tellius dataset from where the data would be read.
- If Views are read into Tellius, then the role BigQuery Data Editor needs to be assigned to the service account of the same dataset or a new dataset created solely for Tellius to create temporary tables.
- Click on the dataset and select Options → Share.
- Under Add principals, paste the service account email address copied from the first section.
- Under Assign roles, provide the required role.
- Click on Save.