5.5

Refresh Pipeline Help Guide

The Refresh Pipeline module in Tellius provides a smart orchestration layer for synchronizing Business Views (BVs) and their underlying datasets. It ensures streamlined data refreshes, reduces redundancy, and delivers end-to-end visibility into scheduled and on-demand data jobs.

Manage refresh pipeline

1. We've added a new tab Refresh Pipeline under Data module. Under Data → Refresh Pipeline, you can find the above page.

2. The search bar allows you to quickly find a pipeline by name.

3. Click on Add New Pipeline to open the configuration panel for creating a new pipeline.

4. Table Columns:

• Name: Name of the pipeline

• Business Views: Lists all Business Views that are part of the pipeline

• Frequency: Indicates how often the pipeline is scheduled to run

• Created By: Displays the creator of the pipeline

• Last Updated: Shows when the pipeline was last modified.

1. To edit a pipeline, click on the three-dot menu of that pipeline and select Edit.

2. To delete a pipeline, click on the three-dot menu of that pipeline and select Delete. Deleting a pipeline permanently removes the pipeline and an irreversible action.

How to create a new pipeline

This is your starting point for defining custom refresh workflows based on your organization’s data dependencies.

1. Click on the Add New Pipeline button and the following window will be displayed.

New pipeline creation

1. In the Pipeline Name, provide a unique name for your pipeline.

2. Select one or more Business Views to include in the pipeline.

3. Click on Add Pipeline button to create the pipeline. Or, click on Cancel to dismiss.

Pipeline Canvas

Once you've added a pipeline, it opens the following visual canvas editor. The visual editor is where you view the flow of your refresh pipeline. how the selected datasets and Business Views are arranged, execution order, and configure refresh rules. It gives you full visibility into how your data refreshes are orchestrated.

Pipeline canvas

1. In the left pane, you can find the pipeline scheduler:

• Start Date: Choose the date the pipeline should begin executing.

• Frequency: Set how often the pipeline should run (e.g., daily, weekly).

• Start Time: Set the exact time of day the pipeline should trigger.

1. In the central canvas area, you can find the visual flow builder.

2. Each node block represents a Dataset or a Business View. Shows which datasets are a part of each Business View in the pipeline.

3. Flat file nodes show the warning “Flat files can’t be refreshed” indicating non-refreshable sources.

4. For each node block, you can enable/disable refresh using the toggles. This helps you skip static or unnecessary datasets, reduce load time, and debug specific parts without deleting nodes.

Sometimes, different datasets within a pipeline often have different refresh cadences. That's why Tellius provides node-level toggle control. This allows reuse of the same pipeline for varied refresh schedules without duplication.

1. Click on Add Business View if you want to add Business View(s) to the current pipeline.

2. Click on Publish to save the pipeline and activate the configured schedule.

3. Click on Execute Now to trigger an on-demand refresh instantly.

4. If a node fails, execution halts, and errors are logged. You can retry from the point of failure.

5. Real-time updates on success/failure are pushed to the Notifications page.

---

Rich KPI Chart

The Rich KPI chart is a powerful, compact visualization designed to track the trend of KPI metric over time using a mini area chart (sparkline). Given a measure and a date dimension, it highlights period-over-period change (YoY, MoM, etc.) using color-coded deltas.

Example: Highlight sales by month per region or category and compare YoY or MoM changes

---

Redshift Spectrum Data

Tellius now supports querying data stored in Amazon S3 by leveraging Redshift Spectrum. This means if your data lives in CSV or Parquet files inside an S3 bucket, you don’t need to move it elsewhere to analyze it in Tellius.

Here’s how it works:

1. First, create an external table in Amazon Redshift Spectrum that maps to your S3 file. This step tells Redshift how to read and interpret the raw file.

2. Once the external table is created, you can simply connect to Redshift from Tellius and import that external table, just like any regular Redshift table.

3. From there, you can browse, query, and join it with other datasets inside Tellius—no additional transformation or file copying needed.

This setup is especially helpful for organizations that store raw data in S3 but still want to analyze it in a fast, flexible way without complex pipelines. You’ll find a full step-by-step guide for creating external tables in the AWS Redshift Spectrum documentation.

Step-by-Step Setup:

1. Upload your data to S3 Place your .csv or .parquet files in a secure Amazon S3 bucket. Make sure the bucket is accessible from your Redshift cluster (IAM permissions required).

2. Create an external schema in Redshift This schema connects Redshift to your AWS Glue Data Catalog, which Redshift uses to manage metadata for external tables.

   sqlCopyEditCREATE EXTERNAL SCHEMA spectrum_schema
   FROM data catalog
   DATABASE 'your_glue_database'
   IAM_ROLE 'your_redshift_role'
   REGION 'us-east-1';

3. Define an external table for your S3 file Use a SQL CREATE EXTERNAL TABLE statement to map your S3 file to a table. Specify columns, data types, file format, and the S3 path.

   Example:

   sqlCopyEditCREATE EXTERNAL TABLE spectrum_schema.sales_data (
     order_id INT,
     customer_id INT,
     total_amount FLOAT
   )
   STORED AS PARQUET
   LOCATION 's3://your-bucket-name/path/to/data/';

4. Verify access and preview data in Redshift Run a simple SELECT * query to confirm that Redshift can read from the external table.

5. Connect Redshift to Tellius In Tellius, use the native Redshift connector to connect to your Redshift cluster (including credentials and connection settings).

6. Import the external table into Tellius Once connected, browse your Redshift schemas and import the external table just like any native Redshift table. You can now search, join, and analyze the data within Tellius.

---

Copy & Paste Charts Across Vizpads

Copy to Clipboard:

The cross-Vizpad Copy to Clipboard feature allows you to seamlessly copy a chart from one Vizpad and paste it into another tab or Vizpad. The copied chart or table remains in your clipboard across tabs until pasted. Only one chart/table can be copied to clipboard at once. This preserves all the chart configuration, formatting and filters.

Copy to Clipboard

Copy to Clipboard

1. Navigate to the target Vizpad tab where you want to reuse the chart.

2. Ensure you're in Edit mode.

3. Click on the Add Chart button and select the copied chart "Profit by order date" at the bottom of the panel.

Add Chart panel

1. The copied chart instantly gets pasted onto your current tab.

The copied chart remains available during your session until you copy a different one or log out.

---

Exporting Tables with Full Context

Tellius now offers a powerful to export tables (flat or detailed) exactly as they appear in your Vizpad—with all filters and metadata intact. This eliminates the need to rebuild context manually in Excel or CSV files.

Row, cell, and table comments are excluded to improve performance and reduce file size.

1. Select Export, and select your desired format: CSV, Excel, or PowerPoint.

2. If you select CSV, the following configuration appears:

• Set Custom Limit: Toggle on to define:

  • Row Limit: The number of rows to include.

  • Column Limit: The number of columns to export.

  

  Export as CSV

1. If you select Excel, the following configuration appears:

• Included Columns: Choose specific columns to include or exclude in the downloaded Excel. Click on Select All to select all the columns. Search, sort, or filter to find the required columns.

• Include Metadata: Each column comes with an option to include its metadata (toggle on/off).

• Set Custom Limit: Toggle on to define:

  • Row Limit: The number of rows to include.

  • Column Limit: The number of columns to export

Exporting as Excel

The exported Excel file contains an additional sheet which lists metadata of included columns (if opted-in). Metadata includes Display name, Description, Synonyms, and Aliases set.

• Use Excel format for sharing internally with business teams.

• Use CSV for loading into pipelines or systems that process raw data.

• Set row/column limits for faster downloads or sampling large datasets.

---

Custom Calendars for Live Connections

Tellius supports Custom Fiscal Calendars at the datasource level, making them fully compatible with live-mode querying for Snowflake, Redshift, and BigQuery. This enhancement allows users to configure and apply calendars directly from Data → Connect.

When configuring your Snowflake, Redshift and BigQuery connection to view and manage available fiscal or custom calendar options. Under Custom Calendars, you'll see a list of predefined calendars (e.g., ISO 8601, Gregorian, Q3 format, Fiscal Calendar).

This new configuration flow makes it easy for users—especially data owners—to apply fiscal calendars without any dependency. Whether you create a new one, map an existing one, or upload from a CSV, Tellius ensures your fiscal logic is respected across dashboards, insights, and filters.

Custom Calendars in live mode

Click on the three dot menu to configure your custom calendar in three ways:

1. Create New Calendar Table

• Automatically generates a new calendar table in your connected database.

• Tellius creates a table with the expected structure (dates, fiscal weeks/months/years).

• You must have write access to the selected database. Use this option if you don’t already have a calendar table.

• Once created and populated, map it in Tellius so it can be used in Business Views.

• You’ll see the following message stating that a table will be created in your existing data location.

Creating new calendar table

2. Map Existing Calendar Table

• Instead of building a new calendar, you can just tell Tellius where to find your existing one.

• Tellius will then connect to it and use it when creating charts or filtering by dates.

• Select the relevant database, schema, and table from dropdowns.

• Click on Map Table to connect the table.

• Tellius now knows where to look for your fiscal calendar logic.

Map existing calendar table

3. Download CSV File for Calendar

Clicking "Download CSV File for Calendar" directly downloads a pre-filled calendar table in CSV format. Useful if you prefer offline editing or want to migrate fiscal data from spreadsheets.

After mapping or creating the calendar

• Once a calendar is successfully mapped, it will show the tag “Manual” next to the calendar name.

Custom Calendars

• Calendars not yet configured will display a warning: “This calendar needs to be configured before it can be used.”

• If the calendar table becomes unavailable, Tellius will fall back to a standard ISO calendar.

---

• No More “First Day of the Week”: Tellius now infers week starts based on the fiscal year start (e.g., if your fiscal year starts on a Sunday, all weeks start on Sundays).

• Datasource Defaults: Once a calendar is mapped to a data connection, it becomes the default for all Business Views using that connection. Individual BVs can override it if needed.

---