June 20, 2022

New in Potens

Goliath: Some keyboard shortcuts extended to tables references with parameters
1. 1. Highlight table name in Editor (Ctrl)
  2. Locate table in Navigator (Ctrl-Click)
  3. Locate & Preview (Ctrl-Shift-Click) table
Magnus: Workflow execution time alert
Added new magic parameter var_sys_execution_time_alert_minutes.
When value is set to greater than 0 and workflow’s execution time is greater than or equals to that value - alert is sent to workflow owner (recipient by default). As always, recipients can be set using var_sys_notification_recipients magic parameter

Some fixes / improvements

IntelliSense – updated with all recently introduced by BigQuery Team keywords, phrases, syntax, etc.
Goliath: Snapshot Table – Added Preview Menu Option. Snapshots can now be previewed
Admin Suite: Groups Update Log – Added new column “Updated By”
Export Table (Goliath), GCS Export Task (Magnus) – Different minimum scopes are required now for exporting to GCS.
Previously devstorage scopes were enough to export to GCS. Now bigquery or cloudplatform scopes are needed. This is reflected in incremental auth when performing these actions.
Goliath: Pick Datasets Modal – respect spacing (compact, normal, large) settings
Goliath: Mark as Favorite – Parameters values were not saved when option is checked
Previously, checking parameters when marking as favorite would not save parameters and their values. Now parameters are correctly saved.
Admin Suite: Roles Transfer Log does not expand – fixed bug where single quote in toUser column or null value in request json body prevent entry from expanding when clicked on the plus icon
Magnus: Dashboard – Incorrect values in cards when selecting another user (not session User – which is feature available for Admins)
When selecting a different user, the values in each card was incorrect. It would show values for the current user. This is fixed so that now the correct count for the user is displayed.
Magnus: Workflow editor – fixed edge case bug when workflow save was allowed even when there is no change
Github export/import – fixed bug when devstorage scope is asked even when it is not needed
Magnus Dashboard: add messaging for workflows with executions that are not rendered.
Added a warning modal listing “problem workflows” with daily executions greater than 2000 which are not visualized.
and more ...

May 25, 2022

New in Potens

Goliath Command Palette - user interface element that gives users quick access to most commands, actions, settings available in Goliath – use Shift+Ctrl+K (Win) or ⇧⌃K (Mac) to invoke Command Palette
The command palette lists available commands along brief descriptions and documentation links.
Some fixes / improvements
- Goliath: Listing Google Cloud Storage now available under devstorage.readonly scope
- Goliath: Table Preview under GoBQ mode
- Goliath: Choppy Highlighting when cursor is moving over object icons
- Goliath Pin/Unpin: Mispositioned Cursor leads to wrong pin to be act upon
- Magnus Failure Dashboard: Improved “By Error” and “By Workflow Error” reports
- Magnus: Improved API Template Selector
- Magnus: Default Timezone is not sticking beyond user's session
- Magnus: Improved handling mis-formatted email addresses
- Magnus: fixed record parameter handling when converting Execute Workflow Task to API Task
- Magnus: support standard BQ table syntax in inputs such as in bq task destination table name.
  Supports project.dataset.table in addition to project:dataset.table
- Magnus: add support for Exact Search in workflow browser to disable searching for labels and instead allow searching for literal colons.
- Admin Suite: Service account key presence indication – On Users page, added indication if valid private key or hmac key is registered for service accounts
  and more …

March 9, 2022

New in Potens

Goliath: Built-in Parameters – Added var_yesterdaydate to list of built-in parameters
var_yesterday displays yesterday’s date as YYYY-MM-DD.
Magnus: Kill Workflow - Allow users to kill workflow from the history details dialog.
This feature previously was available for Magnus Admins only.
Now it is available for Admins, Owner, Delegates, and the run user (such as in the case of a shared workflow).
Kill Workflow button can be found by clicking on the Workflow Running status line at the bottom of the history details dialog, if the workflow is currently running and they have the necessary permission.

March 2, 2022

New in Potens

Goliath. More Integration with GitHub
User can set GitHub location associated with given workspace/tab, commit changes, commit on run, auto commit on run, etc..

Sidenote: Why Integration with GitHub is important!? Just few points …
- GitHub is a repository
- It makes it easy to contribute to your and your Team’s projects
  There is a wiki and issue tracker that makes it easy to include more in-depth documentation and get feedback about your project. If you want to contribute, you just fork a project, make your changes and then send them a pull request using GitHub web interface.
- Track changes in your code across versions
  When multiple people collaborate on a project, it’s hard to keep track revisions—who changed what, when, and where those files are stored. GitHub takes care of this problem by keeping track of all the changes that have been pushed to the repository. You can have a version history of your code so that previous versions are not lost with every iteration.
- Documentation
  By using GitHub, you make it easier to get excellent documentation about your project.
- And many more …
Magnus. More Integration with GitHub
User can set GitHub location associated with the workflow, pull, commit, and auto commit changes.
Magnus. New built-in parameters: var_yesterdayDate and var_shareLink
var_yesterdayDate is the same as var_yesterday but with hyphens separating each component (2022-02-24 instead of 20220224)
var_shareLink is URL to the workflow in Magnus, the same one from the Share Link button.
Magnus. Support for User Groups
Added Groups support to workflows’ Delegates and sharedWith users.
Magnus Admins can now manage allowed Groups via Admin Suite, so then Groups can be used in Workflows
Admin Suite. Bulk Role Transfer API
Bulk Role Transfer now can be invoked from outside the Potens.io via respective API.
API for initiating Transfer process as well as API to retrieve status/state of Transfer Process now available for remote execution by Admin account
See https://wiki.viantinc.com/display/PAS/Role+Transfer+APIs for details
Magnus Editor. Workflow Graph View
Added a graphical navigator to the right of the workflow editor which allows quicker access to tasks by scrolling to a task when clicking its icon in the graph. Graph View allows to see whole workflow outline at once. Also, when workflow is in edit mode, Graph View reflect changes on fly, etc.

February 16, 2022

Goliath Integration with GitHub – Save and Load SQL, Script, Tab, Workspace
Workspaces can be saved and loaded from GitHub
In addition to workspaces being saved as favorites or saved/loaded locally, they can now be committed to and pulled from GitHub.

Similarly, user can load saved file from GitHub
Search/Filter for Project Selectors (Billing and Data Projects in Explorer and Editor Menu)
Added input fields which act as filters within data and billing project menus which also enable some keyboard navigation using the arrow keys in project submenus

November 8, 2021

IntelliSense (IS) – added option for Search style to support IntelliSense for data objects
When typing project, dataset, table, and column names in a query they can be matched anywhere in their name by text typed. Previously, typed text would match on the start of the name. Now, if any of the typed text matches anywhere in the word the item will be displayed.
An option has been added under Settings to toggle this behavior.
Hover over Settings, identify option Match Start of Word and check or uncheck to set behavior.

If checked, the match will perform like it previously did which is to match by the start of the word.
If unchecked, words will be matched by the typed text anywhere in the word.

Match Start of Word

Match Anywhere in Word
External Formats – Parquet has been added as a file format option were applicable:
1. 1. Load Table Data
  2. Export Table
  3. Create External Table
    Click Format dropdown in respective Form and select Parquet as the option.
Copy to Clipboard – Query results, up to 16,000 rows or 10MB, can be copied to the clipboard.
Run a query, click on the Copy to Clipboard icon in the query results toolbar
Save Result to Table – Write preference have been added for Save Results as Table.
Previously write options defaulted to write if empty.
Run a query, choose ‘Save as Table’, and in the ‘If Table Exists’ dropdown select Fail, Append, or Overwrite.
Loading and Querying Hive Partitioned data in Cloud StorageUser can load and query data that is stored in Cloud Storage using a hive partitioning layout. Hive partitioning means that the external data is organized into multiple files, with a naming convention to separate files into different partitions

October 13, 2021

Goliath now supports BigQuery Sessions recently introduced by Google
In Goliath, user can create new session(s), multiple Tabs can join same session … open Options Panel to enable Session Mode
As FYI: Typical uses for a session include the following:
Maintain transient session data. Define variables and temporary tables once and use them throughout the session.
Look up query history by session. If you want to keep track of a behavior that happened at a particular time during the session, you can view the history of changes that were made during the session.
Create multi-statement transactions over multiple queries. Within a session, you can begin a transaction, make changes, and view the temporary result before deciding to commit or rollback. You can do this over several queries in the session. If you do not use a session, a multi-statement transaction needs to be completed in a single query.
Table preview (new shortcut) – Command + Shift + Click on table reference in query text navigates to respective table in Navigation Panel and auto-open preview for this table

September 2, 2021

New:

Switch Billing/Data Projects – Added option to Settings to display project format for switch billing/data projects as either name (id) or id (name).

Users can now select their preferred display project format in Settings.

Options include:

“Friendly Name (Project ID)”

and

“Project ID (Friendly Name)”.

Projects listed in switch Billing and Data Project context menu will be shown in preferred format.

Fixes / Improvements (most visible, user facing items):

Data Project – Fixed bug where selecting a data project in Switch Data Project with no datasets left the data project name empty.
Displaying a data project that does not have any datasets resulted in the project name not being displayed. The project name is now correctly displayed.
Query Options – Fixed issue where user without the proper scopes was not prompted for incremental authorization when setting destination table or retention in query options.
Modals – Fixed issue where some modals did not have a focus on an input field when the modal was opened.
Some modals (Modify Dataset, Export Table, Modify Table, Save Query/Workspace, Save View, Save Favorite, Parameters, Show Options, Set Result Page) did not have a focus on an input field. They now have a focus on an input field.
Edit Procedure – Fixed issue where selecting Edit Procedure from context menu showed a template for functions and not for procedure.
Navigator – Fixed bug with sort getting disabled on context menu confirmation
When confirming a context menu form, the dataset’s objects sort would become disabled and not be re-enabled
Query result – Fixed bug with Null was transformed to string in result grid.
Nulls are now displayed and treated as null
Set Results Limit – Fixed bug where negative number could be set resulted in errors when submitted.
Added validation to modal to require whole positive number.
Ticker – Improved logic to persist hide state.
Now, when user click Hide button once – scrolling text will not be shown to user unless new ticker content is detected
Query Text – Fixed bug when Clearing Tab sets [incorrectly] SQL Mode to Legacy Mode
Query Options – Fixed bug when Encryption Option is not cleared when edit query
Query Error – Fixed bug when “destination project not found” error not displayed
Error message was not being displayed when the destination was incorrect. The message now properly displays on error.
New Version Prompt – Fixed bug when “New Version” prompt keeps popping up for some time
Copy Table – Fixed bug when notification was missing for copy table completion when destination project is not active data project
Pin Dataset Objects – Fixed bug when sort order (descending) is reset (to ascending) when pinning a table or other objects within the dataset
IntelliSense – Fixed bug for autocomplete of data object’s columns
Tables with alias and partially typed column name would append column to already typed name. Now the selected name replaces the typed already name.
IntelliSense – Fixed bug for autocomplete of data object’s columns of record type
Tables/Objects with records would not show hints for record columns. Record columns are now shown.
Command (⌘) + Click shortcut behavior – Fixed bug when this shortcut worked only for table but not for views, models, etc.

August 4, 2021

IntelliSense for table/view aliases
Type table alias followed by dot and IntelliSense will present you with all respective columns to pick from

July 30, 2021

Table Snapshots
BigQuery table snapshots are now in Preview since June 25, 2021.
A table snapshot is a low-cost, read-only copy of a table's data as it was at a particular time. For more information, see Introduction to table snapshots.

Users can:
Create Snapshot with Time Travel feature

View/Explore Snapshots

Restore Table, etc.
Column Level Security
BigQuery column-level security is now generally available.
Policy tags can be replicated across locations.
For more information, see Introduction to BigQuery column-level security.
Row Level Security
Row-level security on table data is now (since June 21, 2021) generally available in BigQuery.
User can see table’s Row Access Policies

through respective table’s Contextual Menu
Parametrized Data Types
BigQuery now supports parameterized types. This feature is in Preview since June 7, 2021.
Table Valued Functions
Table functions are now available in Preview since June 28, 2021.
These user-defined functions, commonly known as table-valued functions (TVFs), return a table value.

June 15, 2021

Density/Spacing Setting: Added setting to control density (line spacing) for Navigator/Explorer Panel and Data/Results Grids
Share Dataset/Table: Control permissions via Identity and Access Management (IAM)

May 27, 2021

Goliath. UI Redesign - Modals, popups, buttons, navigator, grids, options, and parameters have been re-styled
New styles and appearance for modals, native alerts, popups within the Navigator, and grids for job history and query results. Modals with forms, options, and parameters are now presented in a sliding panel.
Most buttons and some contextual menu items are organized into new Menu System on top of Editor
Goliath. Save/Load Multi-tabs – Save Workspace has an option to save multiple tabs
An option was introduced in Save Workspace to save multiple tabs. When selected and saved multiple tabs will be opened the next time the file is opened via Load Workspace. If the tab is named Load Workspace and Favorites will rename the tab to the name when saved.

April 7, 2021

Goliath: IntelliSense

User now can select preferred style for reserved words (keywords) to be used in IntelliSense

Note: when query pasted into Goliath Editor from outside sources – the query will be formatted based on selected preferences

New shortcut is now available to switch between upper and lower cases – SHIFT+CTRL+U
Using of this shortcut will also change respective setting
Note: Change of preferred case (either through Settings or respective shortcut) is applied to all tabs in Editor and queries/scripts in them

Reminder: Upper/Lower Case management happens dynamically on background and does not change actual text of query/script, thus when you will copy / paste it outside of Goliath – you might see formatting different from how it appears/displayed in Goliath Editor. To make sure copy/paste preserves displayed format – use SHIFT+CTRL+F before copying

March 18, 2021

IntelliSense. Autocomplete Mode by default
An autocomplete option is now available. It is set via Settings and is enabled by default.
IntelliSense. Respect case user typing with.

vs.
IntelliSense. Improved coloring for DDL and DML statements and overloaded Keywords like LEFT function vs. LEFT JOIN statement
IntelliSense. Improvements for Net functions (NET.*), HyperLogLog++ functions (HLL_COUNT.*), Encryption functions (AEAD.*, KEYS.*)
Query Parameters. Interactive feedback / prompt when query consists of undefined parameter(s). Improved Hints
If undefined parameter is identified in query – respective message is presented as well as Hint (Flashing circle) to follow

In case when users still try to execute the query with undefined parameter(s) – below popup presented

If “Set Parameters” selected - Parameters Panel is auto opened for user to work with
Query Parameters. Improved apply for all parameters styles (<var_param>, :var_param, @param) and for all parameters data types (string, number, boolean).
Goliath Tour. Some fixes and improvements

February 18, 2021

Goliath: Share Table – Add feature to display and set sharing of table

Share Table option is now available in table’s context menu.
Authorize Routines – Added to Share Dataset context menu

Routines are now listed and can be added within Share Dataset context menu
Modify Routine Info – Added to context menu

Routines can have their description added/updated in Modify Routine Info from respective context menu.
Multiple fixes and improvements based on your feedback.

February 3, 2021

IntelliSense – (Magnus, Goliath) Added and updated Keywords to reflect most recent new and updated BigQuery features.
Added keywords: SUBSTRING, ASCII, CHR, INITCAP, INSTR, LAST_DAY, LEFT, OCTET_LENGTH, REGEXP_INSTR, REGEXP_SUBSTR, RIGHT, SOUNDEX, TRANSLATE, UNICODE, KEYS.NEW_KEYSET, KEYS.ADD_KEY_FROM_RAW_BYTES, AEAD.DECRYPT_BYTES, AEAD.DECRYPT_STRING, AEAD.ENCRYPT, ST_CLUSTERDBSCAN, ARRAY, ML.ARIMA_COEFFICIENTS, ML.FEATURE_IMPORTANCE. Added keyword statements CREATE EXTERNAL TABLE, DROP EXTERNAL TABLE, ALTER TABLE ADD COLUMN, EXPORT DATA, TRUNCATE TABLE, ADD COLUMN, ADD COLUMN IF NOT EXISTS, EXPORT DATA, EXPORT MODEL.
Updated keyword descriptions for ST_GEOGFROMGEOJSON, ST_GEOGFROMTEXT, REGEXP_EXTRACT, ST_NPOINTS, JSON_QUERY, JSON_VALUE.
Processing locations – (Magnus, Goliath) Added new locations
Added Iowa (us-central1), Oregon (us-west1), Belgium (europe-west1), and Netherlands (europe-west4)
Partitioning – Goliath UI updated to reflect most recent BigQuery Partitioning options, totaling to below summary:
Partitioning by Ingestion Time, Partitioning by Field of one of the data type – Date, Datetime, Timestamp, Int
With Partitioning Type - Day, Hour (except for Date), Month, Year and by Integer Range
Clustering – Goliath UI updated to reflect most recent BigQuery Clustering options, totaling to below summary:
Clustering option is now available even without partitioning
Data type check has been added for Clustering Fields
Allowed Data types: DATE, BOOL, GEOGRAPHY, INT64, NUMERIC, BIGNUMERIC, STRING, TIMESTAMP, and DATETIME
Multiple fixes and improvements based on your feedback.

January 27, 2021

Goliath: Results Data Grid – Added thousands separator for row number column.
Multiple fixes and improvements based on users' feedback.

January 21, 2021

Pin / Unpin Show on top in Navigator – New option added - [show] On top
When enabled – pinned item (dataset or object or folder) being moved on top of the respective list

New option works in conjunction with others – for example

January 13, 2021

Pin / Unpin Folders in Navigator – Folders now can also be pinned / unpinned in similar manner as it was previously introduced for Projects, Datasets and Objects

December 14, 2020

Incremental Authorization: During signup, user is asked for the most basic scope, bigquery.readonly, to perform actions within the applications. Some actions may need additional permissions and when initiated - a prompt requesting to grant them is presented. This flow is known as incremental authorization and introduced mostly to relax required permissions for trial users and new clients onboarding. Check out documentation here - https://potensio.zendesk.com/hc/en-us/articles/360052386432-Incremental-Authorization-

Note: this is Beta release – please let us know if any issue noticed

Important recommendation: Current Poten.io Clients who are adding new users after incremental authorization has been released (early December 2020) can recommend these users to grant the below scopes in advance to bypass incremental authorization process

bigquery
storage.full_control
cloud-platform
drive scopes

Pin / Unpin Projects, Datasets Objects in Goliath’s Navigator: Projects, Datasets and the Objects within Datasets can be pinned for easy access to frequently used items. The Navigator and the Switch Projects context menu both contain controls to show only pinned or both pinned and unpinned items. See more details in https://potensio.zendesk.com/hc/en-us/articles/115003427151-Navigator#pinunpin

Note: this is Beta release – please let us know if any issue noticed
Number of fixes and improvements. Some items:

Fixed Data Grid’s columns (re)sizing in Goliath
and many more …

July 14, 2020

Text Insertion into Query Editor
All actions that would previously clear the query text area before inserting text now instead present with modal for insert options.
This includes actions such as open query from recently run, script tables list, create model, create function, create procedure, create materialized view, list partitions, job history show query, load workspace, and gobq examples.

Defaults can be set in user settings.
Number of fixes and improvements

June 24, 2020

Integer Range Partitioning – Partitioning by integer range is available now in Goliath’s Nav Panel
Create empty table, load table data, and jobs history template modal updated to include integer partitioning. Nav popups updated to include integer partitioning metadata.
Materialized Views – Added materialized views handling in Goliath
Materialized Views are now identified by an icon in the nav, have proper context menu items, and display metadata.
Number of fixes and improvements

May 13, 2020

[NEW] Resizable Columns - Data / Result Grid columns can now be resized.
Hovering over a data / result grid column header will display a resize icon. When clicked the column size can be adjusted right/left to decrease/increase the column size. Currently resizable columns are available for page results up to 10,000 rows.
[NEW] Fold / Unfold Code, Hide / Show Editor, Dark Theme: added keyboard shortcuts
Query editor can be toggled to show/hide using keyboard shortcut CTRL+I
Query text can be toggled to fold/unfold a selection using keyboard shortcut CTRL+Q
Query text can be toggled to fold/unfold all using keyboard shortcut CTRL+Shift+Q
Dark Theme can be toggled to enable/disable dark theme using keyboard shortcut CTRL+M
[NEW] Dark Theme: added System Theme
User can define time frame for system to auto-switch Dark Theme on and off
Number of fixes and improvements

Fold / Unfold Code: fold/unfold state is persisted when switching Editor’s Tabs
BQ cost calculations: Billing tier has finally been removed from the calculation.
Model Schema in Navigator: was broken by use of obsolete API
Dark Theme – improved / fixed styling
Geo Visualization – is now restricted to only single Editor Tab at a time
and more …

March 24, 2020

Dark Theme
What a dark theme means to a developer is more screen time, more engagement and likely more revenue.

The reason is that dark screen is helping to concentrate your eyes longer and helping your brain to keep more attention on the screen. And there is real researches that have done to understand why actually it is easier to write a code on dark screen with lighter text

Theme can be switched to Dark and back to Light by going Settings >> Dark Mode
Hide / Show Query Editor
Allows to allocate more screen area for data / result view / preview
Fold / Unfold code fragments in Editor
Code folding is a feature that allows the user to selectively hide and display – "fold" – sections of a currently edited code as a part of routine edit operations. This allows the user to manage large amounts of code while viewing only those subsections of the code that are specifically relevant at any given time.

January 9, 2020

New in Goliath in January 2020 & Q4 2019

Full support for Scripting and Stored Procedures
Added Customer Managed Encryption Option
Improvements in Geo-Visualization

August 28, 2019

Execution Details: Query Execution Timeline
Added Slots Usage Timeline Chart
Both Query Execution Timeline Charts are synchronized when zooming in/out
Number of fixes and improvements

August 13, 2019

Multi-Tabs:
Add / Remove / Rename / Re-Order Tabs (up to 20 tabs, up to 15 characters in Name)
Editor / Options / Result / Preview / Charts panes are local to each Tab
Navigator / Browsers are global to whole Goliath
Support for Routines: Persistent UDF (Beta) and Stored Procedures (Alpha - requires white-listing by Google)
Functions and procedures are displayed in navigator along with respective context menu items, actions, etc.
Query Execution Plan and Timeline is now available directly from within Editor for currently running or completed query
Pagination is now available from within Data Grid / Explorer of Query Result / Table Preview / Jobs History
Silent Paging within Data Explorer
When navigating through records in Data Explorer pressing the “up” key on the first row of the current page goes to the last row in the previous page and pressing “down” goes to first row of next page
Number of fixes and improvements

June 26, 2019

New in June 2019

Jobs History: “Recent Jobs” Menu Item relabeled as “Jobs History” and moved to Context Menu of Billing Project (previously was under Resource Projects)
Jobs History: added “Execution Details” Tab with Visualization of Timeline and Execution Plan
Single Sign On (SSO): Added SSO to support integration with 3rd party tools/sites
ML Models: Models are fully supported in Navigator
Save to Google Drive Action is added to Action Bar
Geo Visualization: Added Custom Color Gradient Editor for Heatmap Style
Geo Visualization: Added respective action in case when result / preview consists of geo columns

When clicked – directly opens respective geo visualization
Multi-Tabs: Very early and limited Beta for Multi-Tab mode
Add / Remove / Rename / Re-Order Tabs (limited to three Tabs as of now)
Editor / Options / Result / Preview panes are local to each Tab
Navigator / Browsers are global to whole Goliath

April 4, 2019

New Feature: New button added to Goliath - "Automate with Magnus" which allows to copy Goliath's workspace into Magnus and create new workflow off of that workspace for further automation
Geo Visualization: Added more shapes for Pin Style
Added processing locations São Paulo (southamerica-east1) and Zürich (europe-west6)
Some cosmetic changes / rearrangements
- - "Run" Action Icon is not available anymore in Toolbar above Query Editor.
    "Run Query" Button in Toolbar below Query Editor should be used
  - "Download Result", "Save as Table" and "Pivot/Chart Result" Action Items moved to Result Pane

March 20, 2019

Geo Visualization – Transformation Functions added to data driven styles

Users can now apply functions (Identity, Linear, Interval, and Category) to data driven visualization style settings. When applied, data driven values are transformed based on the selected function and specified input and output buckets
This allow high level of flexibility in mapping/translating data from query’s data into some reasonably acceptable values for styles attributes
Some fixes / improvements here and there like few examples below o)
- Improved centering / focusing of visualized objects
- DDL and DML queries were missing in Recently Run Queries Contextual Menu
- Run-time Preview now respects selected query – important for multi-query mode with parameters
- Query duration in Query Stats pop-up now displays correct precision of time

February 14, 2019

Further additions for Geo Visualization (still in Beta):
1. Heatmap Style:
  1. Added Style Preview (previously only available for Pin, Circle, Polygon and Line styles)
  2. Added Heatmap Attributes for further customization (in addition to previously available Radius and Intensity)
    - Blur, Min Opacity, Max Intensity, Max Zoom
    - Reset Button allows to reset heatmap style to optimized default values
  3. Added Preset Color Gradients
2. Greatly Improved Performance of Visualization geo objects
  1. Processing 10,000 geo-points in 3-5 sec; 100,000 geo-points in 25-30 sec – still not recommended
    Warning: this was a stress test – we do not recommend really using that amount of entry points to be used with Visualization Tool – there is always way of pre-aggregating datapoints before visualization
  2. Performance is consistent across styles for initial drawing as well as for changing styles from one to another (in between Pins, Circles and Heatmap styles)
3. Accumulation of Visualizations from different result-sets
  1. Multiple query result-sets can be visualized on the same canvas.
    Current and all previous result-sets columns are available in active columns and layer menu (to choose from – to hide/show or remove not needed anymore)
4. Some UX improvements/additions
  1. Collapse / Expand Style Preview
Some fixes / improvements here and there like few below o)
- Added New Processing Locations (LA, Hong Kong)
- Fix for Load File w/o extension
- Improved logic for Default Dataset

January 25, 2019

Further additions for Geo Visualization (still in Beta):
1. Download Visualization as Image
2. Added “Source column” to selection for Tooltips and Popup Info
3. Heatmap style for Geo Points
4. Many more … (still work in progress. We plan to wrap up by mid-end February)
Some Fixes / Improvements (like few below)
1. Parameters use in GoBQ mode
2. Query Stats is now available for CTAS queries
3. Save Query is fixed for multi-query mode
4. Popup Info for Storage bucket now includes lifecycle information
5. Added newly introduced functions for IntelliSense – like ST_X, ST_Y

December 12, 2018

Added ability to Create External Table (Google Cloud Storage, Google Drive)
Added Left Click style for invoking Contextual Menu in Navigation Panel
Added Sheet and Range as an option for External Table based on Google Sheet
Added new Processing Locations: London, Singapore, Sydney, Northern Virginia, Finland and Taiwan
Added Parquet and ORC formats available for Load Table Data
External source on Table Info Popup is now linked (clickable) to respective file/sheet on GCS / Google Drive
UI Redesign for presenting Billing vs. Data Projects. Both are now on top of Navigation Panel. Billing Project selector removed from Settings
Geo Visualization Tool (Alpha) - Massive amount of visualization related features – just start exploring and ask if any questions.
It is in Alpha though! Documentation is not available yet. But most is self-descriptive if apply a little effort
The main features are:
1. Layers
  1. Base Layer: Esri World Street Map or Blank Map
  2. Each Geography Column represented as separate Secondary Layer
2. Supported types:
  1. Point / Multi-Points
  2. Line / Multi-Lines
  3. Polygon / Multi-Polygons
  4. Geo-Collection
3. Multiple Zooming / Collecting options
4. Rich Styling
  1. Point as Pin: Color, Shape, Engraved Icon
  2. Point as Circle: Radius (Fixed or Scaled with Map), Color and Opacity for Fill and Stroke, Width for Stroke
  3. Polygon: Color and Opacity for Fill and Stroke, Width for Stroke
  4. Line: Color, Opacity and Width for Stroke
5. Data Driven Styles: any of attributes can be bound to specific column to derive value from
6. Data Driven Object Tooltips, Object Popups and Visualization Footer
Some minor fixes, improvements. See examples below:
1. Improved messaging when navigating to last page in preview of table with streaming buffer
2. Fixed / Improved uploading files to Cloud Storage (some types were getting corrupted after uploading)
3. Template Job was not preserving Delimiter

October 9, 2018

BigQuery Geospatial (GIS) Support
1. Collections Visualization
2. Introduced Zoom Options
  1. Zoom to Object
  2. Zoom to Collected Objects
  3. Preserve Zoom
3. Added ability to:
  1. Clear Visualization
  1. View All - zoom out to all Collected Objects
4. Overall Improvement for Geography data type Visualization
Better support for External Tables
1. External Source Configuration Details in Table’s Info Popup

October 2, 2018

BigQuery Geospatial (GIS) Support
1. POINTs and MULTIPOINTs Visualization
- - multi- LINEs and POLYGONs visualization already supported since August release
  - support for COLLECTIONs visualization will come in next release
1. Added Preserve Mapping Option
2. Added Label below the Visualization
3. Overall Improvement for Geography data type Visualization
More support for BigQuery ML
1. Added Template for ‘Produce Confusion Matrix’ for Query Model list
IntelliSense
1. Added new functions to IntelliSense:
  ML.CONFUSION_MATRIX(), ST_GeogFromWKB(), ST_AsBinary(), GENERATE_UUID()

September 12, 2018

More support for BigQuery GIS
1. Geography data type Visualization
2. Preview (truncated) vs Full WKT for Geography data type
3. IntelliSense for Geospatial functions
More support for BigQuery ML
1. Training Options now presented in Model Info Popup
2. Context sensitive ‘Create / Train Model’ Menu Items
Improved highlighting and IntelliSense support for tables
1. Smart tables selection in multi query mode
2. Coloring tables in query
3. Highlight tables with CTRL/CMD
4. Navigate to and open table with CTRL/CMD + Click
Improved query validation on billing project change, for multi query mode, etc.s

August 14, 2018 (July'18)

IntelliSense: added support for BQML, Clustering and other recently added functions, features
Processing Location: added full support for Copy/Load/Export/Save Table and Run Query
Navigator / Browser: Support to Create Table with empty schema
Table Export: Added DEFLATE and SNAPPY compressions for AVRO format
Direct link: direct link with project not in Switch Project List will temporary add the project to the list (assuming user has access)
Data Definition Language (DDL): improved UX – better messaging in result panel and sync with Navigator’s appearance
Partitioned Tables: added Require Filter and Partition Expiration to respective Forms (Create, Load, Modify Table)

Below new BigQuery features - recently announced during Google Cloud Next’18 are now supported in Goliath
BigQuery ML: full support – Navigator / Browser, IntelliSense, etc.
- BigQuery ML, available now in beta
Clustered Tables: full support - Create, Load, Info, IntelliSense, etc
- BigQuery Clustering, in beta
BigQuery Geospatial: limited yet support – Schema in Navigator and IntelliSense.
Full IntelliSense support expected in next release
- BigQuery GIS, in public alpha

June 19, 2018 (Q2'18)

Partitioned Tables: support for creating and loading data. Both ingestion-time and field based partitioning. Also available in load template from Recent Jobs
Destination Table message: now it survives after various user’s UI activity
Fix for Recently Run
Added autocomplete for Favorites, so it is easier just to pick existing favorite from list to be overwritten
Added warning message if user is about to overwrite existing Favorite Query / Script
New Item in Tables’ Contextual Menu for partitioned Tables
Tour and Help/Guides Links “promoted” and available now in right-top corner for easier access
Currently effective billing project is now displayed under the Settings
Invoking Recent Jobs Menu Item from Navigation Panel opens Recent Jobs Browser for currently in effect billing project, no matter which project is open in Navigator.
To see Recent Jobs for any available billing project – user should Switch Project from within Context Menu of Recent Jobs Browser
Added recently introduced functions, keywords, etc. to IntelliSense
Many/many more fixes, improvements – let us know if you see something you asked / reported but not addressed yet

January 4, 2018

External Tables got their own icon to be represented in Navigator
Fix: Goliath Tour did not work from page that was opened using Shared link
Fix: UDF UI is now disabled for Standard SQL
Fix: Some minor issues with GoBQ Editor
Fix: in some edge cases Share Link did not expand datasets/tables
Fix: Goliath Tour did not work in case user had empty project or dataset or some other objects “used” in Tour.
Many more not user exposed fixes and improvements

December 20, 2017

Fix: Paging for Preview of Streaming tables
Fix: Issue with checking billing project to display Recent Jobs
Manage Configuration links to admin tool for Org Admins

December 13, 2017

Added skinning and environment awareness (helps, links, etc. )

December 6, 2017

Removed displaying Max Billing Tier from options, parameters, and GoBQ scripts

November 1, 2017

Fix for "Query Formatting" (CTRL-SHIFT-F)
Fix for "Share Project Link" with Favorite when spaces in favorite name
"Load Config" – added message on corrupted previously saved file (MD5)

October 24, 2017

Save / Load Settings added to User Settings
New recently introduced Functions added to IntelliSense
Numerous small fixes / improvements

September 26, 2017

Additional support for source table in Job Template for Copy
1. Multiple source tables
2. Table decorators
3. Table partitions
_FILE_NAME pseudo column support for External Tables
Numerous fixes / improvements
1. Consecutive duplicate Queries/Scripts not added to Recently Run
2. Open in Goliath doesn’t display destination table when options hidden
3. and more

September 19, 2017

Run “in-focus” Query
Notification added to display destination table when Options are hidden
Notification added to indicate when Query Result is from cache
Fix Context Menu that got accidentally disabled in latest release
Refresh has been added as an option to Context Menu in Job History Browser.
Favorite Query/Script has been added as an option to Share Direct Link (project level)
Auto populate (smart entry) for projects, datasets, and tables have been added to Save View and Save Result as Table Dialogs
When running a query, including when using Shift-F5 to run a selected or in-focus query, the cursor does not reset to the start of the query editor text area and rather stays unchanged
Adding an existing bucket in Add Bucket prompt no longer displays an error message
Added feature to see all buckets associated with same project at the same time – rather than by individual bucket
Numerous smaller fixes / improvements

August 15, 2017

Pop-Up Form (Smart Entry) for Destination Table
Bucket / File Info Popup in Storage Navigator
Fixes, improvements

August 8, 2017

Goliath for Cloud Storage (Beta)
1. Project’s Buckets Navigation
2. Specific Bucket Navigation
3. Add/Remove Favorite Buckets
4. Removed some Early Beta limitations
Project / Dataset / Table Smart Entry across all Actions Dialogs
Multiple Fixes

August 1, 2017

Goliath for Cloud Storage (Early Beta)
Added ability of enabling/disabling certain Goliath features on per user basis
Number of minor fixes, improvements

July 19, 2017

Open Magnus BQ or Script Task in Goliath
Number of minor fixes, improvements

July 6, 2017

Recently Run [Queries / GoBQ in Goliath]
Favorite [Query / GoBQ]
GoBQ Examples
Open Magnus BigQuery Task or Go Script Task in Goliath (in Beta now)
Extra notification / warning on Billing Tier greater than 1 if no any specific setting were set
Number of minor fixes, improvements

June 7, 2017

Support for Local File Upload into GBQ
Support for Standard SQL style Named Parameters
Few minor fixes, improvements

May 31, 2017

Navigator and Browser Full Redesign
“Recent Jobs” Redesign
Fix for Copy, Export and Load jobs to use proper billing project
Improved Metadata Caching to support Navigator, Browser and IntelliSense
Multiple fixes, improvements (IntelliSense, Visualization, Usage Logging)

March 28, 2017

Default Data Project: Show on Load
Multiple fixes, improvements (IntelliSense, Visualization, Usage Logging)

March 22, 2017

Changed behavior for Run Query Button
Changed behavior for Parameters Button
Added IntelliSense Support for new Standard SQL Functions introduced in recent BigQuery Releases
Some random performance improvements

March 7, 2017

Improved IntelliSense for Data Objects
- Partitioned Tables
- Repeated Fileds
- Metadata Tables
- Not registered (with Goliath) projects
Added IntelliSense Support for new Functions
Some random performance improvements

February 16, 2017

Goliath IntelliSense now supports Data Objects (projects / datasets / tables) and Data Schema (columns / types )

February 9, 2017

Control Panel Redesign
Project Selector redesign
Data Objects (Projects>Datasets>Tables) & Context aware IntelliSense
Ability to select Billing Project from those projects where User has respective rights
Some fixes:
- CTRL-Z and Right Click inside Editor
- Right Click over icons in Navigator
Many more

January 23, 2017

Playground Redesign
1. Defaults:
  1. Standard SQL is default version
  2. SQL Version Auto-detection is disabled by default
  3. Preferences
2. Enhanced and Preview modes are now removed from top panel
  1. Enhanced mode is available as check option now for Legacy SQL only
  2. Preview mode is available from within contextual menu
  3. Download feature in Toolbar is now available in Preview Mode
3. Edit Mode is eliminated. Editor is always in edit mode now!
‘Script “select * from table”’ menu option in contextual menu – replaced with ‘Script “select from table”’
Direct Links - added browser panel and dataset options to project direct link
Fixed info popup for external tables in Navigator
Added Size and Rows count in Query Status Popup
_partitiontime added to the list of fields in Contextual Menu for Partitioned Tables
Added visual handlers to all splitters
Fix for paging on streaming table preview
Fix for parameter collection from Options Panel
Improvements for Visualization Panel (Pivot/Chart Results)
Usage Logging
Many more

December 20, 2016

Direct Link: Share Link Menu added for Project/Dataset/Table Contextual Menu
IntelliSense and Help on Hover for ALL Legacy and Standard SQL Functions
Link to Documentation on Hover for ALL Legacy and Standard SQL Functions
Redesign for Download Result feature
Multiple UX fixes, improvements

December 15, 2016

Panel Splitters complete redesign
Built-In parameters no longer editable, and always have recent values
IntelliSense for Parameters (in BigQuery Editor)
Direct Link feature
Users can now reference/share specific project, dataset or even table via direct link.
Below is syntax to use:
Project: http://goliath.potens.io/?nav=project
Dataset: http://goliath.potens.io/?nav=project:dataset
Table: http://goliath.potens.io/?nav=project:dataset.table
Fix for Full Screen button positioning
Multiple fixes and improvements for IntelliSense and Help Hints
"New Version" Push Notification

December 7, 2016

Record Parameters Support (Magnus style)
Rich Editor
- IntelliSense with Tooltips and Tooltips on Hover in BigQuery Standard Mode
- Preserve Keywords Case with Ctrl-Shift-F

November 30, 2016

DML Query shows number of affected rows
BigQuery Editor:
- Help Hints on Keywords hover
- Help Hints while in Auto-complete / Intellisense Mode (CTRL+Space)
Parameters: Double Evaluation Option/Switch
Create Table: added ability to create partitioned tables
Light Viant Branding for Start/Login Page and Re-Login Pop-Up

November 15, 2016

Goliath Tour
Run Selected Query Only (SHIFT+F5)

November 2, 2016

Company-wide release of Goliath!
Full User Documentation

October 26, 2016

Improved Parameters Panel
Run-Time Preview
Ability to Remove (previously added) Project
Billing / Default Project
Hints Framework

October 12, 2016

Support for Workspaces
Extra Support for Views
- Save View with UDF
- View in Standard SQL Mode
- SQL Mode indication in View Info PopUp
SQL-mode Sensitive Table reference Insert

October 5, 2016

Rich Editor – more features (to match those recently added to Magnus)
- Icon to go Full Size Editor (for MAC users; For PC - F11/ESC also can be used)
- Embracing Selection in Brackets – ({[‘”`
- Multiline and multi-position Cursor/Carets and Selection (Alt + Left Click – PC / Command + Left Click - Mac)
- Block Selection, Copy
- Proper treating escaped SQL Keywords – e.g. [date] instead of auto upper-case for DATE. This is useful when, for some reason, you want to use keyword as alias but don’t want it to be treated by editor as a keyword
Support for recently introduced BigQuery DML
- See Data Manipulation Language
- and Data Manipulation Language Syntax

September 28, 2016

Parameters Support (compatible with Magnus)

September 21, 2016

SQL Mode Auto-detection
Max Billing Size
Project Persistence (local to Browser)
Long Term size in Table/Dataset Info
Many Enhancements across the app

September 07, 2016

Dataset Labeling / Tagging
Dataset Filtering by Labels/Tags
Multiple fixes/improvements across UI

August 10, 2016

Rich Editors for BigQuery (Standard, Enhanced), JS UDF and GoBQ mode
- Lines Numbering
- Active Line
- Code Coloring
- Auto-completion (CTRL+SPACE)
- Matching bracket
- Commenting / Uncommenting (CTRL+/)
- Full Screen mode (F11)
Actions for Recent Jobs
- Edit Query (with further Save / Run / etc.)
- Show Previous Result
- Cancel Query / Job
- Use Job as a Template for new Job and Run it

July 20, 2016

Support for Inline UDF
Save / Load Code for BQ Query / UDF / GoBQ
As well as Save UDF to Cloud Storage
Add Field(s) Option for Modify Table Schema
GoBQ Mode
- Added packages:
  - crypto/md5
  - bytes
Added aliases for fmt.Fprint* functions
- xFprint, xFprintf, xFprintln
Improved Error Messaging :
- Go specific errors with line, etc. vs.
- Sandbox Env specific error

July 13, 2016

GoBQ Mode
More Action Items in Context Menu
- Modify Dataset Info
- Modify Table Info
- Modify Table Schema

July 6, 2016

Jobs History with Paging
Support for External (in GCS) UDF
Support for Partitioned Tables

June 15, 2016

Jobs / Query History

June 7, 2016

Share Dataset / Dataset ACL Management
Streaming Buffer in Table Info Popup (on currently streamed table hover)
Collapse/Expand Menu Items for Groups
Show [reusable] Table Schema
Show [reusable] Query Result Schema

May 25, 2016

Download Result as CSV, JSON, AVRO to user’s computer
Create Table / Load Data from GCS in variety of formats / options
Export Table to GCS
View specific Contextual Menu and Icon
Max Billing Tier and SQL Version in Query Stats Popup

May 18, 2016

Save Query as View
Save Result as Table
Support for Standard SQL vs. Legacy SQL
Support for Max Allowed Billing Tier
Some Cosmetic changes in UI

May 12, 2016

Object Management across application (Contextual Menu in Navigation Panel, Object Browser, etc.)
- Project:
  - Browse, Create Dataset, Refresh
- Dataset:
  - Browse, Delete, Script Tables List, Refresh
- Table:
  - Preview, Delete, Copy, Script

April 20, 2016

Retention option for when table as destination for query
Continuous paging in both Result and Pivot Panels
Resizable Data Explore Popup (enhanced mode for record/nested type fileds)

April 07, 2016 (Beta - aka Sandbox v.2)

Sandbox v2 is in Beta

March 09, 2016

Rich paging functionality with result’s total rows count and current page’s start and end
Auto Size option for result paging
Save and Pivot Functionality available in all Modes (Standard, Enhanced and Preview)
Regular Expression support in filters
Owner Info added in Object Browser and Object Metadata Popups
Dataset Browser has contextual menu now for “table” column. Actions available so far: Preview, Insert and Select *. More to come.
- Preview – obviously initiate Preview Mode for respective table. Note: Preview Mode allows you to walk thru / page Table content for absolutely free.
- Insert – inserts respective table name into Query Editor (if in Edit Mode of either Standard or Enhanced)
- Select * - Replace Query Editor text with “SELECT * FROM <respective table name>”
Result Header shows data type (on mouse hover) and data itself justified based on its data type
- Note: in Enhanced mode record fields are not flattened (as it is in Standard Mode which is the Native BQ UI behavior). So you can explore data (unison logs for example) as it is stored or produced off of your query (if it produces record or nested fields).
- To actually see whole record/nested data - you need to double click on respective data cell in result grid

March 02, 2016

Project/Dataset Browser with filtering, sorting, etc.
- Click on Project title above Navigation Panel or double click on dataset name (in navigation or project browser) to load respective browser
- Click on browser’s header to sort
Query Editor / Launcher with great support for Standard, Enhanced and Preview mode with unlimited paging
Easy result browsing/storing/pivoting/charting/etc
Query stats, including project and billing cost

January 14, 2016 (Alpha - aka Sandbox v.1)

Data Warehouse Team is proud to announce alpha availability of new Self-Serve Tool – BigQuery Sandbox

Pre-BigQuery Versions

April 16, 2015

- Sandbox Quick Tour - Retrospective Video

April 22, 2014

- Hadoop / Hive based Self-Service Tool
- Self-Serve - Step-by-Step User Guide

March 7, 2014

- Hadoop / Hive based Self-Service Tool
- UI - Walk-through and Examples

Match Start of Word	Match Anywhere in Word

Articles > Release Notes

June 20, 2022

May 25, 2022

March 9, 2022

March 2, 2022

February 16, 2022

November 8, 2021

October 13, 2021

September 2, 2021

August 4, 2021

July 30, 2021

June 15, 2021

May 27, 2021

April 7, 2021

March 18, 2021

February 18, 2021

February 3, 2021

January 27, 2021

January 21, 2021

January 13, 2021

December 14, 2020

July 14, 2020

June 24, 2020

May 13, 2020

March 24, 2020

January 9, 2020

August 28, 2019

August 13, 2019

June 26, 2019

April 4, 2019

March 20, 2019

February 14, 2019

January 25, 2019

December 12, 2018

October 9, 2018

October 2, 2018

September 12, 2018

August 14, 2018 (July'18)

June 19, 2018 (Q2'18)

January 4, 2018

December 20, 2017

December 13, 2017

December 6, 2017

November 1, 2017

October 24, 2017

September 26, 2017

September 19, 2017

August 15, 2017

August 8, 2017

August 1, 2017

July 19, 2017

July 6, 2017

June 7, 2017

May 31, 2017

March 28, 2017

March 22, 2017

March 7, 2017

February 16, 2017

February 9, 2017

January 23, 2017

December 20, 2016

December 15, 2016

December 7, 2016

November 30, 2016

November 15, 2016

November 2, 2016

October 26, 2016

October 12, 2016

October 5, 2016

September 28, 2016

September 21, 2016

September 07, 2016

August 10, 2016

July 20, 2016

July 13, 2016

July 6, 2016

June 15, 2016

June 7, 2016

May 25, 2016

May 18, 2016