1. Potens.io
  2. Goliath
  3. Meet Goliath

Articles > Release Notes

June 26, 2019  

New in June 2019

  • Jobs History: “Recent Jobs” Menu Item relabeled as “Jobs History” and moved to Context Menu of Billing Project (previously was under Resource Projects) 

    3.png

  • Jobs History: added “Execution Details” Tab with Visualization of Timeline and Execution Plan

    4.png

  • Single Sign On (SSO): Added SSO to support integration with 3rd party tools/sites
  • ML Models: Models are fully supported in Navigator 

    5.png

  • Save to Google Drive Action is added to Action Bar

    6.png

  • Geo Visualization: Added Custom Color Gradient Editor for Heatmap Style 

    7.png

  • Geo Visualization: Added respective action in case when result / preview consists of geo columns

    8.png

    When clicked – directly opens respective geo visualization 

    9.png

  • Multi-Tabs: Very early and limited Beta for Multi-Tab mode  
    Add / Remove / Rename / Re-Order Tabs (limited to three Tabs as of now)
    Editor / Options / Result / Preview panes are local to each Tab
    Navigator / Browsers are global to whole Goliath  

    10.png

April 4, 2019  

  • New Feature: New button added to Goliath - "Automate with Magnus" which allows to copy Goliath's workspace into Magnus and create new workflow off of that workspace for further automation

  • Geo Visualization: Added more shapes for Pin Style



  • Added processing locations  São Paulo (southamerica-east1) and Zürich (europe-west6)

  • Some cosmetic changes / rearrangements 



      • "Run" Action Icon is not available anymore in Toolbar above Query Editor.  
        "Run Query" Button in Toolbar below Query Editor should be used

      • "Download Result", "Save as Table" and "Pivot/Chart Result" Action Items moved to Result Pane
     

March 20, 2019  

  • Geo Visualization – Transformation Functions added to data driven styles

    Users can now apply functions (Identity, Linear, Interval, and Category) to data driven visualization style settings.  When applied, data driven values are transformed based on the selected function and specified input and output buckets
    This allow high level of flexibility in mapping/translating data from query’s data into some reasonably acceptable values for styles attributes

    02-03.png

  • Some fixes / improvements here and there like few examples below o)

    • Improved centering / focusing of visualized objects
    • DDL and DML queries were missing in Recently Run Queries Contextual Menu
    • Run-time Preview now respects selected query – important for multi-query mode with parameters
    • Query duration in Query Stats pop-up now displays correct precision of time

February 14, 2019  

  • Further additions for Geo Visualization (still in Beta):
    1. Heatmap Style:
      1. Added Style Preview (previously only available for Pin, Circle, Polygon and Line styles)
      2. Added Heatmap Attributes for further customization  (in addition to previously available Radius and Intensity)
        • Blur, Min Opacity, Max Intensity, Max Zoom
        • Reset Button allows to reset heatmap style to optimized default values

          1.png

      3. Added Preset Color Gradients

        2.png

    2. Greatly Improved Performance of Visualization geo objects
      1. Processing 10,000 geo-points in 3-5 sec; 100,000 geo-points in 25-30 sec – still not recommended
        Warning: this was a stress test – we do not recommend really using that amount of entry points to be used with Visualization Tool – there is always way of pre-aggregating datapoints before visualization
      2. Performance is consistent across styles for initial drawing as well as for changing styles from one to another (in between Pins, Circles and Heatmap styles)
    3. Accumulation of Visualizations from different result-sets
      1. Multiple query result-sets can be visualized on the same canvas. 
        Current and all previous result-sets columns are available in active columns and layer menu (to choose from – to hide/show or remove not needed anymore)
    4. Some UX improvements/additions
      1. Collapse / Expand Style Preview
  • Some fixes / improvements here and there like few below o)
    • Added New Processing Locations (LA, Hong Kong)
    • Fix for Load File w/o extension
    • Improved logic for Default Dataset

January 25, 2019  

  • Further additions for Geo Visualization (still in Beta):
    1. Download Visualization as Image
    2. Added “Source column” to selection for Tooltips and Popup Info
    3. Heatmap style for Geo Points
    4. Many more … (still work in progress. We plan to wrap up by mid-end February)

      3.jpg

  • Some Fixes / Improvements (like few below)
    1. Parameters use in GoBQ mode
    2. Query Stats is now available for CTAS queries
    3. Save Query is fixed for multi-query mode
    4. Popup Info for Storage bucket now includes lifecycle information
    5. Added newly introduced functions for IntelliSense – like ST_X, ST_Y

December 12, 2018  

  • Added ability to Create External Table (Google Cloud Storage, Google Drive)
  • Added Left Click style for invoking Contextual Menu in Navigation Panel
  • Added Sheet and Range as an option for External Table based on Google Sheet
  • Added new Processing Locations: London, Singapore, Sydney, Northern Virginia, Finland and Taiwan
  • Added Parquet and ORC formats available for Load Table Data
  • External source on Table Info Popup is now linked (clickable) to respective file/sheet on GCS / Google Drive
  • UI Redesign for presenting Billing vs. Data Projects. Both are now on top of Navigation Panel. Billing Project selector removed from Settings
  • Geo Visualization Tool (Alpha) - Massive amount of visualization related features – just start exploring and ask if any questions. 
    It is in Alpha though! Documentation is not available yet. But most is self-descriptive if apply a little effort 
    The main features are:
    1. Layers
      1. Base Layer: Esri World Street Map or Blank Map
      2. Each Geography Column represented as separate Secondary Layer
    2. Supported types:
      1. Point / Multi-Points
      2. Line / Multi-Lines
      3. Polygon / Multi-Polygons
      4. Geo-Collection
    3. Multiple Zooming / Collecting options
    4. Rich Styling
      1. Point as Pin: Color, Shape, Engraved Icon
      2. Point as Circle: Radius (Fixed or Scaled with Map), Color and Opacity for Fill and Stroke, Width for Stroke
      3. Polygon: Color and Opacity for Fill and Stroke, Width for Stroke
      4. Line: Color, Opacity and Width for Stroke
    5. Data Driven Styles: any of attributes can be bound to specific column to derive value from
    6. Data Driven Object Tooltips, Object Popups and Visualization Footer 

      4.png

  • Some minor fixes, improvements. See examples below:
    1. Improved messaging when navigating to last page in preview of table with streaming buffer
    2. Fixed / Improved uploading files to Cloud Storage (some types were getting corrupted after uploading)
    3. Template Job was not preserving Delimiter

October 9, 2018  

  • BigQuery Geospatial (GIS) Support
    1. Collections Visualization
    2. Introduced Zoom Options
      1. Zoom to Object
      2. Zoom to Collected Objects
      3. Preserve Zoom
    3. Added ability to:
      1. Clear Visualization
      1. View All - zoom out to all Collected Objects
    4. Overall Improvement for Geography data type Visualization   

      5.png

  • Better support for External Tables
    1. External Source Configuration Details in Table’s Info Popup

October 2, 2018  

  • BigQuery Geospatial (GIS) Support
    1. POINTs and MULTIPOINTs Visualization

      6.png

      • multi- LINEs and POLYGONs visualization already supported since August release

        7.png

      • support for COLLECTIONs visualization will come in next release
    1. Added Preserve Mapping Option

      8.png

    2. Added Label below the Visualization
    3. Overall Improvement for Geography data type Visualization 
  • More support for BigQuery ML
    1. Added Template for ‘Produce Confusion Matrix’ for Query Model list
  • IntelliSense
    1. Added new functions to IntelliSense: 
      ML.CONFUSION_MATRIX(), ST_GeogFromWKB(), ST_AsBinary(), GENERATE_UUID()

September 12, 2018  

  • More support for BigQuery GIS
    1. Geography data type Visualization
    2. Preview (truncated) vs Full WKT for Geography data type
    3. IntelliSense for Geospatial functions
  • More support for BigQuery ML
    1. Training Options now presented in Model Info Popup
    2. Context sensitive ‘Create / Train Model’ Menu Items
  • Improved highlighting and IntelliSense support for tables
    1. Smart tables selection in multi query mode
    2. Coloring tables in query
    3. Highlight tables with CTRL/CMD
    4. Navigate to and open table with CTRL/CMD + Click
  • Improved query validation on billing project change, for multi query mode, etc.s

August 14, 2018  (July'18)

June 19, 2018  (Q2'18)

  • Partitioned Tables: support for creating and loading data. Both ingestion-time and field based partitioning. Also available in load template from Recent Jobs 
  • Destination Table message: now it survives after various user’s UI activity 
  • Fix for Recently Run 
  • Added autocomplete for Favorites, so it is easier just to pick existing favorite from list to be overwritten
  • Added warning message if user is about to overwrite existing Favorite Query / Script
  • New Item in Tables’ Contextual Menu for partitioned Tables
  • Tour and Help/Guides Links “promoted” and available now in right-top corner for easier access
  • Currently effective billing project is now displayed under the Settings
  • Invoking Recent Jobs Menu Item from Navigation Panel opens Recent Jobs Browser for currently in effect billing project, no matter which project is open in Navigator. 
    To see Recent Jobs for any available billing project – user should Switch Project from within Context Menu of Recent Jobs Browser
  • Added recently introduced functions, keywords, etc. to IntelliSense 
  • Many/many more fixes, improvements – let us know if you see something you asked / reported but not addressed yet

January 4, 2018

  • External Tables got their own icon to be represented in Navigator
  • Fix: Goliath Tour did not work from page that was opened using Shared link
  • Fix: UDF UI is now disabled for Standard SQL
  • Fix: Some minor issues with GoBQ Editor
  • Fix: in some edge cases Share Link did not expand datasets/tables
  • Fix: Goliath Tour did not work in case user had empty project or dataset or some other objects “used” in Tour. 
  • Many more not user exposed fixes and improvements

December 20, 2017

  • Fix: Paging for Preview of Streaming tables
  • Fix: Issue with checking billing project to display Recent Jobs
  • Manage Configuration links to admin tool for Org Admins

December 13, 2017

  • Added skinning and environment awareness (helps, links, etc. )

December 6, 2017

  • Removed displaying Max Billing Tier from options, parameters, and GoBQ scripts

November 1, 2017

  • Fix for "Query Formatting" (CTRL-SHIFT-F) 
  • Fix for "Share Project Link" with Favorite when spaces in favorite name
  • "Load Config" – added message on corrupted previously saved file (MD5)

October 24, 2017

  • Save / Load Settings added to User Settings
  • New recently introduced Functions added to IntelliSense
  • Numerous small fixes / improvements

September 26, 2017

  • Additional support for source table in Job Template for Copy
    1. Multiple source tables
    2. Table decorators
    3. Table partitions
  • _FILE_NAME pseudo column support for External Tables
  • Numerous fixes / improvements
    1. Consecutive duplicate Queries/Scripts not added to Recently Run
    2. Open in Goliath doesn’t display destination table when options hidden
    3. and more

September 19, 2017

  • Run “in-focus” Query
  • Notification added to display destination table when Options are hidden
  • Notification added to indicate when Query Result is from cache
  • Fix Context Menu that got accidentally disabled in latest release
  • Refresh has been added as an option to Context Menu in Job History Browser.
  • Favorite Query/Script has been added as an option to Share Direct Link (project level)
  • Auto populate (smart entry) for projects, datasets, and tables have been added to Save View and Save Result as Table Dialogs
  • When running a query, including when using Shift-F5 to run a selected or in-focus query, the cursor does not reset to the start of the query editor text area and rather stays unchanged
  • Adding an existing bucket in Add Bucket prompt no longer displays an error message
  • Added feature to see all buckets associated with same project at the same time – rather than by individual bucket
  • Numerous smaller fixes / improvements

August 15, 2017

  • Pop-Up Form (Smart Entry) for Destination Table
  • Bucket / File Info Popup in Storage Navigator
  • Fixes, improvements

August 8, 2017

  • Goliath for Cloud Storage (Beta)
    1. Project’s Buckets Navigation
    2. Specific Bucket Navigation
    3. Add/Remove Favorite Buckets
    4. Removed some Early Beta limitations
  • Project / Dataset / Table Smart Entry across all Actions Dialogs
  • Multiple Fixes

August 1, 2017

  • Goliath for Cloud Storage (Early Beta)
  • Added ability of enabling/disabling certain Goliath features on per user basis
  • Number of minor fixes, improvements 

July 19, 2017

  • Open Magnus BQ or Script Task in Goliath
  • Number of minor fixes, improvements 

July 6, 2017

  • Recently Run [Queries / GoBQ in Goliath]
  • Favorite [Query / GoBQ]
  • GoBQ Examples 
  • Open Magnus BigQuery Task or Go Script Task in Goliath (in Beta now)
  • Extra notification / warning on Billing Tier greater than 1 if no any specific setting were set
  • Number of minor fixes, improvements 

June 7, 2017

  • Support for Local File Upload into GBQ 
  • Support for Standard SQL style Named Parameters
  • Few minor fixes, improvements 

May 31, 2017

  • Navigator and Browser Full Redesign
  • “Recent Jobs” Redesign
  • Fix for Copy, Export and Load jobs to use proper billing project
  • Improved Metadata Caching to support Navigator, Browser and IntelliSense
  • Multiple fixes, improvements (IntelliSense, Visualization, Usage Logging)

March 28, 2017

  • Default Data Project: Show on Load 
  • Multiple fixes, improvements (IntelliSense, Visualization, Usage Logging)

March 22, 2017

  • Changed behavior for Run Query Button 
  • Changed behavior for Parameters Button
  • Added IntelliSense Support for new Standard SQL Functions introduced in recent BigQuery Releases
  • Some random performance improvements

March 7, 2017

  • Improved IntelliSense for Data Objects
    • Partitioned Tables
    • Repeated Fileds
    • Metadata Tables
    • Not registered (with Goliath) projects
  • Added IntelliSense Support for new Functions
  • Some random performance improvements

February 16, 2017

  • Goliath IntelliSense now supports Data Objects (projects / datasets / tables) and Data Schema (columns / types ) 

February 9, 2017

  • Control Panel Redesign
  • Project Selector redesign
  • Data Objects (Projects>Datasets>Tables) & Context aware IntelliSense
  • Ability to select Billing Project from those projects where User has respective rights
  • Some fixes:
    • CTRL-Z and Right Click inside Editor
    • Right Click over icons in Navigator
  • Many more

January 23, 2017

  • Playground Redesign
    1. Defaults:
      1. Standard SQL is default version
      2. SQL Version Auto-detection is disabled by default
      3. Preferences
    2. Enhanced and Preview modes are now removed from top panel
      1. Enhanced mode is available as check option now for Legacy SQL only
      2. Preview mode is available from within contextual menu
      3. Download feature in Toolbar is now available in Preview Mode
    3. Edit Mode is eliminated. Editor is always in edit mode now!
  • ‘Script “select * from table”’ menu option in contextual menu – replaced with ‘Script “select  from table”’
  • Direct Links - added browser panel and dataset options to project direct link
  • Fixed info popup for external tables in Navigator
  • Added Size and Rows count in Query Status Popup
  • _partitiontime added to the list of fields in Contextual Menu for Partitioned Tables
  • Added visual handlers to all splitters
  • Fix for paging on streaming table preview
  • Fix for parameter collection from Options Panel
  • Improvements for Visualization Panel (Pivot/Chart Results)
  • Usage Logging
  • Many more

December 20, 2016

  • Direct Link: Share Link Menu added for Project/Dataset/Table Contextual Menu 
  • IntelliSense and Help on Hover for ALL Legacy and Standard SQL Functions 
  • Link to Documentation on Hover for ALL Legacy and Standard SQL Functions 
  • Redesign for Download Result feature 
  • Multiple UX fixes, improvements

December 15, 2016

  • Panel Splitters complete redesign
  • Built-In parameters no longer editable, and always have recent values
  • IntelliSense for Parameters (in BigQuery Editor)
  • Direct Link feature
    Users can now reference/share specific project, dataset or even table via direct link.
    Below is syntax to use:
    Project:  http://goliath.potens.io/?nav=project
    Dataset: http://goliath.potens.io/?nav=project:dataset
    Table: http://goliath.potens.io/?nav=project:dataset.table 
  • Fix for Full Screen button positioning
  • Multiple fixes and improvements for IntelliSense and Help Hints
  • "New Version" Push Notification

December 7, 2016

  • Record Parameters Support (Magnus style)
  • Rich Editor
    • IntelliSense with Tooltips and Tooltips on Hover in BigQuery Standard Mode
    • Preserve Keywords Case with Ctrl-Shift-F

November 30, 2016

  • DML Query shows number of affected rows
  • BigQuery Editor:
    • Help Hints on Keywords hover
    • Help Hints while in Auto-complete / Intellisense Mode (CTRL+Space)
  • Parameters: Double Evaluation Option/Switch
  • Create Table: added ability to create partitioned tables
  • Light Viant Branding for Start/Login Page and Re-Login Pop-Up

November 15, 2016

  • Goliath Tour
  • Run Selected Query Only (SHIFT+F5)

November 2, 2016

  • Company-wide release of Goliath!
  • Full User Documentation

October 26, 2016

  • Improved Parameters Panel
  • Run-Time Preview
  • Ability to Remove (previously added) Project   
  • Billing / Default Project
  • Hints Framework

October 12, 2016

  • Support for Workspaces
  • Extra Support for Views
    • Save View with UDF
    • View in Standard SQL Mode
    • SQL Mode indication in View Info PopUp
  • SQL-mode Sensitive Table reference Insert

October 5, 2016

  • Rich Editor – more features (to match those recently added to Magnus)
    • Icon to go Full Size Editor (for MAC users; For PC - F11/ESC also can be used)
    • Embracing Selection in Brackets – ({[‘”`
    • Multiline and multi-position Cursor/Carets and Selection (Alt + Left Click – PC / Command + Left Click - Mac)
    • Block Selection, Copy
    • Proper treating escaped SQL Keywords – e.g. [date] instead of auto upper-case for DATE. This is useful when, for some reason, you want to use keyword as alias but don’t want it to be treated by editor as a keyword
  • Support for recently introduced BigQuery DML

September 28, 2016

  • Parameters Support (compatible with Magnus)

September 21, 2016

  • SQL Mode Auto-detection
  • Max Billing Size
  • Project Persistence (local to Browser)
  • Long Term size in Table/Dataset Info
  • Many Enhancements across the app

September 07, 2016

  • Dataset Labeling / Tagging
  • Dataset Filtering by Labels/Tags
  • Multiple fixes/improvements across UI

August 10, 2016

  • Rich Editors for BigQuery (Standard, Enhanced), JS UDF and GoBQ mode
    • Lines Numbering
    • Active Line
    • Code Coloring
    • Auto-completion (CTRL+SPACE)
    • Matching bracket
    • Commenting / Uncommenting (CTRL+/)
    • Full Screen mode (F11)
  • Actions for Recent Jobs
    • Edit Query (with further Save / Run / etc.)
    • Show Previous Result
    • Cancel Query / Job
    • Use Job as a Template for new Job and Run it

July 20, 2016

  • Support for Inline UDF
  • Save / Load Code for BQ Query / UDF / GoBQ
  • As well as Save UDF to Cloud Storage
  • Add Field(s) Option for Modify Table Schema
  • GoBQ Mode
    • Added packages:
      • crypto/md5
      • bytes
  • Added aliases for fmt.Fprint* functions
    • xFprint, xFprintf, xFprintln
  • Improved Error Messaging :
    • Go specific errors with line, etc.    vs.
    • Sandbox Env specific error

July 13, 2016

  • GoBQ Mode
  • More Action Items in Context Menu
    • Modify Dataset Info
    • Modify Table Info
    • Modify Table Schema

July 6, 2016

  • Jobs History with Paging
  • Support for External (in GCS) UDF
  • Support for Partitioned Tables

June 15, 2016

  • Jobs / Query History 

June 7, 2016

  • Share Dataset / Dataset ACL Management
  • Streaming Buffer in Table Info Popup (on currently streamed table hover) 
  • Collapse/Expand Menu Items for Groups
  • Show [reusable] Table Schema
  • Show [reusable] Query Result Schema

May 25, 2016 

  • Download Result as CSV, JSON, AVRO to user’s computer
  • Create Table / Load Data from GCS in variety of formats / options
  • Export Table to GCS
  • View specific Contextual Menu and Icon
  • Max Billing Tier and SQL Version in Query Stats Popup

 

May 18, 2016

  • Save Query as View
  • Save Result as Table
  • Support for Standard SQL vs. Legacy SQL
  • Support for Max Allowed Billing Tier
  • Some Cosmetic changes in UI

May 12, 2016

  • Object Management across application (Contextual Menu in Navigation Panel, Object Browser, etc.)
    • Project:
      • Browse, Create Dataset, Refresh
    • Dataset:
      • Browse, Delete, Script Tables List, Refresh
    • Table:
      • Preview, Delete, Copy, Script

April 20, 2016 

  • Retention option for when table as destination for query
  • Continuous paging in both Result and Pivot Panels
  • Resizable Data Explore Popup (enhanced mode for record/nested type fileds)

April 07, 2016 (Beta - aka Sandbox v.2)

  • Sandbox v2 is in Beta

March 09, 2016

  • Rich paging functionality with result’s total rows count and current page’s start and end
  • Auto Size option for result paging
  • Save and Pivot Functionality available in all Modes (Standard, Enhanced and Preview)
  • Regular Expression support in filters
  • Owner Info added in Object Browser and Object Metadata Popups
  • Dataset Browser has contextual menu now for “table” column. Actions available so far: Preview, Insert and Select *. More to come.
    • Preview – obviously initiate Preview Mode for respective table. Note: Preview Mode allows you to walk thru / page Table content for absolutely free.
    • Insert – inserts respective table name into Query Editor (if in Edit Mode of either Standard or Enhanced)
    • Select * - Replace Query Editor text with “SELECT * FROM <respective table name>”
  • Result Header shows data type (on mouse hover) and data itself justified based on its data type
    • Note: in Enhanced mode record fields are not flattened (as it is in Standard Mode which is the Native BQ UI behavior). So you can explore data (unison logs for example) as it is stored or produced off of your query (if it produces record or nested fields).
    • To actually see whole record/nested data - you need to double click on respective data cell in result grid 

March 02, 2016

  • Project/Dataset Browser with filtering, sorting, etc.
    • Click on Project title above Navigation Panel or double click on dataset name (in navigation or project browser) to load respective browser
    • Click on browser’s header to sort
  • Query Editor / Launcher with great support for Standard, Enhanced and Preview mode with unlimited paging
  • Easy result browsing/storing/pivoting/charting/etc
  • Query stats, including project and billing cost

January 14, 2016 (Alpha - aka Sandbox v.1)

  • Data Warehouse Team is proud to announce alpha availability of new Self-Serve Tool – BigQuery Sandbox

 

Pre-BigQuery Versions

April 16, 2015

    • Sandbox Quick Tour - Retrospective Video

April 22, 2014

    • Hadoop / Hive based Self-Service Tool
    • Self-Serve - Step-by-Step User Guide

March 7, 2014

    • Hadoop / Hive based Self-Service Tool
    • UI - Walk-through and Examples