1. Potens.io
  2. Magnus
  3. Meet Magnus

Articles > Release Notes

September 17, 2019 

  1. Workflow Billing: Added cascade billing project option to workflow header in workflow editor

  2. API Wizard: Added API Key as a Credential options to API wizard
  3. Some minor improvements / fixes
     

August 28, 2019 

  1. API Task: Extend API Wizard with APIs requiring additional non-sensitive or non-restrictive scopes
    About 30 more APIs are available for use in API Wizard  
    mceclip2.png

  2. Some minor improvements / fixes 
    • Fixed exposure of incorrect / not-applicable compressions in Export Tasks
    • Email Task: Allow empty email address in recipients list

August 13, 2019 

  1. Workflow Browser: Improved coverage of Last Run At attribute in Workflow Browser

    Till recently, Last Run At attribute was ONLY available for workflows run manually or directly by schedule or via Execute Workflow Task by owner or delegate or queue less-remote execution (v1). Other runs like via trigger, remote (v2) runs, via Execute Workflow Task by “shared with” users were not accounted
    Since now, all invocations are counted, so users can see better / correct and UpToDate picture of their workflows’ usage 

  2. BigQuery Task: Output to Parameter now supports date/time BQ types: Timestamp, Datetime, Date, Time

    We still don’t support ARRAY and STRUCT data types to be used as output to parameters. Will be addressed in future releases

  3. Some minor improvements / fixes
    • Lifetime validation falsely identifies duration of 93 days as exceeding the max (93 days) allowed when end-of-daylight-saving lands within the lifetime
    • API Wizard conflicted with some Chrome Extensions

  4. API Wizard – is a great tool on its own developed by Potens.io Team

    Wizard currently supports about 160 Google APIs with 110 of them ready to be used w/o any extra permissions to be given. See list below

    mceclip0.png

    Note: To use given API – it needs to be enabled – so contact Magnus Team for this

    In next release we plan to add 30 more APIs to be available for immediate use in API Wizard  

    mceclip2.png
 

August 6, 2019 

New in July 2019

  • BigQuery Task: Full support for Query Prefix

    SQL variant, either legacy SQL or standard SQL, cab be set by including a prefix to your query
    #legacySQL - Runs the query using legacy SQL

    #standardSQL - Runs the query using standard SQL

    Now, user can have BigQuery Task in the Loop running queries stored / generated with mixed SQL versions/dialects (Legacy vs Standard)

  • Email Task: Added Email Priority Selector

    mceclip0.png

  • API Task: Added API Wizard

    mceclip1.png

  • History Details: Navigate to Child and Parent workflow in History Details

    Previously troubleshooting of below execution of parent / children workflows was possible only by opening History Details for each respective workflow one-by-one     
     mceclip2.png

    Now, user can start from any workflow and then navigate up to parent workflow or down to child workflow directly within workflow’s History Details 

    mceclip3.png

  • Workflow Execution Notification Email: Added direct link to workflow
  • Some minor improvements / fixes

June 26, 2019 

New in June 2019

  • Execute Workflow Task: Added support for Return Parameters

    1.png

  • Workflow Browser: Added Manual Run feature
    No need to Open Workflow anymore for Manual Run

    2.png

  • Service Account registration and use to run workflows: JSON private key file is now supported (in addition to previously supported p12)
  • Single Sign On (SSO): Added SSO to support integration with 3rd party tools/sites
  • Minor improvements / fixes (few examples below)
    • Hub Task: increased max item’s timeout to 6 hours.
    • History Details: when workflow killed while being within Loop Task – that Loop Task and all nested Tasks were not shown in History Details which prevented user from effective troubleshooting 
    • Remote Workflow Execution: Improved stability for Remote Execution – based on quite an edge case from one of our DLP client 

April 4, 2019 

  • BigQuery Task: Added processing locations São Paulo (southamerica-east1) and Zürich (europe-west6)

  • Add Workflow: New button added to Goliath - "Automate with Magnus" which allows to copy Goliath's workspace into Magnus and create new workflow off of that workspace for further automation

March 20, 2019 

  • Workflow Browser - Added “All Above” option

    02-01.png

  • Copy Workflow functionality now available for Workflow’s Delegates

    02-02.png

  • Minor improvements / fixes 
    As an example: API Task - Template Selector: pre-select the first template when Service selected

March 13, 2019 

  • API Task - Added more API templates:
    1. BigQuery: Create External Table from GCS with Autodetect
    2. BigQuery: Create External Table from GCS with Schema
    3. Data Transfer: Export/Import To/From Cloud SQL
    4. DoubleClick Bid Manager: Retrieve Entities in SDF format
    5. DoubleClick Bid Manager: Retrieve Line Items in CSV format
    6. DoubleClick Bid Manager: Upload Line Items in CSV format
    7. DoubleClick Bid Manager: Run a Stored Query to generate a report
    8. Firebase: Generate short Dynamic Links
    9. Firebase: Get analytics data for short Dynamic Links
  • Script Task - Added XML support for Golang and JavaScript
  • Workflow Editor: Added Workflow Tree button to left nav bar

February 20, 2019 

  • API Task - Added more API templates:
    • PubSub: Publish Message
    • Magnus: Get History
    • Artificial Intelligence - Natural Language: Annotate Text
    • Artificial Intelligence - Natural Language: Analyze Entities
    • Artificial Intelligence - Translation: Translate Ttext
    • Artificial Intelligence - Vision: Annotate Image
    • Dataflow: Bulk Compress GCS files
    • Dataflow: Bulk Decompress GCS files
    • Dataflow: WordCount Example
    • Dataflow: GCS Text to BQ
  • Workflow Task - Added Asynchronous Execution Mode
  • Cost attribution for BigQuery Tasks in Async mode is now presented in History Details

February 14, 2019 

  • GCS Export Task - Added Asynchronous Execution Mode along with Collect Feature
  • Workflow and History Browsers – light cosmetic changes: some UI controls are regrouped
  • API Task - Added more API templates:
    • BQ: Copy a BQ table
    • BQ: Create a BQ View
    • BQ: Run a BQ query
    • GCS: Copy an object
    • GCS: Get metadata of an object
    • GCS: Download an object
    • GCS: Get a list of objects from a bucket
    • GCS: Delete an object
  • Added new Processing Locations (Los Angeles, Hong Kong)
  • Improved cost attribution for BigQuery Tasks in Async mode

February 6, 2019 

  • BigQuery Task – Added Asynchronous Execution Mode along with Collect Feature
  • Added New Task Type – Hub Task
  • API Task – Added Collect Feature
  • API Task – Added two more Templates
    • Remote execute of Magnus Workflow via Queue
    • Export BigQuery table to Google Cloud Storage
  • Few fixes/improvements:
    • New recently introduced Processing Locations
    • Fix for BigQuery Job Cancel Feature

January 24, 2019 

  • Templates are introduced in API Task 
  • Improved features / performance of Workflow Browser and History Browser
  • Workflow Editor is now opened in a new tab when view/edit/archive/add icon is clicked.
    History Browser is now opened in a new tab when history icon is clicked
  • Few fixes/improvements:
    • Over-validation for GCS buckets when creating/updating Trigger
    • Improved performance of BQ Task to poll BQ job status the first time at 1 sec, then at 5 sec, 10 sec, up to 1 minute interval. Before the first poll was at 5 sec

December 12, 2018 (Q4'18)

  • Triggers are now updatable
  • MySQL Task is now executed within SQL transaction
  • FTP Task: user can specify custom port in FTP path
  • Loop Task: sleep time between iterations reduced to 100 ms
  • Workflow Editor:
    • Added “Extend Workflow Lifetime” button for quick extension to another 90 days – only active long-term workflows are qualifie
    • “Show Workflow Execution History” action icon in left Tool Bar now opens History Browser for respective workflow in new Tab
  • “Magnus Long-term Workflows About to Expire” Notification Email now has direct link to respective workflows
  • Added new Processing Locations to BQ Task, GS Export Task, FTP Task, FTP-GS Task.
    • London, Singapore, Sydney, Northern Virginia, Finland and Taiwan
  • Waiting in Queue Remotely Executed Workflows are now listed in History Browser with empty Start and Finish dates and with “Pending” as a Status and respective indicator
  • Magnus v5 – massive upgrade to Google Cloud SQL powered backend
  • Limits for Workflow’s Parameters:
    • parameter name up to 100 chars.
    • parameter value up to 18000 chars.
    • parameter schema up to 3000 chars.
    • At the end of workflow execution, parameter value and schema of workflow-owned parameters are truncated if length exceeds max allowed
  • Fixes, improvements – let us know if you see something you asked / reported but not addressed yet. Few examples below:
    • Issue with Custom Projects when there is an expired user either owner or delegate
    • Issue with Email Task attachment size limit
    • Edge case: Workflow/History Browser: “workflow not found”
    • Edge case: exposing extra workflows names in Execute Workflow Task
    • History Browser in hierarchical mode: Fixed UI NaN bug for BQ cost.

August 13, 2018 (July, 2018)

 

June 19, 2018  (Q2 2018)

  • Created number of detailed Tutorials Articles and Videos 
  • Added Time Zone support.
    1. User can choose Time Zone to use for representing dates/times in UI
    2. User can set Time Zone to use for scheduling on per Workflow basis
  • Added Lifetime’s End Date to Workflow Browser
    When End Date is closer than 7 days, it is being red-colored so easy to catch!
  • Enable copy of Get Started Example Workflows
  • Introduced various size based limits
    1. FTP Task, the file cannot be more than 32 MB (recently increase to 100MB)
    2. Magnus Remote API, the request body cannot be more than 32 MB.
  • Remote APIs Optimization
  • Fixed validation issue for BigQuery Task with View as destination
  • Improved FTP-to-GCS Task
  • Workflow Editor:
    1. Parameters Panel expanded by default
    2. Each Task Panel now supplied with respective (context sensitive) Help Link (icon)
    3. Built-in parameters are no longer editable in Parameters Panel
    4. Ability to add link to Workflow’s documentation (by request only)
  • Welcome email and personalized Hello Magnus Workflow for new Potens Users
  • Trigger v2 (for Potens.io)
  • Auto login in when referred from Signup Page
  • Many/many more fixes, improvements – let us know if you see something you asked / reported but not addressed yet

January 4, 2018

  • On Workflow Save – if a newer version is detected (due to team’s collaborative work on same workflow or if user simply opened same workflow editor in different sessions and “lost track” of where there most recent changes done) user asked for confirmation (save or cancel)
  • Added new Action Icons to Workflow Editor’s Toolbar
    • Share Workflow; Copy Workflow; Disable/Enable All Tasks
  • Added Some Limitations for
    • Email Task - Max Attachment Size – 25MB
    • FTP-GS Task - Max File Size – 32MB
    • API Task - Max API Response Size – 32MB
  • User facing bugs fixed
    • Manual run of a long-running workflows does not show Workflow Completed Popup
    • When creating new workflow/trigger, if task added - user is not able to correct invalid workflow ID/trigger ID
  • Some more internal fixes and improvements
  • The rest is massive Potens.io related upgrades – supposed to be transparent for internal users (vindicotech.com, adelphic.com, viantadcloud.com ) 

December 13, 2017

  • On Workflow Save – notify user if a newer version is detected 
  • Fixed bug for Run/Save
  • Fixed bug Lifetime
  • Some more fixes and improvements
  • The rest is massive Potens.io related upgrade – supposed to be transparent for internal users (vindicotech.com, adelphic.com, viantadcloud.com ) 

December 6, 2017

  • Standard SQL is a default SQL dialect for newly created BigQuery Tasks
  • Billing Tier setting is retired so is removed now from BigQuery Task UI 
  • The rest is massive Potens.io related upgrade – supposed to be transparent for internal users (vindicotech.com, adelphic.com, viantadcloud.com )

November 1, 2017

  • Roles rearranged between Admin/Advanced Admin and Sys Admin
  • Updated scope for Admin views in Workflow/History/Trigger Browsers
  • Added consumption logic for Licensed and Free Trial Users 
  • Added more infrastructure items into config

September 26, 2017

  • Workflow lifetime expiration notification 
    (only for workflows with 90-93 days lifetime forced by recently introduced 90 days rule)

August 16, 2017

  • Email Task: multiple GCS attachments
  • Email Task: optional GCS attachments
  • Workflow Versions: Load/Copy Selected Previous Version
  • Fixes and Improvements

August 9, 2017

  • Workflow Versions
  • History Details Refresh
  • Fixes and Improvements

August 2, 2017

  • Get Started Examples 

July 19, 2017

  • Open in Goliath 
  • Loop Task in History Details
  • Conversational Pub/Sub Event based Triggers – Public Beta
  • Execute Workflow Task – Nested Calls Limit
  • New How To Articles created for wiki and will be available shortly

July 6, 2017

  • Open in Goliath (Beta)
  • Changes in Misc Task (Beta)
  • Loop Task in History Details (Beta)

June 8, 2017

  • GCS Event based Triggers – Public Beta
  • Conversational Pub/Sub Event based Triggers – Private Beta
  • On-Save Notification – more Enhancements
  • How to use Magnus with AWS – example code fix to properly treat all AWS regions – `Thank you!` to  Hiroshi Yabu (Xumo)
  • Some small fixes / improvements 

May 31, 2017

  • On-Save Notification Enhancements
  • Workflow Tree Explorer
  • Remote Workflow Execution v2 with Fair Scheduler
  • GCS Triggers Support – in Private Beta
  • Many small fixes / improvements

April 12, 2017

  • Breakpoint Task
  • Added Icons for IntelliSense Popup 
  • Many small fixes / improvements

March 30, 2017

  • User’s Default Billing Project (as per Magnus configuration) is now visible / available in UI.
  • Some small fixes / improvements 

March 22, 2017

  • New Feature: Ability to set Billing Project for Workflow
  • Added IntelliSense Support for new Standard SQL Functions introduced in recent BigQuery Releases

March 8, 2017

  • Added IntelliSense Support for new Standard SQL Functions
  • Remote Workflow Execution: Added remote API for getting workflow execution status by History ID
  • Introduced Billing vs Viewable Projects Concept

February 9, 2017

  • "Add Workflow" is available now from within Workflow Browser
  • History Details: Run Info Section displays parameters overrides and run user/mode
  • Workflows and history visibility based on billing project
  • Added Python code example for Remote Execution implementation 
  • Some small fixes

January 24, 2017

  • Workflow Execution via remote call
  • Workflow Execution with Passing Parameters via remote call

January 18, 2017

  • Access/Jump to Workflow History directly from within Workflow Editor
  • Ability to Pivot Record Parameter Info Popup
  • Some UX fixes, improvements – you will most likely notice by yourself 

January 5, 2017

  • Deployment Push Notification
  • Increase Workflow ID Length up to 50
    Under popular demand we had to increase size of that attribute so it is easier for you to have more descriptive IDs
  • UX fixes, improvement

December 28, 2016

  • IntelliSense and Help on Hover for ALL Legacy and Standard SQL Functions
  • Link to Documentation on Hover for ALL Legacy and Standard SQL Functions
  • Better support for System Parameters  
      No need any more to remember all valid options for specific sys parameter. 
      They are available to select from drop-down 
  • Added Billing Tier to Cost Calculation - in effect since 01/01/2017
  • Multiple UX fixes, improvements

December 15, 2016

  • IntelliSense for Parameters extended to Magic and Sys Parameters
  • IntelliSense for Parameters extended to Script, API Call and Email Tasks as well as UDF Editor (In-line mode) in BigQuery Task
  • Multiple fixes and improvements. E.g.
    • Improved error messaging for Script Task
    • Improved Keyword/Functions recognition in Rich Editor / IntelliSense
    • Double Slash is recognized as comments sign for BigQuery Legacy SQL

December 7, 2016

  • BigQuery Task: Mixed Priority
  • BigQuery Rich Editor: IntelliSense with Tooltips and Tooltips on Hover in BigQuery Standard Mode
  • IntelliSense support for Parameters with “<” + “Ctrl-Space”

November 30, 2016

  • Workflow Browser: Tasks Icons in Tasks Tooltips 
  • Light Viant Branding for Start/Login Page and Re-Login Pop-Up

November 29, 2016

  • Script Task: show standard output in History Details Popup
  • Task Details in History Browser: added Task Start Time for each Task
  • Added Tasks’ icons in Workflow Editor and History Browser (Workflow Details and Task Details)
  • BigQuery Editor: 
    • Preserve Auto Formatting (keywords capitalization) via CTRL+SHIFT+F
    • Help Hint on Keywords hover
    • Help Hints while in Auto-complete / Intellisense Mode (CTRL+Space)

November 10, 2016

  • Share Workflow via Permalink
  • Updated Home Page
  • Various small fixes

November 9, 2016

  • Company-wide release of Magnus v.3!
  • Full User Documentation

October 25, 2016 

  • Run-Time Notification to cover workflows called via Execute Workflow Task
  • Cost, Billing Tier and other stats from Child Workflows are rolled up to Parent Workflow when it is shown collapsed in History Browser’s Hierarchical Mode
  • Find/Replace and Parameters Panels are now always Visible/Accessible
  • Workflow Editor got Vertical Floating Toolbar with frequent used Shortcuts
  • Contextual Tab Titles
  • Various small fixes 

October 12, 2016 

  • JavaScript for GoTo Task’s Expression Builder
  • Navigation thru Task Details in History Details (History Browser)
  • DML Support in BigQuery Task
  • Various fixes 

October 5, 2016 

  • Last Run At new column in Workflows Browser
  • Task Details link in History Details for below tasks (more tasks added)
    1. GoTo Task
    2. Export to MySQL Task
    3. FTP Task (FTP To)
    4. FTP-to-GS Task (FTP From)

September 28, 2016 

  • Cancel Job for BigQuery Task in History Details (History Browser)
  • On-Save Notifications Support (in addition to previously ONLY available On-Run Notifications)
  • Task Details link in History Details for below tasks (previously available ONLY for BigQuery Task)
    1. Email Task
    2. Execute Workflow Task
    3. API Task
    4. Script Task

September 21, 2016 

  • New Magic Parameters
  • Multiple Rich Editor enhancements
  • Many Improvements and Bugs Fixing

September 7, 2016 

  • Full Size” Button for Rich Editor (to compliment F11 that is for PC only as of now)
  • Max Billing bytes option – allows to set billing limit on per query level
  • Admin support for recently introduced Secure/Locked Workflows features
  • Multiple fixes / improvements across
    1. History Browser: Hierarchical View
    2. Workflow Editor: Improved parameters validation
    3. Workflow Editor: fixes for Chrome Search (CTRL-F) and Magnus’s built-in Find/Replace feature
    4. Many more …

August 24, 2016 

  • Secure/Locked Workflows Support
  • Rich Editors added to all modes and popups
  • Standard SQL mode is available now for View as an Destination in BigQuery Task

June 28, 2016 

  • BigQuery Task. Rich Editors 
    • Lines Numbering
    • Active Line
    • Code Coloring
    • Auto-completion
    • Matching bracket
    • Commenting / Uncommenting (Ctlr + / or Cmd + /)
    • Full Screen mode (F11 / Esc)

June 21, 2016 

  •  1. Script Task. Rich Editors for all modes (Go, JavaScript, Lua)
    • Lines Numbering
    • Active Line
    • Code Coloring
    • Auto-completion (for JavaScript only for now)
    • Matching bracket
    • Commenting / Uncommenting (Ctlr + / or Cmd + /)
    • Full Screen mode (F11 / Esc)
  • Script Task. Go-lang Mode: 
    • Added packages:
      • crypto/md5
      • bytes
    • Added aliases for fmt.Fprint* functions
      • xFprint, xFprintf, xFprintln
  • Magnus’s output “magic” parameter automatically conforms to chosen SQL Version of BigQuery Task 

July 6, 2016 

  • BigQuery Task: Support for Inline Code for UDF Resources
  • Workflow History Browser: Hierarchical View for Workflows run with Execute Workflow Task
  • Few bugs are fixed

June 14, 2016 

  • BigQuery Task: Support for UDF Source as external files in Cloud Storage
  • By popular demand - Copy Workflow - most asked feature in last many months! 

May 25, 2016 

  • Find / Replace Feature in Workflow Design / Edit Mode
  • BigQuery Task: support for
    1. Standard SQL
    2. Max Allowed Billing Tier
    3. Parametrized Retention
  • Execute Workflow Task: added workflows type selector  

May 18, 2016 

  • Workflow History Browser: Added Workflow Filter by user’s access 
  • Workflow Browser: Search Workflow by Content
  • Support for configurable Billing Projects
  • Number of improvements and optimizations in UI and Backend …

May 11, 2016 

  • Workflow Design Time Improvements
  • White List based sharing Workflow with domain
  • Multiple UI improvements
  • Weekly reports distributed to producers of data and consumers of data under Magnus Self-Serve

May 4, 2016 

  • More options for FTP-to-GS Task:
    • ftp multiple files using wildcard
    • ftp whole folder
    • support for return parameter with list of successfully loaded files

April 28, 2016 

  • New Feature: Shared Workflows 

April 20, 2016 

  • New Task Type: FTP-to-GS Task
  • New Feature for Email Task: File in Cloud Storage as an email attachment 
  • Simple how-to example is ready – see workflow “HOWTO_EXPORT_IMPORT”

April 13, 2016 

  • New Feature: Failure Escalation for Mission Critical Magnus Workflows
  • GCS Export Task: Fix to address recent adjustments in cloud projects permissions

April 7, 2016 

  • Go support for Script Task 
  • Retention Options

March 8, 2016

  • “Advanced” Mode for BigQuery Editor 

March 2, 2016 

  • Workflow Search in Workflow History Browser  
  • JavaScript support in Script Task

January 6, 2016 

  • Mostly tuning, optimization 
  • Public access to FTP Task. This is on demand so far
  • Mini “New Tasks” Bar within Loop Task

December 10, 2015 

  • Enhanced API Task – allows supporting wide range of REST API, including AWS (s3, ec2, etc.) ones 
  • Billing Tier in Workflow History and History Details

October 1, 2015 (v.2 Release)

  •  See announcement!

September 9, 2015 (v.2 Beta)

  • Greatly Improved stability and exceptions (mostly from google cloud) handling - that was priority #1 for v2
    • Multiple fixes and improvements, mostly backend related
    • Retry logic and many more
  • Better and friendlier workflow UI including but not limited to:
    • Collapsing/expanding tasks; all and individual
    • Hiding disabled tasks
    • Targeted positioning of new task
    • Advanced Properties panel for some tasks
  • New BETA Features
    • Loop Task: Loop Specific On-Failure Behavior. Skip to next iteration
    • Record Parameter: Referencing Items Count and Fields Name
    • GoTo Task: Expressions based evaluation
    • Script Task: Lua is the option for scripting as of v2 release. Passing workflow’s parameters in and getting result out to parameter(s) is supported
    • MySQL Export Task: this is to support [for now] light (below 500MB at a time) data export from GBQ to MySQL. Please note: Performance improvement will be a subject for v4, after which 500MB limit will be eliminated
    • FTP Task: FTP, sFTP and FTPs are supported. For DW internal use for now. Will be opened to public in v3
    • API Task: For Advanced Users - any BigQuery and/or Cloud Storage APIs can now be part of your workflow as a separate Task – still in testing. Planned to be available to public by Final v2.

August 24, 2015 (v.2 Alpha) 

  • Expand / Collapse Workflow’s Tasks
  • Expand / Collapse Single Tasks
  • Hide/Show Disabled Tasks
  • Add New Task to selected position
  • Task Behavior On-Failure
  • GS Export Task - Additional Options for Export Format
  • Email Task - HTML and Attachment Support
  • Loop Task - Loop Support
  • Misc Task
  • Execute Workflow Task
  • Record Type Parameter

May 20, 2015 

  •  Email Task 

May 20, 2015 (v.1 Beta)

  • DW Self-Serve Tool Beta is available!

May 4, 2015

  •  Workflow Notifications 

April 13, 2015 (v.1 Alpha) 

  • Multi-Steps Workflows
  • Orchestration & Scheduling
  • Different Tasks Types to implement most common flow patterns
  • Extensions/Extras/Parameters
  • Simple UI
  • Safety & Security
  • New Features
  • Sneak Preview Videos