Tutorial Introduction

Tutorials are available to introduce users to core tasks and concepts for creating Magnus workflows. The tutorials available include:

1. BigQuery Task Tutorial
2. Parameters Tutorial
3. Email Task Tutorial
4. Google Storage Export Task Tutorial
5. Loop Task Tutorial
6. Go-To Task Tutorial
7. Execute Workflow Tutorial

Where to start

It is recommended that users start with BigQuery Task Tutorial and progress to the next tutorial following the order in list above. Subsequent tutorials build upon concepts introduced in the previous tutorial.  

Structure

Each tutorial will provide an introduction presenting the concepts being discussed, a scenario that demonstrates the concept, a list of items that the user will learn by reading through the tutorial, steps to create a workflow using the concepts, a review of what the workflow will do when run, additional documentation that expands upon items covered in the tutorial, a reference to a completed version of a workflow that is the result of walking through the tutorial, and what the next recommended action is.

Public Dataset and Billing

Tutorials query and reference data available in public dataset bigquery-public-data.san_francisco.bikeshare_trips.  Users are walked through various activities including querying BigQuery public data, exporting data to Google Cloud Storage, and saving data to tables.  All activity is billed to the project associated to the user's account.

Total Query cost of all tutorials is 391MB ($0.001864) and is subject for 1TB of Always Free Tier (https://cloud.google.com/free/).

Saving, Exporting, and Cleaning Data

Data can be queried from a public dataset but it cannot be saved to a table in the public dataset.  When the tutorial prompts to save or export data replace the examples or placeholders with a location of your own dataset or cloud bucket.  When a tutorial is complete be sure delete any table or file created during the tutorial steps.

Workflow Names

Workflow names are unique.  When prompted to create a workflow provide a unique name for the workflow different than what is provided in the tutorial.  The tutorial references workflow names as guidance.

Customizing Workflows

The goal of each tutorial is to introduce users to Magnus workflow concepts.  Specific steps are provided along with a sample scenario to help guide the user and explain the concepts in action. Tutorials are starting points and users are encourage to begin thinking about how to apply the concepts they learn to their own workflows.