README.md

Lab Overview

Azure Machine Learning designer (preview) gives you a cloud-based interactive, visual workspace that you can use to easily and quickly prep data, train and deploy machine learning models. It supports Azure Machine Learning compute, GPU or CPU. Machine Learning designer also supports publishing models as web services on Azure Kubernetes Service that can easily be consumed by other applications.

In this lab, we will be using a subset of NYC Taxi & Limousine Commission - green taxi trip records available from Azure Open Datasets. The data is enriched with holiday and weather data. Based on the enriched dataset, we will learn to use the Azure Machine Learning Graphical Interface to process data, build, train, score, and evaluate a regression model to predict NYC taxi fares. To train the model, we will create Azure Machine Learning Compute resource. We will do all of this from the Azure Machine Learning designer without writing a single line of code.

Exercise 1: Register Dataset with Azure Machine Learning studio

Task 1: Upload Dataset

1. In Azure portal, open the available machine learning workspace.

2. Select Launch now under the Try the new Azure Machine Learning studio message.

   

3. When you first launch the studio, you may need to set the directory and subscription. If so, you will see this screen:

   

   For the directory, select Udacity and for the subscription, select Azure Sponsorship. For the machine learning workspace, you may see multiple options listed. Select any of these (it doesn't matter which) and then click Get started.

4. From the studio, select Datasets, + Create dataset, From web files. This will open the Create dataset from web files dialog on the right.

   

5. In the Web URL field provide the following URL for the training data file:

   https://introtomlsampledata.blob.core.windows.net/data/nyc-taxi/nyc-taxi-sample-data.csv
   

6. Provide nyc-taxi-sample-data as the Name, leave the remaining values at their defaults and select Next.

   

Task 2: Preview Dataset

1. On the Settings and preview panel, set the column headers drop down to All files have same headers.

2. Scroll the data preview to right to observe the target column: totalAmount. After you are done reviewing the data, select Next

   

Task 3: Select Columns

1. Select columns from the dataset to include as part of your training data. Leave the default selections and select Next

   

Task 4: Create Dataset

1. Confirm the dataset details and select Create

   

Exercise 2: Create New Training Pipeline

Task 1: Open Pipeline Authoring Editor

1. From the studio, select Designer, +. This will open a visual pipeline authoring editor.

   

Task 2: Setup Compute Target

1. In the settings panel on the right, select Select compute target.

   

2. In the Set up compute target editor, select the available compute, and then select Save.

Note: If you are facing difficulties in accessing pop-up windows or buttons in the user interface, please refer to the Help section in the lab environment.

Task 3: Add Dataset

1. Select Datasets section in the left navigation. Next, select My Datasets, nyc-taxi-sample-data and drag and drop the selected dataset on to the canvas.

   

Task 4: Split Dataset

1. Select Data Transformation section in the left navigation. Follow the steps outlined below:

   1. Select the Split Data prebuilt module

   2. Drag and drop the selected module on to the canvas

   3. Fraction of rows in the first output dataset: 0.7

   4. Connect the Dataset to the Split Data module

   

Note that you can submit the pipeline at any point to peek at the outputs and activities. Running pipeline also generates metadata that is available for downstream activities such selecting column names from a list in selection dialogs.

Task 5: Initialize Regression Model

1. Select Machine Learning Algorithms section in the left navigation. Follow the steps outlined below:

   1. Select the Linear Regression prebuilt module

   2. Drag and drop the selected module on to the canvas

   

Task 6: Setup Train Model Module

1. Select Model Training section in the left navigation. Follow the steps outlined below:

   1. Select the Train Model prebuilt module

   2. Drag and drop the selected module on to the canvas

   3. Connect the Linear Regression module to the first input of the Train Model module

   4. Connect the first output of the Split Data module to the second input of the Train Model module

   5. Select the Edit column link to open the Label column editor

   

2. The Label column editor allows you to specify your Label or Target column. Type in the label column name totalAmount and then select Save.

   

Task 7: Setup Score Model Module

1. Select Model Scoring & Evaluation section in the left navigation. Follow the steps outlined below:

   1. Select the Score Model prebuilt module

   2. Drag and drop the selected module on to the canvas

   3. Connect the Train Model module to the first input of the Score Model module

   4. Connect the second output of the Split Data module to the second input of the Score Model module

   

Note that Split Data module will feed data for both model training and model scoring. The first output (0.7 fraction) will connect with the Train Model module and the second output (0.3 fraction) will connect with the Score Model module.

Task 8: Setup Evaluate Model Module

1. Select Model Scoring & Evaluation section in the left navigation. Follow the steps outlined below:

   1. Select the Evaluate Model prebuilt module

   2. Drag and drop the selected module on to the canvas

   3. Connect the Score Model module to the first input of the Evaluate Model module

   

Exercise 3: Submit Training Pipeline

Task 1: Create Experiment and Submit Pipeline

1. Select Submit to open the Setup pipeline run editor.

   

   Please note that the button name in the UI is changed from Run to Submit.

2. In the Setup pipeline run editor, select Experiment, Create new and provide New experiment name: designer-run, and then select Submit.

   

3. Wait for pipeline run to complete. It will take around 8 minutes to complete the run.

4. While you wait for the model training to complete, you can learn more about the training algorithm used in this lab by selecting Linear Regression module.

Exercise 4: Visualize Training Results

Task 1: Visualize the Model Predictions

1. Select Score Model, Outputs, Visualize to open the Score Model result visualization dialog.

   

2. Observe the predicted values under the column Scored Labels. You can compare the predicted values (Scored Labels) with actual values (totalAmount).

   

Task 2: Visualize the Evaluation Results

1. Select Evaluate Model, Outputs, Visualize to open the Evaluate Model result visualization dialog.

   

2. Evaluate the model performance by reviewing the various evaluation metrics, such as Mean Absolute Error, Root Mean Squared Error, etc.

   

Next Steps

Congratulations! You have trained and evaluated your first machine learning model. You can continue to experiment in the environment but are free to close the lab environment tab and return to the Udacity portal to continue with the lesson.