01_ml5

Introduction to ml5.js and pre-trained models

Objectives:

• Understand the concept of a “machine learning model.”
• What is a “pre-trained model”?
• What does it mean to discuss the “architecture” of a machine learning model?
• Define and diagram an artificial neural network.
• Understand what ml5.js is and how it fits into the TensorFlow and open source machine learning library ecosystem.
• Learn how to create an image classifier with ml5.js and MobileNet.
• Understand how the MobileNet model was trained, specifically the origins and collection methodology for the training.
• Session 1b Slides

ml5.js video tutorials

• A Beginner's Guide to Machine Learning with ml5.js - video tutorial
• ml5.js: Image Classification with MobileNet - video tutorial
• ml5.js: Webcam Image Classification - video tutorial

ml5.js resources

• ml5 website
• all ml5 examples

ml5 code editor examples

• Image Classification
• Drag and Drop Image Classification
• Webcam Image Classification
• Webcam Image Classification Text to Speech
• Image Classification Scavenger Hunt

Defining Machine Learning yet again

• "Machine learning is programming with examples, not instructions" -- from Kyle McDonald - Weird Intelligence.
• "A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at tasks in T, as measured by P, improves with experience E." -- Tom Mitchell (1998): Machine Learning book.
  • Example: classifying images of dogs and cats.
    • E = Watching you classify images as dogs or cats.
    • T = Classifying images as dogs or cats.
    • P = The % of images correctly classified.

Classification and Regression

• Classification and regression both involve making a "prediction" based on input data.
• Classification refers to predicting an output with a discrete set of possibilities like a set of categories or labels. For example: "Given an input image, is it a dog or cat?"
• Regression refers to predicting an "continuous" output (a fancy way of saying number). For example: "Given the number of bedrooms, what is the price of a house?" or "Given an input image of a cat, how much does the cat weigh?"

Reading / Viewing:

1. Read Andrey Kurenkov's 'Brief' History of Neural Nets and Deep Learning
2. Read ImageNet: The Data That Transformed AI Research—and Possibly the World by Dave Gershgorn (Note: Fei-Fei Li is no longer at Google; she is currently Co-Director of the Stanford Human-Centered AI Institute)

Assignment 1B

1. Explore ImageNet. What surprises you about this data set? What questions do you have? Thinking back to last week’s assignment, can you think of any ethical considerations around how this data was collected Are there privacy considerations with the data?
2. Using the ml5.js examples above, try running image classification on a variety of images. Pick at least 10 objects in your room. How many of these does it recognize? What other aspects of the image affect the classification, including but not limited to position, scale, lighting, etc.
3. Document your thoughts on MobileNet and image classification in a blog post and add a link to the Assignment 1b Wiki.