module09-neuro

Genetic Algorithms

Core Material

For each module, I will provide written and video tutorials on the topics. You can review whichever format suits you best. If the amount feels overwhelming, please reach out and we can help you narrow things down, and select a subset of the material to focus an exercise around. It's a lot!

• 📕 A People’s Guide to AI by Mimi Onuoha and Mother Cyborg (chapters 4-5, p. 43-67)
• 📗 Nature of Code 10.1 - 10.4 (skip 10.5 on, JS version of chapter not yet ready)
• 🎥 What is a Neural Network? from 3Blue1Brown (19 minutes)
• 🚂 Train a Neural Network with ml5.js (35 minutes)

Code Examples

• 💻 Nature of Code 10.1: Simple Perceptron
• 💻 Train Your Own Neural Network ml5.js
• 💻 Neuroevolution w/ ml5.js: Evolve Velocity
• 💻 Neuroevolution w/ ml5.js: Flappy Bird

Reference Research and Artistic Work:

• Deborah Aschheim: Neural Architecture
• Beauty and the Brain, A Neural Approach to Aesthetics

Supplemental Material

For each module, I will provide a list of additional video tutorials and readings that you may draw on for further exploration. It's unlikely you would be able to consume everything in one week and if you are looking for guidance about what might fit with your interests and learning style the most, please reach out.

Further Reading on Data and Neural Networks

• 📕 Data and Society’s Algorithmic Accountability Primer

Neuro-Evolution Further Reading

• 📕 Evolution 101: Neuroevolution by Danielle Whittaker
• 📕 Evolving Novel Behaviors via Natural Selection
• 📕 Evolving Neural Networks through Augmenting Topologies

Other NeuroEvolution examples

• 💻 Asteroids Learning by @xviniette
• 💻 steering agent with p5.js by @lazoviccorp
• 💻 Snake NeuroEvolution by @emgoz, 🎥 Snake NeuroEvolution video
• 🎥 NeuroEvolution playing Super Mario

Reinforcement Learning / Q-Learning

• 📕 Simple Reinforcement Learning with Tensorflow Part 0: Q-Learning with Tables and Neural Networks by Arthur Juliani
• 📕 Demystifying Deep Reinforcement Learning by Tambet Matiisen
• 📕 Playing Atari with Deep Reinforcement Learning (original DeepMind paper, 🎥 Playing Atari Video)

Related Reinforcement Learning Tools

• 🛠 Unity ml-agents
• 🛠 OpenAI gym

Emoji Key

The following emoji key will hopefully help you navigate the material for each module.

• 🚂 Video tutorial from Coding Train
• 🎥 Other video tutorial
• 📗 Nature of Code book
• 📕 Other reading
• 💻 Code examples
• 🎨 Creative project references

Examples from 2021

• https://editor.p5js.org/natureofcode-archive/sketches/uMKZm0aEW
• https://editor.p5js.org/natureofcode-archive/sketches/WswXPZdd4
• https://editor.p5js.org/natureofcode-archive/sketches/Rjm816gLl
• https://editor.p5js.org/natureofcode-archive/sketches/CF9M3atLy
• https://editor.p5js.org/natureofcode-archive/sketches/gF3JHSwca