DSC Capstone2020

From Immersive Visualization Lab Wiki
Jump to: navigation, search


DSC 180 Capstone Section A01: Explainable AI


In this capstone domain we are going to study how we can make machine learning systems more user friendly by exploiting additional knowledge we can derive from the system and present it to the user. These types of systems are called Explainable AI.

The example we are going to use in this class is object recognition in images. We are first going to learn about saliency and attention maps, then get to know a large publicly available image data set (COCO) and finally we are going to implement the Grad-CAM algorithm in PyTorch and apply it to the COCO image data set.

The quarter will end with a proposal for your capstone project, which you will be working on in the winter quarter.

This class will be entirely remote.

You can use the DSMLP cluster, which already has the COCO data set installed.


Week Discussion Date Discussion Wed 12-12:50pm (Link to Slides) Participation Tasks (Due Tuesdays at noon) Checkpoints (Due Fridays)
1 Oct 7 Overview None for week 1
2 Oct 14 Saliency Maps Literature review
3 Oct 21 COCO Image Data Set COCO Dataset
4 Oct 28 Introduction to Grad-CAM Custom COCO Demo Replication Checkpoint #1
5 Nov 4 Introduction to Grad-CAM
6 Nov 11 Veterans Day (No Discussion) Implementation of methods
7 Nov 18 Replication Checkpoint #2
8 Nov 25 Implementation of Grad-CAM
9 Dec 2 Implementation of Grad-CAM
10 Dec 9 Capstone Project proposal Final Replication Report


Useful Links

Direct CNN Visualization