Difference between revisions of "DSC Capstone2020"
From Immersive Visualization Lab Wiki
(→Schedule) |
(→Schedule) |
||
| Line 32: | Line 32: | ||
| [[Media:01_CourseOverviewF20.pdf|Overview]] | | [[Media:01_CourseOverviewF20.pdf|Overview]] | ||
| None for week 1 | | None for week 1 | ||
| + | | | ||
|- | |- | ||
| 2 | | 2 | ||
| Line 37: | Line 38: | ||
| [[Media:02_SaliencyMapsF20.pdf|Saliency Maps]] | | [[Media:02_SaliencyMapsF20.pdf|Saliency Maps]] | ||
| [[DSC180F20W2|Literature review]] | | [[DSC180F20W2|Literature review]] | ||
| + | | | ||
|- | |- | ||
| 3 | | 3 | ||
| Line 42: | Line 44: | ||
| [[Media:03_CocoDatasetF20.pdf|COCO Image Data Set]] | | [[Media:03_CocoDatasetF20.pdf|COCO Image Data Set]] | ||
| [[DSC180F20W3|COCO Dataset]] | | [[DSC180F20W3|COCO Dataset]] | ||
| + | | | ||
|- | |- | ||
| 4 | | 4 | ||
| Line 47: | Line 50: | ||
| | | | ||
| [[DSC180F20W4|Custom COCO Demo]] for Replication Checkpoint #1 | | [[DSC180F20W4|Custom COCO Demo]] for Replication Checkpoint #1 | ||
| + | | | ||
|- | |- | ||
| 5 | | 5 | ||
| Line 52: | Line 56: | ||
| | | | ||
| Description of methods | | Description of methods | ||
| + | | | ||
|- | |- | ||
| 6 | | 6 | ||
| Line 57: | Line 62: | ||
| Veterans Day (No Discussion) | | Veterans Day (No Discussion) | ||
| Implementation of methods | | Implementation of methods | ||
| + | | | ||
|- | |- | ||
| 7 | | 7 | ||
| Line 62: | Line 68: | ||
| | | | ||
| [[DSC180F20W7|Replication Checkpoint #2]] due | | [[DSC180F20W7|Replication Checkpoint #2]] due | ||
| + | | | ||
|- | |- | ||
| 8 | | 8 | ||
| Line 67: | Line 74: | ||
| | | | ||
| Implementation of Grad-CAM | | Implementation of Grad-CAM | ||
| + | | | ||
|- | |- | ||
| 9 | | 9 | ||
| Line 72: | Line 80: | ||
| | | | ||
| Implementation of Grad-CAM | | Implementation of Grad-CAM | ||
| + | | | ||
|- | |- | ||
| 10 | | 10 | ||
| Line 77: | Line 86: | ||
| | | | ||
| [[DSC180F20W10|Final Replication Report]] due, Capstone Project proposal due | | [[DSC180F20W10|Final Replication Report]] due, Capstone Project proposal due | ||
| + | | | ||
|} | |} | ||
Revision as of 10:26, 28 October 2020
Contents |
DSC 180 Capstone Section A01: Explainable AI
- Instructor: Jurgen Schulze
- Discussion: Wednesdays 12-12:50pm on Zoom at https://ucsd.zoom.us/j/9100475160
- Office hours: Fridays 10-11am on Zoom at https://ucsd.zoom.us/j/97761107672
- Piazza Discussion Board: https://piazza.com/ucsd/fall2020/dsc180
Overview
In this capstone domain we are going to study how we can make machine learning systems more user friendly by exploiting additional knowledge we can derive from the system and present it to the user. These types of systems are called Explainable AI.
The example we are going to use in this class is object recognition in images. We are first going to learn about saliency and attention maps, then get to know a large publicly available image data set (COCO) and finally we are going to implement the Grad-CAM algorithm in PyTorch and apply it to the COCO image data set.
The quarter will end with a proposal for your capstone project, which you will be working on in the winter quarter.
This class will be entirely remote.
You can use the DSMLP cluster, which already has the COCO data set installed.
Schedule
| Week | Date | Discussion Topic | Participation Tasks (Due Tuesdays at noon) | Checkpoints (Due Fridays) |
|---|---|---|---|---|
| 1 | Oct 7 | Overview | None for week 1 | |
| 2 | Oct 14 | Saliency Maps | Literature review | |
| 3 | Oct 21 | COCO Image Data Set | COCO Dataset | |
| 4 | Oct 28 | Custom COCO Demo for Replication Checkpoint #1 | ||
| 5 | Nov 4 | Description of methods | ||
| 6 | Nov 11 | Veterans Day (No Discussion) | Implementation of methods | |
| 7 | Nov 18 | Replication Checkpoint #2 due | ||
| 8 | Nov 25 | Implementation of Grad-CAM | ||
| 9 | Dec 2 | Implementation of Grad-CAM | ||
| 10 | Dec 9 | Final Replication Report due, Capstone Project proposal due |
Papers
- Paper for replication: Grad-CAM: Why did you say that? Visual Explanations from Deep Networks via Gradient-based Localization
- Paper on COCO image dataset: Microsoft COCO: Common Objects in Context
- Original attention map paper: Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps
- Learning Deep Features for Discriminative Localization
- Visualizing CNNs with deconvolution
Useful Links
- Main DSC Capstone Website
- Introduction to how CNNs Work
- Tensorflow Playground
- Grad-CAM implementation in Pytorch
- COCO Image Dataset
- http://cs-people.bu.edu/jmzhang/excitationbp.html
Direct CNN Visualization
- https://github.com/conan7882/CNN-Visualization
- https://medium.com/@awjuliani/visualizing-neural-network-layer-activation-tensorflow-tutorial-d45f8bf7bbc4
- drawNet: http://people.csail.mit.edu/torralba/research/drawCNN/drawNet.html
- https://towardsdatascience.com/how-to-visualize-convolutional-features-in-40-lines-of-code-70b7d87b0030
- https://towardsdatascience.com/understanding-your-convolution-network-with-visualizations-a4883441533b
- http://cs231n.github.io/understanding-cnn/
