start
This is an old revision of the document!
The following schedule is tentative and is being updated.
Please send your suggestions regarding lecture topics to Chuck using this Google Docs form. Questions regarding assignments should be entered in Canvas discussions.
August
Week | Topic | Material | Reading | Assignments |
---|---|---|---|---|
Week 1: Aug 23, 256 | Overview of course. Review of neural networks training and use. | 01 Introduction to CS545 02 Searching for Good Weights in a Linear Model | JupyterLab Introduction, watch the video then play with jupyter lab. The Batch from DeepLearning.AI. Yay, Colorado! | |
Week 2: Aug 30, Sept 1 | Thursday lecture cancelled. Please watch pre-recorded lecture in Echo360. Quiz1 and A1 questions. Regression with neural networks. | 03 Fitting Simple Models Using Gradient Descent in the Squared Error | Quiz 1 due Wednesday, August 31, 10:00 PM, in Canvas |
September
Week | Topic | Material | Reading | Assignments |
---|---|---|---|---|
Week 3: Sept 6, 8 | Introduction to Neural Networks | 04 Introduction to Neural Networks 04a Simple Animations | Activation functions in deep learning: A comprehensive survey and benchmark, Neurocomputing, volume 503, 2022, pp. 92-108 | |
Week 4: Sept 13, 15 | Python classes. A2. | 04b Introduction to Python Classes | Classes Tutorial | A1 Three-Layer Neural Network due Monday, Sept 12th, at 10:00 PM Anderson-Solution-A1 |
Week 5: Sept 20, 22 | Optimizers. Autoencoders. | 05 Optimizers Updated Sept. 27th 05a Collecting All Weights into One-Dimensional Vector for Use in Optimizers 06 Autoencoders 06a Visualizing Weights New | Pandas Cheat Sheet | A2 NeuralNetwork Class due Thursday, Sept 22nd, at 10:00 PM Anderson-A2-Solution |
Week 6: Sept 27, 29 | A3. Classification | 07 Introduction to Classification | JAX Ecosystem Streamlit |
October
Week | Topic | Material | Reading | Assignments |
---|---|---|---|---|
Week 7: Oct 4, 6 | Classification. Convolutional neural networks. | 08 Classification with Linear Logistic Regression 09 Classification with Nonlinear Logistic Regression Using Neural Networks 10 JAX neuralnetworks_app.tar 11 Convolutional Neural Networks CNN Backpropagation Notes | The Great AI Reckoning | A3 NeuralNetwork Class Using Optimizers due Tuesday, October 4th, at 10:00 PM. Updated Sept. 27th. |
Week 8: Oct 11, 13 | Pytorch. Convolutional neural nets | 12 Introduction to Pytorch 13 Convolutional Neural Networks in Pytorch 14 Convolutional Neural Networks in Numpy | ||
Week 9: Oct 18, 20 | Reinforcement Learning | 15 Introduction to Reinforcement Learning 16 Reinforcement Learning with Neural Network as Q Function | ||
Week 10: Oct 25, 27 | Reinforcement Learning | 17 Reinforcement Learning for Two Player Games 18 Reinforcement Learning to Control a Marble 19 Reinforcement Learning Modular Framework |
November
Week | Topic | Material | Reading | Assignments |
---|---|---|---|---|
Week 11: Nov 1, 3 | Transfer learning in Reinforcement Learning. Brain-Computer Interfaces | Slide presentations | ||
Week 12: Nov 8, 10 | BCI. Recurrent Neural Networks. | 20 Recurrent Networks in Numpy 21 Recurrent Networks in Pytorch 22 Classifying EEG Using Recurrent Neural Networks | ||
Week 13: Nov 15, 17 | K-means clustering. K-nearest-neighbor classification. Support Vector Machines. | 23 K-Means Clustering, K-Nearest-Neighbor Classification 24 Support Vector Machines | ||
Week 14: Nov 29, Dec 1 | Introduction to Transformers | 25 Introduction to Transformers |
December
Week | Topic | Material | Reading | Assignments |
---|---|---|---|---|
Week 15: Dec 6, 8 | Transformers: Self-Attention Replaced by Fourier Transform. Cascade Ensemble Network | 26 FNet--Replace Self-Attention with Fourier Transform 27 Cascade Ensemble Network | ||
Dec 12-16 | Final Exam Week | No Exams in this course |
start.1664666476.txt.gz · Last modified: 2022/10/01 17:21 by anderson