CS545: Machine Learning

User Tools

Site Tools

Trace:
start

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revisionPrevious revision
Next revision		Previous revision
start [2023/10/16 10:18] – [October] andersonstart [2023/12/07 09:17] (current) – external edit 127.0.0.1
Line 39: Line 39:
 |< 100% 18% 20% 22% 20% 20%  >| |< 100% 18% 20% 22% 20% 20%  >|
 ^  Week      ^  Topic      ^  Lecture Notes  ^  Reading          ^  Assignments  ^ ^  Week      ^  Topic      ^  Lecture Notes  ^  Reading          ^  Assignments  ^
-| Week 7:\\  Oct 3, 5  | Classification with QDA, LDA, and linear logistic regression.  | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/10 Classification with Linear Logistic Regression.ipynb|10 Classification with Linear Logistic Regression]]  | | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/A3 NeuralNetwork Class Using Optimizers.ipynb|A3 NeuralNetwork Class Using Optimizers]] due Thursday, October 5th, 10:00 PM |+| Week 7:\\  Oct 3, 5  | Classification with QDA, LDA, and linear logistic regression.  | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/10 Classification with Linear Logistic Regression.ipynb|10 Classification with Linear Logistic Regression]]  | | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/A3 NeuralNetwork Class Using Optimizers.ipynb|A3 NeuralNetwork Class Using Optimizers]] due Thursday, October 5th, 10:00 PM\\ Examples of good A3 solutions can be [[https://www.cs.colostate.edu/~anderson/cs545/notebooks/goodones|found here]] |
 | Week 8:\\  Oct 10, 12  | Classification with Nonlinear Logistic Regression. Introduction to Reinforcement Learning.  | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/11 Classification with Nonlinear Logistic Regression Using Neural Networks.ipynb|11 Classification with Nonlinear Logistic Regression Using Neural Networks]]\\ [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/12 Introduction to Reinforcement Learning.ipynb|12 Introduction to Reinforcement Learning]]  | | | Week 8:\\  Oct 10, 12  | Classification with Nonlinear Logistic Regression. Introduction to Reinforcement Learning.  | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/11 Classification with Nonlinear Logistic Regression Using Neural Networks.ipynb|11 Classification with Nonlinear Logistic Regression Using Neural Networks]]\\ [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/12 Introduction to Reinforcement Learning.ipynb|12 Introduction to Reinforcement Learning]]  | |
-| Week 9:\\  Oct 17, 19  | Reinforcement learning. Learning to play games. | | [[https://lastweekin.ai/p/241|Last Week in AI]]\\ [[https://www.cbsnews.com/news/geoffrey-hinton-ai-dangers-60-minutes-transcript/?utm_source=substack&utm_medium=email|Geoffrey Hinton: AI Dangers, on 60 Minutes]]  | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/A4 Neural Network Classifier.ipynb|A4 Neural Network Classifier]] due Wednesday, October 18th, 10:00 PM <color red>Modified Oct. 10th, 4:15 PM</color> | +| Week 9:\\  Oct 17, 19  | Reinforcement learning with Q Function as Neural Network. Learning to play games. | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/13 Reinforcement Learning with Neural Networks as Q Function.ipynb|13 Reinforcement Learning with Neural Networks as Q Function]]\\ [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/14 Targets and Deltas Summary.ipynb|14 Targets and Deltas Summary]]\\ [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/15 Reinforcement Learning for Two Player Games.ipynb|15 Reinforcement Learning for Two Player Games]]  | [[https://lastweekin.ai/p/241|Last Week in AI]]\\ [[https://www.cbsnews.com/news/geoffrey-hinton-ai-dangers-60-minutes-transcript/?utm_source=substack&utm_medium=email|Geoffrey Hinton: AI Dangers, on 60 Minutes]]  | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/A4 Neural Network Classifier.ipynb|A4 Neural Network Classifier]] due Wednesday, October 18th, 10:00 PM\\ Examples of good A4 solutions can be [[https://www.cs.colostate.edu/~anderson/cs545/notebooks/goodones|found here]]\\ And here are [[https://www.cs.colostate.edu/~anderson/cs545/notebooks/neuralnetworksA4.zip|python script files]] as A4 answer.   | 
-| Week 10:\\  Oct 24, 26  | Reinforcement learning for control of dynamic systems.  | | |+| Week 10:\\  Oct 24, 26  | Modular framework for reinforcement learning. Convolutional Neural Networks.   | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/16 Modular Framework for Reinforcement Learning.ipynb|16 Modular Framework for Reinforcement Learning]]\\ [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/17 Convolutional Neural Networks.ipynb|17 Convolutional Neural Networks]]  | | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/Project Proposal and Report Example.ipynb|Project proposal]] due at 10 pm Friday evening, October 27th.  |
  
 ===== November ===== ===== November =====
Line 48: Line 48:
 |< 100% 18% 20% 22% 20% 20%  >| |< 100% 18% 20% 22% 20% 20%  >|
 ^  Week      ^  Topic      ^  Lecture Notes  ^  Reading          ^  Assignments  ^ ^  Week      ^  Topic      ^  Lecture Notes  ^  Reading          ^  Assignments  ^
-| Week 11:\\  Oct 31 Nov 2  | Recurrent neural networks.  | | | +| Week 11:\\  Oct 31 Nov 2  | Ray. Pytorch.  Convolutional Neural Networks.  | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/18 Ray for Parallel Processing.ipynb|18 Ray for Parallel Processing]]\\ [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/19 Introduction to Pytorch.ipynb|19 Introduction to Pytorch]]\\ [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/20 Steps Towards Convolutional Nets in Pytorch.ipynb|20 Steps Towards Convolutional Nets in Pytorch]]  | [[https://www.whitehouse.gov/briefing-room/statements-releases/2023/10/30/fact-sheet-president-biden-issues-executive-order-on-safe-secure-and-trustworthy-artificial-intelligence/|President Biden's Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence]]  | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/A5 Reinforcement Learning.ipynb|A5 Reinforcement Learning]] due Friday, Nov 3rd, 10:00 PM. <color red>This notebook and a5.zip were updated slightly Oct. 26th, 11:00 AM. </color>  | 
-| Week 12:\\  Nov 7, 9  | Unsupervised learning. Dimensionality reduction. Autoencorders. | | | +| Week 12:\\  Nov 7, 9  | Convolutional Neural Networks. Ensembles.  | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/21 Convolutional Neural Network Class in Pytorch.ipynb|21 Convolutional Neural Network Class in Pytorch]]\\ [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/22 Ensembles.ipynb|22 Ensembles]]  | | 
-| Week 13:\\  Nov 14, 16  | Clustering.  | | | +| Week 13:\\  Nov 14, 16  | Clustering. K-Nearest Neighbors. Jax.  | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/23 K-Means Clustering, K-Nearest-Neighbor Classification.ipynb|23 K-Means Clustering, K-Nearest-Neighbor Classification]]\\ [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/24 Introduction to Jax.ipynb|24 Introduction to Jax]]   | [[https://www.science.org/doi/10.1126/science.adi2336|Learning skillful medium-range global weather forecasting]] by DeepMind, using graph-convolutional_networks (GNNs) implemented in with jax.  | 
-| Fall Break:\\ Nov 20-24 | No classes  | +| Fall Break:\\ Nov 20-24 | No classes.  | 
-| Week 14:\\  Nov 28, 30  | Ensemble methods. Mixture-of-experts. Transformers.  | | |+| Week 14:\\  Nov 28, 30  | Support Vector Machines. Web Apps with Streamlit. Word Embeddings.  | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/25 Support Vector Machines.ipynb|25 Support Vector Machines]]\\  [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/26 Web Apps with Streamlit.ipynb|26 Web Apps with Streamlit]]\\  [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/27 Word Embeddings.ipynb|27 Word Embeddings]]  | [[https://www.nature.com/articles/d41586-023-03635-w|ChatGPT generates fake data set to support scientific hypothesis]]  | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/A6 Convolutional Neural Networks.ipynb|A6 Convolutional Neural Networks]] due Friday, Dec. 1, 10:00 PM.  |
  
 ===== December ===== ===== December =====
Line 58: Line 58:
 |< 100% 18% 20% 22% 20% 20%  >| |< 100% 18% 20% 22% 20% 20%  >|
 ^  Week      ^  Topic      ^  Lecture Notes  ^  Reading          ^  Assignments  ^ ^  Week      ^  Topic      ^  Lecture Notes  ^  Reading          ^  Assignments  ^
-| Week 15:\\  Dec 5, 7  | Other topics in current research.  | | [[https://www.cs.colostate.edu/~anderson/cs545/notebooks/2023_AI-scientists-topline-report81.pdf|AI Scientists’ Perspectives on AI]]  | +| Week 15:\\  Dec 5, 7  | Transformers.  | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/28 Introduction to Transformers.ipynb|28 Introduction to Transformers]]\\ [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/29 Transformers Predicting Text.ipynb|29 Transformers Predicting Text]]\\ Chuck's Recent Projects:\\ 1. Pretraining Speeds Up RL\\  2. Brain-Computer Interfaces\\  3. Explaining a Neural Network's Decisions   | [[https://colab.research.google.com/drive/1Qhq2FO4FFX_MKN5IEgia_PrBEttxCQG4?usp=sharing&utm_source=substack&utm_medium=email#scrollTo=r_20uEgdp4W_|Automatic detection of hallucination with SelfCheckGPT]]\\ [[https://arxiv.org/pdf/2309.13638.pdf|Embers of Autoregression: Understanding Large Language 
-| Dec 11-15  |  Final Exam Week  |  No Exams in this course  | +Models Through the Problem They are Trained to Solve]]    | | 
 +| Dec 11-15  |  Final Exam Week  |  No Exams in this course  | | [[https://nbviewer.org/url/www.cs.colostate.edu/~anderson/cs545/notebooks/Project Proposal and Report Example.ipynb|Project Report]] due at 10 pm Tuesday evening, December 12th.  |
  
  
  
start.1697473136.txt.gz · Last modified: 2023/10/16 10:18 by anderson