ARTIFICIAL INTELLIGENCE

CSCI-UA 0472 Β· SPRING 2024 Β· COURANT INSTITUTE OF MATHEMATICAL SCIENCES

INSTRUCTOR Alfredo Canziani, Ernest Davis
LECTURES Monday & Wednesday 11:00 – 12:15, Zoom
MATERIAL 2024 repo

Context

It’s January 2024. I come back from the Winter Break and… I’m promoted to full-teaching faculty with new duties, including teaching an undergraduate Artificial Intelligence (AI) course here at NYU. We merged two offerings of this course and split the content among the two instructors. Ernie covered the Knowledge-Based AI part in the first half of the semester, while I took care of the Learning-Based AI & Natural Language Processing (NLP) bit. This second half of the course is what I’m releasing to the public. Working on this course and teaching my Deep Learning one took all my time. Therefore, I made no progress on the Energy-Based Deep Learning book this Spring semester.

Lectures

Legend: πŸ–₯ slides, πŸ“ notes, πŸ““ Jupyter notebook, πŸŽ₯ YouTube video.

  1. Course first part recap, NaΓ―ve Bayes intro πŸ–₯ πŸ–₯ πŸŽ₯
  2. Discrete probability recap, NaΓ―ve Bayes classification πŸ–₯ πŸ–₯ πŸ“ πŸŽ₯
    • RN, chapter 12 – Quantifying uncertainty
  3. NaΓ―ve Bayes parameters estimation and Laplace smoothing πŸ–₯ πŸŽ₯
  4. Binary classifier evaluation, binary Perceptron πŸ–₯ πŸ–₯ πŸŽ₯
  5. Multiclass perceptron, binary and multiclass logistic regression πŸ–₯ πŸ–₯ πŸŽ₯
  6. Optimisation (gradient ascent) πŸ–₯ πŸŽ₯
  7. Statistical natural language processing πŸ–₯
    • RN, chapter 23 – Natural language processing
      Sections 23.1.0–23.1.4, 23.1.7, 23.6
    • JM, chapter 3 – N-gram language model
      Sections 3.0–3.6
  8. Digit captioning πŸ–₯
    • Read programming assignment 4
  9. Classification with neural nets πŸ–₯
    • YouTube animations made by my high-schooler: vid1, vid2.
    • PyTorch tensor tutorial notebook. πŸ““
    • PyTorch classification notebook. πŸ““
  10. Language sampling and neural NLP πŸ–₯
    • JM, chapter 3 – N-gram language model
      Section 3.4
    • JM, chapter 6 – Vector semantics and embeddings
      Sections 6.0, 6.3, 6.4, 6.9–6.11
    • RN, chapter 23 – Natural language processing
      Section 23.1.5
    • RN, chapter 24 – Deep learning for NLP
      Sections 24.0, 24.1, 24.2.0
  11. Convolutional nets + NB πŸ–₯
    • PyTorch convnet tutorial notebook. πŸ““
  12. Recurrent nets + NB πŸ–₯
    • PyTorch recurrent net tutorial notebook. πŸ““
  13. Recurrent nets for NLP and attention πŸ–₯
    • RN, chapter 24 – Deep learning for NLP
      Sections 24.2–24.6

Suggested readings