Course Number
705.651
Next Offered
Summer 2024
Location
Online
Course Format
Virtual Live

An apparently new breed of neural network — the large language model (LLM) — figures increasingly in today’s news: ChatpGPT and Microsoft’s new chatbot-like Bing Chat interface seem to garner headlines on the daily. This course constitutes a thorough introduction to this technology, tracing the historical threads in computational linguistics and language modeling that led to it, and exploring the design patterns that underpin its application in modern AI systems. In between, students will learn about language modeling, the attention mechanism, prompt and instruction tuning, composability, quantization, low-rank adaptation, and the wealth of software and hardware optimizations that enable LLMs to be used at scale and with acceptable latencies.

Course Offerings

Waitlist Only

Large Language Models: Theory and Practice

705.651.8VL
05/28/2024 - 08/13/2024
Tues 7:00 p.m. - 10:05 p.m.
Notes: This course uses the Virtual Live format. All students participate online through live web-conferencing at the scheduled day and time. This is a live-online course in which students participate in live weekly lectures and discussions, and are able to interact extensively with the instructors. All classes are recorded for download and review.
Semester
Summer 2024
Course Format
Virtual Live
Location
Online
Cost
$5,270.00
Course Materials