Large Language Model Agents

Prospective Students

• To sign up for the course, please fill in this form.
• For course discussion and questions, please join the MOOC channel at LLM Agents Discord.

Course Staff

Instructor	Co-instructor
Dawn Song	Xinyun Chen
Professor, UC Berkeley	Research Scientist, Google DeepMind

Guest Speakers

Denny Zhou	Shunyu Yao	Chi Wang	Jerry Liu
Burak Gokturk	Omar Khattab	Graham Neubig	Nicolas Chapados
Yuandong Tian	Jim Fan	Percy Liang	Ben Mann

Course Description

Large language models (LLMs) have revolutionized a wide range of domains. In particular, LLMs have been developed as agents to interact with the world and handle various tasks. With the continuous advancement of LLM techniques, LLM agents are set to be the upcoming breakthrough in AI, and they are going to transform the future of our daily life with the support of intelligent task automation and personalization. In this course, we will first discuss fundamental concepts that are essential for LLM agents, including the foundation of LLMs, essential LLM abilities required for task automation, as well as infrastructures for agent development. We will also cover representative agent applications, including code generation, robotics, web automation, medical applications, and scientific discovery. Meanwhile, we will discuss limitations and potential risks of current LLM agents, and share insights into directions for further improvement. Specifically, this course will include the following topics:

• Foundation of LLMs
• Reasoning
• Planning, tool use
• LLM agent infrastructure
• Retrieval-augmented generation
• Code generation, data science
• Multimodal agents, robotics
• Evaluation and benchmarking on agent applications
• Privacy, safety and ethics
• Human-agent interaction, personalization, alignment
• Multi-agent collaboration

Syllabus

Completion Certificate

LLM Agent course completion certificates will be awarded to students based on the rules of the following tiers. All assignments are due December 12th, 2024 at 11:59PM PST.

Trailblazer Tier:

• Complete all 12 quizzes associated with each lecture
• Pass the written article assignment

Mastery Tier:

• Complete all 12 quizzes associated with each lecture
• Pass the written article assignment
• Pass all 3 lab assignments

Ninja Tier:

• Complete all 12 quizzes associated with each lecture
• Pass the written article assignment
• Submit a project to the LLM Agents Hackathon (more details coming soon!)

Legendary Tier:

• Complete all 12 quizzes associated with each lecture
• Pass the written article assignment
• Become a prize winner or finalist at the LLM Agents Hackathon (more details coming soon!)

Honorary Tier:

• For the most helpful/supportive students in discord!

NOTE: completing the assignments associated with this course in order to earn a Completion Certificate is completely optional. You are more than welcome to just watch the lectures and audit the course!

Coursework

All coursework will be released and submitted through the course website.

Quizzes

All quizzes are released in parallel with (or shortly after) the corresponding lecture. Please remember to complete the quiz each week. Although it’s graded on completion, we encourage you to do your best. The questions are all multiple-choice and there are usually at most 5 per quiz. The quizzes will be posted in the Syllabus section.

Written Article

Create a twitter post, linkedin post, or medium article to post on Twitter of roughly 500 words. Include the link to our MOOC website in the article and tweet.

• Students in the Trailblazer or Mastery Tier should either summarize information from one of the lecture(s) or write a postmortem on their learning experience during our MOOC
• Students in the Ninja or Lengendary Tier should write about their hackathon submission

The written article is an effort-based assignment that will be graded as pass or no pass (P/NP). Submit your written article assignment HERE.

Labs

There will be 3 lab assignments to give students some hands-on experience with building agents. Students must pass all 3 lab assignments. All labs are due December 12th, 2024 at 11:59pm PST. Please read the instructions carefully here. Please read the FAQs here before asking questions in Discord.

Hackathon

Check out our hackathon website here. Sign up for the hackathon here — every member of the team should signup individually. A separate team formation form will be released soon. There are no limits to team sizes.

For any questions, please visit our Hackathon FAQ here. You can also ask questions and find potential team members in our LLM Agents Discord.