Courses

Winter 2023

Announcement

January 10 Announcement: Welcome!

New quarter starts, and welcome to ECS 189G on Deep Learning.

ECS 189G-0001 Deep Learning (Syllabus, Project)


Course Information

ECS 189G Deep Learning
Date: Jan 9-March 17, 2023
Time: T/R 10:30-11:20 AM
Venue: Young Hall 184

Instructor Information

Instructor: Jiawei Zhang
Email: jiwzhang[AT]ucdavis.edu
Office: Zoom Link to Join
Office Hours: 12:15-1:15PM (Tuesday)

TA #1: Qingyang Teng (Q&A, Project)
Email: qteng[AT]ucdavis.edu
Office: Zoom Link to Join
Office Hours: 3:00-4:00PM (Thursday)

TA #2: Xinhao Xiang (Q&A, HW, Exam)
Email: xhxiang[AT]ucdavis.edu
Office: Zoom Link to Join
Office Hours: 4:00-5:00PM (Friday, Week 2 - 6)

TA #3: Xiao Liu (Q&A, HW, Exam)
Email: xioliu[AT]ucdavis.edu
Office: Zoom Link to Join
Office Hours: 4:00-5:00PM (Friday, Week 7 - 10)

Course Description

Do you know how the recent Turing Awards were given to the deep learning field? For what contributions? Deep learning is one of the hottest topics and technology with edge-cutting applications in various areas currently, e.g., search engine, e-commerce, self-driving vehicle, robotics, gaming, and highly like the coming metaverse. What breakthroughs turned the rather mathematical idea into reality? What are the classic milestones that pioneered and shaped the landscape of the deep learning field? What are the state-of-the-art methods just coming out yesterday? Do you know that, although deep learning has been widely used in our real-life products and services now, researchers are even more fascinated by general deep learning issues? The new challenges naturally arise in the junction of deep learning vs class machine learning, deep vs shallow, general-purpose AI vs expert system, even human vs robots, and many more novel contexts. What are the current topics and future agenda? To build the essential foundation as a stepping-stone to deep learning research, this course exposes students to various deep learning concepts, methods, and applications. We will broadly explore the classic as well as more recent research work.

Topics Covered

  • basic math, optimization, machine learning background knowledge
  • neural network basics, error backpropagation algorithm
  • auto-encoder model for data encoding and re-construction
  • convolutional neural network (CNN) for computer vision
  • recurrent neural network (RNN) for natural language processing
  • graph neural network (GNN) for network embeddings
  • other advanced topics...

Textbook

Required textbook.

  • Deep Learning, 1nd edition, by Ian Goodfellow and Yoshua Bengio and Aaron Courville. MIT Press, 2016.

Recommended textbook.

  • Neural Networks and Deep Learning: A Textbook, 1st edition, by Charu Aggarwal. Springer, 2018.
  • Neural Networks and Learning Machines, 3rd edition, by Simon S. Haykin. Pearson, 2008.

Prerequisites

Students should come with good programming skills. ECS 060 or ECS 032B or ECS 0036C or equivalent courses are required. If you are not sure whether you have the right background, please contact the instructor. Note: We will not cover programming-specific issues in this course.

Course Format

The course is lecture-based with two examinations (one midterm and one final). There are individual assignments and a group-level programming project. In order to encourage attending classes and participating in discussions, there will be several in-class quizzes for students.

  • Lectures and Class Participation: We strongly encourage (and appreciate!) students to attend classes, because effective lectures rely on students' participation to raise questions and contribute in discussions. Although we probably will have a large class, we will strive to maintain interactive class discussions if possible. We will provide lecture notes before class, which will be posted on the Schedule page.
  • Questions: We encourage students discussing their questions and problems first with their group peers and classmates. This way, you can get immediate help and also learn to communicate "professionally" with your peers. In any case for more thorough discussion, come to the office hours of TA's and the instructor's. Any announcement will be posted on the Announcement page. Make sure to check it frequently enough to stay informed.
  • Assignment: There will be a few written assignments spaced out over the course of the quarter. All the assignments should be done individually by the students. Assignments should be submitted before the class begins on the due dates.
  • Exam: There will be a mid-term exam and a final exam held at the mid & end of the quarter.
  • Project: There will be a quarter-long project, which involves significant deep learning application programming. The project will be structured with several milestones due in the course of the quarter, leading to a demo and write-up near the end of the quarter.



Course Schedule and Progress

Schedule Sheet Link

Youtube Channel

Time

6/10 Weeks

Assignments

1/2 Assignments

Project

3/5 Project Stages

Exams

1/2 Exams

Grading Policy

The course grade will break down as follows

  • Assignment: 20%
  • Project: 40%
  • Mid-term: 10%
  • Final exam: 25%
  • Quizzes: 5%
Any regrading request should be submitted to the instructor or the TA(s) within one week since the graded deliverables are handed out to the students.
Final Grade
  • A+: [100-95], A: (95-90], A-: (90-85];
  • B+ (85-80], B: (80-70], B-: (70-65];
  • C: (65-60], D: (60-50];
  • F: (50-0].
This table indicates minimum guaranteed grades. Under certain limited circumstances (e.g., an unreasonably hard exam), we may select more generous ranges or scale the scores to adjust.


Late Submission Policy

  • Late assignments will not ordinarily be accepted. If, for some compelling reason, you cannot submit an assignment on time, please contact the TA or instructor as far in advance as possible. Written assignments or project deliverables are due at the beginning of a class, you should hand them in at the beginning of the class
  • No credit will be given to late programming projects
  • No make-up exams (except under extremely unusual circumstances)

Other Issues

Gemeral Policy

  • University Attendance Policy: Excused absences include documented illness, deaths in the family and other documented crises, call to active military duty or jury duty, religious holy days, and official University activities. These absences will be accommodated in a way that does not arbitrarily penalize students who have a valid excuse. Consideration will also be given to students whose dependent children experience serious illness.
  • Academic Honor Policy: The UC Davis Code of Academic Conduct outlines the University's expectations for the integrity of students' academic work, the procedures for resolving alleged violations of those expectations, and the rights and responsibilities of students and faculty members throughout the process. Students are responsible for reading the Code of Academic Conduct and for living up to their pledge to "...be honest and truthful and... [to] strive for personal and institutional integrity at UC Davis." (UC Davis Code of Academic Conduct, found here)
  • Syllabus Change Policy: Except for changes that substantially affect implementation of the evaluation (grading) statement, this syllabus is a guide for the course and is subject to change with advance notice.
Collaboration/Academic Honesty: All course participants must adhere to the academic honor code of UC Davis which is available in the student handbook. All instances of academic dishonesty will be reported to the university. Every student must write his/her own homework/code (unless you are in the same group for the programming project). Showing your code or homework solutions to others is a violation of academic honesty. It is your responsibility to ensure that others cannot access your code or homework solutions. Consulting related textbooks, papers and information available on the Internet for your coding assignment and homework is fine. However, copying a large portion of such information will be considered as academic dishonesty. If you borrow a small piece of any such information, please acknowledge that in your assignment. Please see the following link for a complete explanation of the Code of Academic Conduct.
Student Disabilities: Americans With Disabilities Act: Students with disabilities needing academic accommodation should: (1) register with and provide documentation to the Student Disability Center; (2) bring a letter to the instructor indicating the need for accommodation and what type. This syllabus and other class materials are available in alternative format upon request. For more information about services available to UC Davis students with disabilities, contact the Student Disability Center.