IST 597:  Foundations of Deep Learning
  Fall 2018

Instructor: Dr. C. Lee Giles

TA: Ankur Mali

Time and Place: Fall, 2018. 2:30-5:30, Wednesday, 121 Earth and Engineering Sciences.

Office Hours:  Giles, Thursday 3-4,  E350 Westgate Bldg.
                         TA, Tuesday 1:30-3:30, E345 Westgate Bldg.

Course Overview

This is a three hour course for graduate students that meets once a week. The course will introduce the mathematical foundations of deep learning: linear algebra, probability and information theory, numerical computation, and machine learning basics. We will then cover modern practical deep networks and their applications. We will investigate deep feedforward networks, convolutional networks, and recurrent networks as well as practical methodologies, including model regularization and parameter optimization. Practical applications will be utilized for course projects.

Course Mission Statement:

This course is intended to prepare students to understand, design, develop and use deep learning methods.

Course Prerequisites:

Students should be able to learn the basics of deep learning fundamentals.

Schedule (syllabus):
  This schedule is subject to change. Please check it on a regular basis for assignments. The reading list is here; most classes will have online handouts. It is the student's responsibility to download that material.

Course Materials and References:
Course materials can be found here. There will also be links on the schedule.

        Research Project: 60%
                            Project proposal: 10%
                            Final project and presentation: 50%
                       Exercises: 30%

                       Paper review presentations: 10%


There will be two exercises.

Texts and Readings: 

The reading list is on the schedule above.  We will use chapters and sections from the online text:

Research Project:

Students will be placed in teams. Each team will propose and investigate an interesting application of deep learning.
There will be a proposed topic presentation, a final presentation, and a research paper in ACM paper format.


There will be two presentations for the project and two for assigned research papers to review.
For the assigned papers, each team will make two review presentations on the two assigned paper(s).

Email: All email to the instructor and TA about this class should contain "IST597" in the subject line.  For example, the subject line might read "IST597: Question about ....".  Email without this information might be deleted by spam filters or placed in a folder to be read at a later date.  Email with the appropriate identifier will usually be read within 24 hours of being received.


Reuse: Materials from this course can be publicly reused in other courses. This course supports Open Educational Resources (OER).