CS 221: Computational Complexity
Spring 2006


Description | Topics | Prerequisites | Grading | Readings | Related Courses

Instructor: Salil Vadhan (MD 337)
    Shopping week office hours: Fri 2/3 1-2, Mon 2/6 1:30-2:30, Wed 2/8 1:30-3
TFs: Minh Nguyen, Emanuele Viola (both in MD 140)
Assistant: Carol Harlow (MD 343, has handouts)

Room & time: TuTh 2:30-4, MD G-135
Course email address (use for all questions): cs221@eecs.harvard.edu
Course website: http://www.courses.fas.harvard.edu/~cs221/

Course Description

Computational complexity aims to understand the fundamental limitations and capabilities of efficient computation.  For example, which computational problems inherently require a huge running time to solve, no matter how clever an algorithm one designs? This most basic question of computational complexity is now understood to be both extremely difficult and of great importance, as demonstrated by all the attention given to the famous P vs. NP question.    At the same time, however, this is but one of many the fascinating issues addressed by complexity theory (and covered in this course).  First, running time will not be the only computational resource we consider, but also space/memory, nondeterminism, randomness, parallelism, communication, algebraic operations, and quantum mechanics.  We will also study a variety of types of computational problems, such as decision, search, counting, optimization, and proof verification. We will introduce an array of complexity classes to capture these resources and problem types.  We will use the powerful notions of reduction and completeness to establish relationships between seemingly unrelated problems, classes, and resources.   Indeed, it is in discovering such connections that complexity theory has had its greatest successes, and we will conclude the course with one of the most surprising ones: the equivalence between probabilistic verification of mathematical proofs (PCPs) and the complexity of finding approximate solutions to optimization problems.  We will also examine various approaches to separating P and NP, and more generally to proving lower bounds on complexity. Finally, we will study what happens when one relaxes the requirement for an algorithm to be "correct", for example from worst-case complexity to average-case complexity or from exact solutions to approximate solutions.

The material in this course can be of interest to a wide range of graduate students and advanced undergraduates, ranging from those who plan to do research in the theory of computation, to those working in other areas of computer science and mathematics, to those interested in computational aspects of other fields such as economics and physics.

Tentative List of Topics


The prerequisite for this course is Computer Science 121 (or the equivalent at another university) with a good grade (B+ or higher).    If you do not formally meet this requirement but still wish to take this course, you must (a) come to my office hours during shopping week to discuss your preparation for the course, (b) do Problem Set 0, and (c) come to my office hours again before add/drop date to discuss your performance on PS0 and comfort in the course so far.    For students meeting the prerequisite,  Problem Set 0 is optional, but we encourage you to work through the problems.

The most important topics that we will be assuming from CS 121 is comfort with Turing machines, computability, asymptotic running time, and NP-completeness.  General mathematical maturity, e.g. comfort with proofs, basic discrete probability, & combinatorics,  will also be assumed.

Grading & Problem Sets

The requirements of the course: The biweekly problem sets will typically be due on Wednesday by 5 PM. You are allowed 12 late days for the semester, of which at most 5 can be used on any individual problem set. (1 late day = 24 hours exactly).  For an exception, you must have your senior tutor (for undergrads) or your advisor (for graduate students) contact me.

The problem sets will be challenging, so be sure to start them early.  You are encouraged to discuss the course material and the homework problems with each other in small groups (2-3 people), as long as you list all discussion partners on your problem set. Discussion of homework problems may include brainstorming and verbally walking through possible solutions, but should not include one person telling the others how to solve the problem.  In addition, each person must write up their solutions independently.  You may not look at another student's written solutions.


As texts we will be using:

I expect that neither of these is as polished as a published textbook, and probably contain some typos and minor errors.  However, the situation is better than previous offerings of cs221, where only about 1/2 of the material was in a textbook at all.  We will provide photocopies of the relevant parts of these materials for students in the class.  As a class, we will maintain an on-line collection of typos, errors, and confusing parts to send to the authors in return for them sharing their unpublished materials with us.

The following texts are also on reserve in the library.  Sipser is the text used in CS121, and is highly recommended for a review of the material in CS121.

Related Courses