Entropy, mutual information, and Shannon's coding theorems; lossless source coding, Huffman, Shannon-Fano-Elias, and arithmetic codes; channel capacity; rate-distortion theory, and lossy source coding; source-channel coding; algorithmic complexity and information; applications of information theory in various fields.
4
UnitsLetter
Grading1, 2, 3
PasstimeNone
Level LimitEngineering
Collegegrade was determined by 5 homework assignments, with the professor and TA's seemingly making it up as the quarter went on. lectures had little relation in content or difficulty to the hw, generally covered material significantly simpler than the knowledge required for the homework. assignment instructions were often vague or hard to follow.
Great and passionate lecturer. Made the class very interesting and approachable!
I took this class in Fall 2021 and was worried because of the stories from past quarters with this professor. But everything was great: lectures were solid, homework was challenging but reasonable and interesting, and I learned a lot. Would recommend/take other classes with him
I took this course with hesitation, but it was absolutely great. Course has improved across the board. No complaints: the homework assignments were challenging but clear and fair, the professor and TAs were helpful during lectures, office hours, and outside of class. 10/10 Greatest professor redemption arc I've ever seen, kudos to Professor Feng.
Class was very straightfoward. 6 homework assignments for 100% of the grade. Homework gradescope results were available, so it's easy to know how you're doing in the class. Generous with late days as well, 10 days for the entire course. He has definitely heard the feedback and improved a lot. I highly recommend this professor now!
I took this class with worries, but it was one of the best CS classes I've taken at UCSB. The class materials are seriously interesting and helpful in other classes. I feel like I now have a better understanding in some of the features in programming languages. 6 hws sum up the total class grade with 10 free late days. No exams.