Entropy, mutual information, and Shannon's coding theorems; lossless source coding, Huffman, Shannon-Fano-Elias, and arithmetic codes; Channel capacity; rate-distortion theory, and lossy source coding; source-channel coding; algorithmic complexity and information; applications of information theory in various fields.

Prerequisites: ECE 139 or equivalent, or PSTAT 120A-B.

4

Units

Letter

Grading

1, 2, 3

Passtime

None

Level Limit

Engineering

College
These majors only cmpsc
FENG YU
Yu Feng
2.6
40 reviews
See All
CMPSC 225 Rose K Winter 2024 Total: 10
CMPSC 225 Gibson J D Winter 2023 Total: 12
See All
40
2.6
CMPSC162 . Feng Yu 15 Days Ago

The lecture is clear and easy to understand, however, the final is getting very hard, much harder than last year. (In case everyone gets an A)

0 helpful 0 unhelpful
CMPSC162 . Feng Yu 25 Days Ago

Yu Feng was a very reasonable, engaging professor and his lectures were super clear, so I was never confused even when it got a bit abstract. He went through the entirety of last quarter's final so that we feel prepared. CS162 is much, much easier than CS160. No complaints from me.

0 helpful 0 unhelpful
CS160 . Feng Yu 1 Year, 9 Months Ago

grade was determined by 5 homework assignments, with the professor and TA's seemingly making it up as the quarter went on. lectures had little relation in content or difficulty to the hw, generally covered material significantly simpler than the knowledge required for the homework. assignment instructions were often vague or hard to follow.

0 helpful 0 unhelpful
CMPSC162 . Feng Yu 2 Years Ago

Great and passionate lecturer. Made the class very interesting and approachable!

0 helpful 0 unhelpful
CS160 . Feng Yu 3 Years Ago

I took this class in Fall 2021 and was worried because of the stories from past quarters with this professor. But everything was great: lectures were solid, homework was challenging but reasonable and interesting, and I learned a lot. Would recommend/take other classes with him

0 helpful 0 unhelpful
CMPSC162 . Feng Yu 3 Years Ago

I took this course with hesitation, but it was absolutely great. Course has improved across the board. No complaints: the homework assignments were challenging but clear and fair, the professor and TAs were helpful during lectures, office hours, and outside of class. 10/10 Greatest professor redemption arc I've ever seen, kudos to Professor Feng.

0 helpful 0 unhelpful
See all 40 reviews
CMPSC 196
0 / 10 Enrolled
Undergraduate Research
T B A
98.6% A
CMPSC 196B
0 / 5 Enrolled
Undergraduate Research
T B A
100.0% A
CMPSC 199
0 / 10 Enrolled
Independent Studies in Computer Science
T B A
100.0% A
CMPSC 209
15 / 35 Enrolled
Logic and Applications in Computer Science
Jianwen Su 2.0
M W
11:00 AM - 12:50 PM
67.7% A
CMPSC 211B
5 / 10 Enrolled
Numerical Simulation
Petzold L
M W
09:00 AM - 10:50 AM
63.2% A
CMPSC 216
2 / 10 Enrolled
Level Set Methods
Frederic Gibou 4.0
M W
12:30 PM - 13:45 PM