To learn a bunch of definitions about entropy and information measures that will be useful through the quarter, and to present some simple but important theorems: Jensen's inequality, and the information inequality
In this lecture a bunch of definitions and a few simple theorems are presented. While these might be somewhat bewildering at first, you should just hang on and dig in. There is a sort of ``algebra of informational quantities'' that must be presented as preliminary material before we can get much further.