StudyBrixFree worksheets, study guides and courses

Subjects

Information theory

Choose questions individually, practise online, or create a worksheet with matching answers. Counts include generated variants, not only authored originals.

Make a worksheet59 question instances

Sample exercises

Advanced university · Information theory

A discrete variable is uniformly distributed over 49 outcomes. Find its Shannon entropy in bits. Round the final result to 4 decimal places if needed. Answer in bits.

Answer and explanation

5.6147 bits

Each probability is 1/49. Hence H = −49(1/49)log₂(1/49) = log₂(49).

Advanced university · Information theory

A discrete variable is uniformly distributed over 51 outcomes. Find its Shannon entropy in bits. Round the final result to 4 decimal places if needed. Answer in bits.

Answer and explanation

5.6724 bits

Each probability is 1/51. Hence H = −51(1/51)log₂(1/51) = log₂(51).

Advanced university · Information theory

A discrete variable is uniformly distributed over 5 outcomes. Find its Shannon entropy in bits. Round the final result to 4 decimal places if needed. Answer in bits.

Answer and explanation

2.3219 bits

Each probability is 1/5. Hence H = −5(1/5)log₂(1/5) = log₂(5).

Study notes

Related courses

Mathematics3 lessons

Abstract algebra and discrete proofs

Study groups, vector-space quotients and proof techniques with carefully scoped definitions.

24 quiz questions · Advanced university, University
Mathematics5 lessons

Advanced mathematical methods

Study complex analysis, residues, Fourier series, PDE boundary conditions and convexity through focused lessons.

40 quiz questions · Advanced university
Mathematics4 lessons

Practical statistics and inference

Learn descriptive statistics, probability, sampling and inference with worked reasoning.

32 quiz questions · University