Choose questions individually, practise online, or create a worksheet with matching answers. Counts include generated variants, not only authored originals.
A discrete variable is uniformly distributed over 49 outcomes. Find its Shannon entropy in bits. Round the final result to 4 decimal places if needed. Answer in bits.
Answer and explanation
5.6147 bits
Each probability is 1/49. Hence H = −49(1/49)log₂(1/49) = log₂(49).
Advanced university · Information theory
A discrete variable is uniformly distributed over 51 outcomes. Find its Shannon entropy in bits. Round the final result to 4 decimal places if needed. Answer in bits.
Answer and explanation
5.6724 bits
Each probability is 1/51. Hence H = −51(1/51)log₂(1/51) = log₂(51).
Advanced university · Information theory
A discrete variable is uniformly distributed over 5 outcomes. Find its Shannon entropy in bits. Round the final result to 4 decimal places if needed. Answer in bits.
Answer and explanation
2.3219 bits
Each probability is 1/5. Hence H = −5(1/5)log₂(1/5) = log₂(5).