Attention, please show the calculations in details, comments have to be provided.

Question

You have information source with M symbols.
1. Calculate the amount of the information in bits for one M-ary symbol, considering that the probabilities of the symbols are the same.
2. Calculate the amount of the information in bits for M symbols.
3. Calculate the entropy of the source, considering that the probabilities of the symbols are the same. Check and explain the result.
4. Calculate the redundancy of the source, considering that the probabilities of the symbols are the same. Check and explain the results.

You have probability distribution for the source with the M symbols.
5. Calculate the amount of the information in bits for M symbols, considering given probabilities.
6. Calculate the entropy of the source, for given probability distribution. Make conclusions.
7. Calculate the source redundancy , for given probability distribution. Compare with the value You got in the 4. Explain.
8. Perform economy coding with the Haffman code.
9. Decode bit sequence with the number B. Explain.
10. Calculate the source redundancy after coding, check, compare with the values got in 4 and 7, explain.

3 Dinckan Alper M10 Source8 B3
Nr.3. 11011111 10110010 11111010 01001111 10111100
Nr 8
1 0.2
2 0.2
3 0.11
4 0.01
5 0.01
6 0.3
7 0.07
8 0.04
9 0.02
10 0.04