Consider the following problem through the lens of a Markov Decision Process (MDP), and answer questions 1 - 3 accordingly.

Question

Damilola is a soccer player for the ML United under-15s who is debating whether to sign for the NLP Albion youth team or the Computer Vision Wanderers youth team. After three years, signing for NLP Albion has two possibilities: He will still be in the youth team, earning 10,000 (60% chance), or he will make the senior team and earn 70,000 (40% chance). Lastly, he is assured of making the Computer Vision Wanderers senior team after three years, with a salary of 37,000.
Below true or false ?
Q1
Given that Damilola only cares about having the highest expected salary after three years, ML United under-15s is achieved through the action of signing for Computer Vision Wanderers.

Q2
Let us now assume that Damilola cares about the utility derived from the salary as opposed to the salary itself. And his utility function, which baffles economists, is given by Utility, where , and & are constants. In this scenario, the optimal policy ML United under-15s would be to sign for NLP Albion.

Q3:
There are 3 unique states defined in total in this setting.