The correct answer is:
A) Every time the speaker of the dialogue changes
In dialogue writing, it's standard practice to start a new paragraph every time a new character speaks. This helps to clarify who is speaking and makes the text easier to read.