“Must be paid the day of” means “must be paid on that day,” correct?

Answer 1

"on that day" <~~yes

If it read "by the day of..." then the payment could be made any time between now and that particular day.

Answer 2

I would assume it must be paid before or on that day.