The correct statement regarding the advancements in mathematics during the Gupta period is:
They developed a decimal system with a numeral for zero.
While the Gupta period indeed made significant contributions to mathematics, including advances in concepts such as square numbers and square roots, the development of the decimal system and the introduction of zero as a numeral are among the most notable transformations in mathematics during this era.