The correct answer is:
a. they measure the amount of the decay of particular unstable atoms in a rock.
This process is known as radiometric dating, where scientists measure the abundance of radioactive isotopes and their stable decay products to determine the age of the rock.