The classic algorithm applied to modern cryptography from the options you provided is modular arithmetic.
Modular arithmetic is fundamental in many cryptographic algorithms, such as RSA and Diffie-Hellman, whereas pseudorandom number generators, linear search, and binary sort are not classic algorithms specifically used in cryptography.