Question

When a gas filled balloon is cooled, it shrinks in volume; this occurs no matter what gas is originally placed in the balloon. Why? I was thinking maybe because the number of collisions are less and so the slower moving particles aren't hitting the walls and stretching the balloon as much?

You are on the right track. Not only are there fewer collisions but the molecules are moving slower.