40 matchsticks are arranged to form a 4 by 4 grid of 16 smaller squares.

What is the fewest number of matchsticks that need to be removed so that there are no squares (of any size) remaining?