The point in the diagram where all of the energy is gravitational potential energy is when the swing is pulled back prior to release.
At this position, the swing has maximum height, and therefore the maximum gravitational potential energy. Once the swing is released, it starts converting that potential energy into kinetic energy as it moves forward and backward.