The best explanation for your observation is:
The bus moves forward, while inertia keeps you in place.
When the bus starts moving, your body tends to remain in its original state of rest due to inertia, which is the tendency of an object to resist changes in its state of motion. As the bus accelerates forward, you feel as if you are moving backward relative to the bus.