Based on the context that often surrounds stories involving conflicts and families needing to flee, the most reasonable inference about why Moshe's family left the village so quickly would be:
Fighting between soldiers had come too close to the village.
This inference suggests an immediate threat that would necessitate a hurried departure for safety.