The detail from the text that best supports an inference about the backgrounds of the dock workers is:
They have callused hands.
This detail suggests that the workers are accustomed to manual labor, indicating they likely come from backgrounds that involve physical work, which hints at their experience and possibly their socio-economic status.