The best explanation for the number of southern votes cast for Johnson’s impeachment is: Most southern representatives disliked Johnson.
Many southern representatives were unhappy with Johnson’s approach to Reconstruction and felt he did not adequately support their interests, leading to their votes for impeachment.