The group most likely to be concerned about the Bank of the United States is:
people in favor of states’ rights
This is because the Bank's control over loans and its ability to limit state banks' lending would be seen as a threat to state autonomy and local economic interests, particularly for farmers and merchants who relied on loans.