The best summary of the Anti-Federalists' logic against a single large republic is: A single large republic will make it difficult if not impossible to represent the views of the people.
Anti-Federalists argued that a large republic would lead to the interests of diverse populations being overlooked, making it harder for citizens to have a meaningful say in their government and for representatives to accurately reflect the views of their constituents.