Was it possible for the Southern states to be "kicked out" of the union?

Permission to leave the Union could have been arranged, although it might have required a constitutional amendment approved by 3/4 of the states. That is, after all, what the South wanted: to secede from the Union. If the South had won the Civil War, it would have remained the separate country that it proclaimed itself to be.