The correctly written sentence with speech tags and quotations is:
Abigail replied, "Yes, I would love to go to the concert with you!"
This sentence has proper punctuation and capitalization around the quoted speech and correctly places the speech tag before the quotation.