The most logical conclusion to this story is: Caleb confronts Alicia, who admits her guilt and returns the money.
This conclusion follows the narrative's development, as Caleb witnesses the theft and is faced with a moral dilemma. Confronting Alicia would be a natural response to his growing certainty about her actions.