The sentence can be improved by making the following change:
B. Insert a comma after "values."
The corrected sentence would be: "It all started when we identified our core values, last Friday."
Option A (changing "started" to "starting") would not be appropriate without further context, and option C (deleting the quotation marks) is not necessary unless the sentence is part of a larger text that requires it.