In the sentence "In 1961, he read a poem at the inauguration of President John F. Kennedy," the word "poem" is the direct object.
The structure of the sentence is such that "he" is the subject, "read" is the action verb, and "a poem" is what he read, making it the direct object of the verb "read."