The best explanation for why silk was a luxury good used only by elites in Rome and Greece is:
Silk had to travel a long distance, which helped make it very expensive due to travel costs.
Silk was produced primarily in China and required extensive trade routes to reach other parts of the world, contributing to its high cost and exclusivity.