To find the unit rate of books per box, you divide the total number of books by the total number of boxes:
\[ \text{Unit Rate} = \frac{\text{Total Books}}{\text{Total Boxes}} = \frac{20 \text{ books}}{4 \text{ boxes}} = 5 \text{ books per box} \]
Thus, the unit rate is 5 books per box.