To find the number of books per box, you can divide the total number of books by the number of boxes.
So the calculation would be:
\[ \text{Books per box} = \frac{36 \text{ books}}{4 \text{ boxes}} = 9 \text{ books per box} \]
Therefore, there are 9 books per box.