To find out how many more miles Nathaniel needs to ride to meet his goal, we start with his total goal of 23.2 miles and subtract the miles he has already ridden.
\[ \text{Miles remaining} = \text{Total goal} - \text{Miles ridden} = 23.2 \text{ miles} - 4 \text{ miles} = 19.2 \text{ miles} \]
Next, we need to determine how many miles he needs to ride each day over the next 4 days to reach this remaining distance. We do this by dividing the remaining miles by the number of days.
\[ \text{Average miles per day} = \frac{\text{Miles remaining}}{\text{Number of days}} = \frac{19.2 \text{ miles}}{4 \text{ days}} = 4.8 \text{ miles per day} \]
Therefore, the average number of miles Nathaniel would have to ride each day to meet his goal is
\[ \boxed{4.8} \text{ miles per day}. \]