If the eardrums are intact, I favor ear drops (some of which are available over the counter). The home remedy of a few drops of warm baby oil or olive oil can also be effective. If more relief is needed, perhaps give some baby acetaminophen or ibuprofen for the pain.
Whenever it’s appropriate to treat with pain relief rather than antibiotics, the choice is clear, and it’s a green one.