Even after a mild infection, the overall size of the brain had shrunk, researchers found.