Soaring grocery prices are having an impact on consumer optimism.