The Cavaliers ruled out guard James Harden for Wednesday night's game at Milwaukee after he suffered a non-displaced fracture in his right thumb Tuesday against the Knicks.