The artwork of a judge hitting a protester with a gavel has been removed from the listed building.