How could someone get past the right to free speech when trying to ban the confederate flag?

One could make the argument especially after the civil war that the flag represents insurrection against the United States, hence treason. But even that is very weak as even the post-war government allowed it's display.