"It's not an attack on freedom of speech when we do it"