Yes, I did it against Man City last year (welp). I got caught as an Arsenal fan but everyone was cool about it :). Just dont celebrate too much when Arsenal score and keep your emotions in check.
Also helped that I came from the states and people seemed surprised that someone would make the journey to attend the game.
The mind games begin..