How do you define racism?
I am well aware of what racism is, and the nastiness of evil racist bigots. One of my adopted sons is black!
Racism is an attitude that is constant for the racist where ever they are in the world. So for example the Nazis didn't like Jews where ever they were. Some Nazis came to Britain before the war and aired their hatred of them, even British Jews.
People here who object to immigrants swarming into our country are not racist because they don't have that attitude when they are abroad because they have no emotional tie to the foreign country they are in. People who they would restrict coming to the UK, and so be bias against them, they would happily socialise with in that persons own country. A racist doesn't do that, they look down on those they are racist against regardless of where they are and treat them with a contempt that is unconscionable.
People have a right to be concerned with their society, country and culture and neighbourhood; the place they call home.