I think that's enormously simplistic.
Much of what societies do is.
As already noted it assumes that circumstances and individuals are fairly static.
Arguably. I'd argue, as you would, that this is wrong, but at the practical level of going out and operating in that society, rather than sitting at home typing about it, THE REST OF SOCIETY is making those judgements and operating upon them. You and I can both agree that's simplistic, but that doesn't change the fact that it's happening.
As we have moved to a more complex idea of mind, I think we've moved into an easy label of neuriduvergent/neurotypical and my unease with that is in no way assuaged by that being a social rather than a scientific label.
Academia and, to an extent, healthcare have moved to a more complex idea of mind. Education is starting on that journey. But the workplace? Families? Which 'we' you think about makes that statement range anywhere from absolute certainty to blatantly false.
Rather it is made worse as I think we try and imlement social policies based on a pseudoscientific justification that relies on self diagnosis, often of very complex conditions.
If you want to implement policies you need to structure them in a way that they will be implemented, you need social acceptance. If that means adopting the language of everyday even whilst you try to illuminate the nuances and distinctions that's what you do.
O.