There's no definitive evidence that we have such freedom as you describe, but let's say you're right for the sake of the argument. My system of morality wouldn't allow me to create or maintain the freedom of an adult to rape a child, for example; if I could un-create such a thing I would, and if I knew such a thing was going on I'd do everything I could to stop it. So would most people, actually; a very very small proportion would wring their hands and say, "Well, I know it's terrible, and I'd love to help, but it's really none of my business." Fewer still would say, "Good." Both would be utterly monstrous.
If I had good reason to believe that in my street (hell, anywhere) a child was being abused in some way - in fact let's not be speciesist about it; if I thought an animal was being abused - I would (a) have the desire to stop it, (b) know how to go about stopping it (by alerting relevant authorities - police; social services; RSPCA and so forth) and (c) would go about stopping it by putting (b) into action. That would be the moral thing to do. Folding my arms and either supportively or even reluctantly placing the supposed freedom of the abuser to abuse above the right of the child or animal not to suffer would not be the moral thing to do. In fact such an act of omission would be downright immoral. In a case such as this I have (1) knowledge of an evil act; (2) knowledge of how to stop it; (3) the desire to stop it and (4) the ability to stop it. Sadly there are a vast number of cases where human beings possess (1), (2) and (3) but, crucially, not (4). For example, I would stop the suffering of children and animals everywhere if I had it in my power, but alas I don't. And that's just for an ordinary human being. Turning to any tolerably traditional conception of a god, however, it's not at all clear which out of (1), (2), (3) and (4) apply, but one thing is for sure - it can be any combination of at most any three, but it can't be all four simultaneously.
That, as I've said before, is the difference between most people and the god you think exists.
Well; that and the fact that people actually do exist, of course.