Each person will recall different details. Hence the different accounts of the nativity. However, Mat and Luke both agree that Jesus was born in Bethlehem and lived afterwards in Nazareth. It's what we expect!
For example, about 25 years ago I was with my two friends and we were travelling from church to someone's house for coffee. Paul, who was driving a separate car, didn't stop in time and hit the back of the car I was in which Ben was driving. We had just arrived.
Now if you ask Paul to recount the incident he may not tell you that Ben and I had pulled over a little before the house we were going to, as we weren't sure which house it was. That may have been why he went into us.
Paul and Ben will probably recall details that I don't remember.
The bit about Rhoda in Acts 12 would be typical of the way people recall an event. That she forgot to let Peter in makes it more memorable. It's like being reminded of information you are trying to recall during an exam by the mannerisms of the lecturer who taught it.