I'll out myself as someone who is a fan of a lot of what Allen has produced. I liked the early films up till somewhere around Manhattan Murder Mystery, a couple of them flit in and out of my favourite films. I bought records of his stand up, and own his books Getting Even, Without Feathers, and Side Effects. Not quite a full on fan boy, and I once watched Cassandra's Dream for free and felt ripped off. Last year I went to see Manhattan at the cinema for its anniversary and was amazed how well it stood up as a film and how badly it stood up in its 'morals'. I was astounded that the portrayal of a character manipulating a 17 year old character, who was played by a 17 year old actress hadn't been called out more at the time as deeply scary. And there are many examples in other films and his writing of such as well which was not called out.
I think Allen gets a different approach from many people to Weinstein because in part there is an ickiness of the accusations of Dylan Farrow that we struggle with more than most of those against Weinstein. Add to that a strange doubt that such an intellectual weedy chap could be doing anything that bad as opposed to a big cigar chomping deals man.
I won't be getting rid of the books, or the records, but I doubt I will watch many of his films again. Not out of any boycott but because when I came out of Manhattan it made me feel stained for watching it, because of what was in the film in plain sight.