I am sure that has made him very popular indeed, with Labour.
It is not always a bad thing to be seen to be disagreeing with your leadership, particularly if they don't like you, and they are in a weak position. If the boss does not particularly like you, and is in a strong position, it is best to keep you own counsel.