This may be true, but I think all men understand their potential and thus would project their apprehension, especially those related to those women going into a restroom with trans males, and there are those females, who might not be comfortable too. I am not qualified to answer this question, I just assume it to be true.
I just checked a Time article on the subject of trans men in bathrooms of Samoa and it said: “Nobody flipping cares.”
I do remember when I entered a bar, which had unisex bathrooms and I loved it. It was fun and no one cared at all. They were respectful of women, and while I was using the urinal, for example, a woman putting makeup on looked at me. I looked back and she turned away.
I think you may be correct. Will women weigh in on this?
Oh, I do remember women wanting men to help protect them from rapists, for example, and can’t understand why men don’t know how bad some men are. We don’t know what other men do when we are not with them, so we don’t know.