Do you have proof of this such as links to videos or news reports? Can you provide any proof? Personally, I regularly use restrooms and locker rooms with trans women, and have never had a problem with this. If this is actually happening, I want to know about it.
I actually wrote an article I think you might benefit from reading, it’s on my page called I Use Bathrooms with Trans women.
Also, it is totally cool to use the word woman. I haven’t heard anyone say that word is wrong. I am a woman! See, it’s fine. Including trans women in the word Woman doesn’t diminish its power at all.