You failed to include a very relevant part of information in your post: your own gender. I don’t know if you omitted it on purpose, or out of obliviousness, but going on the assumption that you’re a man due to your language towards women:
Did it not occur to you that a male patient could actually be acting more aggressively towards your female coworkers? That he would be less cooperative towards those “damn nagging women” than towards a man? And that the standards of what makes a male patient scary could be completely different from the perspective of a woman?
Men experience the world very differently from women, particularly when it comes to social interactions. Just because YOU haven’t had too much of a problem with this patient doesn’t mean that your female coworkers have experienced the same thing.
Basically the scheme from Office Space