The number of casual partners I have is determined by my character, not my ity. Do you agree?

At the moment I'm dating two men, of whom I've only had with one of them. Each man knows I'm casually dating. Some would think I'm promiscuous. And some would say I'm promiscuous BECAUSE I am gay. What do you think?