Yeah... Negan is written to be somewhat concerned with appearing/behaving in a bigoted manner in regard to race/POC and is generally anti-misogynistic (compare and contrast with the comic version of the Governor who
, but he also seems to be the "No Fat Chicks" t-shirt wearer in the zombie apocalypse...
It's not really consistent with the character, but Kirkman is clearly trying to balance plausibility in his characters (AMC tends to fail at this...), while also recognizing that being grossly offensive to his readers would cause more harm than good... it works well enough with Negan given his idiosyncratic nature, but yeah, he can be a real jerk-off.
Google "Here's Negan" if you want to read some of his back story. It's an ongoing mini-series (up to part 8, I think).
It gives a little insight into his nature, might reveal something about his openness to people on the one hand while being a sadistic nut on the other... it will also give some background on why his bat is named Lucile and why he "treats her like a lady", or whatever.
And, for whatever its worth, its all cannon -- written by Kirkman as offical back story.