I think that Harad has a history of being led by the tyrannical Black Numenoreans, and, as far as I can understand the sources, that's still the case at this point. So my earlier thought that something has changed in Harad has to be modified, the change isn't that great, or it is a subtle one: at this time, the Black Numenoreans lose their power or hand it over to Mordor.
In any case, it fits with Gandalf's role as a spy. He has few friends or contacts, and he is probably hated by the ruler/s. His friends are like The Beaver Family in The Lion, The Witch, and the Wardrobe. There is perhaps a resistance movement, like in German-occupied France or Belgium during WWII, or the rebels in Rouge One and Star Wars IV (when the rebels really are underdogs).
The people of Harad are divided, though, not only in near and far Harad, but in several tribes, and it sounds like there could be a lot of conflict among them. Maybe the Black Numenorean rule has been one of 'divide and conquer', and Sauron now, through puppets, manages to unite several of the tribes?