"As synthetic images spread across the web, they could give new life to outdated and offensive stereotypes, encoding abandoned ideals around body type, gender and race into the future of image-making."
The problem being that, while forced to pretend otherwise for PR reasons, the people who build these models view that as a feature and not a bug. ('Objectively determined prejudice' is one of the things they're most excited about in this tech)
"Tech companies have grown increasingly secretive about the contents of these data sets, partially because the text and images included often contain copyrighted, inaccurate or even obscene material."