>It's absolutely possible, as demonstrated by this thread
you gotta fight the thing the whole way. it wants to recreate cosplay and fetish shit, since it was trained by normie/coomer programmers. a model that simply scrapes lolibrary and learns the tags lolibrary uses--like all the models that are built off of scraping danbooru--would absolutely rule.
craiyon/dall-e mini has trained on enough angelic pretty & taobao reseller pics to know lolita fashion well, its quality is just shit.
my dream method would be to scrape lolibrary and use with the RichWear data set, to finetune SD. the results for jfash would be amazing.