[ 3 / biz / cgl / ck / diy / fa / ic / jp / lit / sci / vr / vt ] [ index / top / reports ] [ become a patron ] [ status ]
2023-11: Warosu is now out of extended maintenance.

/vt/ - Virtual Youtubers

Search:


View post   

>> No.62986445 [View]
File: 103 KB, 983x382, Screenshot 2023-11-20 Controlling Text-to-Image Diffusion by Orthogonal Finetuning.png [View same] [iqdb] [saucenao] [google]
62986445

>>62985157
>Is OFT a lora alternative or a new way to make them?
It's both - a new type of lora and a training method. Their paper: https://oft.wyliu.com/

To train, you use kohya scripts and latest dev version of https://github.com/KohakuBlueleaf/LyCORIS/tree/dev#training
Settings are something like this: --network_module lycoris.kohya --network_args "algo=diag-oft" "preset=attn-mlp" "constrain=1e-4" --network_dim=4
"constrain" should be either 0, or roughly equal to LR

Navigation
View posts[+24][+48][+96]