[ 3 / biz / cgl / ck / diy / fa / ic / jp / lit / sci / vr / vt ] [ index / top / reports ] [ become a patron ] [ status ]
2023-11: Warosu is now out of extended maintenance.

/vt/ - Virtual Youtubers

Search:


View post   

>> No.52512304 [View]
File: 146 KB, 1024x1536, 00077-2361398443.jpg [View same] [iqdb] [saucenao] [google]
52512304

>>52510592 good morning

I should really upgrade my model its been months
>>52509196
Thanks for your work. I will give this a try

I think local text ai is in its early nai leak days. I looked into a bit yesterday. 4bit and soon 3bit quantization and now Exlama. Models now can have 8k token size instead of 2k. I tried a 13B model and in run with less then 10GB vram and outputs in 2 seconds.

Navigation
View posts[+24][+48][+96]