/vt/ - Virtual Youtubers

Just curious if any computer or tech anons /here/ may have some idea of the possible answer to this question,
What is the oldest type of computer system that is likely to be capable of running a Neural Network or Language Model similar to Neuro sama on it with some degree of useful or practical functionality? Vid related
>https://www.youtube.com/watch?v=d5kk62l40fg
For instance, I would guess that with today's knowledge you could probably build a system using Vacuum tubes and such but that might be impractical due to the sheer size and scale such hardware space would require, but what about after the invention of transistors, like would any systems from the 1960s to the 1980s be able to run a Neuro sama-type network or would only computers from the late 1990s or 2000s and beyond really be able to handle the job?
Just a curious question I've ben thinking about, and I'd be interested in hearing any anons thoughts about this.