/jp/ - Otaku Culture

Took a break over the weekend and so did the network. Today's version has gone through an intensive training and has stopped temporarily green texting. I've mostly focused on the theory side for the past few days and tried unsuccessfully implementing a new hidden layer to the training. While this current version of the network is starting to resemble humanlike posting more and more, there's still a few pitfalls where it starts rambling like a lunatic.

I'll start experimenting more with different training methods soon and I'm cooking up the biggest training batch yet (each training epoch takes over 10 minutes with the new configuration). There's also an other way of doing this kind of text generation that I want to try out. The method I've been using is character level generation (meaning that each letter is generated one after another), but there's also a method where complete words are generated instead of single letters.