Automatic Subtitles

[Anonymous No.]

So I checked out Rin's stream of VILLAGE and I noticed she had automatic English subs enabled. I don't watch Nijisanji but how long has this been a thing? Why hasn't Cover done anything with this technology yet? How reliable is it? It seems like the language barrier is the only thing holding Japanese V-tubers back from truly expanding overseas and this kind of thing would be a godsend.

[Anonymous No.]

>>3616286
automatic subtitles are still garbage tech, I don't think it'll ever work with japanese because the sentence structure is completely different

[Anonymous No.]

>>3616286
They've been doing this for awhile. When Kanae streams on twitch he enables it as well for his oversea's viewers.

It's pretty shit but sometimes it actually translates it to a point where people can get a jist of what they are saying.

[Anonymous No.]

>>3616286
Rin set it up a few weeks ago. Some others also had it before, like Masaru and Haruka. Hololive's streams with a lot of EOPs usually have live translators in chat anyway, and they are, unless they pure garbage, still better at conveying what vtubers say.

[Anonymous No.]

>>3616361
>>3616816
>>3616862
Do you guys feel like the technology can be advanced and refined into something better or is it just a dead idea?

[Anonymous No.]

>>3616286
I remember Ui having something similar, it was trash. The creators of LiveTL were trying something similar too, but the community thought It could cause some controversies if something was mistranslated so they stopped

[Anonymous No.]

>>3616964
The progress of voice recognition and machine translation has nothing to do with vtubers, really. Try asking in /g/

[Anonymous No.]

>>3616964
I don't see it being a functional idea outside of sci-fi unless we come up with some way to scan the brain mid-speech

[Anonymous No.]

>machine translations of Japanese
>Google's machine translations of Japanese

[Anonymous No.]

>>36964
We already have working tools like DeepL that do it in a very basic sense, but perfect JP>EN conversion needs current translation tools to be able to accurately read and interpret context on both languages, which needs computing power not found on any PC that you can buy on stores.

[Anonymous No.]

>>3617368
hola kaichou check out my shitty japanese :^)
いつOKトワあいスモークDUDE
ノー!ノー!アイ…アイドーントスモーク!アイドーントスモークや!

[Anonymous No.]

>>3616286
you are a retard if you thing that is a good idea, specially how shitty they are

[Anonymous No.]

>>3617368
>English rapidly degrading
>Barely speaks english anymore
OHAYO!! mogs you in your path

[Anonymous No.]

>>3616286
If you actually watch them you will see a lot of funny mistranslations and even unintentionally sexual stuff. It's good for lulz

[Anonymous No.]

perfect and immediate auto-TLs just aren't ever going to be a thing sadly, there's too much context and cultural influences that you really need a human touch to do it justice

[Anonymous No.]

>>3617619
IMAGINE THE LOGS

[Anonymous No.]

Googles auto detect for Japanese is awful. Let alone their ability to translate it.

[Anonymous No.]

>>3616286
>>3617619
I'm going exchange my skeleton with Rin's!

[Anonymous No.]

>>3616964
Japanese in particular is extremely contextual. We're still decade away from live machine tl

[Anonymous No.]

I want to put my dick between Rin's tits

[Anonymous No.]

>>3617284
I think it could manage to be improved to a degree where its useful for small streamers to appeal to wide international audiences, but i never see it replacing livetl

[Anonymous No.]

Mirei used it too
https://youtu.be/5G3RT2ISE-I

[Anonymous No.]

>>3617619
Exploring tight moms with Rin!

[Anonymous No.]

>>3617579
Is there anyone who can match her on making both JP and EN fans understand her streams?

[Anonymous No.]

>>3616964
AI will solve this problem in our lifetime. Deep learning is fucking magic.

[Anonymous No.]

>>3618913
We're not getting anything close to AGI in our lifetime, if ever. Deep learning has issues too e.g. the AI that runs YouTube.

[Anonymous No.]

>>3619032
Translation doesn't need AGI

[Anonymous No.]

They can help slightly if you don't speak any Japanese at all or occasionally catch a word if you do speak some Japanese, but it's pretty rough. I wouldn't be surprised if Cover intentionally doesn't use it since they keep content on a tighter leash and sometimes translations like >>3618807
happen.

[Anonymous No.]

>>3616286
The people behind LiveTL announced exactly this, then shut down their own project a day later. Pic related.

Mistranslations from fansubbed clips (coughOkaMoricough) have set off some real bullshit in the past, and auto translation is a constant stream of mistranslations. I kinda get why Cover doesn't want to deal with that.

[Anonymous No.]

>>3616286
Because if the Auto subtitles fuck up, people are going to take the sub as unequivocal proof of a fuck up, which in turn could lead to constant YABs.

[Anonymous No.]

no because the language fucking SUCKS and if you can't see what's immediately happening or are not informed of the context elsewhere it's very hard to comprehend

[Anonymous No.]

>>3616286
That's interesting, but the quality is pretty bad and I can't see it getting any better any time soon. And you just know there would be plenty of retards who would treat those obvious mistranslations as serious statements.
Anyway, didn't know Rin had any english viewers. Except for that one time long ago when Pewdiepie mentioned her cover of country roads and a bunch of kids invaded her streams for few weeks.

[Anonymous No.]

>>3616286
>Why hasn't Cover done anything with this technology yet?
I think Kira used to have this but it's so unrealiable that it's not worth it

[Anonymous No.]

>>3619070
It does when you have to deal with languages that are heavily context-based like the East Asian languages are. Can an AI based in deep learning understand human context well enough?

[Anonymous No.]

>>3616286
>I'm gonna make Columbine look like a fucking joke

[Anonymous No.]

>>3616964
No. Technology is reclining despite what people will tell you. Do your reps because a machine will never give you accurate Japanese translations.

[Anonymous No.]

>>3618807
>かしこいさかな
>Mom is tight at this age
How do you get the japanese right but the translation completely fucking wrong? I cannot fathom where the TL picked any of these concepts up. Still better than a live TL faggot because it's funny.

[Anonymous No.]

>>3620176
The translation is for a previous sentence which is not displayed

[Anonymous No.]

>>3618809
>>3618809
Kiara?
I don't watch her so I dunno but she does seem fluent in both.

[Anonymous No.]

>>3620328
Not really, she is fluent in both languages but she doesn't actually translate herself a lot, only on Holotalks.
Same with Coco, though she has been putting some effort lately.
Pikamee isn't fluent in english but translates EVERYTHING she says in every stream.

[Anonymous No.]

>>3620530
Pikamee may not be exactly fluent but her English is still great and she has some cute tics here and there.

[Anonymous No.]

[Anonymous No.]

is this as good as DeepL translations that doujin artists have started to use to bypass scanlators

[Anonymous No.]

>>3621165
the eternal EOP keeps talking about irrelevant shit as always

[Anonymous No.]

>>3616286
because auto subs are shit and it could put something on the screen that Cover or the talents wouldn't want there.

[Anonymous No.]

>>3616286
Gundou sensei was using it in her free chat stream the other day.
Its garbage but it means they dont mind english in their chat, I guess.

[Anonymous No.]

>>3620175
I will NEVER do my reps.

[Anonymous No.]

>>3616964
it can only work if the AI is also watching the video and piece together the context of what the chuubas are saying. Japanese is a retardedly context heavily language; if english is stuctured like japanese, it would sound caveman speak.

[Anonymous No.]

>>3619804
>coughOkaMoricough
Explain

[Anonymous No.]

>>3625910
The trick is realizing that most Japanese themselves aren't actually 'fluent' but everyone knows enough to get by on
Most of them can barely write any kanji at all even if they can read it and they get tripped up on the homophones if the context isn't clear enough
You've just got to realize when you're at that point where you're good enough to communicate and understand everything you want to

[Anonymous No.]

>>3619804
haha bowing festival

[Anonymous No.]

>>3616964
>Do you guys feel like the technology can be advanced and refined into something better
Ignore every opinion that disagrees with this statement: if humans can translate, then advanced AI will be able to eventually.

[Anonymous No.]

>>3631676
Based on everything I've ever seen from humans translating, this is grim news for the prospects of computer translation.

[Anonymous No.]

>>3631823
I never said advanced AI will be limited to human capability.

[Anonymous No.]

>>3616286
because it sucks

[Anonymous No.]

>>3630378
Something something Aloe related something something BTFO'd by their subreddit mods.

[Anonymous No.]

>>3631518
>The trick is realizing that most Japanese themselves aren't actually 'fluent' but everyone knows enough to get by on
You are completely wrong. Pretty much everyone in Japan is fluent in speaking their own language.
>Most of them can barely write any kanji at all even if they can read it and they get tripped up on the homophones if the context isn't clear enough
Wrong again. They can write a lot of kanji by hand. The number peaks somewhere near the end of school for most people since there is less of a need to hand write notes.

You are just repeating EOP cope.

[Anonymous No.]

>>3616964
You ever watch Star Trek? You know how everyone, even aliens, speak English? It's because they had "universal translators" on those little badges they wore.
In the real world, a device like that would literally need to read your mind in order to work.
Every translator out there just translates raw text without context. None of them are smart enough to infer context. That'd take a whole new generation of a generation of translation tech to get right.
It needs to hold a running database of what is even happening to understand things properly, which is at present impractical.
If you've ever fucked around with AI Dungeon you'd get a good idea of that, it doesn't have much in terms of memory, and it forgets things very quickly because of how intensive it is to process a large running memory.
Truth be told, we likely won't see something like this until computers aren't using silicon for processors. That's decades off. Minimum.
For the same reason the self-driving car meme is finally dying - it won't work because driving isn't a case of pure recognition, it involves heavy fucking reasoning to do properly. Google even said they'd need to program their cars to break the law to avoid crashing because that shit happens ALL the time on roads. Even by police.
You could say "well what about a huge server farm", apply that to everyone and you see why it is impractical. A few thousand people would already overload the biggest server farms of Amazon and Google.

[Anonymous No.]

>>3616286
If you have some basic knowledge of Japanese and how computer worked out/fucked up the sentence, it's helpful. VN machine translation is already out there for years, it's not amazing, but it's not so bad either. I really, really wanted to play this Marunomi sequel 3 months ago and I was surprised I could understand the story without issues.

Back to the Vtubers, it does help how in the heat of playing the game, the sentences are going to be simple and short, so the machine is not going to have much trouble. But collab with two or three of them talking about what they ate at dinner or some niche stuff? It's going to brick.

Dude, if we would have reliable technology to translate stuff on the spot, it would be used in business and government agencies everywhere. Imagine going to China to do business and you can pop up some app on the phone which translates Chinese mandarin, live. Maybe in 10 years it's going to be good enough. Maybe.