/vt/ - Virtual Youtubers

It depends on how their tracking is.
If they have shit tracking, like hololive vtubers, they have to push a button.
If they have good tracking, it's based on their face.

>>11946052
Facial patterns indicate which state of emotion you're in. Tracking has come that far.

t. Hotkey enthusiast

>>11946052
Yes

>>11946052
Like humans do, when I'm sad I press a button in my asshole and I make a sad face.

I'm surprised that considering the holo girls use an iPhone for face tracking (if I remember correctly) they need to push buttons to change their facial expression, since the iPhone's Memoji thingy is surprisingly good at picking up facial expressions correctly

>>11946492
Oh I thought they used their webcams

>>11946492
>use an iPhone for facial tracking

You'd imagine that a billion dollar company like Cover would be supplying them with special cameras

>>11946492
a button would be the best way to do it, imagine having to hold your own face for minutes just to get the avatar to change

>>11946052
>Do they click a button
yes. Despite everyone in this thread being awfully misinformed, all vtuber applications require you to press a button to get a specific emotion of your avatar, even with the best tracking.

>>11946645
The iPhone has one of the best consumer cameras on the market and they can make an app for a single platform without having to worry about the infinite variations of Android.

>>11946492
Cover's vtubing software has fallen behind the rest of the industry.

>>11946492
I don't get how people can use their phones to vtube. It seems simpler with a webcam.

>>11946658
Well, I've never used the memoji thingy but from what I've seen of people using it it doesn't simply detect what emotion your face is holding and then swap to a preset avatar emotion or something, it simply mimicks your facial traits in real time. I guess it'd be harder to do using a 2D model, but they definitely should have something like that for their home 3D models I think.

>>11946566
>>11946645
Like I implied I could be wrong, but that's what I remember they used. At the very least, you know the technology exists and it's possible; even indies have better face tracking. Also, iPhone's camera is very good and it's likely a lot cheaper.

>>11946645
>billion dollar company

>>11946816
iPhones have specialized cameras for facial recognition. It's way better than an ordinary webcam.

How do they switch emotions when using the 3D models?

>>11946755
My co worker has a shitty 50 dollar cracked modded chinese phone and camera app can track like 20 emotions when using those animal face filters that have way more pixels than hololive's models

>>11946755
Literally I've never seen anyone outside of Korone use the angry emoji

>>11946052
>>11946294
gura is ugly as fuck

>>11946948
I think one of the staff members change them. Either that or the talents are holding some kind of remote that lets them change the expressions themselves.

>>11946052
they use buttons, not because they are lazy but it means they dont have to fake smile just to have the anime girl smiling. if it got their real expression they will be sad 24/7.

>>11946899
That would be a very uncomfortable set up. A webcam would be better than using an iphone in this instance is what that anon was saying

>>11946957
They usually have quite a few expressions. Risu 2.0 has a ton but only ever uses the default one because she's lazy.

>>11947787
All holos use company provided iPhones

>>11947055
>if it got their real expression they will be sad 24/7
It's funny and it's true, it's true and funny.

Of course they push a button. You can even see it .Like Gura will pause look at chat THEN blush. Not that it makes her any less cute.

>>11947787
Uncomfortable how?

How does this indie BTFO all these corporate sponsored millionaires when it comes to facial tracking?

>>11947969
Holding an iPhone to face track for hours is more uncomfortable than sitting at your desk in front of a webcam

>>11946645
>billion dollar company like Cover
This is your brain on Marxism

>>11948038
Put the phone on a stand on your desk?
Is that not what people do? Do they actually hold their phone while trying to play games and stream at the same time?

>>11948088
They don’t face track with iPhones

>>11948038
Yeah, can't imagine how uncomfortable that must b-

>>11948088
yes thats why they are so bad at games, they have special hololive brand 1 handed controllers but it still nerfs them.

>>11946957

>>11948038
Why on earth. annon you dont have to hold the iphone the whole time, buy a helping tool to do the job.

>>11948038
bro they use a fucking phone stand like this >>11948108

>>11948108
I want to believe that anon wasnt that stupid

>>11948104
What do they use then?

>>11946052

I wonder how 3D streams work though. Do they have someone behind the scenes who changes the facial expressions or is there some kind of emotion recognition.

>>11948038
Never have kids.

>>11948716
*outdoes Cover's technology with simple buttons hooked up to shortcuts*
heh, nothing personnal

>>11947842
Reminder they need to return the phone when they graduate.

>>11946957
https://www.youtube.com/watch?v=JQ0CttAftQA

>>11949714
Oh noooo black company, I can't believe it.

>>11949811
>FAWK YOU BRION IRONSU

>>11949714
What the fuck are they gonna do if you don't?

>>11950386
A hitman breaks you knees

>>11949714
Holy shit. Returning company property after you leave?

>>11948038
Can you please apologize for your stupidity?

>>11950754
Never seen before.

>>11946957
You just wanted pictures didn't you.

>>11949009
Check out nanabun the sony 2.5d idols mocap apparel

>>11946052
The common thing is to have an interface where you press a button and change the avatar or scene. It can be one in HTML with the web page open on another screen and you change it with clicks/keys or it can be connected to a phone. It can also be created in Unity with the same functions. there are also those types of tablets with programmable buttons.

>>11946658
Or, better yet, having options to both when there are indies with better tracking.

>functioning real-time facial recognition tech actually exists
holy shit it's the future

>>11959483
I actually thought something like a stream deck or a separate set of buttons is the norm, but >>11946755 tells me otherwise.

>>11948038
Are you dumb

Does anyone have that clip of Calliope accidentally revealing her expressions overlay?

>>11960561
The "tech" is literally those Instagram cat filters, anon

>>11948038
Based

>>11960561
Robocosan uses a stream deck. She has shown it as part of her PC showcase stream

>>11955643
not him but yes

>>11948038
Please be bait.

>>11951252
You dont get to keep a company car after getting fired

>>11946052
yes, the tech is still ongoing on better facial recognition.

unless they do facial mocap every time they stream

>>11948690
he probably is

the "button to display an emotion" option is better in a sense, you don't have to act it so you can keep the drooling retard pokerface we all have in front of a screen
reminds me of how ayame was uncomfortable with her V2 because she had to now watch her jaw since it tends to go slack when she's in front of a screen

>>11946755
I wonder what the numbers on each side and the mountain icon on the left do?

>>11963779
You posted some state of the art stuff for recording really high res and polygon count, and 3d
Vtubers generally use something geared towards live feed, lower res and much lower poly, which is way cheaper. You dont need any of this for 2d.
I had a youtube video saved somewhere in my favorites explaining all of this but i cant find it for the life of me.

>>11950724
>Calli-chan, I'm sorry it has to be this way...
>NO SUISEI PLEASE, WE DID A COVER TOGETHER

>>11961746
>instagram cat filters
Those do something beyond just identifying a face in the image?

>>11964689
mountain is probably background

>>11946645
it's infinitely cheaper to develop an inhouse company only app using iphone camera technology than make their own camera

>>11946645
They just need the LiDAR on iPhone camera.

>>11965104
I'm talking about these
https://www.youtube.com/watch?v=Jto2peSOLac

You seriously never saw this or played with it yourself? Sometimes I feel like a fucking normie with 100 friends compared to some of you I swear to god

>>11965664
>a fucking normie with 100 friends
Are you though?

>>11946755
>Ina's legs spread that far apart

Coom...

>>11946658
>>11946658
Other companies and even indies have fluid real-time expressions, it's just Hololive that's lagging behind

>>11946755
POWER
STANCE

>>11965664
I've seen videos but I never really paid attention to it. So it's something similar to deepfake I assume? Seems like with some tweaking and enough training this sort of model can do real time facial expression identification.

>>11972531
It literally already does expressions dude
Just do a little bit of research this crap has been around for over 5 years
Social media was unbearable while it was trendy every single thot used it thinking it was cute and funny
It can do smiles, open mouth, tongue out, frowns, a ton of stuff

>>11946755
:-O

>>11946755
does this apply to the wide eyes too? Or do they just open them wide and it happens

>>11946957

>>11974092
ngl Mori's personality and voice are huge turn offs but her model makes me funny

>>11946991
i lost at this
why?

>>11974086
Usually wide eyes is a different expression, you can tell when they change to it.

>>11974218
you have big gay

>>11974261
I couldve sworn back in the day you could see watame fiddle with her model moving her face and opening and closing her eyes to get the void face to proc, oh well

>>11974267
>acts like a man
>lower voice to sound like a black man
>if you're not attracted to male qualities you're gay

Vtubers are like puppeteers...so yes all the good ones have buttons to press for facial expresion...but also have some amount of face tracking. The skilled ones know how to combine both into their characters. Pic not necessarily related to quality or skill.

>>11974492
>spends time having her nails and hair done
>gushes over manlets and chads in media
>does bathtub streams
>does totally-not-a-date-with-chat "language learning" streams
>commissions a daki that depicts her in her actual lingerie
>fantasizes about getting pinned to a bed by someone stronger than her
Ah yes, the masculine things. Things that manly men do.

>>11974086
think anon, think. Most of them are gooks with slanted eyes. Have you seen a gook trying to open their eyes wide?
There's your answer

>>11975411
>implying I watched any of these when bitch sounds like a dude

>literal threadreader
ew, I shoulda known

>>11974919
Mori really is a master at her craft

If I wanted to watch black males I'd go to worldstar hiphop not hololive faggot

>>11946755
And yet Gura is limited to only ahappy and a sad face, a very shitty looking sad face when her mouth is open.

>>11974086
>Braps
>Pupils contract in surprise
I severely underestimated Hololive's tech.

>>11974919
That's actually a pretty interesting way to look at it. Vtubers being modern day puppeteers.

>>11976098
She also has an angry face and a blush overlay. The red Gura edit she made herself using OBS. Maybe one day she'll get a better rig and new expressions.

>>11976279
But anon that would require work and HUNDREDS of dollars spent probably!

>>11975411
>in her actual lingerie
>manlets and chads in media
>pinned to a bed by someone stronger than her
Alright deadbrap, as someone with too bad of internet to watch streams, tell me something. What the fuck is with Mori? I'd heard previously (admittedly from 4chan, a less than reliable source) she's some kind of incel who can't get laid or something, yet she's lusting after chad manlets in Japan? I get not finding a chad in japan (unless her definition of chad is weird, hopefully it's normal), but surely she isn't unfuckable or something? Is she truly just as much as a spaghetti-spiller as she is in streams?

>>11946991
your mother is dead

>>11948067
go back

>>11946645
u have no idea how business works huh loser? why do u think they became a million* dollar company in the first place? money doesnt grow on trees u fucking idiot. don't vote.

>>11949207
They use streamdeck, the gizmo is compatible. Roboco showed hers off more than a year ago.

>>11946052
A lot of software can force a reaction with a shortcut.
But most people, from my experience, leave it on freeform tracking mode where it will pick up exactly what your face is doing. (mostly indies)
>>11946796
Vtube studio and indies using shit webcams would beg to differ. iPhones tracking isn't good and good image recognition has been solved for a decade+.
The depth sensing in iPhone literally isn't high enough resolution for good face tracking at the distances most people place them in streaming setups, which is why their face tracking fucking fails and spazzes out most of the time, and can't do something as simple as tracking their mouth position.