[ 3 / biz / cgl / ck / diy / fa / ic / jp / lit / sci / vr / vt ] [ index / top / reports ] [ become a patron ] [ status ]
2023-11: Warosu is now out of extended maintenance.

/sci/ - Science & Math


View post   

File: 505 KB, 1248x364, 1545962009199.png [View same] [iqdb] [saucenao] [google]
10247951 No.10247951 [Reply] [Original]

Some examples of the Topaz AI upscaling art from old video games. Interesting how AI can do such a good job.

>> No.10247952
File: 274 KB, 576x564, dsbd3kB.png [View same] [iqdb] [saucenao] [google]
10247952

>>10247951

>> No.10247957

Could you half-life grunts? Wonder what details it would bring out

>> No.10247961
File: 270 KB, 512x400, 0XizGCA.png [View same] [iqdb] [saucenao] [google]
10247961

zoom in in next image post of the bottom left

>> No.10247966
File: 21 KB, 510x255, tPMY7Sp.png [View same] [iqdb] [saucenao] [google]
10247966

>>10247961

>> No.10247970
File: 298 KB, 864x452, e43k29H.png [View same] [iqdb] [saucenao] [google]
10247970

last image post unless people want to see more. The advancement of AI into best-in-class upscaling was pretty rapid.

>> No.10247990

>>10247970
More fgt

>> No.10247994
File: 186 KB, 392x448, Trp6DYq.png [View same] [iqdb] [saucenao] [google]
10247994

>>10247990

>> No.10248002

>>10247994
Can I use this to play elder scrolls 2 with good graphics?
Anyone try Doom?

>> No.10248014

>>10247994
>>10247970
>>10247966
>>10247961
>>10247952
>>10247951

impressive... very nice.

>> No.10248016

>>10247951
>zoom and enhance is about to become a reality
wtf

>> No.10248088

>>10247961
>>10247966
Zoom and enhance!
https://www.youtube.com/watch?v=gF_qQYrCcns

>> No.10248098

>>10247994
I could fap to that.

>> No.10248142
File: 812 KB, 2720x2720, 1545497433903.jpg [View same] [iqdb] [saucenao] [google]
10248142

>>10248016
>>10248098
>not enhancing noise into optimized fapping material

>> No.10248271

Is there somewhere you can do this online?

>> No.10248277
File: 12 KB, 250x309, 1545529620827.jpg [View same] [iqdb] [saucenao] [google]
10248277

>>10248142
Soooooon

>> No.10248301

>>10248016
your brain is literally zoom&enhancing constantly.

>> No.10248322

Waifu2x

>> No.10248326

The biggest hurdle was probably collecting and cleaning all the training data.

>> No.10248349

>>10248271
https://topazlabs.com/

>> No.10248359

>>10248349
More than 90% of their products are things you can already do in photoshop in literal minutes
Why would anyone buy a black and white plugin?

>> No.10248361

>>10248359
they use this
https://topazlabs.com/trials

>> No.10248391

Shit's cool Anon. Post more

>> No.10248397

>>10247951
Fake and gay

>> No.10248401

I want to believe.

>> No.10248407

>>10248397
This
It's 100% fake

>> No.10248451

I don't know if I'm more impressed by the upscaler or the pixel artists who were able to create art with enough information that these images could be generated from them.

>> No.10248457
File: 56 KB, 447x604, free shrugs.jpg [View same] [iqdb] [saucenao] [google]
10248457

>>10248349
>>10248361
>No Linux version.

Is there any documentation about what research it's basing it's approach on? Maybe there is another implementation of the technique on github somewhere.

>> No.10248466

>>10248088
lol, reminded me of this
https://www.youtube.com/watch?v=3uoM5kfZIQ0

>> No.10248486
File: 132 KB, 688x144, hpGjyeB.png [View same] [iqdb] [saucenao] [google]
10248486

>>10248397

>> No.10248496

It takes several seconds to generate a picture and thus isn't viable for gaming yet

>> No.10248499

>>10248496
Oh also there's no continuity between two generated frames either, so you'd essentially see a fuckton of swirling in the objects.

>> No.10248517

>>10248496
>It takes several seconds to generate a picture and thus isn't viable for gaming yet
No shit. It's probably a GAN. Only retards on /g/ and /v/ blurt out retarded shit about gaming as soon as they see stuff like this.

>>10248499
There are GANs that work over sequences of frames and I'm pretty sure there should be no problem generalizing the technique here. Though I don't know why you'd want that desu.

>> No.10249011

>>10248496
Could easily make an automatic texture pack generator though. But with all the single pics from this one and ESRGAN I havent seen anyone do a full pack for any game...

>> No.10249036

>>10249011
morrowind
https://www.nexusmods.com/morrowind/mods/46221?tab=description

Gothic 1 https://www.reddit.com/r/GameUpscale/comments/a9ssit/gothic_1_esrgan_project/

a doom 1 version
https://www.doomworld.com/forum/topic/99021-v-0-95-doom-neural-upscale-2x/

>> No.10249070

>>10249036
Ah ok I guess it still doesnt look like much since the models are still low polygon count. Anyone know how hard it would be to use this kind of machine learning to work with 3D models? It should kind of be the same principle although probably much more time consuming...

>> No.10249133

>>10249070
depends whether they were modeled low-poly to begin with

then again i'm just assuming this upscaling method relies on the images having once been high resolution and then downscaled, leaving behind contributions that can be identified by the network. maybe that's not how it be.

>> No.10249150

>>10249133
Nah thats not how it works as far as I know. I read through the paper behind esrgan a bit and it basically looks for objects it recognizes and adds features to that area that are in line with the object.
They have some examples on their github page where they compare original HD images with downscaled and then put through esrgan versions. One of them was some form of mansion with open windows in the original which werent really noticeable at all anymore in the downscaled version, but then reappeared with closed windowbars after esrgan upscaled it again...
Also I doubt these old graphics are downscaled high resolution images. Most likely they were drawn pixel by pixel like with modern pixel art.

>> No.10250569

>>10247951
Any Morrowind?

>> No.10250610

>>10247951
how does this compare to waifu2x? Or are they made for separate use cases?

>> No.10250735

I'd love to see an AI-based automatic tris-to-quads converter and/or "sharp edges finder" for constraining Catmull-Clark subdivisions as a similar process to this in 3D.

>> No.10250797

>>10250569
There’s an entire texture pack available for morrowind.

>> No.10250804

>>10247966
If I see that fucking bottle one more time,

>> No.10252046
File: 203 KB, 1920x1080, after touch up.jpg [View same] [iqdb] [saucenao] [google]
10252046

>>10250804

>> No.10252050
File: 164 KB, 1920x1080, beforeoutside.jpg [View same] [iqdb] [saucenao] [google]
10252050

>>10252046

>> No.10253645

>>10247970
This is bullshit. I can tell because, for it to reconstruct the ribs like that, it would have to know that its recomstructing imagery of a ribcage. For a system to have insight like that it would have to have pretty good quality wide generalization and reasoning, basically would be full AGI.

So either the neural net that makes these images is a few steps from being a full blown AGI, or this is bullshit and either a higher resolution skelly than we see there was used, or it was run 1000 times on the skelly and they chose one where it happened to look really good.

I dont think we are nearly that close to agi so its probably bullshit

>> No.10254016 [DELETED] 
File: 317 KB, 1088x368, upscale comp.jpg [View same] [iqdb] [saucenao] [google]
10254016

So it's 5:30am and I finally got this shit working
It's not Topaz like OP said- it's called ESRGAN and it's a Deep Learning tool

Again, I'm tired as fuck so I'm sure I did something wrong/haven't read the documentation closely enough, but I haven't been getting fantastic results

Went ahead and made a quick comparison

>> No.10254035
File: 391 KB, 1360x368, upscale comp.jpg [View same] [iqdb] [saucenao] [google]
10254035

Here's my comparison of all the different methods mentioned ITT

>> No.10254041

>>10254035
Topaz wins, but only since it adds an artistic touch to it. The original is better otherwise

>> No.10254044

>>10254041
for my money, in terms of setup time and price, waifu2x is still the best option
Topaz is objectively the winner, but it's not $100 better

>> No.10254058

>>10254044
I'd keep the original desu, it looks fine

>> No.10254061

>>10254058
Agreed
I just meant in terms of upscaling

>> No.10254141

>>10252050
>>10252046
Wow, it's fucking nothing

>> No.10254146

>>10254141
t. spoiled baby

>> No.10254740
File: 2.40 MB, 4014x774, stickman upscale comparison.jpg [View same] [iqdb] [saucenao] [google]
10254740

>>10254035
Decided to run a comparison using a real photo
ESRGAN seems geared toward this type of work, but TOPAZ about ties it up

It's interesting to see how the two different methods attack the same problem

>> No.10254777

>>10254035
>>10254740
So does this mean OP's posts are bullshit?

>> No.10254800

>>10248457

it's almost certainly a CNN set up in a GAN configuration. i actually thought about doing something like this a while back, since you don't need an annotated dataset, just a big set of images that you can downsample/upsample for input and then train with the originals as the targets.

>> No.10254803

>>10254777
There are some bullshit images going around itt.

>> No.10254809

>>10254740
Kek

>> No.10255729

>>10254035
the second one kinda looks cute

>> No.10255859

Brainlet here, how long before technology like this can be used to cockblock game developers who try to sell HD remasters by making free fanmade texture packs for every game?

>> No.10256007

>>10255859
Interesting point. I'd love to see this used on Phoenix Wright or Professor Layton and see how it squares up to the official HD remasters

>> No.10256183

>>10256007
Nintendo would never allow it.

>> No.10257264

>>10256183
not officially you mean

>> No.10257281

>>10257264
>>10256183
I only meant comparing one or two screencaps, not redoing the entire games

>> No.10257308

>>10248499
nah, adding optical flow to GANs is fairly simple nowadays

>> No.10258068

>>10248496
So what's stopping you from generating them beforehand?

>> No.10259981

Possible evil appliances: Lying about graphics in pre order promo video.

Evilest AI that actually exist.

>> No.10260003

>>10248496

the idea is that you could upscale textures/sprites in order to replace the lower quality original versions.

>> No.10260015
File: 11 KB, 168x164, 1501268056758.jpg [View same] [iqdb] [saucenao] [google]
10260015

>>10247951
Can you try it on this?

>> No.10260486
File: 853 KB, 2206x1968, sci expirment.jpg [View same] [iqdb] [saucenao] [google]
10260486

It's interesting how AI handles this problem.

>> No.10260494
File: 86 KB, 672x656, 1546360364637_output.jpg [View same] [iqdb] [saucenao] [google]
10260494

>>10260015
400% upscale (150-200% is ideal)

>> No.10260521

Hear me out-imagine a lossy compression method using this to enlarge images that have been shrunk down to decrease size.
thoughts?

>> No.10260544

>>10260521
https://arxiv.org/abs/1609.04802

https://arxiv.org/abs/1809.00219

>> No.10262025

Damn this actually delivers

>> No.10262927

>>10260486
Is that Taeyeon?

>> No.10263670

Try it on censored porn.

>> No.10264397

>>10260494
Beautiful.

>> No.10264411
File: 47 KB, 600x590, 6699B540-BF86-49ED-BB4D-011E8B0A886C.jpg [View same] [iqdb] [saucenao] [google]
10264411

>>10247970
I want a general for this