Duke4.net Forums: I tried doing neural network upscale of DN3D textures. Who can implement it back into the game? - Duke4.net Forums

Jump to content

  • 2 Pages +
  • 1
  • 2
  • You cannot start a new topic
  • You cannot reply to this topic

I tried doing neural network upscale of DN3D textures. Who can implement it back into the game?

User is offline   Jimmy 

  • Let's go Brandon!

#31

Yeah I'm talking about actually fixing errors in the original art. The gun barrels in most of those tiles show erroneous AI behaviour because the original art was so lazy.
0

User is offline   Zaxtor 

#32

Nice stuff.
Nothing wrong with improving stuff.
Those mobs are from mid 90s so making 2010s stuff is good.
Improvement etc

lots of old stuff get improvement.
0

User is online   Phredreeke 

#33

View PostJimmy 100MPH, on 19 February 2019 - 10:38 PM, said:

Yeah I'm talking about actually fixing errors in the original art. The gun barrels in most of those tiles show erroneous AI behaviour because the original art was so lazy.


TBH I don't think it matters that much if those edits are made pre or post upscale.

Here's another pair of frames, this time showing one of the flaws in the process. some of the smaller blood spatter was erased while creating the mask. (frames like these I would edit by hand in my Blood upscale)

Posted Image
2

User is offline   Danukem 

  • Duke Plus Developer

#34

Still damned good, even if missing a few pixels of blood. I would argue that the Octabrain upscale is good as-is: the tendrils of blood thin out in a very natural way and look fine, even if it's not 100% faithful. If a human being had produced that image a few years ago, I doubt that anyone would have complained.

The enforcer on the other hand needs a little help where the arm is coming off.
0

User is offline   Jimmy 

  • Let's go Brandon!

#35

Fixing bad behaviour after the upscale sounds like 10x the work to me.
0

User is online   Phredreeke 

#36

I reworked the way I made masks, using a pair of upscales as a basis, instead of the original sprite.

Posted Image

Left new, right old. It looks better for these sprites, but worse for others. Possibly I can filter out part of the image and overlay it on the old mask...
3

User is offline   oasiz 

  • Dr. Effector

#37

These are by far the most promising Duke3D upscales I've seen.
1

User is offline   Radar 

  • King of SOVL

#38

I don't know anything about upscaling. Is this something that can be done on-the-fly at decent frame rates, or is an asset drop-and-replace the only way this can be implemented?

This post has been edited by Radar: 20 February 2019 - 10:41 AM

0

User is offline   MusicallyInspired 

  • The Sarien Encounter

#39

No. At least not yet. It takes anywhere from one to several seconds to generate a single image depending on how large the source image is (it increases by 4x) and how fast/how much memory your GPU has. It can be done by CPU as well but the processing time increases quite a bit.

This post has been edited by MusicallyInspired: 20 February 2019 - 11:01 AM

0

User is online   Phredreeke 

#40

Honestly I don't think you'll ever get low enough latency to do it in real time.
0

User is offline   MusicallyInspired 

  • The Sarien Encounter

#41

Yeah and we've never needed more than 640k of memory, right? You underestimate technology. We've got real-time raytracing now that looks ten times better than Toy Story's pre-rendered graphics from 1995. The Starry Expanse remake project looks better than Riven's 1997 state of the art pre-rendered graphics. It'll happen. I give it 10 years max. And that's generous.
0

User is online   Phredreeke 

#42

You're right, I'm being overly cynical, also I'm not considering application specific implementations, like cacheing previous frames.
0

User is offline   Jimmy 

  • Let's go Brandon!

#43

Consider this: One day you'll be able to feed sprite frames into an AI that constructs a completely accurate 3D model out of it. And it won't be long now either.
0

User is offline   MusicallyInspired 

  • The Sarien Encounter

#44

You know what would be neat, create a sprite from 3 angles (front, back, side) in the standard t-pose. Then the algorithm would extrapolate it into a 3d model and animate a standard walking cycle and spit out the appropriate animation frames in whatever resolution you want.
0

User is offline   Radar 

  • King of SOVL

#45

I just want polymer lights without dropping down to 10 fps, k.

This post has been edited by Radar: 20 February 2019 - 03:23 PM

2

User is offline   MusicallyInspired 

  • The Sarien Encounter

#46

Get a faster system. Mine works fine. I go below 30 sometimes, but I've never had major problems otherwise with the HRP in the standard Duke levels. Ever. I don't ever go down to 10.
0

User is offline   Radar 

  • King of SOVL

#47

I'm kidding around. I actually don't know how fast polymer runs on my system. (probably slow though)

This post has been edited by Radar: 20 February 2019 - 03:37 PM

1

User is offline   Mark 

#48

View PostJimmy 100MPH, on 20 February 2019 - 02:41 PM, said:

Consider this: One day you'll be able to feed sprite frames into an AI that constructs a completely accurate 3D model out of it. And it won't be long now either.

That goal is close already. At least a year ago I saw vids of programs that turn a series of still pics into a 3d model. It required more than 3 views but they work very well. I remember downloading one of the programs but never tried it. I must have gotten sidetracked with something else and forgot about it until now.

Some modeling programs already have an "autorig" function to rig up an animated skeleton to a model. They are not perfect and rely on some tweaking afterwards. But the main parts of the dream program are here now just waiting to be refined and combined.

This post has been edited by Mark: 21 February 2019 - 05:58 AM

0

User is offline   ---- 

#49

View PostMark, on 21 February 2019 - 05:53 AM, said:

I must have gotten sidetracked with something else and forgot about it until now.


\o/ Boobies
1

User is online   Phredreeke 

#50

View Postfuegerstef, on 22 February 2019 - 11:27 AM, said:

\o/ Boobies


Posted Image
0

User is offline   Micky C 

  • Honored Donor

#51

One difficulty in turning the Duke sprites into models with ANNs is that the sprites are quite noisy in that they’re touched-up versions of images of the original models. The ANNs might have some difficulty in overcoming discrepancies between the different views. I’m sure it’s possible, but it makes the task more complicated.

Add to that we probably want high quality models, not just low-res 3D versions of the original art. I’d guess upscaling 3D models is a lot more difficult than upscaling 2D images?
0

Share this topic:


  • 2 Pages +
  • 1
  • 2
  • You cannot start a new topic
  • You cannot reply to this topic


All copyrights and trademarks not owned by Voidpoint, LLC are the sole property of their respective owners. Play Ion Fury! ;) © Voidpoint, LLC

Enter your sign in name and password


Sign in options