Duke4.net Forums: [RELEASE] Duke Nukem 3D Upscale Pack - Duke4.net Forums

Jump to content

Hide message Show message
Welcome to the Duke4.net Forums!

Register an account now to get access to all board features. After you've registered and logged in, you'll be able to create topics, post replies, send and receive private messages, disable the viewing of ads and more!

  • 2 Pages +
  • 1
  • 2
  • You cannot start a new topic
  • You cannot reply to this topic

[RELEASE] Duke Nukem 3D Upscale Pack

User is online   Micky C 

  • Honored Donor
  • 3,734

#31

This is fantastic work.

So how automatic is the upscaling process? Would it be feasible to do not only the sprites, but textures as well, ie all the art in the game?

Polymer wishlist: Global illumination, SSAO, Bloom, reflective surfaces, adjustable specular (wetness), volumetric lighting.
Mapper of the Month December 2014.

Herbs? Tell me more!
0

User is online   NightFright 

  • The Truth is in here
  • 903

#32

I think textures are easier than sprites since they would work pretty much like HRP textures, especially since they would maintain their aspect ratios.
0

User is online   Phredreeke 

  • 305

#33

It's fairly automated, I put together a folder with images to be upscaled, this is then run through a number of scripts

1. creates a mask from the image in question
2. antialias the edges of the image, this is then fed to ESRGAN
3. the result of ESRGAN is run through a second script that sharpens, downscales and applies respective game's palette
4. finally, the mask from step 1 is applied to the downscaled image

There's actually an additional couple of steps I've used to add the small detail like bloodspatter, but it's rather complicated, but the above gives a fairly understandable picture of the process. For textures step 1 would be omitted, but in step 2 instead the edges would be slightly extended (either by mirroring or wrapping/tiling) to give context to both the antialiasing preprocess but most importantly ESRGAN.

Yes, it can be done to textures, I've got a folder of textures I've done as a proof of concept, HOWEVER, unlike the sprites a lot of them are going to need manual work (see the attached picture for a worst case example)

Attached thumbnail(s)

  • Attached Image: tile4246_rlt.png

0

User is offline   Mark 

  • Honored Donor
  • 2,822

#34

How does it handle seamless tiling textures? Do texture edges still match up?
0

User is online   MusicallyInspired 

  • 3,262

#35

That would likely require work by hand as well.

Roland SC-55 Music Packs
Latest release: Heretic SC-55 Music Pack (12/12/18)
*new* Buy the Mage's Initiation Original Soundtrack on Bandcamp by me!
Buy the P&C Adventure/RPG game Mage's Initiation on Steam, GOG, and Humble
0

User is online   Trooper Dan 

  • Duke Plus Developer
  • 3,594

#36

View PostMusicallyInspired, on 28 February 2019 - 05:52 PM, said:

That would likely require work by hand as well.


It had better not, or that would be a deal breaker. Imagine doing hand edits on thousands of images to make them tile properly, and then having to do that all over again every time the upscaling method is improved.
0

User is offline   Mark 

  • Honored Donor
  • 2,822

#37

The reason I thought to ask was earlier today I was testing results of converting some seamless high res 32 bit textures to lower res and duke palette. They looked great alone but the tiling was noticably off. I didn't bother to determine if it was the size and/or color downgrade that was the issue.

This post has been edited by Mark: 28 February 2019 - 07:27 PM

0

User is online   Phredreeke 

  • 305

#38

Basically, if you want the upscaled image to tile seamlessly you include context on the sides of the image when you upscale it then crop it out afterwards
1

User is offline   Marya 

  • 16

#39

I apologize in advance, but i have a very poor eye for detail. So does this essentially make sprites sharper and cleaner looking?
0

User is online   Phredreeke 

  • 305

#40

The goal is to appear as if the game's sprites had originally been at double resolution. I leave it to others to judge how well I've achieved that goal.
0

User is offline   Marya 

  • 16

#41

View PostPhredreeke, on 01 March 2019 - 07:45 AM, said:

The goal is to appear as if the game's sprites had originally been at double resolution. I leave it to others to judge how well I've achieved that goal.
So does that include the strippers and other girls or are they not updated yet?
0

User is offline   MrFlibble 

  • 642

#42

View PostLunick, on 25 February 2019 - 02:05 AM, said:

Made a quick video showing the pack in action



I just realised a thing (Phredreeke had kindly allowed me to check out the pack before the public release), the larger sprites kind of beg to have more animation frames too (like Smooth Doom or whatever that project is called). E.g. take a look at the Enforcer firing at 0:25, it feels sorta jerky. But that would require quite some work yet.

Basically ESRGAN did some very good job on scaling the sprites up, and Phredreeke refined the method to get proper sprite masks almost to perfection. However some manual touch-up could still be used on some frames, there's some colour bleeding out into wrong areas, e.g. the Trooper's eyes have some pixels off in certain frames:
Posted Image
Also some detail on he sprites gets blurry at some angles. For example, the claws/spikes on the Octabrain are sort of not pronounced enough in certain frames.

Pretty sure that an artist of Cage's calibre could fix that in no time (provided there was time and willingness to spend effort on this).

View PostPhredreeke, on 28 February 2019 - 03:11 PM, said:

It's fairly automated, I put together a folder with images to be upscaled, this is then run through a number of scripts

1. creates a mask from the image in question
2. antialias the edges of the image, this is then fed to ESRGAN
3. the result of ESRGAN is run through a second script that sharpens, downscales and applies respective game's palette
4. finally, the mask from step 1 is applied to the downscaled image

If you could share the exact scripts that you use that would be of great help to other gaming communities like Daggerfall Unity who are also doing sprite upscales with ESRGAN.
0

User is online   Phredreeke 

  • 305

#43

Upscaled textures, shown next to the original for comparison.

Posted ImagePosted Image
Posted Image Posted Image
Posted ImagePosted Image
Posted Image

However, I still got issues with tiles with text on it such as this and the order sign above.

Posted Image

If anyone wish to take on the role of "fixing" such problem tiles please either DM me or reply in this thread. (this also applies to Blood as well as potentially other Build games once we got an adequate source port)
1

User is offline   MrFlibble 

  • 642

#44

Phredreeke, am I right that the anti-aliasing process you do is aimed at properly processing sprite edges and nothing else?

If yes, have you considered cropping the outline of each sprite by one pixel and pasting this over the anti-aliased version to keep the edges anti-aliased while everything else remains sharp? Perhaps that would save you the need to sharpen the image in post-processing, which is a step I'd personally like to avoid as it might result in colour distortion (like what we observed on the border areas between colour-swappable blue and skin colour on the Trooper and dancers).
0

User is online   Phredreeke 

  • 305

#45

No, it's not just for the sake of sprite edges. I could have achieved that with a much simpler script.

The neural network upscalers are trained on images downscaled with bicubic filters. This is not representative of the graphics being upscaled. I am not able myself to train a model based on pixel graphics, so instead I alter the source image to look like what the neural network would expect had it been downsampled from a larger resolution original.

IMO the artifacts of the sharpening filter outweighs the artifacts from not preprocessing.
1

User is offline   LeoD 

  • 488

#46

View PostPhredreeke, on 05 March 2019 - 04:31 AM, said:

Posted Image
The monks are drunk...
This pack fills an ugly little gap in the HRP: decorative wall-aligned textures which show up as models and usually need to be notmd'd via maphacks. Now we have something better than the original ART that used to show up instead. Quite an improvement for just a few extra MB.
Therefore I'd like to ask you to process the Duke ART (1405ff) for this purpose, too.
0

User is online   Phredreeke 

  • 305

#47

Right now I'm working on my Blood upscale.

I'm a bit confused over what you're asking for. You want upscales for the sprites that the HRP replaces with models?
0

User is offline   LeoD 

  • 488

#48

View PostPhredreeke, on 22 March 2019 - 12:11 PM, said:

I'm a bit confused over what you're asking for. You want upscales for the sprites that the HRP replaces with models?

Yes, because of this:
Attached Image: model.jpg Attached Image: notmd.jpg Attached Image: notmd-ups.jpg

View PostPhredreeke, on 22 March 2019 - 12:11 PM, said:

Right now I'm working on my Blood upscale.

15 years of HRP, 4 years since v5.4, and no new release on schedule - we're not exactly in a hurry here. :dukegoof:
0

User is offline   Mark 

  • Honored Donor
  • 2,822

#49

never mind, I read the post again and deleted my comments.

This post has been edited by Mark: Yesterday, 01:40 PM

0

User is online   Phredreeke 

  • 305

#50

Unfortunately Duke is among the sprites that don't upscale well

Attached Image: tile1405.png
0

User is offline   Hendricks266 

  • Sperge Overlord
  • 6,319

  #51

Upscales have never been allowed in the HRP. You could make your own pack as a complement to it.

At one point I had a setup with Blender and an MD3 importer that actually supported animations and UVs, and I used it to render the HRP's images of all the pickups for use in EDuke32's HUD. You could do that for these cases too.
0

User is online   Tea Monster 

  • Polymancer
  • 2,114

#52

Someone should start a project where people use their art talents to manually recreate the existing tiles in a higher resolution than what exists in the original game files. You could call it something like "High Resolution Pack" or something.
0

User is offline   LeoD 

  • 488

#53

View PostHendricks266, on 22 March 2019 - 02:21 PM, said:

Upscales have never been allowed in the HRP.
Not for reasons that apply here. Not for reasons that apply nowadays. These upscales may only show up when explicitly requested by a notmd maphack command for a specific instance. In my working folder I have indeed put them into the maphacks hierarchy.
0

User is online   NightFright 

  • The Truth is in here
  • 903

#54

You either make an upscale pack that only includes upscales or you make an HRP with custom made highres artwork. Including upscales would basically be violating the license it's shipped with. We have rejected upscales as HRP entries in the past, and only because their quality got better, it doesn't mean the rules can be changed.

I know how frustrating it is not to get a new HRP for so long, but you shouldn't mix styles for the sake of filling gaps. We ran out of people who want to provide custom made content, but you can't just run stuff through filters now, even if manual adjustments are added. It's different approaches that don't fit together. HRP entries need to be done from scratch.


This post has been edited by NightFright: Yesterday, 03:27 PM

0

User is online   MusicallyInspired 

  • 3,262

#55

Word.

Roland SC-55 Music Packs
Latest release: Heretic SC-55 Music Pack (12/12/18)
*new* Buy the Mage's Initiation Original Soundtrack on Bandcamp by me!
Buy the P&C Adventure/RPG game Mage's Initiation on Steam, GOG, and Humble
0

User is offline   Fantinaikos 

  • 289

#56

Tried to fix the face a little.
Attached Image: tile1405.png
1

User is online   Phredreeke 

  • 305

#57

I don't know if this was LeoD's intent, but please don't distribute my upscales with HRP assets.
0

User is offline   LeoD 

  • 488

#58

View PostPhredreeke, on 22 March 2019 - 04:01 PM, said:

I don't know if this was LeoD's intent, but please don't distribute my upscales with HRP assets.
It was, indeed.

View PostNightFright, on 22 March 2019 - 03:10 PM, said:

Including upscales would basically be violating the license it's shipped with. We have rejected upscales as HRP entries in the past, and only because their quality got better, it doesn't mean the rules can be changed.
I'm outnumbered anyway, but please cite me that very passage from hrp_art_license.txt.
0

User is offline   Hendricks266 

  • Sperge Overlord
  • 6,319

  #59

The appropriate thing to cite would be 3D Realms Forums discussions on the topic, but I can't look for them right now. Instead, have a look at my NWHRP / VacaHRP submission guidelines (dated 2010) which state the no derivative works rule (#4).
0

Share this topic:


  • 2 Pages +
  • 1
  • 2
  • You cannot start a new topic
  • You cannot reply to this topic


All copyrights and trademarks are property of their respective owners. Instead of reading this text, you could be playing Ion Maiden! ;) © 2018 Voidpoint, LLC

Enter your sign in name and password


Sign in options