Stable Diffusion for Mir Artwork

[meacher]

I didn't really look if this has been posted already but oh well...

If you haven't heard about Stable Diffusion, its similar to DALL-E, a text to image generator except that you can download and run the components and models locally (and sell any created works if you are that way inclined).

I would only really recommend it to Windows user with Nvidia GPU's as the setup is easy and has a high success rate vs AMD/Linux.

The point is that when I started typing this post, I started generating images that are attached (limit 20 per forum post but stable diffusion spit out 3 times that before I finished typing, I picked some colourful ones). No effort was required past installing stable diffusion and well, some of them are really quite good starting points (or even entirely useable final images). Between stable diffusion and ChatGPT you can have a Mir themed website setup in about an hour.

################

If you want to check out stable diffusion and you run Windows,

I use the "AUTOMATIC1111's WebUI" which can be found at the links below.

GitHub : https://github.com/AUTOMATIC1111/stable-diffusion-webui

Install instructions (Nvidia) : https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Install-and-Run-on-NVidia-GPUs

Install instructions (AMD) : https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Install-and-Run-on-AMD-GPUs

Unstable Diffusion's Discord is a good Discord for tips/help too : https://discord.gg/aTzxbWbatn

################

My version of install instructions for Windows/Nvidia:

Install this : https://www.python.org/ftp/python/3.10.6/python-3.10.6-amd64.exe
-click "add to PATH" or "add to system environment variables" during install.

Install this : https://github.com/git-for-windows/git/releases/download/v2.39.2.windows.1/Git-2.39.2-64-bit.exe
-Again click "add to PATH" or "add to system environment variables" during install.

Download and extract this : https://github.com/AUTOMATIC1111/stable-diffusion-webui/archive/refs/heads/master.zip
-somewhere you wont move it and with at least 20GB of free space

Run webui-user.bat from inside the extracted files and wait until it finishes installing and downloading the required stuff.
If it appears to be stuck, just wait unless there is a clear error.

When its ready, you'll be able to go to http://127.0.0.1:7860 where you will find the UI for Stable Diffusion.

 

[meacher]

 

[Jev]

Game changer this

 

[meacher]

I think so ^_^
I'll post some better examples when I'm free next.

The wider implication here is possibly generating entirely new assets that technically belong to the server creator and legally being free of mir, all via batch img2img script... that's a tall order tbh but not completely insane now either...

 

[meacher]

Some more examples, as promised...

Again, I didn't put much effort in to any of this and its not a perfect solution or the answer to your graphics problems but its certainly a very useful tool to have in the toolbox.

So, maybe you want some new MP potion images....stable diffusion!



Oops, Maybe you wanted HP instead?


Don't want a background? ...OK!
(see attachment)


Don't need potions? no problem...
Being more specific about the style and what you want is up to you really...


Sometimes, txt2img doesnt really understand some stuff but you can simply regenerate the problem items with an alternate prompt, over and over until you find your perfect image...



You could possibly, maybe, even get new maps out it...
(i assume you would need way to load .png as a map etc...)


"That's cool and all but i'd just be happy to find high quality versions of the old stuff"
Well, thats fair, and ... Stable diffusion!

With img2img you can get "effectively the same image" but really, its a unique regeneration, and you can change the resolution, giving the appearance of upscaling. for example...

The old image, on the left. A basic img2img upscale in the middle. Img2img loopback on the right.



Is it the same character, not really... but thats good when they lawyers come knocking.... Is it close enough, yeah pretty much and you can continue to re-generate with different settings until it's right or get close enough (and drop it into photoshop still.)

Other artwork for websites or whatever, as seen in previous post, you can get a very similar look and simply changing the "prompt" will give some amazing results, for example, adding "photorealistic"


or adding "wearing a Helmet"..


Its really quite capable and gives the avarage joe a chance to create some great art/graphics etc


I'm not sure what other examples to give really, I don't have any mir assets to hand either...

I hope the above adds something anyways...

Any questions or anything?

 

[Lilcooldoode]

It'll be perfect when it can create fully useable sprite sheets

 

[meacher]

It'll be perfect when it can create fully useable sprite sheets

You could feed it sprite sheets until it knows what they are and can create them to your spec ...
Useful if you wanted your sprite sheets in a specific order/style etc.

Or its possible it can do it already with some persuasion to be fair, it has batch and API capabilities too.
You would just need to get the prompts correct etc.

but as example, someone has actually done the above already for, i want to say Stardew valley, so i can show you its possible, if nothing else...
obviously this was fed a walking sprites but i personally generated the below using the model.


If you had a way to generate sprite sheets for what is already available that you have and want more of, then you're winning i guess.

 

[Lilcooldoode]

I can generate sprite sheets from current armours/mobs/weapons if you think it's possible

 

[Hercules]

I can generate sprite sheets from current armours/mobs/weapons if you think it's possible

I don’t care what WS says about u LCD, I think your alright

Post automatically merged: Apr 22, 2023

Some more examples, as promised...

Again, I didn't put much effort in to any of this and its not a perfect solution or the answer to your graphics problems but its certainly a very useful tool to have in the toolbox.

So, maybe you want some new MP potion images....stable diffusion!

View attachment 31325

Oops, Maybe you wanted HP instead?
View attachment 31324

Don't want a background? ...OK!
(see attachment)
View attachment 31326

Don't need potions? no problem...
Being more specific about the style and what you want is up to you really...
View attachment 31330

Sometimes, txt2img doesnt really understand some stuff but you can simply regenerate the problem items with an alternate prompt, over and over until you find your perfect image...

View attachment 31343

You could possibly, maybe, even get new maps out it...
(i assume you would need way to load .png as a map etc...)
View attachment 31331

"That's cool and all but i'd just be happy to find high quality versions of the old stuff"
Well, thats fair, and ... Stable diffusion!

With img2img you can get "effectively the same image" but really, its a unique regeneration, and you can change the resolution, giving the appearance of upscaling. for example...

The old image, on the left. A basic img2img upscale in the middle. Img2img loopback on the right.
View attachment 31328 View attachment 31329 View attachment 31336
View attachment 31337 View attachment 31338 View attachment 31339

Is it the same character, not really... but thats good when they lawyers come knocking.... Is it close enough, yeah pretty much and you can continue to re-generate with different settings until it's right or get close enough (and drop it into photoshop still.)

Other artwork for websites or whatever, as seen in previous post, you can get a very similar look and simply changing the "prompt" will give some amazing results, for example, adding "photorealistic"
View attachment 31332 View attachment 31333

or adding "wearing a Helmet"..
View attachment 31334 View attachment 31335

Its really quite capable and gives the avarage joe a chance to create some great art/graphics etc


I'm not sure what other examples to give really, I don't have any mir assets to hand either...

I hope the above adds something anyways...

Any questions or anything?

Fantastic stuff

 

[Martyn]

@meacher can it be used to make a banner for Discord?

if you could try, it would be appreciated, recommended and ratio 960x540 16:9

 

[LightBringer]

Honestly looks really good.

Something I can't get side tracked with or I will end up tinkering with it for months

 

[Sanjian]

yeah i got side tracked designing ai voices for my npcs and getting them in game... was a great feature but most people were skipping them so effort vs end result wasnt worth it

 

[FloppyQ]

It can even be used to create an avatar!

"A fat Pikachu eating a pile of ****" perhaps.

 

[meacher]

I can generate sprite sheets from current armours/mobs/weapons if you think it's possible

To be honest its probably a tall order for me to pull it off, i'm not all that good with stable diffusion yet and haven't done any model training before. that said, I can see people have done it and there are a few guides on the internet so, let me have a proper look at what's required and get back to you.

@meacher can it be used to make a banner for Discord?

if you could try, it would be appreciated, recommended and ratio 960x540 16:9

I suspect that's probably pretty easy, here's 20 (forum post limit). some better than others. Slap "The Legend of Mir" or whatever on them at your convenience.

Happy to do some more, i just used that last prompt from the realistic ones in previous post and changed resolution though really, if you want a different style, anime or whatever just let me know and i'll generate some more.

 

[Valhalla]

It can even be used to create an avatar!

"A fat Pikachu eating a pile of ****" perhaps.

Accurately describes 1/2 of this forums users tbh

 

[meacher]

Someone asked for those icon images, heres the link however, people are better off getting the software and doing their own to get what they want or to automatically remove backgrounds etc, rather than my hap-hazard "this could work" technique.

StableDiff_RPG_Icon_Run

 

[Jev]

Wonder if these would look good as buff icons?

Mana/HP % Buff

Gold Drop % Buff

Skill learning % Buff

Movement speed % Buff

etc etc
Thoughts?

 

[meacher]

maybe for now i try and use stable diffusion to upscale some of the assets where possible.
probably still a fair size job ... but if there is some interest in trying etc

A quick example upscale being like:











Get the settings/workflow right and possibly batch process everything

 

[Hercules]

maybe for now i try and use stable diffusion to upscale some of the assets where possible.
probably still a fair size job ... but if there is some interest in trying etc

A quick example upscale being like:

View attachment 31388 View attachment 31389

View attachment 31391 View attachment 31390

View attachment 31395 View attachment 31396

View attachment 31393



Get the settings/workflow right and possibly batch process everything

Have you tried it on maps/tiles?

 

[meacher]

Have you tried it on maps/tiles?

see what happens i guess...

not sure how well it would all work to be honest, the more i look at it...

some random tiles...






bit hit n miss really, bonus is the tiles are all the same size so batch process would be easier on them.