Why use (gen)AI?

Hello!

If you are reading this page you are probably either really angry/annoyed or curious.

So, why am I using AI to draw a manga?

The reasons are actually quite simple:

  • I have a story to tell.
  • I don't know how to draw.
  • I want to try something new.

I want to talking about these reasons, but before we go into my internal debate on this, I want to present my process.

I will also use the term AI with the term genAI interchangeably, even if I am aware that there are researchers and workers around the globe working on other types of artificial intelligence.

The process
The writing

The writing is an original story that I invented.
I didn't and won't use genAI to write the story, scenario, characters, dialog and any other text. All character concepts, who they are, what they want, what they wear, all come from my head. I don't plan on using genAI for this, simply because I enjoy the creativity of imagining all the aspects of the story, and it is something I can do. If it's good or not remains to be seen. 

The drawing

Yes, this is part is done by genAI, but the process is more elaborate than just write a prompt, take that image and then use it. Image generation is used in two different ways.

The first use is direct prompting. This is used to "fill" the manga panels with something. Think of it as a quick "sketch".

The second use is for the final image, but the difference is that for that image, I will do things differently. I will use ClipStudioPaint's puppet system to place a puppet in the scene and that have that as a reference pose for the AI. I will also use 3D objects and photos of real places either as backgrounds or as reference images to guide the AI. Finally, these images are touched up, a lot! Sometimes some sections are redrawn by AI, and sometimes I do it. The final touch ups, adjustements and consistency is usually done manually.

For the actual generation, I use ComfyUI with an Illustrious checkpoint variant and get my checkpoints and LORA's on CivitAI.
I won't explain what these things are. Look it up! It's pretty interesting.
I run everthing locally, meaning all of this runs on my machine, it does not run in some data center run by big tech.

Up to now, I have found that it's actually pretty difficult to get genAI to generate consistently images and/or complex scenes, so modifying and building scenes using multiple images and photos is necessary.

I would like to talk about this more, and I will post about this as the project moves forward, but I won't elaborate too much here. I am not an AI power-user, so I still have much to learn.

Building the panels and page layouts

I am not an artist, mangaka or anything remotly close to that in real life, but I have decided to do this myself, without genAI. Personally, I use ClipStudioPaint to build the layouts and panels. I admit that I didn't do a super deep search on this subject.
I read a little on the subject of manga page layouts. I downloaded and paid for CSP and started playing with it. I have a feeling this non-preparation will come bite me in the ass later, especially if this thing goes to print (hey, you never know!), but I wanted to get started and just try.

Business and promotional stuff

I guess this website falls in this category. I plan on writing posts myself and posting in different social media. Yes, I will use AI-generated images as extra context for this, but the writing and interactions will be done manually, along with all the other steps described above.

The debate

Yeah. A lot of people are against the use of AI like generating images. I'll try to write the arguments I've heard and why I think it's OK to try what I am doing.

You are using work that was stolen.

Yes, it's true that models are used using images found on the internet.
However, I would argue that someone learning to draw and a model learning to draw are very similar in concept. The biggest difference between the two is speed. And yeah, that is super unfair, but I really do think that:

  • Artist can also use generative AI to their advantage.
  • Artist will always be better than most random people, using AI or not.

Also:

  • I am not using a specific artists' style, the checkpoints I picked feel very generic to me.
  • I am not using anyone's intellectual property directly (like, it's not a Naruto fanfic)

And, I really think that someone with an original story and/or an original drawing style can and will continue to be able to stand out, even with the existence of genAI.

There are a bunch of people out there saying artists should stop drawing, because it's not necessary anymore, and I couldn't disagree more. Innovation and originality still come from humans.

Also, I would like to point out that, regardless of the fact that genAI is used here, it's still a ton of work!

Wait, you are trying to make money off of this too?!?

Yeah, I mean, why not? The whole thing is an experiment!
Also, when you think about it, there are a bunch of things I am doing that take a lot of work. It's taken me hours to come up with a story. I takes hours to build the manga.  Each page, each panel is placed by hand. Yeah, I'm not drawing the images, but using genAI is not a walk in the park either. It hallucinates and often makes weird errors. It cannot do complex things easily. I almost always have to make modifications to images, and often have to compose more or less complex scenes. Also, to keep things consistent, the background is often simply a color like black or white. So these have to be built manually and then "upgraded" through genAI. Anyway, I digress, I do put in a lot of time in this, and time is money?

GenAI is bad for the environment and the companies building it are evil

I actually agree with you! I am a reader of Ed Zitron and I think way too much money and power is going into models that CEOs want to use to replace us. That is why I use models locally, on my machine. Also, CivitAI's community is very free-style and random, because it's basically a bunch of people trying out genAI stuff and posting their work, not some corporation trying to make money off of it.

And, uhh, why hen... an adult theme?

Ah, an interesting question!

Because that's what you all want...

No, but seriouly, I really believe sex is an integral part of the human experience, and that, traditionally, people are afraid to use it to tell a story. Yes, this story has nudity and explicit sex, but it's still a story about humans. That are fucking.

That's my attempt here, anyway.

This page is probably too short and is just a bunch of random thoughts. I do plan on updating it as I go.