C.W.K.
Stream
Lesson 07 of 10 · published

Generation vs. Editing vs. Transformation vs. Upscaling

~17 min · foundations, mental-model, l7

Level 0Spark
0 XP0/100 lessons0/14 achievements
0/200 XP to next level200 XP to go0% complete

Not all AI image operations are the same thing. Understanding the differences is like understanding the difference between building a house from scratch, renovating a room, converting a house into a restaurant, and adding a second floor. Same building — completely different operations.

The Four Modes

Generation:      Nothing ──▶ [Model] ──▶ New image from scratch
                 "Build a house"

Editing:         Existing image + mask ──▶ [Model] ──▶ Modified region only
                 "Replace the kitchen countertop"

Transformation:  Existing image + instruction ──▶ [Model] ──▶ Same structure, new style
                 "Convert this house to Mediterranean style"

Upscaling:       Low-res image ──▶ [Model] ──▶ Higher-res image with added detail
                 "Add a second floor with matching architecture"

Generation (Text-to-Image)

The model creates an image from scratch, guided only by your text prompt (and its learned priors). This is the most "creative" mode — maximum freedom for the model, but also maximum unpredictability. You describe what you want; the model produces its interpretation.

Editing (Inpainting / Local Edits)

You provide an existing image and indicate a specific region to change. The model replaces only that region while keeping everything else intact. This is powerful because you can keep 95% of a great image and fix just the part that went wrong — a hand, a face, a background element.

Transformation (Image-to-Image / Style Transfer)

You provide an existing image as a structural guide, and the model generates a new image that follows the same basic composition but with a different style, mood, or treatment. Think: same scene, different artistic interpretation. The "strength" parameter controls how much the model deviates from the original — low strength preserves more of the input, high strength gives the model more creative freedom.

Upscaling (Super-Resolution)

The model takes a low-resolution image and generates a higher-resolution version, inventing plausible fine details that weren't in the original (skin texture, fabric weave, leaf detail). This isn't just "making pixels bigger" (that's interpolation) — it's generating new detail that's consistent with the image content.

Why the Distinction Matters

Professional workflows almost always combine these modes:

  1. Generate a batch of images from a prompt
  2. Select the most promising one
  3. Edit (inpaint) any flawed regions
  4. Transform if you want a style change
  5. Upscale the final result to production resolution

Treating generation as a single step ("prompt → done") is the beginner trap. Treating it as a pipeline of complementary operations is what produces professional results.

Key Takeaways
  • Generation creates from scratch. Editing modifies a region. Transformation changes style/treatment. Upscaling adds resolution and detail.
  • Professional results almost always combine multiple modes — generate, select, edit, upscale.
  • Don't expect one-shot perfection from generation alone. Think in workflows, not single prompts.

External links

Exercise

Generate one image of a scene. Then use inpainting (or regenerate just a portion) to change ONE element. Compare the four modes (T2I, I2I, inpaint, upscale) on the same source image and document where each excels.

Progress

Progress is local-only — sign in to sync across devices.
Spotted a bug or have feedback on this page?Report an Issue

Comments 0

🔔 Reply notifications (sign in)
Sign inPlease sign in to comment.

No comments yet — be the first.