Lesson 0.2Lesson 0.2 · Foundations — How Generative AI Sees Design
The Generative-AI Tool Landscape
A map of the ecosystem - so you choose by job, not by hype
There is no 'best' tool - only the right tool for this job.
Every week someone declares a new king of AI image generation, and every week they are wrong, because the question has no single answer. Midjourney, Stable Diffusion, DALL-E, Firefly and Flux are not competitors on one ladder - they sit at different points on a map. Add the design-specialised tools - Veras, Krea, Maket, and Studio Matrx's own DesignAI - and the map, not any ranking, is what you actually need. Learn the axes and you can place any tool that launches next month without anyone telling you where it goes.
Don't pick a favourite tool. Learn the map, keep a kit, choose per job.
The generalists: five models you will meet everywhere
Five general-purpose text-to-image systems dominate the conversation, and each earns its place for a different reason.
Midjourney is the aesthete. Closed, hosted, subscription-only, it produces the most beautiful images out of the box with the least effort - which is exactly why it is the fastest route to a mood or a concept, and why Module 2 leans on it. You cannot see its weights or run it locally; you rent its taste.
Stable Diffusion is the open foundation. Its weights are public, it runs on your own machine, and almost every advanced technique in this course - ControlNet, LoRAs, IP-Adapter - was built on it. It trades Midjourney's effortless polish for total control. If you want to condition a generation on your own line drawing, you will end up here.
DALL-E (OpenAI) is the conversational one. Reached through ChatGPT, it excels at understanding a plain-language brief and is unusually good at following literal instructions - but it is closed, hosted, and less tuned for architectural beauty than Midjourney.
Adobe Firefly is the commercially cautious one. Adobe trained it on licensed and public-domain imagery and offers indemnity, which is why it matters to anyone billing a client. It is woven into Photoshop's generative fill, making it the natural choice for editing real project photos rather than dreaming from scratch.
Flux (Black Forest Labs), from the team behind the original Stable Diffusion, is the new high-fidelity open model - strong prompt-following, notably better at legible text and hands, available both hosted and to run locally. Treat it as the current open-model front-runner for realism.
Notice that these five are not five versions of the same thing. Midjourney sells you taste; Stable Diffusion sells you control; DALL-E sells you obedience to plain language; Firefly sells you peace of mind; Flux sells you fidelity. A single project can call on several of them at different hours of the same day, and the practitioner who understands that stops asking 'which is best' and starts asking 'which does this hour need'.
Five generalists, five personalities. None is 'best' - each is best at something.
The specialists: tools built for design work
Around the generalists sits a ring of tools that assume you are a designer, not a hobbyist making dragons. They give up some flexibility to hand you controls that speak your language.
Veras (EvolveLAB) plugs straight into Revit, SketchUp and Rhino: it takes your actual 3D model or viewport as the structural skeleton and renders style onto it, so the geometry stays yours while the AI supplies material and light. This is the pattern the whole course is building toward - AI as a finisher on top of your drawing.
Krea is the real-time canvas: you sketch or drag shapes and it renders as you move, collapsing the prompt-wait-judge loop into something that feels like drawing. It is superb for fast, interactive exploration.
Maket works on the other end of the pipe - programmatic floor-plan generation and early space planning from constraints, plus material and style ideation. It is a reminder that 'generative AI' is not only pretty pictures; some of it operates on layout logic.
DesignAI, Studio Matrx's own tool, is built specifically for Indian homes and interiors: restyle a room, explore palettes, and generate options grounded in local context and materials. Because it is purpose-built, it hides the prompt-craft plumbing behind design-native choices - a gentler on-ramp than a raw Stable Diffusion install. You can try it at /designai.
The trade is always the same: a specialist tool gives you relevant controls and guardrails at the cost of the generalist's open-ended range. For production design work, that trade is usually worth it.
There is a second, quieter benefit to the specialists: they encode defaults a designer would choose. A generalist will happily render a physically impossible interior with theatrical lighting because it looks striking; a tool built for design nudges toward plausible ceiling heights, buildable details and materials that exist. It cannot enforce those things - remember, none of these tools has real logic - but its training and its interface bias it toward the design-sensible, which means less time spent steering away from nonsense and more spent on the decision that matters.
The four axes that actually separate them
Forget rankings. Every tool sits somewhere on four axes, and knowing where tells you what it is good and bad for.
Open vs closed. Can you see and download the model's weights? Open models (Stable Diffusion, Flux) can be run, inspected, fine-tuned and extended by anyone - the basis for every control technique later in this course. Closed models (Midjourney, DALL-E) are rented black boxes: brilliant, convenient, and out of your hands.
Hosted vs local. Whose computer runs it? Hosted tools run on someone else's GPU - nothing to install, pay per use, and your images (and prompts) leave your machine. Local tools run on your own hardware - private, unlimited once set up, and free of per-image cost, but they demand a capable GPU and patience.
General vs design-specific. Was it built to draw anything, or built for us? Generalists give range; specialists give relevant controls, sensible defaults and less prompt plumbing. For a courtyard house you rarely need a tool that can also draw anime.
Commercial safety. Are you cleared to bill a client for what it makes? This is the axis designers forget until it bites. Firefly is explicitly trained on licensed data and carries indemnity; models trained on broadly scraped images sit in murkier territory that Module 5 examines in full. For client deliverables, this axis can outrank aesthetics.
Place any tool on these four and you have its honest profile - no marketing required.
Open/closed, hosted/local, general/specific, safe/murky. Four dials, not one league table.
How to actually choose - by job, not by loyalty
The mature practitioner does not have a tool; they have a kit, and they reach for different tools at different moments.
Chasing a concept or mood in the first hour? Midjourney or Krea - maximum beauty and speed, commercial questions deferred. Need to render your own model while keeping its geometry? Veras or a Stable Diffusion ControlNet workflow. Editing a real project photo - swapping a sky, restyling a wall? Firefly inside Photoshop, both for the tooling and the commercial cover. Producing a client deliverable that will be published and billed? Weigh the commercial-safety axis heavily. Working on an Indian home or interior and want a design-native on-ramp without prompt plumbing? DesignAI.
Notice that the same designer might use four tools on one project. The skill this course builds is not mastery of one interface but fluency in the map - so that when a tool is retired or a new one launches (and it will, monthly), you can place it in seconds and decide whether it changes your kit. Everything downstream - prompting, control, materials, workflow - is a technique you can carry from tool to tool, because they are all denoising appearance from patterns. The interface changes; the mental model does not.
One practical caution as you build your kit: do not confuse familiarity with fit. It is tempting to funnel every task through the one tool whose quirks you already know, and to call that efficiency. But a tool you are comfortable in is not automatically the right one for the job in front of you - reaching for Midjourney to edit a real client photograph, or for a raw Stable Diffusion install to chase a quick mood, is comfort masquerading as judgement. Re-run the four-axis check whenever the task changes, not only when the tools do, and let the map correct your habits.
Midjourney
Closed, hosted general-purpose model; best out-of-the-box aesthetics
The fastest route to a beautiful concept; no local run, no geometry control. The workhorse of Module 2.
Stable Diffusion (incl. SDXL)
Open, local-capable general-purpose model
Public weights; the foundation for ControlNet, LoRAs and IP-Adapter. Trade polish for total control.
Adobe Firefly
Hosted general model trained on licensed / public-domain data
Commercially cautious with indemnity; lives inside Photoshop generative fill - the editor's choice.
Flux (Black Forest Labs)
Newer high-fidelity open model, hosted or local
Strong prompt-following, better text and hands; current front-runner for open-model realism.
Veras / Krea / Maket / DesignAI
Design-specialised tools (render-from-model, real-time canvas, floor plans, Indian interiors)
Relevant controls and guardrails in exchange for range; DesignAI is Studio Matrx's own at /designai.
Workshop - map three tools with one prompt
Instead of reading comparisons, feel the differences yourself. Run one identical prompt through three tools from different corners of the map and let the results teach you the axes.
Any three text-to-image tools from different corners of the map (e.g. Midjourney, a free Stable Diffusion / Flux web space, and Adobe Firefly or Studio Matrx DesignAI). Free tiers are enough.
Goal: experience how tool choice - not just the prompt - shapes the image Inputs: three tools you can access + one shared prompt Time: ~40 minutes
- 1Pick three tools from different regions of the map, e.g. Midjourney (closed/hosted/general), a free Stable Diffusion or Flux space (open), and DesignAI or Firefly (design-specific / commercial-safe).
- 2Write one clear prompt you will not change, e.g.
a small contemporary courtyard house in Kerala, laterite and teak, warm evening light, architectural photograph. Run it in all three. - 3Lay the three results side by side and score each honestly on: out-of-the-box beauty, how literally it followed the brief, and how much fiddling it took.
- 4For each tool, note where it sits on the four axes and one job it is clearly best for. Try one design-specific action a generalist cannot do easily - e.g. restyle a real room photo in Firefly, or render your own model in Veras/DesignAI.
- 5Write a two-line 'kit note' for yourself: which tool you would reach for at concept stage, and which for a billable client deliverable, and why.
You’ll walk away with
A one-page comparison board: the same prompt across three tools, each pinned to the four axes, with your two-line personal 'kit note' on when you'd use which.
Three altitudes on the same idea
Read the band that fits you — or all three.
Build a small, deliberate kit rather than betting on one tool. For concept and client communication, Midjourney's speed is hard to beat; for rendering your own Revit or Rhino geometry without losing it, Veras or a Stable Diffusion ControlNet workflow keeps the design yours; for anything you will publish and bill, weigh commercial safety (Firefly) above raw beauty. Choose per job, and let the axes - not the hype cycle - drive the decision.
Your work lives on the appearance axis, so the specialists pay off fastest. Firefly's generative fill restyles a real room photo with commercial cover; Krea's real-time canvas makes palette and layout exploration feel like sketching; and DesignAI is purpose-built for Indian interiors, hiding the prompt plumbing behind design-native choices. Keep Midjourney for pure mood. You will switch tools within a single client project - that is the intended workflow, not indecision.
Learn the map, not just one app - it is what stays true as tools churn. Install Stable Diffusion at least once: running an open model locally teaches you more about how these systems work than a year of hosted prompting, and it is the foundation for every control technique later in the course. Then keep a free-tier account on Firefly and DesignAI. Being able to place any new tool on the four axes is a more durable skill than being fast in yesterday's interface.
“Midjourney is the best AI tool, so I should just learn that one.”
Do it yourself
No tool needed - reason it through.
- 1Name the four axes that separate generative image tools.
- 2Why can you build a ControlNet workflow on Stable Diffusion but not on Midjourney?
- 3Which tool would you reach for to restyle a real project photograph, and why?
- 4What does 'commercial safety' mean, and when does it outrank aesthetics?
- 5Give one job where a design-specific tool beats a generalist, and one where the reverse is true.
The one line to carry out
Peer-reviewed journals & authoritative standards
- 01Podell, D., et al. - SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesis — arXiv preprint, 2023.
- 02Midjourney - Official Documentation (models, subscriptions, parameters) — Midjourney, Inc., 2026.
- 03Stability AI - Stable Diffusion (open model family) — Stability AI, 2026.
- 04Adobe - Firefly FAQ (training data and commercial use) — Adobe Inc., 2026.
- 05Black Forest Labs - FLUX models — Black Forest Labs, 2026.
You can now place any tool on the map - but a map of tools is not a map of their _abilities_. Whichever you pick, all of them share the same hard limits. Next we draw the honest ledger of what generative AI can and cannot do.
The author
Amogh N P
Architect, interior designer, and creative polymath. Studio Matrx began in his notebooks — his vision of design made honest, useful, and open to everyone. Its Academy is written and taught in his memory, and free, forever.
More about Amogh →