The sketch is the spec now
tldraw’s Make Real turns a drawing into a working page on the canvas, and lets you scribble notes on the result and run it again. A rough sketch used to start a conversation. Now it’s an instruction.
Last week tldraw shipped Make Real. Draw an interface on the canvas, select it and press the button. GPT-4 with vision looks at the drawing and returns a single HTML file, which appears on the canvas as a working page. If it’s wrong, you draw arrows and notes on the result and press the button again. The previous version goes back to the model along with your marks.
It grew out of Sawyer Hood’s draw-a-ui, which passed 10,000 GitHub stars, and Slashdot picked it up the day after launch. Steve Ruiz, tldraw’s founder, described the setup: “You’ve got a canvas that can hold the whole internet and an AI that can see and think.”
What a sketch was for
For most of my career, a rough sketch was a question. You drew three boxes and an arrow, put it in front of people, and the conversation filled in the rest. The roughness was useful. It told everyone the details weren’t decided, so they argued about the structure instead of the shade of blue.
A sketch used to start a conversation with people. Now a sketch is an instruction to a machine that fills every blank with the most likely answer. Leave the empty state undrawn and you get a generic one. Skip the error and there won’t be one. The model doesn’t know which blanks you left on purpose.
Draw the decisions
So the skill shifts a little. A sketch for Make Real should contain the decisions you care about and mark everything else as open.
When I redesigned Uber Studio, the first question was where three things lived on one screen: the accounts, the map and the stream of messages. We drew two answers and pushed one of them to higher fidelity to see what it cost. Those sketches were about one decision each, and everything else on them was placeholder.
That’s how I’d sketch for a tool like this. One decision per drawing, made clearly. Then let the model fill the rest, look at what it chose, and correct it with a note.
The note is the interesting part
The best idea in Make Real is the second press. You critique the output by drawing on it, the same way a design review works, and the next version answers the note. Writing feedback on a page is something designers already know how to do. I didn’t expect it to become the interface.