AI Is Smart Enough,

Let's Just Point and Talk to it ;)

An exploration of multi-input interaction with AI Interfaces, Nov 2025 - Mar 2026

For the first time, I encountered a technology that can almost understand me like other humans do: grasp context, interpret meaning, respond to nuance. Yet we're still typing into little input boxes. So revolutionary for 2026. I can't help but wonder if its the interface that's holding us back. If the AI is human enough to understand us, maybe the interface should let us be a little more human too.

Human communication is wonderfully chaotic if you think about it... we point at things mid-sentence. We gesture vaguely and expect people to understand. Nobody talks like a search query: "Please reference the third blue object from the right". Point and Talk explores how to interact with AI interfaces using natural human behaviors, and whether the responses we get back can feel just as alive.

0:00 / 0:00
1. Select and tap
2. Pull from anywhere
3. Stack your inputs
4. Expand
Same as with text, you can circle and select a specific part of an image. Here, the system generates color options as selectable UI. Color can be compact, so it shows up as something you can just tap through rather than swipe.
From there the selection becomes a reference point. Instead of choosing from presets, you can pull a color from anywhere else on the screen and bring it back to what you selected. The source becomes part of the input.
And then it goes further. You can make multiple selections at once, each one carrying its own instruction. Draw a gesture in between to describe the relationship between them. Your doing what would take several steps in an editing tool.
Finally, a expansion of what you can do with you edits. Nothing related to point and draw, just thought it looks cool ;)
Same as with text, you can circle and select a specific part of an image. Here, the system generates color options as selectable UI. Color can be compact, so it shows up as something you can just tap through rather than swipe.