The Bitter Layout or: How I Learned to Love the Model Picker — Maximillian Piras, Yutori

The Ubiquity and Debate Around Chatbot Interfaces 00:03

  • Many AI-first applications, from chatbots to creative tools like coding assistants and Canva, have converged on a very similar layout: an input field, turn-by-turn UX, and a model picker dropdown.
  • There is a pervasive trend of retrofitting diverse AI tools into the chatbot user experience.
  • Despite ongoing debates about whether chat is the future interface for AI, actual usage patterns reinforce its dominance.
  • Designers and thought leaders have argued both against and in favor of chat interfaces, pointing out their usability issues versus their intuitive appeal and widespread practical adoption.
  • Even with convincing arguments against chat as a future paradigm, real-world usage often returns to chat-based interfaces.

The Model Picker as a Mode Selector 03:34

  • The “model picker”—a dropdown to select among various AI models—has become a central UI element alongside chat.
  • The presenter references Larry Tesler’s disdain for “modes” in UI, arguing that the model picker itself acts as a mode selector, making user interactions less intuitive.
  • Example: Users have to match specific models to desired modes, which can be confusing and reflects a compromise in usability for flexibility.
  • This illustrates the “flexibility-usability trade-off”: As products aim to support more use cases (flexibility), overall usability for specific users tends to decrease.

Product Architecture and Industry Trends 06:31

  • Effective UI and product design depends on understanding the current context, including prevailing trade-offs and technological constraints.
  • Drawing on “The Innovator’s Solution,” the speaker introduces the spectrum from “integrated” (proprietary, optimized, vertically scaled) to “modular” (commoditized, horizontally scaled) product architectures.
  • The AI industry is continually shifting between these points; as components commoditize and decommoditize, designers must strategically decide which parts to integrate and which to modularize.
  • A key question: Are AI models themselves commoditizing, or does each new model still offer a significant leap?

The Bitter Lesson and the Bitter Design Lesson 08:44

  • “The Bitter Lesson,” from Rich Sutton, suggests we shouldn’t assume computational progress plateaus as long as scaling laws persist.
  • Each new AI model triggers intense interest, implying that models themselves are not yet commoditized.
  • This leads to the “bitter design lesson”: If model performance (inference) is the main competitive edge and models aren’t commoditized, then UI design must prioritize adapting to emerging models.
  • Current “bitter layouts”—unremarkable but flexible interfaces with model pickers—excel at integrating new model capabilities, making them pragmatic despite lacking inspiration or usability.
  • Until models fully commoditize and user needs are easily met, UI must prioritize absorption of new model capabilities.

From Bitter to Sweet: The Future of AI UX Design 11:18

  • Referencing Bret Victor’s “The Future of Programming,” the speaker advocates a paradigm shift: from thinking in procedural terms to focusing on higher-level goals and constraints.
  • This mindset shift is necessary as AI-assisted apps become more dynamic, stochastic, and probabilistic; designers can no longer anticipate every possible user journey.
  • The future may involve design systems that set goals and constraints, not just for developers and users but for collaboration with generative models.
  • Quality assurance and user stories may become analogous to reinforcement learning and system prompts when partnering with AI in design.
  • Dario Amodei’s notion that generative AI systems are “grown” rather than “built” provides inspiration to approach design more like gardening than construction.
  • Embracing these lessons can help UI/UX design move past the “bitter layout” and unlock new, adaptive possibilities in the era of AI.