OpenAI「Sol」がデザイン嗜好を習得

We benchmarked GPT-5.6 Sol on Design Arena’s Web Design (Non-Agentic) Arena, and we were surprised to find that it ranks 1st overall. This is 18 places higher than its predecessor GPT-5.5, and is the first time an OpenAI model has placed first on this leaderboard. We dug deeper and broke down the deployments of GPT-5.6 Sol to track which frontend coding tasks the model excels at:

• GPT-5.6 Sol appears to recognize and actively suppress common AI design anti-patterns. We projected the CLIP embeddings of 1,000 websites generated by GPT-5.6 using UMAP to visualize the model’s design manifold. Shockingly, we found that its design space contains clear gaps where GPT-5.5 produces purple gradients, bento-box layouts, oversized hero text, and offset compositions, suggesting that GPT-5.6 has learned these AI-anti patterns but selectively avoids generating them.
• It combines strong templates with unusually high personalization. GPT-5.6 Sol starts from proven design structures but adapts them substantially to each prompt, striking a better balance between consistency and variety than either heavily templated or fully unconstrained models.

GPT 5.6 Sol establishes two new Pareto frontiers for both preference vs speed and preference vs price. It is over 2.44x faster than GLM 5.2 (previously ranked 1st) and 36% faster than Claude Fable 5, with a price of $5/$30 per 1 million tokens versus Claude Fable 5’s $10/$50 per 1 million tokens.

So what changed in GPT-5.6 Sol’s website outputs?

We discovered GPT-5.6 Sol’s design taste has been carefully curated to avoid AI anti-patterns that lead to generic aesthetics. This specialization in design, unique approach to templating, and remarkable multimodal performance places GPT-5.6 Sol first on our single-turn leaderboards.

Model Behavior #1: Explicit Avoidance of AI Anti-Patterns

In our review of GPT-5.5 three months ago, we identified a set of “design smells” that GPT-5.5 consistently produced. These design smells included large typefaces instead of hero images, unusual layout decisions, and overused purple gradients. We’re happy to say that most of these design smells have completely vanished in GPT-5.6 Sol.

While GPT-5.6 Sol is not the only model to solve the anti-pattern issue, it takes a unique approach that’s worth highlighting. We projected the CLIP embeddings of 1,000 websites generated by GPT-5.6 using UMAP to visualize the model’s design manifold: the region of the larger CLIP embedding space occupied by its generations. Find that visualization below.

We were shocked to discover strange holes in the resulting subspace.

These holes are not present in other models, such as in the GPT-5.5 visualization below, since most models produce web designs similar to other previously generated designs, with variations only coming from the prompt itself. Since UMAP projection theoretically preserves holes in the manifold (assuming the right projection parameters), finding holes in one model’s design space, yet not in another model’s, signals that GPT-5.6 Sol may have a cluster of designs within those holes that it’s not generating.

To figure out what designs are within these holes, we overlapped GPT-5.6 Sol and GPT-5.5’s websites within the same embedding space and conducted the same UMAP projection as earlier. From there, we colored all of the GPT-5.6 Sol generations orange, then stacked those on top of GPT-5.5’s generations. Any regions without orange would be patterns specific to GPT-5.5, while any regions with orange would be specific to GPT-5.6 Sol.**

This becomes even clearer if we remove the screenshots and replace GPT-5.5 and GPT-5.6 Sol specific generations with blue and orange dots respectively. This gives us the visualization below, where we can see GPT-5.5 and GPT-5.6 Sol generate mostly similar websites, with GPT-5.6 Sol showing slightly more variance than GPT-5.5. However, there is one major cluster where GPT-5.5 and GPT-5.6 Sol don’t overlap at all: the cluster for websites with purple gradients.**

While GPT-5.6 Sol produces largely similar designs to GPT-5.5, there is a clear effort when it comes to avoiding many common AI anti-patterns. We see the same effect for other anti-patterns, like bento box layouts, large typefaces in hero images, and offset layouts.

This approach is notably different from other models. For example, GLM-5.2 avoids anti-patterns such as large typefaces by learning a set of templates that do not include them. This avoids anti-patterns without creating holes in the generated space since GLM-5.2 simply avoids generating designs with anti-patterns entirely.

While GLM-5.2 appears to have avoided learning design anti-patterns at all (and thus avoids producing them), it appears as if GPT-5.6 Sol has learned that specific design anti-patterns exist, but refuses to produce them. Despite its avoidance of common anti-patterns, this approach doesn’t generalize to all anti-patterns. For example, GPT-5.6 Sol consistently overuses confetti, which appears in over 26.5% of generations. It even goes to the extent of hand-rolling its own confetti libraries when none are provided.

The model also has lower performance when creating charts and data visualizations since it does not excel at utilizing chart.js for creating realistic charts.

Model Behavior #2: Customized Templates Strike the Balance Between Generalization and Specialization

One of the primary signals we measure for model performance is “templating”, where models simulate design taste by learning a set of high-performing templates that play well on the arena. This is normal for frontier-level models, and in a previous analysis for GLM 5.2, we found that this strategy allowed it to reach the first place position on our leaderboard.

Compare this to Claude Fable 5, which we found to have almost no templating. It has a far more varied design space, personalizing each output to the user’s needs.

GPT-5.6 Sol combines the two design approaches by utilizing templates, but making far more changes to create variance within each cluster. Much like how bacteria evolves into different related genetic strains, the model has similar clusters of designs that are then further personalized to a user’s prompt. This is especially apparent when it comes to GPT-5.6 Sol’s use of images, as the model tends to utilize the same image for multiple different contexts and use cases.

This personalization is precisely why GPT-5.6 Sol performs so well on Design Arena, as every user receives a customized website for their use case that still feels as if it were professionally designed.

What this means for model selection

Taken together, these findings suggest that GPT-5.6 Sol’s advantage comes from being both more selective and more adaptive. It appears to have (1) learned which visual patterns make AI-generated websites feel generic, then actively suppresses them, while still preserving a set of reliable design structures that it can customize to each prompt, and (2) combines templated designs with customized outputs. These are some of the primary indicators that have resulted in GPT-5.6 Sol leading the Design Arena leaderboard.We will continue to monitor GPT-5.6 Sol's performance and how it compares to other models. Congratulations to the OpenAI team on the launch, and try out GPT-5.6 Sol yourself on DesignArena.ai.