consens.io
Product Watches Topics Questions Benchmark
Watches Topics Questions Benchmark
Ask your own question

Shared consensus

Have LLMs hit a wall, or is AI still getting smarter?

2026-06-16
  • 6 AI models
  • 1 contradiction
  • 17 sources
Consensus Google Gemini Gemini 3.1Pro
Models consulted
  • OpenAI OpenAI
  • Mistral Mistral
  • Anthropic Claude Anthropic Claude
  • Google Gemini Google Gemini
  • DeepSeek DeepSeek
  • Grok Grok

Consensus answer

The short answer is that AI has not stopped progressing, but the field is currently experiencing a major transition. The era of brute-force scaling—simply adding more raw data and computing power to make large language models (LLMs) bigger—is facing diminishing returns.[1] [13] While AI is absolutely still getting smarter, the methods driving that progress have fundamentally changed.

Why It Feels Like a Wall The perception that AI has "hit a wall" stems from the limitations of the classic pre-training recipe:

  • Diminishing Returns on Scale: The original scaling laws are showing signs of slowing down.[13] As models approach the performance ceiling of their current architectures, each incremental improvement requires exponentially more resources. Consequently, the user-perceived leaps in capability (such as the jump from older models to recent ones) feel smaller, and leading consumer chatbots are heavily converging in performance.[3] [21]
  • Data Exhaustion: High-quality, human-generated public text is rapidly being depleted. Current consumption patterns suggest this data could run out between 2026 and 2028.[14]
  • Physical and Economic Constraints: Soaring computational costs, immense power demands, and chip manufacturing limits are creating significant bottlenecks.[23]
  • "Jagged" Intelligence: Even the most advanced models exhibit uneven capabilities. They can successfully solve expert-level Olympiad math but still struggle with surprisingly simple reliability or perception tasks, such as accurately reading an analog clock.[21]

How AI is Still Getting Smarter Rather than hitting a definitive cognitive ceiling, the industry has bypassed the scaling wall by shifting focus to new drivers of intelligence [1]:

  • Inference-Time (Test-Time) Compute: Instead of relying purely on knowledge baked in during pre-training, newer models are designed to "think," verify logic, and search before generating an answer. This creates a second scaling dimension where giving an AI more computing power during the generation phase drastically improves complex problem-solving and reasoning.[16]
  • Advanced Post-Training and Reinforcement Learning (RL): RL is being heavily utilized to refine model accuracy, behavior, and efficiency, offering significant runway for improvement beyond raw data limits.[2]
  • Synthetic Data: To overcome the impending shortage of human text, researchers are successfully utilizing high-quality, AI-generated synthetic data to continue training advanced systems.
  • Architectural Efficiency: Innovations like Mixture of Experts (MoE) allow models to drastically increase their capacity and parameter count without demanding exponentially more compute during operation. There is also a broader industry pivot toward utilizing smaller, highly specialized, domain-specific models rather than solely relying on massive general-purpose LLMs.[1]
  • Agents and Tool Use: AI is moving from passive text generation to active task completion. On rigorous benchmarks, frontier models are showing sharp improvements; for example, success rates on complex software engineering evaluations have risen from roughly 60% to near 100% in a single year [20], and autonomous agent accuracy on operating system tasks has jumped from 12% to over 66%.[21] However, there remains ongoing debate, with some researchers citing potential mathematical limits on how far purely agentic tasks can scale.[2]

Bottom Line AI has not hit a wall. Instead, the "easy" gains from simply building bigger LLMs are tapering off, marking the end of the brute-force scaling era. AI continues to advance steadily through improved reasoning capabilities, reinforcement learning, architectural breakthroughs, and highly capable agentic systems. Progress is shifting from explosive leaps in general model size to more diversified, efficient, and reliable problem-solving.

Differences

1 notable difference (1 contradiction) across 6 models.

contradiction

Whether the scaling laws themselves are hitting a wall or if progress is just shifting.

Scaling laws are hitting a wall.

Mistral, Grok

“LLMs have largely hit a scaling wall”

Scaling laws still hold and remain useful.

Anthropic

“Scaling laws still hold across modalities and remain useful engineering tools.”

How to verify: Check if scaling laws are considered broken or just less effective for general-purpose model growth.

Best answerOpenAI

Sources

  1. 1 The LLM Scaling Wall is Here. What's Next for AI? - The Results-Driven Microsoft Partner for Project-Centric Enterprises adeaca.com
  2. 2 What if AI Hits a Scaling Wall? The Future of LLMs, Small Models, and AI Agents | by Rohit Patel | Data Science Collective medium.com
  3. 3 LLM Scaling Laws Explained: Will Bigger AI Models Always Win? (2026) buildfastwithai.com
  4. 4 [2503.08223] Will LLMs Scaling Hit the Wall? Breaking Barriers via Distributed Resources on Massive Edge Devices arxiv.org
  5. 5 The End of LLMs As We Know Them: Why 2026 Marks the Beginning of AI’s Next Architecture Revolution | by Aftab | Medium medium.com
  6. 6 The State Of LLMs 2025: Progress, Progress, and Predictions magazine.sebastianraschka.com
  7. 13 AI Beyond the Scaling Laws | HEC Paris hec.edu
  8. 14 Will LLMs Scaling Hit the Wall? Breaking Barriers via Distributed Resources on Massive Edge Devices arxiv.org
  9. 15 International AI Safety Report 2026 arxiv.org
  10. 16 Scaling: The State of Play in AI - by Ethan Mollick oneusefulthing.org
  11. 17 New Approach to Scaling Laws Could Change How AI Models ... hai.stanford.edu
  12. 18 AI Agents Are Poised to Hit a Mathematical Wall, Study Finds gizmodo.com
  13. 19 Thoughts on LLMs in 2026 nateberkopec.com
  14. 20 The 2026 AI Index Report | Stanford HAI hai.stanford.edu
  15. 21 Technical Performance | The 2026 AI Index Report | Stanford HAI hai.stanford.edu
  16. 22 Task-Completion Time Horizons of Frontier AI Models - METR metr.org
  17. 23 Can AI scaling continue through 2030? | Epoch AI epoch.ai

Cite this answer

consens.io. (2026-06-16). Consensus answer to "Have LLMs hit a wall, or is AI still getting smarter?". Models consulted: OpenAI, Mistral, Anthropic Claude, Google Gemini, DeepSeek, Grok. Consensus model: Gemini-Pro. Sources: https://www.consens.io/s/have-llms-hit-a-wall-or-is-ai-still-getting-smarter-gtIX4vz6ceCIpbXG#shareSources. Retrieved from https://www.consens.io/s/have-llms-hit-a-wall-or-is-ai-still-getting-smarter-gtIX4vz6ceCIpbXG

Ask your own question

Related questions

  • Is Gemini 4 Argon actually better than GPT-6 Astra for software engineering? 6 models compared
  • Is GPT-6 Sol actually better value than Claude Opus 5.5 for coding? 5 models compared
  • How is Anthropic developing Claude into a system for autonomous biological research and laboratory automation? 5 models compared
  • Is GLM-5.3-Flash actually better than DeepSeek V4 Flash for coding? 6 models compared

About this consensus

6 AI models answered this question independently on 2026-06-16. A judge model then cross-checked the answers, scored how far they agree and flagged where they differ.

AI models can make mistakes – verify important information against the sources above.

How consensus works →

Thanks – this page has been reported for review.

© 2026 consens.io
App Topics Questions Model pulse Benchmark Model guide How consensus works About Terms Privacy Imprint