Have LLMs hit a wall, or is AI still getting smarter?

Consensus answer

The short answer is that AI has not stopped progressing, but the field is currently experiencing a major transition. The era of brute-force scaling—simply adding more raw data and computing power to make large language models (LLMs) bigger—is facing diminishing returns adeaca hec. While AI is absolutely still getting smarter, the methods driving that progress have fundamentally changed.

Why It Feels Like a Wall The perception that AI has "hit a wall" stems from the limitations of the classic pre-training recipe:

Diminishing Returns on Scale: The original scaling laws are showing signs of slowing down hec. As models approach the performance ceiling of their current architectures, each incremental improvement requires exponentially more resources. Consequently, the user-perceived leaps in capability (such as the jump from older models to recent ones) feel smaller, and leading consumer chatbots are heavily converging in performance buildfastwithai stanford.
Data Exhaustion: High-quality, human-generated public text is rapidly being depleted. Current consumption patterns suggest this data could run out between 2026 and 2028 arxiv.
Physical and Economic Constraints: Soaring computational costs, immense power demands, and chip manufacturing limits are creating significant bottlenecks epoch.
"Jagged" Intelligence: Even the most advanced models exhibit uneven capabilities. They can successfully solve expert-level Olympiad math but still struggle with surprisingly simple reliability or perception tasks, such as accurately reading an analog clock stanford.

How AI is Still Getting Smarter Rather than hitting a definitive cognitive ceiling, the industry has bypassed the scaling wall by shifting focus to new drivers of intelligence adeaca:

Inference-Time (Test-Time) Compute: Instead of relying purely on knowledge baked in during pre-training, newer models are designed to "think," verify logic, and search before generating an answer. This creates a second scaling dimension where giving an AI more computing power during the generation phase drastically improves complex problem-solving and reasoning google oneusefulthing.
Advanced Post-Training and Reinforcement Learning (RL): RL is being heavily utilized to refine model accuracy, behavior, and efficiency, offering significant runway for improvement beyond raw data limits medium google google.
Synthetic Data: To overcome the impending shortage of human text, researchers are successfully utilizing high-quality, AI-generated synthetic data to continue training advanced systems google google.
Architectural Efficiency: Innovations like Mixture of Experts (MoE) allow models to drastically increase their capacity and parameter count without demanding exponentially more compute during operation google google. There is also a broader industry pivot toward utilizing smaller, highly specialized, domain-specific models rather than solely relying on massive general-purpose LLMs adeaca.
Agents and Tool Use: AI is moving from passive text generation to active task completion. On rigorous benchmarks, frontier models are showing sharp improvements; for example, success rates on complex software engineering evaluations have risen from roughly 60% to near 100% in a single year stanford, and autonomous agent accuracy on operating system tasks has jumped from 12% to over 66% stanford. However, there remains ongoing debate, with some researchers citing potential mathematical limits on how far purely agentic tasks can scale medium.

Bottom Line AI has not hit a wall. Instead, the "easy" gains from simply building bigger LLMs are tapering off, marking the end of the brute-force scaling era. AI continues to advance steadily through improved reasoning capabilities, reinforcement learning, architectural breakthroughs, and highly capable agentic systems. Progress is shifting from explosive leaps in general model size to more diversified, efficient, and reliable problem-solving.

Sources

Cite this answer

consens.io. (2026-06-16). Consensus answer to "Have LLMs hit a wall, or is AI still getting smarter?". Models consulted: OpenAI, Mistral, Anthropic Claude, Google Gemini, DeepSeek, Grok. Consensus model: Gemini-Pro. Sources: https://www.adeaca.com/blog/the-llm-scaling-wall-is-here-whats-next-for-ai/, https://medium.com/data-science-collective/what-does-the-future-of-ai-look-like-if-we-hit-the-llm-scaling-wall-6323b8f72e79, https://www.buildfastwithai.com/blogs/llm-scaling-laws-explained, https://arxiv.org/abs/2503.08223, https://medium.com/@aftab001x/the-end-of-llms-as-we-know-them-why-2026-marks-the-beginning-of-ais-next-architecture-revolution-902ee29484f7, https://magazine.sebastianraschka.com/p/state-of-llms-2025, https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGOC0h4-WXXuMsLeIYphmWQvUxMqGWNWXAlfMkOdMrqsRXyKoaEcSqghgVIg9E4kiVeRTYlISfZ6qm0vcNAtsfSGEyWiMvwhG5YoeqiHsroJn-NJzQZbM3Qt-JiqpSsnLDuV69N2tIfuhcHdV1b15BOFkI4R3OtMaX7ee1PmsYMfeEMWy_BEpwli2gpH-ggdQSZEnkCWMtT2Eovp9MXvOegK5Nym3pkLPOJ, https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQEE-p9zkoxAXwPTiEDcW7mr6Eou1lpyvo2lEoDkty2ltJ8hpNP5CovzUvkAY5q86QT04VlZ96MIxOtHMnUT60uRdbmAZFFREIKDM2JcldfKjciqiuxKU7FyE0vaDjpJ11p2rOFewogP5YMk7WJYHzGlQk_BRGs=, https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQHXbd_FK5D5ujXTJSD5_iNlxWBa5J4lQQeRZiPklRnCNjkqzGTGAHmw14u_K2UB9R1QsE8J_VqM65mY05snLowXDzdIDT1XgCRIxpyrPznvVgN8q7iZaY2b, https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGHNHcPb7KstvL1KRctZKCYerXs1zXGiM-wZrRIY8m5gsaf05Y64d8ImH-pPAhewYvVBsYyIejyeN32bxqFp9v34_6er7Ux3bzPdA5ED1ufcrUeoJ48Aw07vi7A86zK6jm7IMPyXntWG4I=, https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQE00CMnAKENZZ8WeP13KbaPmyUE2rVWtyO5yTNNiR9EzAeYdymQoNSk_SfUJeYG3X4myG-4-8Ln0cRKhjxeLlgGl0EnFxj-0Z0Lhmso0tnjMPCqHOrphVpOuxugAA==, https://vertexaisearch.cloud.google.com/grounding-api-redirect/AUZIYQGzZFfSdIGNV39yh2bz4Vt5hT2xmqZxz2Y5rFHi-Fvcgbg_xWHZm8Ua7yCRbsVL_XQtZewNdjKkcgAcDh44ym9zY4Z8d9iYfk1M_A4zHgAte5F2EJ1qSQ9bylo6jwPj7jy67a-Zq1XP1ghHv8Ho4V6M2MgsYxkJ2rRsIzFhjPGBIf8FCyUi20aHmtaVmLYNMiQGZ7Y=, https://www.hec.edu/en/dare/tech-ai/ai-beyond-scaling-laws, https://arxiv.org/html/2503.08223v1, https://arxiv.org/pdf/2602.21012, https://www.oneusefulthing.org/p/scaling-the-state-of-play-in-ai, https://hai.stanford.edu/news/new-approach-to-scaling-laws-could-change-how-ai-models-are-trained, https://gizmodo.com/ai-agents-are-poised-to-hit-a-mathematical-wall-study-finds-2000713493, https://www.nateberkopec.com/blog/thoughts-on-llms-in-2026/, https://hai.stanford.edu/ai-index/2026-ai-index-report, https://hai.stanford.edu/ai-index/2026-ai-index-report/technical-performance, https://metr.org/time-horizons/, https://epoch.ai/publications/can-ai-scaling-continue-through-2030?utm_source=openai Retrieved from https://www.consens.io/s/have-llms-hit-a-wall-or-is-ai-still-getting-smarter-gtIX4vz6ceCIpbXG

Ask your own question

Consensus answer

Differences

Whether the scaling laws themselves are hitting a wall or if progress is just shifting.

Sources

Cite this answer

Related questions