An Alternative Trajectory for Generative AI
cs.AI, cs.LG
Submitted: 2026-03-14
Updated: 2026-11-03
License: http://creativecommons.org/licenses/by/4.0/
The gist: The generative artificial intelligence (AI) ecosystem is undergoing rapid transformations that threaten its sustainability.
Terminology
Abstract
The generative artificial intelligence (AI) ecosystem is undergoing rapid transformations that threaten its sustainability. As models transition from research prototypes to high-traffic products, the energetic burden has shifted from one-time training to recurring, unbounded inference. This is exacerbated by reasoning models that inflate compute costs by orders of magnitude per query. The prevailing pursuit of artificial general intelligence through scaling of monolithic models is colliding with hard physical constraints: grid failures, water consumption, and diminishing returns on data scaling. This trajectory yields models with impressive factual recall but struggles in domains requiring in-depth reasoning, possibly due to insufficient abstractions in training data. Current large language models (LLMs) exhibit genuine reasoning depth only in domains like mathematics and coding, where rigorous, pre-existing abstractions provide structural grounding. In other fields, the current approach fails to generalize well. We propose an alternative trajectory based on domain-specific superintelligence (DSS). We argue for first constructing explicit symbolic abstractions (knowledge graphs, ontologies, and formal logic) to underpin synthetic curricula enabling small language models to master domain-specific reasoning without the model collapse problem typical of LLM-based synthetic data methods. Rather than a single generalist giant model, we envision "societies of DSS models": dynamic ecosystems where orchestration agents route tasks to distinct DSS back-ends. This paradigm shift decouples capability from size, enabling intelligence to migrate from energy-intensive data centers to secure, on-device experts. By aligning algorithmic progress with physical constraints, DSS societies move generative AI from an environmental liability to a sustainable force for economic empowerment.
Sources
- Phi-4 Technical Report
- Benchmarking Vector, Graph and Hybrid Retrieval Augmented Generation (RAG) Pipelines for Open Radio Access Networks (ORAN)
- The De-democratization of AI: Deep Learning and the Compute Divide in Artificial Intelligence Research
- Project Sid: Many-agent simulations toward AI civilization
- Dimensions of Neural-symbolic Integration - A Structured Survey
- The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"
- ChemCrow: Augmenting large-language models with chemistry tools
- Proof of Reasoning for Privacy Enhanced Federated Blockchain Learning at the Edge
- Machine Learning as a Tool (MLAT): A Framework for Integrating Statistical ML Models as Callable Tools within LLM Agent Workflows
- Internet of Agents: Weaving a Web of Heterogeneous Agents for Collaborative Intelligence
- On the Measure of Intelligence
- Bottom-up Domain-specific Superintelligence: A Reliable Knowledge Graph is What We Need
- Logic Tensor Networks for Semantic Image Interpretation
- Scalable Vision Language Model Training via High Quality Data Curation
- From Local to Global: A Graph RAG Approach to Query-Focused Summarization
- SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoning
- Generative AI vs. AGI: The Cognitive Strengths and Weaknesses of Modern LLMs
- Textbooks Are All You Need
- LLM Knowledge is Brittle: Truthfulness Representations Rely on Superficial Resemblance
- Understanding the Effect of Noise in LLM Training Data with Algorithmic Chains of Thought
Related papers
- Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization
- MAVEN-T: Reinforced Heterogeneous Distillation for Real-Time Multi-Agent Trajectory Prediction
- Model Discovery Agent: LLM-assisted Bayesian experiment design for data-efficient discovery of mechanistic world models
- Embeddings for Preferences, Not Semantics
- Can We Trust Item Response Theory for AI Evaluation?
- Diagnosing Task Insensitivity in Language Agents