Invent a Dataset: Measuring dataset generation abilities with zero seed
cs.LG
Submitted: 2026-10-01
Updated: 2026-10-01
Code: https://github.com/tatsu-lab/stanford_alpaca
Project page: https://adaptionlabs.ai/invent-a-dataset
Sources
- A Survey on Data Selection for Language Models
- On the Stability of Iterative Retraining of Generative Models on their own Data
- Which Prompts Make The Difference? Data Prioritization For Efficient Human LLM Evaluation
- Large Language Models Suffer From Their Own Output: An Analysis of the Self-Consuming Training Loop
- Model Collapse Demystified: The Case of Regression
- The Curious Case of Neural Text Degeneration
- FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
- The Stack: 3 TB of permissively licensed source code
- Autodata: An agentic data scientist to create high quality synthetic data
- DatasetResearch: Benchmarking Agent Systems for Demand-Driven Dataset Discovery
- A Survey on Open Dataset Search in the LLM Era: Retrospectives and Perspectives
- G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment
- On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey
- WizardCoder: Empowering Code Large Language Models with Evol-Instruct
- When Less is More: Investigating Data Pruning for Pretraining LLMs at Scale
- Does Writing with Language Models Reduce Content Diversity?
- Standardizing the Measurement of Text Diversity: A Tool and a Comparative Analysis of Scores
- The Curse of Recursion: Training on Generated Data Makes Models Forget
- Galactica: A Large Language Model for Science
- A Survey on Data Synthesis and Augmentation for Large Language Models
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks