Curating Same-Family Neural Networks for LLM-Guided Model Improvement: A Controlled Case Study
cs.LG, cs.CV
Submitted: 2026-07-06
Updated: 2026-08-26
Comments: 17 pages, 1 figure
License: http://creativecommons.org/licenses/by/4.0/
The gist: Neural-network repositories contain executable models, recipes, input transformations, and measured accuracies.
Terminology
Abstract
Neural-network repositories contain executable models, recipes, input transformations, and measured accuracies. We study whether one same-family experiment can be curated as prompt guidance for LLM-based improvement of a low-performing target under equal generation and evaluation budgets. TuneNNGen extends NNGPT with a source-guided route and compares it with target-only generation on one CIFAR-10 target, two fixed source-selection rules, three code LLMs, and an additional SVHN target. Under the historical one-epoch search protocol, best-of-budget accuracy on the available evaluation split rises from 23.98% to 50.49% on CIFAR-10 and from 22.54% to 78.80% on SVHN. Selected five-epoch, three-seed means on train-derived validation splits retain gains of 40.94 points on CIFAR-10, 18.83 on Imagenette, and 7.27 on CIFAR-100. Direct-copy and negative-control analyses show that gains depend on source-target compatibility and LLM adaptation; stored source accuracy alone does not predict transferability.
Sources
- Evaluating Large Language Models Trained on Code
- LEMUR Neural Network Dataset: Towards Seamless AutoML
- Resource-Efficient Iterative LLM-Based NAS with Feedback Memory
- EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizers
- LLMatic: Neural Architecture Search via Large Language Models and Quality Diversity Optimization
- AutoML-Zero: Evolving Machine Learning Algorithms From Scratch
- Large Language Models as Optimizers
- Neural Architecture Search with Reinforcement Learning
Related papers
- Polynomial-Augmented Neural Networks (PANNs) with Weak Orthogonality Constraints for Enhanced Function and PDE Approximation
- AIRL-S: Unifying Reinforcement Learning and Search-Based Test-Time Scaling via Adversarial Inverse Reinforcement Learning
- Transformers as Bayesian In-Context Experimenters: Smoothness-Adaptive Efficient ATE Estimation
- Convergence issues in Relational Concept Analysis based on AOC-posets
- Beliefs Beyond Posteriors: The Predictive Cost of ELBO Binding
- Understanding Diffusion Models via Ratio-Based Function Approximation with SignReLU Networks