DIMWIT: Directly Invoking Models Without Intensive Tuning
cs.PF, cs.AI, cs.CV, cs.DC, cs.OS
Submitted: 2026-11-01
Updated: 2026-11-01
Code: https://github.com/mitosis-project/mitosis-workload-btree
License: http://creativecommons.org/licenses/by/4.0/
The gist: Resource managers typically encode what to do in a task-specific policy---a heuristic, an optimization procedure…
Terminology
Abstract
Resource managers typically encode what to do in a task-specific policy---a heuristic, an optimization procedure, or a model trained for the task---that must be developed before use and may need revision as the workload or system changes. We propose bypassing policy development and instead asking pretrained models to make resource-management decisions directly, given the current system state, desired outcome, and available choices. We evaluate this approach on microservice autoscaling, DRAM sizing, and video encoding, using a frontier LLM and two small decision models. On two microservice applications, a small decision model meets latency targets while using within 10% of the replicas allocated by policy-based autoscalers and within 13% of the frontier LLM. In DRAM sizing, a small decision model reduces DRAM usage by up to 27.5% relative to static provisioning while maintaining at least 95% of baseline performance. In video encoding, it completes encodes up to 4.3 times faster than the frontier LLM, with an imperceptible 1.1-point decrease in Video Multi-Method Assessment Fusion (VMAF), a metric of perceptual video quality. Making individual resource-management decisions may be considerably simpler than developing a general strategy for making them.
Sources
- The GAP Benchmark Suite
- Tuning Fast Memory Size based on Modeling of Page Migration for Tiered Memory
- Barbarians at the Gate: How AI is Upending Systems Research
- Agar: What-If Analysis for Microservice Applications
- Vulcan: Instance-specialized, Verifiable Systems Heuristics Through LLM-driven Search
- ARMS: Adaptive and Robust Memory Tiering System
Related papers
- Instruction-Aware Transfer of GPU Implementation Crossovers: a Tensor-Product Discontinuous Galerkin Operator on GB200, H100, and A100
- denet, A lightweight command-line tool for process monitoring in benchmarking and beyond
- HybridQC: Hardware-Grounded Simulation of Tightly Integrated Hybrid Quantum-Classical Systems
- TileBench: A Controlled Benchmark for Performance Evaluation and Bottleneck Diagnosis of Tile-Based Programming Models
- The M/PH 2/1 Queue: Explicit Distributions, Sojourn Times and Numerical Benchmarks
- Rolling Round-Robin Rate: Standard Heterogeneous Throughput for SPEC CPU