Deterministic, Reproducible Inference in Exact Integer Arithmetic, and Verifiable Distributed Inference as Its Consequence
cs.LG, cs.DC, cs.SE
Submitted: 2026-11-10
Updated: 2026-11-10
Code: https://github.com/pelloran-inc/tritify
Terminology
Sources
- I-BERT: Integer-only BERT Quantization
- I-ViT: Integer-only Quantization for Efficient Vision Transformer Inference
- I-LLM: Efficient Integer-Only Inference for Fully-Quantized Low-Bit Large Language Models
- Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference
- The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits
- QuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice Codebooks
- SpinQuant: LLM quantization with learned rotations
- Petals: Collaborative Inference and Fine-tuning of Large Models
- Slalom: Fast, Verifiable and Private Execution of Neural Networks in Trusted Hardware
- Efficient Memory Management for Large Language Model Serving with PagedAttention
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis