A Historical Trajectory Assisted Optimization Method for Zeroth-Order Federated Learning
cs.LG, cs.AI
Submitted: 2024-09-24
Updated: 2026-11-09
Terminology
Sources
- Federated Learning of Large Language Models with Parameter-Efficient Prompt Tuning and Adaptive Optimization
- Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models
- FedBPT: Efficient Federated Black-box Prompt Tuning for Large Language Models
- Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
- Adaptive Federated Optimization
- Hessian-Aware Zeroth-Order Optimization for Black-Box Adversarial Attack
- FedZeN: Towards superlinear zeroth-order federated learning via incremental Hessian estimation
- Federated Zeroth-Order Optimization using Trajectory-Informed Surrogate Gradients
Related papers
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis
- (Mis)generalization of Helpful-Only Fine-tuning