SensOFormer: Foundation Models for Particle Accelerators
cs.LG, physics.acc-ph
Submitted: 2026-11-01
Updated: 2026-11-01
Code: https://github.com/SalesforceAIResearch/uni2ts
Project page: https://mahindrautela.github.io/sensoformer
Terminology
Sources
- On the Opportunities and Risks of Foundation Models
- Training Compute-Optimal Large Language Models
- Perceiver IO: A General Architecture for Structured Inputs & Outputs
- Scaling Laws for Neural Language Models
- Ti-MAE: Self-Supervised Masked Time Series Autoencoders
- A Time Series is Worth 64 Words: Long-term Forecasting with Transformers
- FM4NPP: A Scaling Foundation Model for Nuclear and Particle Physics
- How Do Vision Transformers Work?
- MORPH: PDE Foundation Models with Arbitrary Data Modality
- Foundation Models for Discovery and Exploration in Chemical Space
- Anti-Oversmoothing in Deep Vision Transformers via the Fourier Domain Analysis: From Theory to Practice
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis