To SIMD or Not to SIMD: Comparing RVV vs. CGRA SoCs for Non-Linear Functions in AI
cs.AR, cs.AI
Submitted: 2026-11-09
Updated: 2026-11-09
Code: https://github.com/MPSLab-ASU/ccf
Terminology
Sources
- Correctly Rounded Functions For Vector Applications: A Performance Study
- Layer Normalization
- Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning
- The Llama 3 Herd of Models
- Gaussian Error Linear Units (GELUs)
- DFX: A Low-latency Multi-FPGA Appliance for Accelerating Transformer-based Text Generation
- EdgeLLM: A Highly Efficient CPU-FPGA Heterogeneous Edge Accelerator for Large Language Models
- A Study of BFLOAT16 for Deep Learning Training
- Scaling Laws for Neural Language Models
- Kimi K3: Open Frontier Intelligence
- FP8 Formats for Deep Learning
- GLU Variants Improve Transformer
- Closer in the Gap: Towards Portable Performance on RISC-V Vector Processors
- FlashAttention-4: Algorithm and Kernel Pipelining Co-Design for Asymmetric Hardware Scaling
- Instruction Scheduling in the Saturn Vector Unit
Related papers
- Embedded Arena: Iterative Optimization via Hardware Feedback
- WitCert: Sound Runtime Risk Observability and Gating for KV-Cache Quantization
- SparsePixels: Efficient Convolution for Sparse Data on FPGAs
- Golden Ruler: A Numeric Format Catalog with Bit-Exact Conformance Vectors for FP8, BF16, MXFP4, and Microscaling Formats
- AMMA: A Multi-Chiplet Memory-Centric Architecture for Low-Latency 1M Context Attention Serving
- RFChipAgent: Multi-Agentic AI Flow for Analog/RF Chip Design