AskALCF: A Self-Improving Agentic System for Intelligent HPC User Support
cs.SE, cs.AI
Submitted: 2026-11-11
Updated: 2026-11-11
Terminology
Sources
- LLM as HPC Expert: Extending RAG Architecture for HPC Data
- Sufficient Context: A New Lens on Retrieval Augmented Generation Systems
- Ragas: Automated Evaluation of Retrieval Augmented Generation
- RAGChecker: A Fine-grained Framework for Diagnosing Retrieval-Augmented Generation
- Enabling Large Language Models to Generate Text with Citations
- Corrective Retrieval Augmented Generation
- Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection
- Seven Failure Points When Engineering a Retrieval Augmented Generation System
- Agent-as-a-Judge: Evaluate Agents with Agents
- Agent-as-a-Judge
- Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
- LLM Evaluators Recognize and Favor Their Own Generations
- Overconfidence in LLM-as-a-Judge: Diagnosis and Confidence-Driven Solution
- Executable Code Actions Elicit Better LLM Agents
- Identifying the Risks of LM Agents with an LM-Emulated Sandbox
- SAFARI: Scaling Long Horizon Agentic Fault Attribution via Active Investigation
- Towards Self-Improving Error Diagnosis in Multi-Agent Systems
- Trust or Escalate: LLM Judges with Provable Guarantees for Human Agreement
- Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models
- Voyager: An Open-Ended Embodied Agent with Large Language Models
Related papers
- ArkEval: Benchmarking and Evaluating Automated CodeRepair for ArkTS
- TestPrism: Rethinking Test Evaluation Beyond a Single Reference
- Mining Workflow Graphs for Black-Box Boundary Testing of Conversational LLM Agents
- Falsification-Based Verification of LLM-Generated Optimization Models: Sound Test Batteries and Their Detection Limits
- GitSkills: A Dataset of Agent Skills on GitHub
- For Coding Agents, the Repository Matters