Vibe-FDTR: An agent-oriented framework for reproducible frequency-domain thermoreflectance data analysis

arXiv:2607.28200 · physics.app-ph, cond-mat.mtrl-sci, cs.AI · Submitted 2026-07-30 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Physics. The day in general physics: instruments, methods and results across the field.

Kai: We're looking at the paper: "Vibe-FDTR: An agent-oriented framework for reproducible frequency-domain thermoreflectance data analysis".

Mira: Here's the gist of the paper. Frequency-domain thermoreflectance (FDTR) is a laser pump-probe technique widely used to measure thermal properties at the micro- and nanoscale; however, it relies on a complex data analysis procedure that demands substantial domain expertise and is susceptible to subtle human errors.

Kai: Here, we present Vibe-FDTR, an agent-oriented framework that enables large language model (LLM) agents to perform reliable and reproducible FDTR analyses directly from natural language requests.

Mira: Accurate measurement of thermal properties at the micro- and nanoscale is essential for understanding heat transport and guiding the thermal design of modern electronic and energy systems.

Kai: Despite the widespread application of TDTR and FDTR, a complex and highly demanding data-processing workflow is required to accurately extract the target thermal properties.

Title and authors: Kai: So we're looking at Vibe-FDTR today. This paper introduces a way for large language models to actually do frequency-domain thermoreflectance analysis reliably from just a natural language request.

Mira: It sounds like they are tackling the big headache of FDTR, which is that it needs tons of expert knowledge and you’re prone to making small mistakes with all that data processing.

Lev: Basically, they're building this agent framework that couples a code package enforcing physical rules with these agent skills that turn your plain language into organized steps for the analysis.

Kai: That coupling is key. They are using configuration files as the persistent specifications and then having the procedural guidance layer translate those user requests into executable FDTR operations through specific agent skills.

Mira: It means the AI isn't just guessing at the right fitting parameters or how to organize a complex sequence of decisions; it’s following a defined physical workflow that already has consistency built in.

Lev: And from an engineering standpoint, this is big because it cuts computational cost by eighty-seven point seven percent compared to previous code agent variants and speeds up execution by over sixty percent.

Kai: That efficiency gain is something I really like to hear about, especially when you’re dealing with the massive datasets involved in these kinds of measurements.

Mira: The paper shows that agents using Vibe-FDTR achieve a success rate of one hundred percent for single-step tasks and ninety-eight point nine percent for multi-step tasks using real data.

Lev: That ninety-eight point nine percent on L2 real data is pretty solid, especially when you compare it to the code agent variant which only hit ninety-one point four and thirty six point seven.

Kai: It really shows that encapsulating domain code and expert knowledge into those agent skills offers a way toward low-barrier, autonomous thermal metrology.

Mira: And they have this optional expert mode where the agent can do things like autonomous sensitivity and uncertainty evaluations to plan experiments or suggest physically grounded recommendations when the task is underspecified.

Lev: That ability to recommend complementary measurement modes or identify poorly separable parameters sounds like it could be really useful for someone trying to design an experiment from scratch.

Kai: For design-only tasks, the agent actually assigns explicit physically reasonable assumptions and tests candidate analysis schemes using sensitivity and uncertainty calculations before giving a recommendation.

Mira: It’s essentially acting like an intelligent copilot that knows where the physical model is weak or where your data might be unreliable before you even start fitting.

Lev: That sounds like a significant reduction in the time spent just figuring out the initial analysis plan, which is usually the bottleneck in these kinds of studies.

Kai: So, to summarize Vibe-FDTR: it's an agent-oriented framework that lets LLMs perform reliable FDTR analyses directly from natural language requests by coupling a configuration-driven code package with procedural agent skills.

Mira: It handles the complex, multi-step nature of thermal property extraction by enforcing physical consistency through the code layer and translating user intent into traceable actions via the guidance layer.

Lev: The real win is that it makes this highly demanding analysis accessible to people who might not be deep experts in both cryogenics and advanced data analysis.

Kai: We're seeing improvements where Vibe-FDTR can provide detailed failure mode analysis, pointing out specific errors like bypassing the intended configuration workflow or failing to maintain consistent parameter transfer across stages for easier debugging.

Mira: That level of traceability is what moves this beyond just a successful run to a truly reproducible scientific process.

Lev: It’s about making sure that when you run this on real hardware, you can actually trust where the errors are coming from and fix the underlying skill or configuration.

Kai: So, we've seen how they improve upon previous methods by making the analysis workflow more structured and verifiable through these agent skills.

Mira: The system's ability to handle L2 real-data workflows with a ninety-eight point nine percent success rate really makes this a practical tool for researchers working with actual experimental results.

Lev: It’s moving the goalposts on what we think is possible for autonomous analysis in these complex metrology areas.

Kai: This paper, Vibe-FDTR: An agent-oriented framework for reproducible frequency-domain thermoreflectance data analysis, really demonstrates how procedural guidance can make complex scientific workflows trustworthy.

Mira: It shows that by giving an agent the right tools and the right way to think about the physics, you lower the barrier for using powerful tools like LLMs in experimental analysis.

Lev: It’s a solid step toward making AI useful not just as a prediction tool, but as an active participant in executing rigorous scientific procedures.

Kai: We'll keep an eye on how this agentic approach develops and see what other complex metrology problems it can tackle next.

The paper's summary: Kai: So, Vibe-FDTR is essentially taking all that messy data analysis in frequency domain thermoreflectance, which used to be this super manual process needing a ton of expert knowledge, and putting it inside an agent framework so large language models can actually do it reliably from plain English.

Mira: Right. It’s about moving away from the kind of one-off fitting where you just throw in parameters hoping for the best, and instead building a whole workflow that checks itself against physics every step of the way.

Lev: I mean, what they’ve built is this layered system with a code layer that handles all the physical rules—like making sure your thermal model doesn't say something physically impossible—and then an agent skills layer that takes what you ask for in words and translates it into those specific, verifiable analysis steps.

Kai: That procedural guidance layer is what I’m most interested in. It means the agent isn't just guessing; it’s following a pre-defined path for the analysis, which is huge when you're dealing with something as non-linear as thermal transport at the microscale.

Mira: Exactly. The paper shows that this approach achieves very high success rates on tasks involving real experimental data, specifically ninety-eight point nine percent for multi-step analyses, which is a big deal compared to what we used to see with simpler agent setups.

Lev: And it’s not just about the final number; they show how it cuts down on the computational cost by eighty-seven point seven percent compared to running just the code agent, and execution time drops by over sixty percent. That matters because running these complex analyses can be really time-consuming on standard hardware.

Kai: It makes sense that efficiency is a big part of this for me, especially since my work with cryogenics and qubits involves managing huge amounts of data where speed and resource usage are always concerns.

Mira: And they have this optional expert mode, which lets the agent proactively check its own work by doing sensitivity evaluations and uncertainty assessments before suggesting an analysis plan. It’s like having an assistant that can tell you if your experimental setup is underspecified or if a certain parameter is just too noisy to trust right now.

Lev: For design tasks, it’s even better because the agent can assign reasonable assumptions and test different ways of analyzing the data using those sensitivity calculations before recommending a final scheme. It’s testing hypotheses autonomously.

Kai: It really shows that encapsulating deep domain knowledge and validated physical code into agent skills is a viable path toward making this kind of thermal metrology accessible to people who aren't just specialists in the field anymore.

Mira: The real value here is how it lowers the barrier for entry. You don't need to be an expert in cryogenics *and* a master of fitting routines; you just need to know how to ask the right question, and Vibe-FDTR handles the rest by guiding the process through physical constraints.

Lev: It’s about taking that invaluable human-expert experience—the "know-how"—and baking it into skills so that a new practitioner or someone from a different field can use powerful tools like language models to get reproducible results.

Kai: So, while we’re looking at how this handles complex thermal properties, I wonder what the limitations are for things outside of just FDTR data fitting. Does this framework have trouble with entirely different types of physical problems?

Mira: That’s a fair point. The paper does mention that the method is specifically tuned for the structure of thermoreflectance data analysis, so it really excels where that physics applies, but it’s not a universal solver for every kind of measurement problem out there.

Lev: And you have to remember, even with all this agent guidance and code checks, if the underlying physical model itself is flawed or incomplete, the output will still be based on that flawed foundation.

Kai: That makes sense. So, it’s a very powerful tool for FDTR analysis right now—reliable and efficient—but we've got to keep an eye on how these agent skills can generalize when we try to apply this framework to entirely different types of physical measurements in the future.

The paper's improvements: Kai: So, we’re looking at what they suggest for improvements to Vibe-FDTR today: they are talking about how to make this agent framework even more robust and useful moving forward than what they presented in the paper.

Mira: They want to focus on making the procedural guidance layer smarter so that it can handle even messier user requests without needing a perfect, pre-written instruction for every single analysis.

Lev: I think they’re pushing for better ways to make those agent skills more adaptable, meaning they should be able to handle a wider variety of underlying physical models or different measurement setups than just the ones tested in the benchmark tasks.

Kai: That makes sense. Right now, it’s great on the benchmark stuff, but I need to know if this framework can actually handle novel experimental data without needing a complete rewrite of the agent's skill set.

Mira: Exactly. They suggest incorporating better mechanisms for self-correction within the agent itself, so when it hits a weird data pattern, it doesn't just fail; it should be able to identify *why* it failed and try a different approach guided by those expert evaluations we talked about earlier.

Lev: From my side, I think they’re focusing on making the code layer even more modular so that if you have a very specific, custom physical model—say, one for a new material—you can plug in that custom physics without having to overhaul the whole framework structure.

Kai: That’s important because my work often involves tailoring models to specific superconducting materials, so being able to swap in those custom physics efficiently is key for real hardware testing.

Mira: And they also seem keen on developing more sophisticated ways for the agent to communicate its reasoning back to the user, not just showing the final result, but explaining exactly which physical assumptions it made at each decision point.

Lev: That level of detailed introspection is crucial because when you’re debugging a complex thermal measurement, knowing precisely where the AI decided to make a specific choice helps you pinpoint if the error came from an initial assumption or from a bad calculation step later on.

Kai: It sounds like they are moving toward a more transparent system where we can really audit the decision-making process of the agent during an analysis run.

Mira: Right. They want to ensure that this tool doesn't become a black box where you just trust the output without knowing the underlying physical reasoning behind those ninety-eight point nine percent success rates.

Lev: It’s about building in more explicit checks for consistency across stages, making sure parameter transfers are tracked meticulously from the start of the analysis all the way to the final output.

Kai: So, if you take it all together, they're not just looking at getting better numbers on FDTR; they’re looking at making this agent framework a more flexible and transparent scientific partner for experimentalists.

Mira: And that flexibility is what will likely allow researchers to push the boundaries of what kind of complex thermal data analysis can be automated and trusted.

Conclusion: Kai: So we’re wrapping up on Vibe-FDTR: An agent-oriented framework for reproducible frequency-domain thermoreflectance data analysis, which is essentially this new way to let language models perform complex thermal property measurements reliably from just natural language requests.

Mira: It’s a really solid piece of work because it takes the incredibly demanding and often manual process of FDTR analysis and wraps it into a verifiable, agent-driven workflow that enforces physical rules.

Lev: And the efficiency gains are notable; cutting computational cost by eighty-seven point seven percent is significant when you think about running these kinds of simulations on real hardware, which usually requires a lot of overhead.

Kai: I agree. It shows that we can get more complex analysis done faster and with higher fidelity than relying on just simple fitting operations or basic code agents.

Mira: The big implication for me is how this democratizes access to this type of measurement; it lowers the barrier so people who aren't thermal metrology experts can use these powerful techniques without needing years of specialized training.

Lev: I just want to say that the success rates they hit on real data, like ninety-eight point nine percent for multi-step tasks, really tells you that this isn't just theoretical potential; it’s actually working on the kind of data you’d get in a lab setting.

Kai: It makes me think about where this can go next. If we can make these agents so good at handling thermal data analysis, what other kinds of complex physical measurements could an agent framework like this tackle?

Mira: That’s where the future lies; if we can prove this approach works across different physical domains, it opens up the door to applying this structured, agent-guided procedural logic to other areas of condensed matter physics or even materials science.

Lev: I just want to stress that for any of this agent work to be truly useful on real hardware, the underlying code and the skills have to be extremely stable and reproducible, which is what they’ve focused on with those configuration files.

Kai: So we’re looking at a system that's not only fast and accurate but also built with a strong foundation for future scaling.

Mira: Exactly. The goal here is to create tools that are trustworthy because they can explain their reasoning through the physics, not just spit out an answer in some black box format.

Lev: It’s about building an experimental assistant that doesn't just suggest parameters but actually guides the entire experimental plan with uncertainty checks built in from the start.

Kai: So we’ve seen how Vibe-FDTR can streamline FDTR analysis, and it points toward a future where agent frameworks are central to complex scientific data processing.

Fuwei Yang, Weiheng Li, Bai Song

National Key Laboratory of Advanced Micro and Nano Manufacture Technology, Peking University · Center for Nano and Micro Mechanics, Tsinghua University · Department of Engineering Mechanics, Tsinghua University · School of Mechanics and Engineering Science, Peking University

physics.app-ph, cond-mat.mtrl-sci, cs.AI

Submitted: 2026-07-30

Updated: 2026-11-07

Comments: For supplementary information, see https://ars.els-cdn.com/content/image/1-s2.0-S3117374826000493-mmc1.pdf

Journal ref: Advanced Scientific Instruments, 100049 (2026)

DOI: 10.1016/j.asi.2026.100049

Code: https://github.com/anomalyco/opencode

License: http://creativecommons.org/licenses/by-nc-nd/4.0/

Importance score: 99/100

The gist: Frequency-domain thermoreflectance (FDTR) is a laser pump-probe technique widely used to measure thermal properties at the micro- and nanoscale; however…

Key concepts

Frequency-domain thermoreflectance (FDTR)
A laser pump-probe technique used at the micro- and nanoscale to measure thermal properties. It involves shining a laser on a material and measuring how it reflects light, which reveals information about heat transport within the material.
Vibe-FDTR Framework Architecture
The core structure consists of two parts: a code layer that enforces physical consistency using configuration files, and a procedural guidance layer that translates user requests into executable analysis steps via agent skills. This separates execution logic from high-level instruction.
Expert Mode
An optional feature where the agent acts as an intelligent copilot for experimental planning. It can autonomously evaluate sensitivity and uncertainty, make physically grounded recommendations for difficult tasks, and suggest complementary measurement modes when data is incomplete.

Terminology

Summary

Frequency-domain thermoreflectance (FDTR) is a laser pump-probe technique widely used to measure thermal properties at the micro- and nanoscale; however, it relies on a complex data analysis procedure that demands substantial domain expertise and is susceptible to subtle human errors. p. 0

Where the paper says it

† songbai@pku. cn Abstract Frequency-domain thermoreflectance (FDTR) is a laser pump-probe technique widely used to measure thermal properties at the micro- and nanoscale; however, it relies on a complex data analysis procedure that demands substantial domain expertise and is susceptible to subtle human errors.

Here, we present Vibe-FDTR, an agent-oriented framework that enables large language model (LLM) agents to perform reliable and reproducible FDTR analyses directly from natural language requests. p. 0
Where the paper says it

cn Abstract Frequency-domain thermoreflectance (FDTR) is a laser pump-probe technique widely used to measure thermal properties at the micro- and nanoscale; however, it relies on a complex data analysis procedure that demands substantial domain expertise and is susceptible to subtle human errors. Here, we present Vibe-FDTR, an agent-oriented framework that enables large language model (LLM) agents to perform reliable and reproducible FDTR analyses directly from natural language requests.

Introduction to the Problem

Accurate measurement of thermal properties at the micro- and nanoscale is essential for understanding heat transport and guiding the thermal design of modern electronic and energy systems. Despite the widespread application of TDTR and FDTR, a complex and highly demanding data-processing workflow is required to accurately extract the target thermal properties. p. 1

Where the paper says it

In addition, TDTR and FDTR have also been expanded to buried interfaces and microfabricated structures, and combined with in situ experiments involving external fields or mechanical manipulations25,26,27,28,29 . Despite the widespread application of TDTR and FDTR, a complex and highly demanding data-processing workflow is required to accurately extract the target thermal properties.

This nonlinear inverse problem is inherently limited by parameter sensitivities and correlations, therefore a single signal or fitting window often provides insufficient identifiability for extracting multiple thermal properties. p. 1
Where the paper says it

Unlike the thermal bridge method where thermal conductivity can be readily derived via Fourier’s law from the applied heat flux and measured temperature difference7,11, thermoreflectance measurements rely on an indirect model fitting procedure30 . This nonlinear inverse problem is inherently limited by parameter sensitivities and correlations, therefore a single signal or fitting window often provides insufficient identifiability for extracting multiple thermal properties.

In practice, a complete thermoreflectance data analysis is rarely a single fitting operation, but rather a sequence of coupled decisions involving data organization, sensitivity evaluation, fitting-parameter selection, and uncertainty assessment. p. 1
Where the paper says it

To obtain reliable results, complementary information from different signals may be required, such as those measured with different laser spot sizes or pump-probe offset distances31,32,28. In practice, a complete thermoreflectance data analysis is rarely a single fitting operation, but rather a sequence of coupled decisions involving data organization, sensitivity evaluation, fitting-parameter selection, and uncertainty assessment.

Vibe-FDTR Framework Architecture

The core of Vibe-FDTR consists of a code layer and a procedural guidance layer, with the former enforcing physical and parametric consistency, while the latter governing how user requests are translated into organized and verifiable analyses. The code layer provides the execution foundation of Vibe-FDTR by integrating data discovery, material-property lookup, model configuration, numerical analysis, and standardized output within a unified package. p. 6

Where the paper says it

Conventional FDTR analysis often relies on separate scripts for different processing and fitting operations, requiring manual transfer of parameters and intermediate results. Vibe-FDTR instead integrates data discovery, material-property lookup, model configuration, numerical analysis, and standardized output within a unified package (Fig.

A central design choice of the code layer is to use configuration files as persistent, machine-readable specifications. p. 6
Where the paper says it

A clear interface also separates agent-directed workflow construction from the implementation of the thermal model and numerical solvers. A central design choice of the code layer is to use configuration files as persistent, machine-readable specifications.

The procedural guidance layer translates user requests into executable FDTR operations through agent skills. p. 6
Where the paper says it

This code-level validation provides the hard constraints of Vibe-FDTR, setting the stage for the procedural rules encoded in the guidance layer. 2 Procedural guidance layer The procedural guidance layer translates user requests into executable FDTR operations through agent skills.

This layer provides task-level guidance for code use, so that the agent does not need to infer the analysis logic via the underlying source code. p. 6
Where the paper says it

Even when a user provides a clear analysis request, the agent still needs to map that request to the correct code entry point, construct the required configuration, select the appropriate analysis module, and pass intermediate files between steps. The role of this layer is therefore to provide task-level guidance for code use, so that the agent does not need to infer the analysis logic via the underlying source code.

Performance and Efficiency Gains

Agents using Vibe-FDTR achieve success rates of 100% and 98.9% across two levels of benchmark tasks, in contrast to 91. p. 0

Where the paper says it

We evaluate VibeFDTR using a controlled benchmark with two levels: synthetic single-step tasks and real-data multi-step tasks based on measurements of gold-coated graphite samples. Across the two levels, agents using Vibe-FDTR achieve success rates of 100% and 98.

4% and 36.7% for the Code-agent variant. p. 0
Where the paper says it

Beyond success rate, Vibe-FDTR also reduces computational cost by 87. 7% relative to the Code-agent variant and cuts execution time by more than 60%.

Vibe-FDTR also reduces computational cost by 87. p. 0
Where the paper says it

6% and 0% when the domain package is also omitted (Agent-only). Beyond success rate, Vibe-FDTR also reduces computational cost by 87.

7% relative to the Code-agent variant and cuts execution time by more than 60%. p. 0
Where the paper says it

Beyond success rate, Vibe-FDTR also reduces computational cost by 87. 7% relative to the Code-agent variant and cuts execution time by more than 60%.

The results demonstrate that encapsulating domain code and expert knowledge into agent skills offers a promising route toward low-barrier, autonomous, and trustworthy thermal metrology. p. 0
Where the paper says it

Finally, an optional expert mode supports experimental planning via autonomous sensitivity and uncertainty evaluations, and formulates physically grounded recommendations for underspecified tasks. These results demonstrate that encapsulating domain code and expert knowledge into agent skills offers a promising route toward low-barrier, autonomous, and trustworthy thermal metrology.

Expert Mode Capabilities

The optional expert mode supports experimental planning via autonomous sensitivity and uncertainty evaluations, and formulates physically grounded recommendations for underspecified tasks. For design-only tasks, the agent assigns explicit physically reasonable assumptions, develops candidate analysis schemes, and evaluates them through sensitivity and uncertainty calculations. p. 7

Where the paper says it

For design-only tasks, missing physical quantities are assigned explicit physically reasonable assumptions, followed by parameter-role assignment to separate fitting parameters from constrained inputs. The skill then develops candidate analysis schemes and evaluates them through sensitivity and uncertainty calculations performed by the underlying task skills.

The expert mode can recommend complementary measurement modes, identify poorly separable parameters, and recognize abnormal data or unreliable fitting conditions. p. 3
Where the paper says it

In the most commonly used frequency-sweep (f-sweep) mode, the modulation frequency is varied to obtain the corresponding thermal response, while beam-offset measurements scan the lateral pump-probe separation at fixed f, which is superior for probing in-plane heat spreading and for characterizing the spot size. The schematics of the two measurement modes are demonstrated in the insets of Fig.

Conclusion on Reliability

The distinction between the variants becomes much more prominent for L2 real-data workflows, where VibeFDTR maintains a rather high success rate of 98.9%, while Agent-only produces no successful runs at all. p. 9

Where the paper says it

Figure 6 shows the number of successful runs out of 10 repetitions for each task, which reflects both numerical correctness and repeated-run reliability. Across both benchmark levels, Vibe-FDTR consistently achieves the highest success rates in all tasks, while the Code-agent and Agent-only references become progressively less reliable as task complexity increases.

The core value of Vibe-FDTR becomes evident because the framework encapsulates invaluable human-expert experience into skills together with the physical model and domain code. p. 6
Where the paper says it

3, the core of Vibe-FDTR consists of a code layer and a procedural guidance layer, with the former enforcing physical and parametric consistency, while the latter governing how user requests are translated into organized and verifiable analyses. Together, the two layers make agent executions predictable and auditable.

By encapsulating validated domain code and expert procedural knowledge into agent skills, Vibe-FDTR lowers the barrier to FDTR analysis for both new practitioners and specialists from other fields. p. 0
Where the paper says it

These results demonstrate that encapsulating domain code and expert knowledge into agent skills offers a promising route toward low-barrier, autonomous, and trustworthy thermal metrology. Keywords: Thermal measurement, frequency-domain thermoreflectance, data analysis, LLM agent, agent-oriented framework 1 arXiv:2607.

Data and Code Availability

The agent inputs and traces will be deposited at this repository. The Vibe-FDTR source, skills and benchmark runner will be available on GitHub. p. 0

Where the paper says it

This framework couples a configuration-driven FDTR code package, which enforces physical and parametric consistency, with procedural agent skills that translate user intentions into organized and verifiable analysis steps. We evaluate VibeFDTR using a controlled benchmark with two levels: synthetic single-step tasks and real-data multi-step tasks based on measurements of gold-coated graphite samples.

Acknowledgments

This work was supported by the Science Fund for Creative Research Groups from the National Natural Science Foundation of China (No. 52521007), the Scientific Research Innovation Capability Support Project for Young Faculty (ZYGXQNJSKYCXNLZCXM-E1) from the Ministry of Education of China, and the High-performance Computing Platform of Peking University. p. 0

Where the paper says it

Vibe-FDTR: An agent-oriented framework for reproducible frequency-domain thermoreflectance data analysis Fuwei Yang 1,2,3* Weiheng Li 1,4* Bai Song 1,4† 1National Key Laboratory of Advanced Micro and Nano Manufacture Technology, Peking University, Beijing 100871, China 2Center for Nano and Micro Mechanics, Tsinghua University, Beijing 100084, China 3Department of Engineering Mechanics, Tsinghua University, Beijing 100084, China 4School of Mechanics and Engineering Science, Peking University, Beijing 100871, China *These authors contributed equally to this work. † songbai@pku.

The authors used OpenCode and DeepSeek API service in order to assist coding and language polishing.

Author Contributions

F.Y.: Conceptualization, Methodology, Software, Writing – Original Draft, Writing – Review & Editing. p. 2

Where the paper says it

Leading open-source LLMs such as DeepSeek-V433 have focused increasingly on agentic capabilities. By enabling AI to interpret user intent and translate it into concrete actions—such as configuration writing, tool calling, and data management—this progress has the potential to significantly improve the efficiency of scientific research.

W.L.: Software, Validation, Investigation, Data Curation, Writing – Original Draft, Writing – Review & Editing. p. 2
Where the paper says it

Leading open-source LLMs such as DeepSeek-V433 have focused increasingly on agentic capabilities. By enabling AI to interpret user intent and translate it into concrete actions—such as configuration writing, tool calling, and data management—this progress has the potential to significantly improve the efficiency of scientific research.

B.S.: Conceptualization, Supervision, Writing – Review & Editing. p. 2
Where the paper says it

Leading open-source LLMs such as DeepSeek-V433 have focused increasingly on agentic capabilities. By enabling AI to interpret user intent and translate it into concrete actions—such as configuration writing, tool calling, and data management—this progress has the potential to significantly improve the efficiency of scientific research.

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. p. 0
Where the paper says it

Vibe-FDTR: An agent-oriented framework for reproducible frequency-domain thermoreflectance data analysis Fuwei Yang 1,2,3* Weiheng Li 1,4* Bai Song 1,4† 1National Key Laboratory of Advanced Micro and Nano Manufacture Technology, Peking University, Beijing 100871, China 2Center for Nano and Micro Mechanics, Tsinghua University, Beijing 100084, China 3Department of Engineering Mechanics, Tsinghua University, Beijing 100084, China 4School of Mechanics and Engineering Science, Peking University, Beijing 100871, China *These authors contributed equally to this work. † songbai@pku.

Conflict of Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Author Declarations

During the preparation of this work, the authors used OpenCode and DeepSeek API service in order to assist coding and language polishing. After using this tool/service, the authors reviewed and edited the content as needed and take full responsibility for the content of the published article.

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Vibe-FDTR can perform reliable analysis directly from natural language requests by coupling a configuration driven FDTR code package with procedural agent skills that translate user intentions into organized and verifiable analysis steps.

  2. The system can achieve high success rates on benchmark tasks, such as 100% for L1 single-step tasks and 98.9% for L2 multi-step tasks, demonstrating its ability to execute complex workflows from real data.

  3. An optional expert mode allows the agent to autonomously perform sensitivity and uncertainty evaluations and formulate physically grounded recommendations for underspecified tasks, acting as an intelligent copilot for experimental planning.

  4. The framework reduces computational cost by 87.7% relative to the Code-agent variant and cuts execution time by more than 60%, significantly improving efficiency compared to previous methods.

  5. The system can provide detailed failure mode analysis, identifying specific errors such as bypassing the intended configuration workflow or failing to maintain consistent parameter transfer across stages, allowing for targeted debugging and improvement of agent skills.

Abstract

Frequency-domain thermoreflectance (FDTR) is a laser pump-probe technique widely used to measure thermal properties at the micro- and nanoscale; however, it relies on a complex data analysis procedure that demands substantial domain expertise and is susceptible to subtle human errors. Here, we present Vibe-FDTR, an agent-oriented framework that enables large language model (LLM) agents to perform reliable and reproducible FDTR analyses directly from natural language requests. This framework couples a configuration-driven FDTR code package, which enforces physical and parametric consistency, with procedural agent skills that translate user intentions into organized and verifiable analysis steps. We evaluate Vibe-FDTR using a controlled benchmark with two levels: synthetic single-step tasks and real-data multi-step tasks based on measurements of gold-coated graphite samples. Across the two levels, agents using Vibe-FDTR achieve success rates of 100% and 98.9%, respectively. In sharp contrast, ablating skills (Code-agent) reduces performance to 91.4% and 36.7%, which drops further to 38.6% and 0% when the domain package is also omitted (Agent-only). Beyond success rate, Vibe-FDTR also reduces computational cost by 87.7% relative to the Code-agent variant and cuts execution time by more than 60%. Finally, an optional expert mode supports experimental planning via autonomous sensitivity and uncertainty evaluations, and formulates physically grounded recommendations for underspecified tasks. These results demonstrate that encapsulating domain code and expert knowledge into agent skills offers a promising route toward low-barrier, autonomous, and trustworthy thermal metrology.

Sources

Related papers