Agentic AI in Automated Markets

summary

The gist

Automated markets increasingly host autonomous, learning trading agents and are powered by formulaic automated market makers (AMMs) These agentic AI systems are studied to understand how…

In short

The study modeled three trading agents—a rational arbitrageur, a manipulator, and a retail herd-follower—using reinforcement learning to see how their distinct behaviors affect market stress and performance in automated markets. The pilot on cryptocurrency data showed that retail agents cause frequent, shallow stress episodes, while manipulators cause rare but long-lasting stress.

Key concepts

Agent Archetypes
Three distinct trading styles were modeled: a rational arbitrageur seeking risk-adjusted returns, a manipulator focused on rapid turnover for short gains, and a retail herd-follower reacting to recent market momentum. These are defined by how they change their trading rewards based on their goals.
Exposure-Control MDP
Trading is treated as a decision process where an agent chooses how much of an asset to hold (exposure) at each step. The system uses risk-adjusted rewards and penalties for market stress to guide the agent's actions, aiming to manage its position between zero and one.
Market Stress Penalties
The reward function includes a penalty term ($ ext{λstress}$) triggered during specific market crash regimes. This allows the model to learn how different agents react when the market is under extreme duress, helping distinguish between behaviors that cause frequent short stress versus those that cause persistent stress.

Terminology used across episodes

This episode discusses

The paper

Agentic AI in Automated Markets · Read on arXiv

Irene Aldridge, Lourenco Belleau-Bhowmik, James Chan, Josh Chang, Kelly Deng, Pranav Dhingra, Xinda Ding, Haodong Fang, Satya Hanumanchi, Carter He, § Shuang He, § Yadong Hou, § Vallab Karanam, Rithvik Kasarla, Tishya Khanna, Jihyun Kim, Sarah Konety, Abhinav Kotta, Anderson Lo, Jake Luther, Omar Mian, § Ishan Patwardhan, § Matteo Perona, § Chenyue Qi, § Shashank Ramachandran, ☿ Shubham Rateria, Jake Swain, David Thai, Michael Twersky, Susan Wu, Dean Xu, Helenna Yin, 内 Jiachun Zheng

Cornell Tech

Automated markets increasingly host autonomous, learning trading agents and are powered by formulaic automated market makers (AMMs). We study how heterogeneous agent behavior shapes stress, risk-adjusted performance, liquidity, and volatility in these types of markets. Three behavioral archetypes are modeled as agentic reinforcement learning (RL) systems: a rational arbitrageur, a manipulator, and a retail herd-follower. Each archetype is defined by its reward function within a common, asset-agnostic exposure-control environment, and each is trained with a value-based Deep Q-Network (DQN) and with REINFORCE using a learned baseline. A pilot on hourly cryptocurrency data (AAVE, ETC, SUI) motivates the hypotheses. Herd-followers produce the most frequent but shortest stress episodes, manipulators the fewest but most persistent, and rational agents the most stable rolling Sharpe ratios despite higher return volatility. SHAP attributions tie these patterns to drawdown and cross-asset signals, short-term volatility and position state, and momentum, respectively. The results motivate behavior-specific regulation rather than uniform limits on volatility or turnover.

Transcript

Introduction to the show: ident: Economics. The day in economics: theory, mechanisms and the evidence beneath them.

Ruth: We're looking at the paper: "Agentic AI in Automated Markets".

Warren: Here's the gist of the paper. Automated markets increasingly host autonomous, learning trading agents and are powered by formulaic automated market makers (AMMs) These agentic AI systems are studied to understand how heterogeneous agent behavior shapes stress, risk-adjusted performance, liquidity, and volatility in these types of markets The pilot on hourly cryptocurrency data motivates hypotheses about the distinct footprints left by rational arbitrageurs, manipulators, and retail herd-followers Agent Archetypes and Modeling Three behavioral archetypes are modeled as agentic reinforcement learning (RL) systems: a rational arbitrageur, a manipulator, and a retail herd-follower Each archetype is defined by its reward function within a common, asset-agnostic exposure-control environment These archetypes are trained with a value-based Deep Q-Network (DQN) and with REINFORCE using a learned baseline The rational arbitrageur maximizes risk-adjusted return with additional penalties on realized volatility and turnover The manipulator receives a bonus proportional to turnover, κturn et−et−1, and a short discount horizon, which favors rapid position cycling and short-term gains The retail herd-follower receives a bonus for aligning exposure with recent momentum, κmom sign(momt) (et − 0.5) Trading is formulated as a discrete exposure-control Markov decision process with riskadjusted, cost-aware rewards and market-stress penalties defined over features available in any market The base reward is a volatility-normalized net return: rbase t = etRt+1 − c et − et−1 σˆt + ϵ - λstress 1

stresst: et DQN is a value-based method that estimates Q(s, a) for the three actions REINFORCE with baseline uses a two-layer policy network and a separate two-layer value network to estimate the expected discounted return and serve as a baseline Pilot Findings on Market Stress The pilot on hourly cryptocurrency data motivates hypotheses about the distinct footprints left by rational arbitrageurs, manipulators, and retail herd-followers Retail agents show the most frequent stress episodes, but these are short, consistent with shallow drawdowns from momentum overreaction Rational agents show a moderate frequency, with controlled exposure limiting both occurrence and duration Manipulators show the fewest episodes, but stress persists the longest when it occurs, most visibly around the major crash regimes near hours 1,450–1,500 Regulatory Implications The pilot suggests that the regulation of automated and agentic trading should target behaviors rather than apply uniform limits on volatility or turnover Recommendations include: 1.

Ruth: For herding (H1), tools such as risk disclosure at the point of trade, leverage and margin limits for retail accounts, and single-stock circuit breakers are suggested 2.

Warren: For high-turnover and manipulative strategies (H2), surveillance should prioritize abnormal turnover and order-cycling patterns, and venues could consider fees that scale with order-to-trade or cancellation ratios 3.

Ruth: For rational risk management (H3, H4), rules that penalize all volatility may suppress the adaptive repositioning that keeps prices informative Limitations and Future Work The study has several limitations, including the lack of price impact or interaction between agents because they are price-takers in separate environments Archetype intensity is a nonlinear function of public signals, and controls for size, value, momentum, volatility, and turnover do not eliminate the risk that intensity proxies for a known characteristic A shared limit-order-book simulator with all three archetypes trading together is suggested as the natural extension to address the lack of price impact or interaction The pilot scale used one run per configuration on about 1,750 hours per asset, and multi-seed training and reward-weight tuning are needed before drawing formal conclusions regarding policy collapse The findings support regulation that targets herding and manipulation while preserving adaptive risk-taking The framework proposed here offers a way to measure that distinction using public data The cryptocurrency pilot shows distinct footprints: frequent, shallow stress for herd-followers; rare, persistent stress for manipulators; and volatile but stable risk-adjusted performance for rational agents References Brad M.

Paper summary: Ruth: So we're looking at this paper, "Agentic AI in Automated Markets," and what it claims is that automated markets are increasingly being run by autonomous learning trading agents powered by those formulaic automated market makers, or AMMs.

Warren: Right. The core idea here is studying how these different agent behaviors shape things like stress, risk adjusted performance, liquidity, and volatility in these types of markets.

Iris: It seems they’re not just looking at the aggregate data because we don't have labels for those behavior types in public datasets.

Ruth: Exactly. Instead of hand-coding trading rules, they model three behavioral archetypes using agentic reinforcement learning systems: a rational arbitrageur, a manipulator, and a retail herd-follower.

Warren: Each archetype gets its own reward function defined within this common environment where the agents trade without knowing anything about the specific asset they're trading.

Iris: And to figure out what those agents are doing, they train each one using a value based deep q network called DQN and with REINFORCE using a learned baseline.

Ruth: The rational arbitrageur, for example, maximizes risk adjusted return but adds penalties for realized volatility and turnover.

Warren: Then you have the manipulator who gets a bonus proportional to turnover, which means rapid position cycling and short term gains because of that short discount horizon they use.

Iris: And the retail herd-follower gets a bonus for aligning exposure with recent momentum, which is basically just betting on what's happening right now.

Ruth: The paper makes five main contributions, starting with formulating trading as a discrete exposure control Markov decision process with risk adjusted cost aware rewards and market stress penalties.

Warren: They define these penalties using features that are available in any market, which is pretty broad because it’s asset agnostic.

Iris: They compare a value based method called DQN with a policy gradient method called REINFORCE with baseline on each archetype and use shap to attribute each learned policy to its inputs.

Ruth: What's really interesting is the pilot study they ran on hourly cryptocurrency data, which motivates their hypotheses about the footprints left by rational arbitrageurs, manipulators, and retail herd-followers.

Warren: So what did that pilot actually show regarding market stress?

Iris: Retail agents showed the most frequent stress episodes, but those are short and consistent with shallow drawdowns from momentum overreaction.

Ruth: Rational agents showed a moderate frequency because their controlled exposure limits both how often they get stressed and how long it lasts.

Warren: And the manipulators show the fewest episodes, but when stress does happen, it persists the longest, most visibly around major crash regimes near hours one thousand four hundred fifty to one thousand five hundred on that cryptocurrency data.

Iris: That's a key finding because it suggests different types of agents leave distinct signatures in market stress.

Ruth: And this leads them to some regulatory recommendations, suggesting we should target behaviors instead of just applying uniform limits on volatility or turnover.

Warren: They suggest tools for herding, like risk disclosure at the point of trade and leverage limits for retail accounts because that relates to the herd follower hypothesis.

Iris: Then for high turnover and manipulative strategies, they recommend surveillance focused on abnormal turnover patterns, and venues could consider fees that scale with order to trade or cancellation ratios.

Ruth: For rational risk management, they suggest rules that penalize all volatility might actually suppress the adaptive repositioning that keeps prices informative.

Warren: It seems like they’re trying to find a way to distinguish between agents who are just taking risks and those who are actively trying to move the market in a way that causes stress.

Iris: They also pointed out some limitations, specifically that because these agents trade independently in separate environments, they don't account for price impact or interaction between the agents themselves.

Ruth: That's fair; they admit that an agent-based simulator with all three archetypes trading together would be the natural next step to address that lack of interaction.

Warren: They also mentioned that the intensity of each archetype is a nonlinear function of public signals, and there are no controls for size, value, momentum, volatility, or turnover in their current setup.

Iris: And they note that the study only used one run per configuration on about one thousand seven hundred fifty hours per asset without multi seed training or reward weight tuning before drawing formal conclusions.

Ruth: So to summarize this paper "Agentic AI in Automated Markets," it models three distinct trading agents using reinforcement learning, showing how their different objectives—arbitrage, manipulation, and herding—create different patterns of stress and risk across markets.

Warren: And the conclusion they draw is that effective regulation needs to target the behaviors themselves rather than just setting uniform limits on volatility or turnover.

Iris: It’s interesting because they use public data to measure these distinctions, showing that retail agents cause frequent shallow stress, while manipulators cause rare but persistent stress episodes.

Ruth: So what this means for us is that we need to be careful not to just look at how much volatility a strategy generates, but whether it’s coming from the rational risk management agent or the herd follower pushing things too hard.

Conclusion: Ruth: So we're wrapping up this look at "Agentic AI in Automated Markets." The authors are looking at how different types of trading agents behave when they run automated markets powered by those AMMs, and they model three distinct agent personalities: the rational arbitrageur, the manipulator, and the retail herd-follower.

Warren: Right. The core finding is that these behaviors leave very different footprints on market stress and risk adjusted performance. It’s not just about how much volatility a strategy generates; it’s about what kind of stress it causes and why those agents are behaving that way in the first place.

Iris: I think the paper's main contribution is using this agent-based approach to link specific reward functions—the things they want each agent to achieve—directly to observable patterns in public market data, like that cryptocurrency pilot.

Ruth: Exactly. The implication for me is that we can start thinking about regulation not just as setting limits on total turnover or volatility, but as trying to target the *behavior* of the agents themselves.

Warren: That makes sense because if you can distinguish between a rational agent managing risk and a herd follower chasing momentum, then the policy needs to change depending on which one is causing trouble.

Iris: And they suggest that for herding behavior, tools like risk disclosure or leverage limits for retail accounts might be more useful than just blanket volatility rules.

Ruth: That’s where it gets interesting; they’re arguing that we need to focus on the specific intent behind the trading action, not just the outcome of high volatility.

Warren: So what this means for anyone watching the markets is that future oversight might have to be more nuanced, trying to spot those distinct signatures of manipulation versus genuine risk management.

Iris: And they’ve pointed out some limitations too; they haven't modeled how these agents actually interact with each other in a real market, which means the next step has to be modeling that interaction itself.

More episodes

← Home