Crossing the Cyber Divide: Sim-to-Sim and Sim-to-Real Transfer for RL Agents
The research addresses policy transfer across different cyber environments by separating state alignment from action translation. It introduces a kill-chain intent interface to map actions and observations between simulators, followed by a Domain-Adversarial Network (DAPN) encoder to align the resulting state distributions. The findings show that feature engineering helps with small gaps, while DAPN is necessary for large gaps, enabling zero-shot transfer.