Benchmarking the Safety of Large Language Models for Robotic Health Attendant Control
Researchers tested 72 large language models controlling medical robots against 270 harmful instructions based on medical ethics principles. The study found a high mean violation rate of 54.4%, with safety heavily dependent on model family and release date, suggesting current methods are insufficient for safe deployment.