Rethinking Opinion Measurement Interfaces for Human-in-the-Loop Optimization
The research tested six different ways to ask humans for opinions during automated optimization tasks like text summarization and image enhancement. The study found that a hybrid method, UI6 ($n$-ANFRD), performed best by capturing more nuanced human feedback than simpler methods. This means the way you design the feedback interface is just as important as the math used to optimize.