Tasteply: Externalizing Stable and Situational Preference as Manipulable Spatial Objects

arXiv:2611.07851 · cs.HC, cs.IR · Submitted 2026-11-05 · Read on arXiv

Listen

Radio episode about this paper

Transcript

Introduction to the show: ident: Computer Science. The day in computer science: software, systems and theory on arXiv.

Tom: We're looking at the paper: "Tasteply: Externalizing Stable and Situational Preference as Manipulable Spatial Objects".

Jane: Here's the gist of the paper. Most recommender systems treat user preferences as a single signal to infer and optimize

4, 5, 13, 14: <ref:2611.07851#pg3>.

Tom: Through Tasteply, we externalize this preference structure as manipulable spatial objects.

Jane: The Core Concept Tasteply decomposes user preference into attractors and a global taste field <ref:2611.07851#pg3>.

Tom: Each situational preference is represented as an attractor, while the stable preference functions as an underlying global field.

Title and authors: Tom: So, building on that idea of the spatial objects, the paper explains the setup in more detail. It starts by saying they take user-liked posts from sources like Bluesky and use those to build both a global taste field and an initial set of attractors.

Jane: They emphasize that these attractors are clustered based on content similarity, but they design them to represent underlying motivations, which is important because it’s not just superficial topic matching.

Lu: The key thing they point out is that the global taste field is defined as the residual preference signal—the part of your taste that isn't captured by any specific situational preference attractor.

Meng: So, if you like a post about music while driving, and another about politics when relaxing, those are two separate attractors, and whatever connects them across both contexts is this global field.

Tom: That’s exactly right. And the system allows users to interact with both layers: moving through the attractors blends situational preferences, and adjusting the global field strength changes how much that overall taste influences what you see.

Jane: It's an interactive system where your current feed updates in real time based on where you are positioned in this 2D space and how strong you set that global preference layer to be <ref:2611.07851#pg2,feed updates in real time>.

Lu: They connect this spatial interaction to broader research in other domains, suggesting that this way of modeling preference as a field and attractors is not unique to recommendations.

Tom: So, the takeaway here is moving away from treating preference as one monolithic score and instead viewing it as a dynamic structure you can navigate.

Jane: It makes the latent preference structure something users can actually influence directly rather than just passively receiving recommendations from.

The paper's summary: Tom: Now, let's talk about what they suggested to make this system better. One major improvement is how they handle feedback. Instead of constantly retraining everything, they suggest updating only the attractors that are active at that exact moment, weighted by their contribution to the feed you’re currently seeing.

Jane: That’s a big deal for efficiency because it means the system only focuses its learning efforts on what matters in that specific context right now.

Lu: They call this a context-gated version of reinforcement learning from human feedback, which is ambitious because it implies the preference structure can evolve situationally without needing a full global update every time.

Meng: From an engineering standpoint, that sounds much more manageable when you’re trying to deploy something at scale; you don't want continuous re-learning across the entire preference space.

Tom: Another suggestion is about how users interact with it—they found that continuous blending is valuable for exploration, but locking onto a single attractor is preferred when you have a very specific goal.

Jane: So, the system seems to offer both ways to use it: fluid movement for discovery and precise selection for targeted tasks.

Lu: They also pointed out the need for discrete selection fallback—if a user has a very clear goal in mind, they should be able to collapse that continuous control into a discrete choice instead of trying to blend things together when blending doesn't help.

Meng: That makes practical sense; if someone needs specific data quickly, they don't want the system spending time navigating a map when they just need a direct answer.

Tom: So these improvements focus on making the system more efficient for real use and giving users clearer control over whether they want exploration or exploitation of their preferences.

Jane: It sounds like they’re trying to bridge the gap between a cool theoretical model and something that actually works smoothly in an application.

The paper's improvements: Tom: So, to wrap up this discussion on "Tasteply: Externalizing Stable and Situational Preference as Manipulable Spatial Objects," we see a way to visualize the messy reality of human preference.

Jane: It moves us away from viewing preferences as a single opaque signal and shows them as a structure made of specific situational objects and an underlying stable field.

Lu: The implication is that we can build recommendation systems where users aren't just passive recipients, but active navigators who directly shape the recommendation space by moving between these defined preference points.

Meng: It’s about giving users more granular control over how the AI interprets their context, which is crucial when you're shipping models to production where context sensitivity matters a lot.

Lalam: From my literature view, I see this approach as a way to finally give structure to the complexity of human taste organization by making it geometrically explicit and manipulable.

Tom: Exactly. It’s about taking that latent structure and making it spatial so users can steer their feed with a clear understanding of what they are doing.

Jane: That’s the big picture: turning abstract preference into concrete, navigable objects that fit how people actually think about context in their daily lives.

Conclusion: Tom: So we looked at "Tasteply: Externalizing Stable and Situational Preference as Manipulable Spatial Objects," and it basically takes all those user preferences, right, and turns them into something you can move around in a map.

Jane: That’s right. They take what we usually think of as one single taste score and break it down into these attractors for specific situations, plus this global taste field that’s the general vibe across everything.

Lu: The core idea is that instead of just guessing what you want based on past clicks, the user can actually steer the AI by moving their position between those situational attractors or by adjusting how much that overall global taste field pulls the feed.

Meng: But I gotta ask, how does that work in practice? If I’m at work and need to focus on one thing, does just clicking a button feel like moving me through the space?

Jane: It does. They show an experimental study with five people where they found that continuously blending between attractors was good for exploring new stuff, but locking onto a single attractor was better if you had a very specific goal.

Tom: That’s interesting because it means the system has to be smart enough to know when to let you explore and when it should just lock in on what you want.

Lu: They even suggested something ambitious—updating only the attractors that are active right now, based on how much they're helping your current feed, kind of like a context-gated learning approach.

Meng: That sounds efficient for deployment because you don't have to re-calculate everything every single time a user changes their mind about what they’re looking at.

Lalam: I can confirm that the structure they built is very flexible; users were able to revise their own structures during the testing, showing it wasn't just some rigid system they had to follow.

Jane: So for someone just listening, this means you’re not just getting a feed; you’re interacting with a preference map where you can actively adjust the weights of what’s happening right now.

Tom: It makes the recommendation process feel less like a black box and more like something you have direct control over.

Lu: It opens up possibilities for long-term algorithms where each situational preference attractor stays a faithful record of that specific context, which is an important step forward from simpler models.

Meng: If we can make the system update based on current activity, it lowers the operational cost of keeping those preference models fresh at scale.

Lalam: I’m pretty confident in this structure; it directly addresses how people actually organize their tastes when they’re juggling different lives and situations.

Tom: So that was "Tasteply: Externalizing Stable and Situational Preference as Manipulable Spatial Objects." It shows us how to make preference a navigable landscape instead of just a static list.

Jane: It really frames the challenge for AI recommendation systems not as finding the perfect score, but as designing a good map for exploration and targeted selection.

Lu: Next up, we’re looking at greedy region growing—how they use approximation techniques to solve tough geometric problems like pathwidth in graphs.

KAIST · Salesforce AI Research

cs.HC, cs.IR

Submitted: 2026-11-05

Updated: 2026-11-05

Journal ref: UIST 2026 Posters

DOI: 10.1145/3830397.3841842

License: http://creativecommons.org/licenses/by/4.0/

Importance score: 100/100

The gist: Most recommender systems treat user preferences as a single signal to infer and optimize [4, 5, 13, 14] <ref:2611.07851#pg3>.

Key concepts

Attractors
These represent specific situational preferences, such as interests in certain topics or contexts. They are built from user-liked posts clustered by underlying motivations rather than simple topic similarity.
Global Taste Field
This is the stable, underlying preference signal that isn't captured by any single situational attractor. It acts as a baseline taste level that can be adjusted globally to influence the overall feed.
Steering Mechanism
Users change their feed by moving their position on a map of these preferences. Blending nearby attractors allows for continuous fine-grained control over how different situational tastes are mixed in the final recommendations.

Terminology

Summary

Most recommender systems treat user preferences as a single signal to infer and optimize [4, 5, 13, 14] <ref:2611. p. 0

Where the paper says it

Tasteply externalizes this structure spatially, representing each situational preference as an attractor and the stable preference as an adjustable global field, letting users steer their feed by moving among them (right). Abstract Most recommender systems treat user preferences as a single signal to infer and optimize, yet human preferences are a mix of stable preferences and situational preferences that turn on and off depending on context.

07851#pg3>. Through Tasteply, we externalize this preference structure as manipulable spatial objects. p. 0
Where the paper says it

Abstract Most recommender systems treat user preferences as a single signal to infer and optimize, yet human preferences are a mix of stable preferences and situational preferences that turn on and off depending on context. Through Tasteply, we externalize this preference structure as manipulable spatial objects.

The Core Concept

Tasteply decomposes user preference into attractors and a global taste field <ref:2611.07851#pg3>. Each situational preference is represented as an attractor, while the stable preference functions as an underlying global field. p. 0

Where the paper says it

Through Tasteply, we externalize this preference structure as manipulable spatial objects. Tasteply represents each situational preference as an attractor and the stable preference as an underlying global field.

This allows users to directly adjust what has stayed latent inside the model by moving among attractors and adjusting the strength of the global field. p. 0
Where the paper says it

Tasteply represents each situational preference as an attractor and the stable preference as an underlying global field. Users can adjust their feed by moving around the space and adjusting the strength of the global field, turning the preference structure that remains latent within the model into something they can see and act on directly to steer the recommendation algorithm.

Preference Space Establishment

The system builds a global taste field and an initial set of attractors from user-liked posts collected from platforms like Bluesky <ref:2611.07851#pg3>. Posts are clustered into attractors designed by underlying motivations rather than just surface-level topical similarity <ref:2611. p. 1

Where the paper says it

Posts are clustered by content, and Tasteply suggests an initial grouping of them into attractors that users can review and adjust. Each attractor is designed to be defined by a user’s underlying motivations rather than surface-level topical similarity [15].

07851#pg3>. The global taste field is defined as a residual preference signal not covered by any situational preference attractor <ref:2611. p. 1
Where the paper says it

As topic similarity alone cannot determine which context a user has in mind for a given post, the user’s review and adjustment lets Tasteply better capture the user’s actual preference structure. After setting up the attractors, the global taste field is defined as a residual preference signals that were not covered in any of the situational preference attractors.

07851#pg3>.

Steering Mechanism

Users steer their feed by moving their position on the preference map to blend nearby attractors. A global field slider adjusts how much the general taste pulls the feed toward the user’s overall taste. p. 1

Where the paper says it

This gives users finer control over their feed than selecting from a fixed set of topics would allow. A global field slider adjusts how much the global preference pulls the feed toward the user’s general taste.

The technical detail involves calculating a query vector as a weighted sum of attractor vectors, renormalized to unit length. p. 1
Where the paper says it

Cursor position 𝑐 weights each attractor by an isotropic Gaussian kernel, so that distant attractors contribute negligibly. The query vector 𝑣𝑞𝑢𝑒𝑟 𝑦 is then calculated as the weighted sum of attractor vectors, renormalized to unit length.

Experimental Findings and Future Directions

An exploratory study with 5 participants confirmed that the layered structure mirrors how people organize their preferences. Participants found that continuous blending offered value when exploring without a fixed target, but locking onto a single attractor was preferred for specific goals. p. 1

Where the paper says it

When pursuing a specific goal, however, the same interaction offered limited value. P4 had a very clear goal of finding specific information on their feed, so they preferred to lock onto a single attractor, so blending offered little value for them.

A suggestion was made to update only the attractors active at the moment based on their contribution to the feed, describing this as a context-gated version of RLHF. p. 1
Where the paper says it

P5 recalled how briefly engaging with a niche interest during casual browsing kept it resurfacing, unwanted, across unrelated sessions. P1 proposed a concrete improvement to the model: user feedback (such as likes or clicks) should update only the attractors active at that moment, weighted by their contribution to the current feed, describing this as a context-gated version of RLHF (Reinforcement Learning from Human Feedback).

This suggests extending the preference structure into a long-term recommendation algorithm where each attractor remains a faithful record of its situational preference. p. 1
Where the paper says it

P1 proposed a concrete improvement to the model: user feedback (such as likes or clicks) should update only the attractors active at that moment, weighted by their contribution to the current feed, describing this as a context-gated version of RLHF (Reinforcement Learning from Human Feedback). Therefore, we suggest extending this preference structure into a long-term recommendation algorithm so that

Evaluation and Limitations

Participant behavior validated that Tasteply’s layered structure is usable, not just legible, as users iteratively revised their structures to match actual usage purposes. The study indicated that no single interaction served both continuous control and discrete selection when a goal required it. p. 1

Where the paper says it

They were skeptical of the granularity of the control, saying they could barely perceive differences between nearby positions. We observed that no single interaction served both cases, so users should be able to collapse continuous control into discrete selection when their goal requires it.

This implies users should be able to collapse continuous control into discrete selection when necessary. p. 1
Where the paper says it

They were skeptical of the granularity of the control, saying they could barely perceive differences between nearby positions. We observed that no single interaction served both cases, so users should be able to collapse continuous control into discrete selection when their goal requires it.

The separation of situational preferences could solve the problem where a single shared preference signal reshapes recommendations across contexts. p. 1
Where the paper says it

Participants suggested Tasteply’s separation of situational preferences could solve a problem they recognized in everyday feed recommendations. When a recommender relies on a single shared preference signal, a passing interest from one context can quietly reshape recommendations across every other context as well.

Acknowledgments

We thank all of our study participants for their insightful feedback.

Green — the paper says it, and the page is printed. Red — no passage carries it, so treat that sentence as unverified. The same check runs on your own text: check a summary against its source, $5.

Improvements for AI systems

  1. Externalize preference structure as manipulable objects: The AI system can allow users to steer their feed by moving among them (Figure 1), directly adjusting what is recommended rather than manipulating a proxy for preference.

  2. Implement continuous spatial control for blending: Users can blend multiple situational preferences continuously by positioning between attractors, allowing for fine-grained control over feed composition when exploring without a fixed target.

  3. Introduce context-gated preference learning: User feedback should update only the attractors active at that moment, weighted by their contribution to the current feed, enabling a system where a passing interest in one context reshapes recommendations across all other contexts.

  4. Develop discrete selection fallback: When a user has a very clear goal of finding specific information on their feed, the system should allow users to collapse continuous control into discrete selection when blending offers little value for their objective.

Abstract

Most recommender systems treat user preferences as a single signal to infer and optimize, yet human preferences are a mix of a stable preference and situational preferences that turn on and off depending on context. Through Tasteply, we externalize this preference structure as manipulable spatial objects. Tasteply represents each situational preference as an attractor and the stable preference as an underlying global field. Users can adjust their feed by moving around the space and adjusting the strength of the global field, turning the preference structure that remains latent within the model into something they can see and act on directly to steer the recommendation algorithm. Through an exploratory study (N=5), we found that this spatial control was effective, along with its limits and future direction as a means of manipulating preference-based recommendations.

Sources

Related papers