ISBC: Interpretable Sparse Binary Coding of Pretrained Text Embeddings
cs.LG
Submitted: 2026-10-31
Updated: 2026-11-03
Comments: updated version for smoother reading of the results
Code: https://github.com/siacus/isbc
License: http://creativecommons.org/licenses/by/4.0/
The gist: Pretrained text embeddings encode semantic structure in high-dimensional continuous spaces whose coordinates are difficult to interpret.
Terminology
Abstract
Pretrained text embeddings encode semantic structure in high-dimensional continuous spaces whose coordinates are difficult to interpret. We introduce Interpretable Sparse Binary Coding (ISBC), which learns a small set of binary dimensions from frozen embeddings without taxonomy labels or downstream outcomes. A trainable encoder and affine decoder combine reconstruction with controls on activity, factor utilization, dependence, and activation uncertainty. Individual bits and their conjunctions select overlapping document groups; complete activation profiles provide finer contexts for conditional comparisons. We evaluate these representations across corpora, backbones, and code configurations through reconstruction, geometry, predictive probes, and document inspection. Empirical cases identify both distinctions within existing categories and shared content across their boundaries. In a mixed-domain corpus, the most frequent profiles predominantly identify source collections, while selected within-source comparisons reveal sentiment and migration contrasts. Selected associations persist in additional documents encoded without refitting. In an engagement application, bits alone improve prediction of log-transformed outcomes over a constant reference, while their combinations identify within-event content contrasts associated with engagement. The results support using binary coordinates and their combinations for empirical interpretation, with complete profiles providing a fine, partly initialization-dependent description rather than a unique discrete taxonomy.
Sources
- BERTopic: Neural topic modeling with a class-based TF-IDF procedure
- Interpretable Embeddings with Sparse Autoencoders: A Data Analysis Toolkit
- Disentangling Dense Embeddings with Sparse Autoencoders
- Aligning Sentence Embeddings to Human Concepts via Sparse Autoencoders
- Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Models
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis