Deep Tensor Network
cs.LG, cs.AI, cs.CV, quant-ph
Submitted: 2023-11-18
Updated: 2026-11-09
Terminology
Sources
- PaLM 2 Technical Report
- Learning Representations by Maximizing Mutual Information Across Views
- VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning
- How to Understand Masked Autoencoders
- PaLM: Scaling Language Modeling with Pathways
- BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
- Improving Self-Supervised Learning by Characterizing Idealized Representations
- SimCSE: Simple Contrastive Learning of Sentence Embeddings
- Transformer in Transformer
- Training Compute-Optimal Large Language Models
- MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
- Green Hierarchical Vision Transformer for Masked Image Modeling
- BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models
- RoBERTa: A Robustly Optimized BERT Pretraining Approach
- Representation Learning with Contrastive Predictive Coding
- GPT-4 Technical Report
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher
- DeepMIM: Deep Supervision for Masked Image Modeling
- Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model
- Information Flow in Self-Supervised Learning
Related papers
- A Physics-Regulated Neural Framework for Learning 3D Grain Growth Dynamics
- FlexMoE: Learning One-for-All Multi-Budget Expert Pruning for Flexible MoE Deployment
- OptiMind: Improving Small Language Models for Optimization Modeling through Formulation Guidance and Multi-Turn Learning
- Staying in the Sweet Spot: Boost Reasoning Evolution via Responsive Rollout Difficulty Manipulation
- Examining the Impact of Data and Training Methods on Emergent and Subliminal Misalignment
- Rethinking Black-Box On-Policy Distillation: A Rubric-based Analysis