Second Brain

❯

100 Reference notes

❯

Folder: 100-Reference-notes/101-Literature

213 items under this folder.

Oct 08, 2025
Into the Rabbit Hull - From Task-Relevant Concepts in DINO to Minkowski Geometry
Sep 29, 2025
Rethinking JEPA - Compute-Efficient Video SSL with Frozen Teachers
- video
- ssl
Jul 25, 2025
Back to the Features - DINO as a Foundation for Video World Models
Jul 25, 2025
EA-ViT - Efficient Adaptation for Elastic Vision Transformer
- efficient_vision
Jul 18, 2025
Franca - Nested Matryoshka Clustering for Scalable Visual Representation Learning
Jul 11, 2025
KV Cache Steering for Inducing Reasoning in Small Language Models
Jul 08, 2025
NeoBabel - A Multilingual Open Tower for Visual Generation
- multimodal
- llm
Jun 11, 2025
IntPhys 2 - Benchmarking Intuitive Physics Understanding In Complex Synthetic Environments
Jun 11, 2025
V-JEPA 2 - Self-Supervised Video Models Enable Understanding, Prediction and Planning
Jun 10, 2025
MoSiC - Optimal-Transport Motion Trajectory for Dense Self-Supervised Learning
- computer_vision
- ssl
Jun 01, 2025
Self-supervised learning of intertwined content and positional features for object detection
- vit
- ssl
Apr 02, 2025
Learning from Streaming Video with Orthogonal Gradients
Mar 11, 2025
Principal Components Enable A New Language of Images
Mar 03, 2025
Deep Learning is Not So Mysterious or Different
Feb 26, 2025
Rate–Distortion–Perception Trade-Off in Information Theory, Generative Models, and Intelligent Communications
- information_theory
- dl_theory
Feb 19, 2025
FlexTok - Resampling Images into 1D Token Sequences of Flexible Length
Feb 17, 2025
Intuitive physics understanding emerges from self-supervised pretraining on natural videos
Feb 14, 2025
Simplifying DINO via Coding Rate Regularization
Feb 12, 2025
Cluster and Predict Latents Patches for Improved Masked Image Modeling
Feb 10, 2025
From Image to Video - An Empirical Study of Diffusion Representations
- video
- diffusion
Feb 10, 2025
From Pixels to Components - Eigenvector Masking for Visual Representation Learning
Feb 10, 2025
Occam's model - Selecting simpler representations for better transferability estimation
Feb 04, 2025
Layer by Layer - Uncovering Hidden Representations in Language Models
- interpretability
Jan 07, 2025
Cosmos World Foundation Model Platform for Physical AI
Dec 19, 2024
Scaling 4D Representations
- video
Dec 18, 2024
TRecViT - A Recurrent Video Transformer
- video
- vit
Dec 13, 2024
Byte Latent Transformer - Patches Scale Better Than Tokens
- llm
- nlp
Dec 06, 2024
Slicing Vision Transformer for Flexible Inference
Dec 04, 2024
Beyond cls - Exploring the true potential of Masked Image Modeling representations
Nov 12, 2024
Interaction Asymmetry - A General Principle for Learning Composable Abstractions
- dl_theory
Oct 31, 2024
Group Crosscoders for Mechanistic Analysis of Symmetry
- mechinterp
- computer_vision
Oct 28, 2024
HoPE - A Novel Positional Encoding Without Long-Term Decay for Enhanced Context Awareness and Extrapolation
Oct 28, 2024
LoRA vs Full Fine-tuning - An Illusion of Equivalence
- dl_theory
Oct 10, 2024
Lost in Time - A New Temporal Benchmark for VideoLLMs
Oct 08, 2024
Round and Round We Go! What makes Rotary Positional Encodings useful?
Oct 03, 2024
Searching for Efficient Linear Layers over a Continuous Space of Structured Matrices
- dl_theory
Oct 01, 2024
nGPT - Normalized Transformer with Representation Learning on the Hypersphere
Sep 26, 2024
HydraViT - Stacking Heads for a Scalable ViT
Aug 20, 2024
Near, far - Patch-ordering enhances vision foundation models' scene understanding
Aug 06, 2024
Learning to Learn without Forgetting using Attention
- continual_learning
Jul 29, 2024
Apple Intelligence Foundation Language Models
- efficient_dl
Jul 15, 2024
No Train, all Gain - Self-Supervised Gradients Improve Deep Frozen Representations Yuki M Asano
Jul 13, 2024
Hydra - Bidirectional State Space Models Through Generalized Matrix Mixers
- sequence_models
Jul 05, 2024
Revealing the Utilized Rank of Subspaces of Learning in Neural Networks
- dl_theory
Jul 04, 2024
Improving Self Consistency in LLMs through Probabilistic Tokenization
- llm
- dl_theory
Jul 03, 2024
How JEPA Avoids Noisy Features - The Implicit Bias of DeepLinear Self Distillation Networks
- dl_theory
Jun 24, 2024
Building on Efficient Foundations - Effectively Training LLMs with Structured Feedforward Layers
Jun 17, 2024
Refusal in Language Models Is Mediated by a Single Direction
Jun 14, 2024
LieRE - Generalizing Rotary Position Encodings
- dl_theory
- vit
Jun 13, 2024
An Image is Worth More Than 16x16 Patches - Exploring Transformers on Individual Pixels
Jun 10, 2024
Learning Continually by Spectral Regularization
Jun 05, 2024
Exact Conversion of In-Context Learning to Model Weights in Linearized-Attention Transformers
- transformers
Jun 04, 2024
Block Transformer - Global-to-Local Language Modeling for Fast Inference
- efficient_dl
- transformers
Jun 03, 2024
The Geometry of Categorical and Hierarchical Concepts in Large Language Models
- dl_theory
- geometry
May 30, 2024
Symmetries in Overparametrized Neural Networks - A Mean-Field View
- dl_theory
- equivariance
May 30, 2024
The Empirical Impact of Neural Parameter Symmetries, or Lack Thereof
May 25, 2024
Certifying Adapters - Enabling and Enhancing the Certification of Classifier Adversarial Robustness
- robustness
May 23, 2024
Grokked Transformers are Implicit Reasoners - A Mechanistic Journey to the Edge of Generalization
- transformers
- mechinterp
May 17, 2024
Using Degeneracy in the Loss Landscape for Mechanistic Interpretability
Apr 26, 2024
Parameter Efficient Fine-tuning of Self-supervised ViTs without Catastrophic Forgetting
Apr 22, 2024
OpenELM - An Efficient Language Model Family with Open-source Training and Inference Framework
- llm
- foundation_models
Apr 21, 2024
Mixture of LoRa Experts
- peft
- efficient_dl
Apr 12, 2024
Scaling (Down) CLIP - A Comprehensive Analysis of Data, Architecture, and Training Strategies
Apr 10, 2024
Average entropy of Gaussian mixtures
- information_theory
Apr 09, 2024
Simultaneous linear connectivity of neural networks modulo permutation
Apr 04, 2024
AdaGlimpse - Active Visual Exploration with Arbitrary Glimpse Position and Scale
Apr 03, 2024
Talaria - Interactively Optimizing Machine Learning Models for Efficient Inference
- efficient_dl
Mar 29, 2024
Efficient Modulation for Vision Networks
- efficient_dl
- computer_vision
Mar 29, 2024
Rewrite the Stars
- dl_theory
- efficient_dl
Mar 28, 2024
DenseNets Reloaded - Paradigm Shift Beyond ResNets and ViTs
Mar 27, 2024
ViTAR - Vision Transformer with Any Resolution
Mar 26, 2024
The Unreasonable Ineffectiveness of the Deeper Layers
Mar 20, 2024
Rotary Position Embedding for Vision Transformer
- efficient_dl
- vit
Mar 05, 2024
Emergent Equivariance in Deep Ensembles
- equivariance
- dl_theory
Feb 17, 2024
On Good Practices for Task-Specific Distillation of Large Pretrained Visual Models
Feb 15, 2024
Revisiting Feature Prediction for Learning Visual Representations from Video
- video
- ssl
Feb 13, 2024
PIN - Positional Insert Unlocks Object Localisation Abilities in VLMs
- multimodal
- object_localisation
Feb 07, 2024
EfficientViT-SAM - Accelerated Segment Anything Model Without Accuracy Loss
- efficient_dl
- vit
Feb 03, 2024
Parameter-Efficient Fine-Tuning for Pre-Trained Vision Models - A Survey
Jan 25, 2024
Rethinking patch dependence for masked autoencoders
- computer_vision
- ssl
Jan 20, 2024
LRP-QViT - Mixed-Precision Vision Transformer Quantization via Layer-wise Relevance Propagation
Jan 17, 2024
Vision Mamba - Efficient Visual Representation Learning with Bidirectional State Space Model
Jan 11, 2024
Surgical-DINO - Adapter Learning of Foundation Models for Depth Estimation in Endoscopic Surgery
Jan 09, 2024
Low-Resource Vision Challenges for Foundation Models
Dec 13, 2023
Harmonics of Learning - Universal Fourier Features Emerge in Invariant Networks
Dec 11, 2023
4M - Massively Multimodal Masked Modeling
- multimodal
Dec 01, 2023
Mamba - Linear-Time Sequence Modeling with Selective State Spaces
- foundation_models
- convolutions
Nov 30, 2023
Knowledge Transfer from Vision Foundation Models for Efficient Training of Small Task-specific Models
- efficient_dl
- foundation_models
Nov 28, 2023
MobileCLIP - Fast Image-Text Models through Multi-Modal Reinforced Training
Nov 24, 2023
Fast, Expressive SE(n) Equivariant Networks through Weight-Sharing in Position-Orientation Space
- geometric_dl
- equivariance
Nov 22, 2023
White-Box Transformers via Sparse Rate Reduction - Compression Is All There Is
- compression
- dl_theory
Nov 09, 2023
Are - Hierarchical - Visual Representations Hierarchical
Oct 30, 2023
Battle of the Backbones - A Large-Scale Comparison of Pretrained Models across Computer Vision Tasks
Oct 28, 2023
Patch-Wise Self-Supervised Visual Representation Learning - A Fine-Grained Approach
Oct 24, 2023
TiC-CLIP - Continual Training of CLIP models
- continual_learning
- multimodal
Oct 23, 2023
SAM-CLIP - Merging Vision Foundation Models towards Semantic and Spatial Understanding
- efficient_dl
- efficient_vision
Oct 20, 2023
Learning with Unmasked Tokens Drives Stronger Vision Learners
Oct 12, 2023
Is ImageNet worth 1 video Learning strong image encoders from 1 long unlabelled video
Oct 11, 2023
MatFormer - Nested Transformer for Elastic Inference
Oct 09, 2023
SimPLR - A Simple and Plain Transformer for Scaling-Efficient Object Detection and Segmentation
Oct 06, 2023
Model Compression in Practice - Lessons Learned from Practitioners Creating On-device Machine Learning Experiences
- efficient_dl
- rq
Oct 03, 2023
Discovering Symmetry Breaking in Physical Systems with Relaxed Group Convolution
Oct 03, 2023
Relaxed Octahedral Group Convolution for Learning Symmetry Breaking in 3D Physical Systems
- relaxed_equivariance
- equivariance
Oct 02, 2023
Adapting Vision Foundation Models for Plant Phenotyping
- peft
- foundation_models
Sep 28, 2023
Vision Transformers Need Registers
Sep 07, 2023
DropPos - Pre-Training Vision Transformers by Reconstructing Dropped Positions
- foundation_models
- vit
Jul 31, 2023
Stochastic positional embeddings improve masked image modeling
- ssl
- dl_theory
Jul 18, 2023
Llama 2 - Open Foundation and Fine-Tuned Chat Models
- foundation_models
- transformers
Jul 11, 2023
Memorization Through the Lens of Curvature of Loss Function Around Samples
- dl_theory
- llm
Jul 07, 2023
Equivariance with Learned Canonicalization Functions
Jun 24, 2023
Structuring Representation Geometry with Rotationally Equivariant Contrastive Learning
Jun 22, 2023
Learning Unseen Modality Interaction
- multimodal
- llm
Jun 17, 2023
Self-Guided Diffusion Models
- computer_vision
- diffusion
Jun 15, 2023
Retrospective - EIE - Efficient Inference Engine onSparse and Compressed Neural Network
- efficient_dl
Jun 12, 2023
A Brief Review of Hypernetworks in Deep Learning
- hypernetworks
Jun 09, 2023
FLSL - Feature-level Self-supervised Learning
- vit
- ssl
Jun 08, 2023
R-MAE - Regions Meet Masked Autoencoders
- foundation_models
Jun 06, 2023
Learning Representations on the Unit Sphere - Investigating Angular Gaussian and von Mises-Fisher Distributions for Online Continual Learning
Jun 01, 2023
AWQ - Activation-aware Weight Quantization for LLM Compression and Acceleration
- efficient_dl
- quantization
May 24, 2023
Fourier Transformer - Fast Long Range Modeling by Removing Sequence Redundancy with FFT Operator
- dl_theory
- spectral
May 22, 2023
Improving Convergence and Generalization Using Parameter Symmetries
May 17, 2023
Efficient Equivariant Transfer Learning from Pretrained Models
- equivariance
May 01, 2023
What Do Self-Supervised Vision Transformers Learn?
Apr 24, 2023
A Cookbook of Self-Supervised Learning
Apr 19, 2023
To Compress or Not to Compress- Self-Supervised Learning and Information Theory - A Review
- information_theory
- dl_theory
Apr 17, 2023
DETRs Beat YOLOs on Real-time Object Detection
- computer_vision
- efficient_dl
Apr 14, 2023
DINOv2 - Learning Robust Visual Features without Supervision
Apr 05, 2023
Segment Anything
Mar 23, 2023
Optimization Dynamics of Equivariant and Augmented Neural Networks
Mar 22, 2023
Correlational Image Modeling for Self-Supervised Visual Pre-Training
- ssl
- dense_ssl
Mar 20, 2023
EVA-02 - A Visual Representation for Neon Genesis
Mar 08, 2023
A general theory of correct, incorrect, and extrinsic equivariance
Feb 14, 2023
Self-supervised learning of Split Invariant Equivariant representations
Feb 07, 2023
Equivariance-aware architectural optimization of neural networks
- dl-theory
- equivariance
Feb 04, 2023
Equi-Tuning - Group Equivariant Fine-Tuning of Pretrained Models
- dl-theory
- equivariance
Jan 30, 2023
Unlocking Slot Attention by Changing Optimal Transport Costs
- computer_vision
- video
Jan 19, 2023
Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture
Jan 12, 2023
Progress measures for grokking via mechanistic interpretability
- interpretability
- mechinterp
Dec 27, 2022
The Forward-Forward Algorithm - Some Preliminary Investigations
- dl_theory
- optimization
Dec 15, 2022
FlexiViT - One Model for All Patch Sizes
Dec 05, 2022
Location-Aware Self-Supervised Transformers for Semantic Segmentation
- ssl
- computer_vision
Nov 22, 2022
DETRs with Collaborative Hybrid Assignments Training
Oct 27, 2022
PatchRot - A Self-Supervised Technique for Training Vision Transformers
- vit
- ssl
Oct 24, 2022
Robust Self-Supervised Learning with Lie Groups
Oct 20, 2022
Surgical Fine-Tuning Improves Adaptation to Distribution Shifts
- peft
- efficient_dl
Oct 18, 2022
VideoMAE - Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Training
- video
- ssl
Oct 13, 2022
The Hidden Uniform Cluster Prior in Self-Supervised Learning
- dl_theory
- ssl
Oct 06, 2022
The Lie derivative for measuring learned equivariance
- equivariance
Oct 05, 2022
RankMe - Assessing the downstream performance of pretrained self-supervised representations by their rank
- ssl
- dl_theory
Oct 04, 2022
VICRegL - Self-Supervised Learning of Local Visual Features
Sep 29, 2022
In Search of Projectively Equivariant Networks
- equivariance
- dl_theory
Sep 29, 2022
Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations
Jul 15, 2022
Position Prediction as an Effective Pretraining Strategy
- ssl
- foundation_models
Jul 07, 2022
Equivariant Representation Learning via Class-Pose Decomposition
Jun 27, 2022
Guillotine Regularization - Why removing layers is needed to improve generalization in Self-Supervised Learning
Jun 21, 2022
On the Maximum Hessian Eigenvalue and Generalization
- optimizability
Jun 18, 2022
Self-Supervised Learning of Object Parts for Semantic Segmentation
Jun 03, 2022
On the duality between contrastive and non-contrastive self-supervised learning
May 27, 2022
On the Symmetries of Deep Learning Models and their Internal Representations
- dl_theory
May 26, 2022
Matryoshka Representation Learning
- dl_theory
May 13, 2022
Toward a Geometrical Understanding of Self-supervised Contrastive Learning
Apr 14, 2022
DeiT III - Revenge of the ViT
- vit
Apr 04, 2022
Exploiting Redundancy - Separable Group Convolutional Networks on Lie Groups
- equivariance
- geometric_dl
Mar 30, 2022
Exploring Plain Vision Transformer Backbones for Object Detection
Mar 30, 2022
How Does SimSiam Avoid Collapse Without Negative Samples A Unified Understanding with Self-supervised Contrastive Learning
Mar 18, 2022
Three things everyone should know about Vision Transformers
- computer_vision
- vit
Feb 14, 2022
How do vision transformers work?
Jan 28, 2022
Approximately equivariant networks for imperfectly symmetric dynamics
Jan 10, 2022
A ConvNet for the 2020s
Jan 03, 2022
Vision Transformer with Deformable Attention
- transformers
- computer_vision
Dec 22, 2021
A Mathematical Framework for Transformer Circuits
- mechinterp
- transformers
Nov 25, 2021
BoxeR - Box-Attention for 2D and 3D Transformers
- transformers
- object_detection
Nov 11, 2021
Masked Autoencoders Are Scalable Vision Learners
- computer_vision
- vit
Oct 19, 2021
Learning Partial Equivariances from Data
- equivariance
- partial_equivariance
Oct 08, 2021
ViDT - An Efficient and Effective Fully Transformer-based Object Detector
Oct 05, 2021
MobileViT - light-weight, general-purpose, and mobile-friendly vision transformer
- efficient_dl
- efficient_vision
Jun 28, 2021
Early Convolutions Help Transformers See Better
Jun 17, 2021
LoRA - Low-Rank Adaptation of Large Language Models
- efficient_dl
- peft
Jun 15, 2021
BEiT - BERT Pre-Training of Image Transformers
Jun 09, 2021
Is Space-Time Attention All You Need for Video Understanding
May 09, 2021
FNet - Mixing Tokens with Fourier Transforms
Apr 29, 2021
Emerging Properties in Self-Supervised Vision Transformers
Mar 25, 2021
A survey of quantization methods for efficient neural network inference
- efficient_dl
Feb 25, 2021
How to represent part-whole hierarchies in a neural network
- dl_theory
Feb 20, 2021
Provably Strict Generalisation Benefit for Equivariant Models
- dl_theory
- equivariance
Feb 04, 2021
CKConv - Continuous Kernel Convolution For Sequential Data
- convolutions
- dl_theory
Dec 08, 2020
Neural Mechanics - Symmetry and Broken Conservation Laws in Deep Learning Dynamics
- dl_theory
Nov 20, 2020
Exploring Simple Siamese Representation Learning
Nov 18, 2020
Dense Contrastive Learning for Self-Supervised Visual Pre-Training
Oct 22, 2020
An image is worth 16x16 words - Transformers for image recognition at scale
- vit
- transformers
Oct 08, 2020
Deformable DETR - Deformable Transformers for End-to-End Object Detection
Jun 17, 2020
Unsupervised Learning of Visual Features by Contrasting Cluster Assignments
- vit
May 26, 2020
End-to-End Object Detection with Transformers
May 20, 2020
Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere
Dec 03, 2019
Towards Understanding the Spectral Bias of Deep Learning
- dl_theory
- spectral
Nov 13, 2019
A Hierarchy of Graph Neural Networks Based on Learnable Local Features
Nov 08, 2019
On the Relationship between Self-Attention and Convolutional Layers
Jun 14, 2019
Fixing the train-test resolution discrepancy
- vit
May 03, 2019
Scaling and Benchmarking Self-Supervised Visual Representation Learning
- ssl
- representation_learning
Jan 29, 2019
An Investigation into Neural Net Optimization via Hessian Eigenvalue Density
Jan 23, 2019
Rethinking Lossy Compression - The Rate-Distortion-Perception Tradeoff
- dl_theory
- information_theory
Dec 05, 2018
Towards a Definition of Disentangled Representations
- disentanglement
- dl_theory
Dec 02, 2018
ProxylessNAS - Direct Neural Architecture Search on Target Task and Hardware
- efficient_dl
- nas
Apr 03, 2018
Hyperspherical Variational Auto-Encoders
- geometric_dl
Feb 11, 2018
G-SGD - Optimizing ReLU Neural Networks in its Positively Scale-Invariant Space
- dl_theory
Jun 07, 2017
Training quantized nets - A deeper understanding
- quantization
May 15, 2017
Curiosity-driven Exploration by Self-supervised Prediction
- rl
Mar 17, 2017
Deformable Convolutional Networks
- cnn
- computer_vision
Nov 03, 2015
Understanding symmetries in deep networks
- dl_theory
Oct 31, 2015
Color Space Transformation Network
- cnn
Jun 08, 2015
Learning both Weights and Connections for Efficient Neural Networks
May 19, 2015
Unsupervised Visual Representation Learning by Context Prediction
- ssl
Jan 01, 1989
Optimal Brain Damage

Created with Quartz v4.5.2 © 2025