The Wall of Wrong

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Searching for MobileNetV3

RoBERTa: A Robustly Optimized BERT Pretraining Approach

DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

Mistral 7B

Mamba: Linear-Time Sequence Modeling with Selective State Spaces

Stable LM 2 1.6B Technical Report

Yi: Open Foundation Models by 01.AI

MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

OLMoE: Open Mixture-of-Experts Language Models

Qwen2.5 Technical Report

2 OLMo 2 Furious

DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

SmolLM2: When Smol Goes Big — Data-Centric Training of a Small Language Model

Deep Residual Learning for Image Recognition

EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks

XLNet: Generalized Autoregressive Pretraining for Language Understanding

Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices

DeBERTa: Decoding-enhanced BERT with Disentangled Attention

Big Bird: Transformers for Longer Sequences

An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision

Learning Transferable Visual Models From Natural Language Supervision

Emerging Properties in Self-Supervised Vision Transformers

LoRA: Low-Rank Adaptation of Large Language Models

DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharing

Swin Transformer V2: Scaling Up Capacity and Resolution

A ConvNet for the 2020s

OPT: Open Pre-trained Transformer Language Models

Scaling Instruction-Finetuned Language Models

BLOOM: A 176B-Parameter Open-Access Multilingual Language Model

Robust Speech Recognition via Large-Scale Weak Supervision

BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models

Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling

DINOv2: Learning Robust Visual Features without Supervision

StarCoder: may the source be with you!

Llama 2: Open Foundation and Fine-Tuned Chat Models

Code Llama: Open Foundation Models for Code

Textbooks Are All You Need II: phi-1.5 technical report

The Falcon Series of Open Language Models

TinyLlama: An Open-Source Small Language Model

DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence

Gemma: Open Models Based on Gemini Research and Technology

Qwen2 Technical Report