LLM を明確に解説する面白い論文 5 選

**

# Introduction

Large language models (LLMs) can feel complicated at first. There are transformers, attention layers, scaling laws, pretraining, instruction tuning, human feedback, retrieval, and many other ideas around them. But the best way to understand large language models is not to start with a huge textbook. A better way is to read a few important papers that each explain one major part of the system. This article is part of a fun series where we learn by exploring core ideas, practical projects, and the research papers behind modern technology. In this article, we will go through five papers that explain how LLMs work**. So, let's get started.

# 1. Attention Is All You Need

**

This is the Attention Is All You Need paper that introduced the Transformer architecture**, which is the foundation of modern LLMs. Before Transformers, many language models used recurrent or convolutional architectures to process sequences. This paper showed that attention alone could be enough to build a powerful sequence model. The most important concept in this paper is self-attention. Self-attention allows each token in a sequence to look at other tokens and decide which ones matter most. This is one of the reasons LLMs can understand context across long sentences and paragraphs. The paper also introduces multi-head attention, positional encoding, and the general Transformer block structure. It is important because almost every major LLM today — including GPT, Llama, Claude, Gemini, and Qwen-style models — is built on the Transformer idea.

# 2. Language Models Are Few-Shot Learners

**

This is the GPT-3 paper. It explains one of the biggest shifts in natural language processing (NLP): instead of training a separate model for every task, a large language model can perform many tasks just by reading instructions and examples in the prompt. The paper introduces GPT-3, a 175-billion-parameter autoregressive language model trained to predict the next token. The most interesting part is not just the model size, but the idea of in-context learning**. The model can see a few examples in the prompt and then continue the pattern without updating its weights. This paper is important because it explains why prompting became so powerful. It helps you understand why LLMs can answer questions, summarize text, translate, write code, and follow examples without being retrained for each task.

# 3. Scaling Laws for Neural Language Models

**

This Scaling Laws for Neural Language Models paper tried to answer a practical question: what happens when we make language models bigger, train them on more data, and use more compute?** It showed that model performance improves in predictable ways as parameters, data, and compute increase. This paper covers the scaling side of modern LLMs and explains why the field moved toward larger models and larger training runs. It is important because it gives you the system-level logic behind modern LLM training. It helps explain why companies invest so much in bigger models, larger datasets, and massive compute clusters. It also gives a useful foundation for understanding newer discussions around compute-optimal training, data quality, and efficient model scaling.

# 4. Training Language Models to Follow Instructions with Human Feedback

**

This is the InstructGPT paper. It explains how a base language model becomes more useful as an assistant. A pretrained model is good at predicting text, but that does not automatically mean it will follow instructions, be helpful, or produce safe responses. The paper uses a training process that includes supervised fine-tuning and reinforcement learning from human feedback (RLHF)**. First, humans write good example responses. Then humans rank model outputs. These rankings are used to train a reward model, and the language model is further optimized to produce responses that humans prefer. This paper is important because it explains the difference between a raw language model and an instruction-following assistant. If you want to understand why chat models behave differently from base models, you should definitely read it.

# 5. Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

**

This Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks** paper explains retrieval-augmented generation (RAG). The main idea is that a language model does not need to rely only on knowledge stored in its parameters. It can retrieve relevant documents from an external source and use them to generate better answers. The paper combines a pretrained generation model with a dense retriever and a document index. This allows the model to access external knowledge while generating responses. This is especially useful for question answering, factual tasks, and situations where information changes over time. This paper is important because many real-world LLM applications use some form of retrieval. Chatbots, enterprise assistants, search systems, customer support agents, and documentation tools often use RAG to ground responses in specific sources.

# Wrapping Up

**

Together, these five papers give you a good overview of how modern LLMs work:

Transformer architecture → pretraining → scaling → instruction tuning → retrieval-augmented generation****

Don't worry if you don't understand every equation or technical detail on your first read. The goal is simply to understand the main idea behind each paper and why it matters. Once you do, most LLM concepts will start to make a lot more sense.

Kanwal Mehreen** is a machine learning engineer and a technical writer with a profound passion for data science and the intersection of AI with medicine. She co-authored the ebook "Maximizing Productivity with ChatGPT". As a Google Generation Scholar 2022 for APAC, she champions diversity and academic excellence. She's also recognized as a Teradata Diversity in Tech Scholar, Mitacs Globalink Research Scholar, and Harvard WeCode Scholar. Kanwal is an ardent advocate for change, having founded FEMCodes to empower women in STEM fields.