FundamentalsUpdated 2026-10-24

Instruction Tuning

Continued training on instruction-response data so a model follows human instructions better.

#训练#对齐#助手

In plain language

A pretrained model only continues text; instruction tuning turns it into an assistant. Training data contains task descriptions, inputs and ideal responses across QA, summarization, writing and refusal. It improves instruction-following and format stability, not knowledge injection; factual updates still require retrieval or continued pretraining. Data quality matters more than volume: a small, diverse, high-quality set often beats mass-produced templates.

Example

After instruction tuning, the same base model follows “answer in three bullets” instead of continuing with prose.

Recommended tools

Related terms