Explain LLM training and evaluation
SamsaraMachine Learning Engineer · Onsite
Last updated
This question evaluates an engineer's competency in LLM engineering, including transformer pretraining and finetuning, alignment approaches like instruction tuning and RLHF, strategies for reducing hallucinations, evaluation and production monitoring practices, and inference optimizations.
Explain how transformer-based large language models are pretrained and finetuned. Compare instruction tuning and RLHF, and discuss strategies to reduce hallucinations. How would you evaluate an LLM (e.g., perplexity, task accuracy, human evaluation) and monitor it in production? What inference optimizations (e.g., quantization, KV caching) would you apply?
Solution walkthrough is for members
Get the full walkthrough with reference code and complexity analysis, plus Kitty Coach at 300 messages a day. Hints, the code runner and community answers stay free.