How to become a Research Engineer (2026)

The roadmap, stage by stage

There are two parallel entry bars. A Master's plus production ML plus demonstrated systems engineering makes you competitive at OpenAI, Anthropic, DeepMind, Cohere, Mistral, Cursor, Databricks, Scale AI, and Cresta. A PhD (or equivalent research output) is more typical for Research Scientist than Research Engineer, though PhD REs exist. The staged path front-loads systems literacy: Stage 0 pushes you into CUDA basics, PyTorch internals, and a first Triton softmax kernel, because at frontier labs an RE is expected to read and profile kernels, not just call them. Stage 1 builds distributed-training literacy across FSDP2, DeepSpeed ZeRO-3, and Megatron-Core, with the signal being a reproduced multi-node training script that makes an explicit parallelism choice. Stage 2 is the heart of the role: the reproduce-a-paper muscle, benchmarked at 2-5 days per paper, producing clean open-source reimplementations of FlashAttention v3, RMSNorm, or a Llama block. Stage 3 moves into frontier internals and standardized evals; Stage 4 builds research-discussion fluency by reading 5+ papers weekly and rehearsing the contribution/methodology/strengths/extensions frame; Stage 5 tailors everything to a chosen lab; Stage 6 is the loop itself. The honest master checklist, per Jobs By Culture, is "8-12 weeks PyTorch fluency + 2-5 days per paper reproduction + 6-8 weeks interview prep + 1 standout open-source artifact." The full transition from senior SWE runs 12-24 months, or 3-5 years if you must build the math and research taste from zero. See the honest path writeup.

The 2026 stack to learn deeply

The 2026 ranking is explicit: PyTorch > FSDP2/DeepSpeed/Megatron > Triton > CUDA > JAX > FlashAttention/vLLM/HF > eval harnesses > experiment trackers. Tier 1 is the non-negotiable frontier core. PyTorch, deeply: every frontier lab uses it as the primary DL framework, and you should be able to reason about the dispatcher, autograd, inductor, and compile. JAX is rising fast because DeepMind is JAX-native and Anthropic is increasingly JAX-friendly for safety work, so you must be able to write and review a JAX training loop. The distributed-training glue is FSDP/FSDP2 (torch.distributed.fsdp), DeepSpeed ZeRO-3, Megatron-Core, and NVIDIA Megatron-FSDP; the build target is a multi-node script that reproduces a paper with an explicit parallelism choice. Triton, the kernel language, is a "plus" signal at OpenAI and Anthropic: write kernels for fused softmax, FlashAttention, and custom activations. CUDA literacy means enough to read kernels, profile them with nsys and Nsight, and reason about memory bandwidth versus compute. Tier 2 is the auxiliary stack: FlashAttention v3 as the canonical kernel to reproduce, vLLM for inference and eval generation, Hugging Face Transformers/Accelerate/TRL for fine-tuning and reward-model training, lm-eval-harness for standardized evals, and W&B or Neptune for experiment tracking. Tier 3 is specialization: for Anthropic interpretability, TransformerLens and nnsight; for OpenAI post-training, TRL plus GRPO plus custom reward models and high-throughput RL infrastructure; for DeepMind, JAX-native scaling and Gemini-family evals.

Portfolio projects that get you hired

The RE portfolio is judged on reproducibility and low-level depth, not breadth. The recommended ladder runs from foundational to standout:\n\n- nanoGPT-style training of a small custom GPT (PyTorch fluency plus paper-to-code).\n- Re-implement "Attention Is All You Need" in a 2-5 day sprint (reproducibility and Transformer literacy).\n- Implement a Llama-family block with RMSNorm, SwiGLU, and RoPE (modern-architecture literacy).\n- Implement FlashAttention v3 as a Triton kernel: this is the standout signal, and most candidates in any role still lack it.\n- Build an RLHF/DPO pipeline on a 7-13B open model (post-training depth).\n- Submit a public lm-eval-harness result for a frontier open model (standardized eval maturity).\n- Write a paper or blog post on a failure mode of a frontier model such as sycophancy or jailbreak reproducibility (frontier-model critique and "scrappy energy").\n- A mechanistic interpretability study using TransformerLens on an open-weight model (the Anthropic interpretability track signal).\n- An open-source contribution to vLLM, FSDP, or the HF Hub (production-system literacy).\n\nThe full standout portfolio is a small open-weight model trained end-to-end on a custom curated dataset with a public eval. Writing Triton kernels for fused softmax, RMSNorm, or a layer-norm variation beats another LoRA project in the eyes of frontier-lab REs, and a Triton-kernel write-up in blog form is the RE equivalent of an accepted open-source patch.

How the role is evolving

Post-training is the new hotness. OpenAI's Post-Training team is responsible for "training the models to be deployed into ChatGPT, the API, and future products," and reasoning models (the o1/o3/o4 line and GPT-5-pro reasoning variants) have arguably made post-training more important than pre-training in 2026. RLHF is shifting toward DPO, GRPO, and RLAIF: less human labeling, more programmatic and verifier-based reward modeling. Interpretability is rising fast enough that "Research Engineer, Interpretability" is now a discrete listing at Anthropic, and the "Tracing the thoughts of a large language model" paper is standard prep reading. Pre-training data quality is back: frontier labs have increasingly woven human-generated data into pre-training and mid-training stages through 2025-2026. Federated and privacy-preserving training is emerging for healthcare, finance, and government labs. Because the RE title (unlike Research Scientist) does not strictly require a publication record, artifact contributions like Triton kernels and open evals are increasingly the currency. Rising directions: post-training specialization, agentic RL, mechanistic interpretability, and multimodal foundation models. Fading: pure PPO/RLHF research and classical RL without a foundation-model context. Two cultural notes matter. Anthropic reference-checks during the cycle, a unique signature, so treat every collaborator and ex-manager as a future reference. And the "AI Safety Needs Great Engineers" thesis from 2021 still defines who gets hired: "Anthropic is bottlenecked on aligned engineering talent."

How to actually get hired

The 6-10 week prep timeline maps onto three distinct lab processes. OpenAI runs a recruiter screen, a technical phone screen, then a 4-6 hour virtual onsite (coding, system design, ML debugging, research discussion, behavioral), end-to-end roughly 6-8 weeks. Anthropic filters with a 90-minute CodeSignal (a 520+/600 score is the bar) plus reference checks, averaging about 20 days. Google DeepMind opens with a rapid-fire quiz on undergraduate fundamentals, then a hiring committee, and is faster than typical FAANG. The question bank spans math and theory (linear algebra: eigenvalues, SVD, PCA; calculus: gradient derivation, autodiff; probability: MLE, Bayesian; information theory), coding (Multi-Head Attention, Transformer layers, CNN, K-means, AUC, KV caching, quantization, speculative decoding), and system design ("how would you train a 100B+ parameter model" with tensor/pipeline/context parallelism). The paper-discussion round is distinctive: you receive a paper 2-3 days prior and must discuss its contribution, methodology, results, strengths/weaknesses, and possible extensions. Behaviorals carry lab phenotypes: OpenAI wants "AGI focus" and scrappy velocity, Anthropic wants safety-first alignment convictions and Constitutional AI enthusiasm, DeepMind wants "Googleyness & Leadership." Common switch-ins: senior SWE to RE with a research portfolio, ML Engineering Lead to RE with eval publications, and Senior ML Platform Engineer to RE with a kernel/Triton stack. ARENA's 4-5 week in-person bootcamps are the single most-targeted career-building program for alignment REs, with non-trivial alumni density at Anthropic and DeepMind safety roles.

Resources to learn from

Books

• Ian Goodfellow, Yoshua Bengio & Aaron Courville, Deep Learning — The foundational math and DL reference; best for refreshers on theory.
• David MacKay, Information Theory, Inference, and Learning Algorithms — Depth on information theory; a frontier-lab math signal.
• Sebastian Raschka, Build a Large Language Model (From Scratch) — From-scratch LLM build covering pretraining and finetuning internals.
• Jay Alammar & Maarten Grootendorst, Hands-On Large Language Models — Visual plus code coverage of RAG and applied LLMs.

Courses

• Andrej Karpathy, microgpt — 200 lines of pure Python with no deps (Feb 12, 2026); the most efficient first-pass RE mental model.
• ARENA (Alignment Research Engineer Accelerator) — 4-5 week in-person bootcamps, 2-3 per year; the top program for alignment REs. Fundamentals chapter at arena-chapter0-fundamentals.streamlit.app.
• BlueDot Impact, AI Safety Fundamentals — Free curriculum on alignment and reproducibility as an entry point to safety RE work.
• Hugging Face LLM Course — Practical HF fluency for production-grade work.

YouTube channels

• Andrej Karpathy — Build neural networks from scratch; the canonical first course for internal mechanics.
• Yannic Kilcher — Daily paper explainers at researcher pace; best for staying current and paper-discussion practice.
• Sebastian Raschka — 306 videos; the "Build a Large Language Model From Scratch" companion channel.
• StatQuest with Josh Starmer — 1.66M subscribers; clear math intuition to sharpen foundations.
• Machine Learning Street Talk — Long-form interviews with frontier researchers; best for building research taste.

Blogs & newsletters

• Ahead of AI (Sebastian Raschka) — Jan-May 2026 LLM papers list (Jun 6, 2026); the quarterly paper cadence.
• Interconnects (Nathan Lambert) — Daily post-training commentary; best for RLHF/DPO/GRPO depth.
• Lilian Weng's blog — Long-form technical posts on RLHF, agents, and diffusion (lilianweng.github.io).
• Tri Dao's blog and Twitter — FlashAttention v3 author; the canonical low-level LLM-systems voice on memory-efficient attention, Triton, and kernels.
• Anthropic Research (Interpretability team) — Interpretability posts; core Anthropic-specific prep.
• AI Alignment Forum — Community blog for technical AI alignment research: interpretability, safety, evals.

Papers & docs

• Vaswani et al., Attention Is All You Need (2017) — The conversational anchor for every research-discussion round.
• Kaplan et al., Scaling Laws for Neural Language Models (2020) — Defines how frontier models are trained.
• Tri Dao et al., FlashAttention (2022) — Cited 5,555+ times; memory-efficient attention and the base for FlashAttention v3.
• Ouyang et al., Training LMs to follow instructions with human feedback (2022) — The InstructGPT/RLHF paper; 28,111+ citations.
• Anthropic, Tracing the thoughts of a large language model (Mar 27, 2025) — Interpretability frontier; a candidate paper for Anthropic paper rounds.
• FSDP, DeepSpeed ZeRO-3, and Megatron-Core multi-node guide (Spheron) — Practical distributed-training walkthrough (Apr 29, 2026).

Communities worth joining

• EleutherAI Discord — Grassroots open-source AI research; strongest LM-internals community for pretraining, evals, dataset curation.
• AI Alignment Forum — Blog plus forum for alignment research discussions.
• Latent Space Discord — Practitioner interviews plus a weekly Paper Club; frontier-engineering talk.
• Hugging Face Discord — Largest HF-specific server; transformers/peft/TRL help.
• r/MachineLearning — Premier AI subreddit; paper announcements and technical discussion.
• r/LocalLLaMA — Local/open-model community; the open-weight frontier ecosystem.
• ARENA alumni network — Direct alignment-RE cohort after a 4-5 week bootcamp.
• AI Safety Fundamentals (BlueDot Impact) — Curriculum-based community on alignment and reproducibility.
• Anthropic "Research Engineer, Interpretability" listing — A discrete, recurring RE role signaling a structured interpretability career path.
• Events: COLM, NeurIPS, ICML, ICLR — Plus AI Engineer World's Fair, alignment workshops (AI Safety Camp), and Anthropic Fellows events.

Sources

• Jobs By Culture, Becoming an AI Research Engineer in 2026 (Jun 2, 2026)
• Sundeep Teki, AI Research Engineer Interview Guide (Nov 29, 2025)
• Sundeep Teki, How to Get Hired at OpenAI, Anthropic & DeepMind in 2026 (Mar 2026)
• Anthropic, Research Engineer, Interpretability (job listing)
• Anthropic, Tracing the thoughts of a large language model (Mar 27, 2025)
• Spheron, Distributed LLM Training: FSDP, DeepSpeed, Megatron (Apr 29, 2026)
• ARENA – AI Safety Education
• AI Safety Needs Great Engineers (Alignment Forum)