Lessons

1Enterprise AI system design48 min read

The reference stack that decides whether an LLM solution survives an audit, a Black Friday, or a prompt-injection incident — the seven layers, multi-tenancy, the SLO-first design move, streaming RAG vs nightly ETL, and the architecture round interviewers actually run.

  • →Enterprise AI Architecture
Read lesson
2Evals for customer-facing AI48 min read

Evals are the only artifact that tells a customer you know what “good” means — the five-class metric taxonomy, LLM-as-judge calibration to >80% human agreement, offline gates vs online sampling, capability-vs-regression suites, and the grader-is-production-code lesson behind Anthropic’s 42%→95% jump.

  • →Evaluation Design
Read lesson
3Observability & feedback loops46 min read

The discipline that lets you tell a customer in a Friday-night incident review what actually happened — the LLM span schema, why time-to-first-token is the new p95 (and how Intercom cut 2s with it), feedback loops that close the system, and continuous-eval drift detection.

  • →AI Observability
Read lesson
4MCP & enterprise connectors46 min read

The substrate that connects AI to a customer’s systems — MCP’s host/client/server model and primitive vocabulary, why it reframes integration from N×M to N+M, the consent/exec security boundaries, and the gateway pattern (Runlayer’s $11M bet on 18,000+ servers) that collapses the OAuth sprawl.

  • →Governed MCP Integration
Read lesson
5Discovery & value storytelling48 min read

The customer-facing half of the job — the SE’s discovery stack (MEDDPICC, SPIN implication questions, Challenger reframe), the fixed five-pain stack of enterprise AI, value/ROI storytelling with credible 200–600% ranges, arming the champion, and the discovery round interviewers run.

  • →Discovery and Value Selling
Read lesson
6Capstone: discovery → solution → demo50 min read

Run the full arc end to end — discovery to a quantified spec, a solution narrative in the customer’s vocabulary, and a hero/problem/resolution demo that re-states the value — then defend it under pressure across the two-round solutions-engineer loop (architecture + discovery/demo).

  • →Enterprise AI Architecture
  • →Evaluation Design
  • →Discovery and Value Selling
Read lesson

Skills in this course

  1. 01Enterprise AI ArchitectureDesign tenant-safe AI systems from requirements, data, SLOs, and cost.
  2. 02Evaluation DesignCombine deterministic, model-based, offline, and online quality checks.
  3. 03AI ObservabilityTrace model and agent behavior, latency, cost, feedback, and drift.
  4. 04Governed MCP IntegrationConnect enterprise tools through scoped identity, policy, and audit controls.
  5. 05Discovery and Value SellingTurn customer pain into a measurable PoV, architecture, and credible value story.