The role
0301Design and build production-grade agentic systems end-to-end: multi-agent orchestration, RAG pipelines, policy-based routing, tool invocation, memory management, and lifecycle observability;
02Build and own RAG pipelines: embeddings, chunking strategy, vector search, context window engineering and tuning against real quality targets;
03Integrate and abstract across multiple LLM providers - OpenAI, Anthropic, Vertex AI, and open-source models - with fallback routing, token, cost, and latency management;
04Implement LLMOps in production: eval harnesses with real quality metrics, prompt versioning, observability tooling (LangSmith, Braintrust, or equivalent), cost and safety monitoring;
05Embed directly with client engineering teams to design, prototype, and deploy agentic solutions - workshops, proofs of concept, code-with sessions, and architecture walkthroughs;
06Build reusable patterns, accelerators, and playbooks that scale beyond the individual client engagement and enable the next one to start faster;
07Define and use metrics to measure agent accuracy, latency, safety, and cost-effectiveness; present findings and recommendations to client stakeholders in business terms.