// Discipline 02
AI Systems Agents, MLOps and observability
From agent architecture to the model in production: governed agents, measurable evaluation and observability to know what the system does and why.
01 · Who it is for
Who it is for Companies taking AI to production With a prototype that works in the demo and fails on real data.
Development and engineering teams That need architecture, evaluation or MLOps for agents and LLMs.
Regulated entities That must be able to explain, audit and limit what a model does.
02 · How we work
How we work Consulting Agent architecture, model choice and an evaluation plan before building.
Development Agents, RAG and inference pipelines with traces, limits and tests, also on your own infrastructure.
Evaluation and audit Test suites, prompt red teaming and error measurement in production.
Training The open course QUANT AGENTIC ORCHESTRATION and custom workshops for teams.
03 · Specialties
Specialties Autonomous agents LLM fine-tuning and deployment Data and inference pipelines MLOps and observability AI applied to markets 04 · Method
Method 01 Diagnosis What data exists, which decision depends on it and what has failed so far.
02 Design Hypothesis, method and success criteria in writing, before building anything.
03 Build and test Reproducible code and analysis, tested against adverse cases.
04 Handover Everything is documented and in your team’s hands.
05 · Sectors
Sectors Finance Research, risk and compliance agents RAG over regulatory documentation Defense Evaluation and assurance of AI systems Assisted analysis of large volumes of text Civil Internal assistants over company documentation Process automation with human oversight 06 · Use cases
Use cases Illustrative cases: they describe the kind of work we do, not specific clients.
From prototype to production Problem An agent that gets the demo right and nobody knows why it fails afterwards. Approach Traces of every step, an in-house evaluation set and explicit limits on what it can do. Deliverable Deployed system, quality metrics and an operations guide. RAG that cites its sources Problem Plausible answers with no way to check them. Approach Indexing with metadata, evaluated retrieval and answers with verifiable citations. Deliverable Retrieval pipeline and quality dashboard. Governed agents for finance Problem Automating research or risk without losing control. Approach Agents with roles, permissions and human review at the critical steps. Deliverable Reference architecture and code (the basis of the QAO course). Model observability Problem Costs, latencies and errors nobody measures. Approach Telemetry for every call, alerts and continuous evaluation. Deliverable Dashboards and alerts integrated into your infrastructure. 07 · Data and topology
Data and topology An agent system is a graph: tools, memories, models and people connected. We design and measure it as such, node by node and path by path.
08 · Research
Research Jul 5, 2026 · 12 min
Second entry in the System 7 field diary — our poker agent for dev.fun's Arena: the pivot to heads-up, the node-locking that finally exploits for real, the v1.5 survival engine, and the war stories of running it in production.
System 7 Jun 21, 2026 · 12 min
A technical field report on building a poker agent for dev.fun's Arena: the heuristic method, LLMs at the table, and the honest results.
System 7 Everything under the tag → Other disciplines