About the LLMOps & AI Observability Market Map
This market map tracks 94 startups across 8 categories in the LLMOps & AI Observability landscape. Evaluation frameworks, production monitoring, safety guardrails, prompt management, cost optimization, and model lifecycle tools keeping AI systems reliable and secure. Curated by Hartmann Capital's venture research team, it provides a comprehensive view of the companies building in this space, from early-stage startups to growth-stage leaders.
Categories & Companies
LLM Evaluation & Testing(18)
Braintrust (Series A, $45M) · Patronus AI (Series A, $20M) · Galileo (Series B, $68M) · Confident AI (Seed, $2.2M) · Maxim AI (Seed, $3M) · HoneyHive (Seed, $7.4M) · Promptfoo (Series A, $23.4M) · Comet ML (Series B, $63M) · Openlayer (Series A, $14.5M) · Deepchecks (Seed, $18.3M) · Kolena (Series A, $21M) · Trismik (Pre-Seed, $2.8M) · Okareo (Pre-Seed) · Cleanlab (Series A, $30M) · Athina AI (Seed, $4.1M) · Giskard (Seed, $1.6M) · LastMile AI (Seed, $10M) · AIMon (Pre-Seed, $2.3M)
AI Observability & Monitoring(13)
Arize AI (Series C, $131M) · LangSmith (Series B, $160M) · Fiddler AI (Series B, $68.6M) · Helicone (Seed, $5M) · Traceloop (Seed, $6.1M) · Langfuse (Acquired) · Evidently AI (Seed, $1.1M) · Langtrace (Seed, $5.3M) · AgentOps (Pre-Seed, $2.6M) · Judgment Labs (Seed) · WhyLabs (Acquired, $14M) · Aporia (Acquired, $30M) · Censius (Private)
AI Safety & Guardrails(12)
Lakera (Acquired, $30M) · Guardrails AI (Seed, $7.5M) · Protect AI (Acquired, $108M) · Arthur AI (Series B, $63M) · Prompt Security (Acquired, $23M) · CalypsoAI (Series A, $23M) · WitnessAI (Series B, $58M) · Dynamo AI (Series B, $30M) · Noma Security (Series B, $100M) · Lasso Security (Seed, $28M) · Robust Intelligence (Acquired, $30M) · Preamble (Seed)
Prompt Engineering & Management(9)
Vellum AI (Series A, $25.5M) · PromptLayer (Seed, $4.8M) · Portkey AI (Seed, $3M) · Agenta (Open Source) · Humanloop (Acquired, $8M) · Orq.ai (Seed, $7.3M) · Dify (Series A, $11.5M) · Klu (Pre-Seed, $1.7M) · Log10 (Seed, $7.2M)
AI Cost Optimization & FinOps(7)
Martian (Seed, $9M) · OpenRouter (Series A, $40M) · Unify (Series B, $59M) · LiteLLM (Seed) · Keywords AI (Seed) · Not Diamond (Seed, $2.3M) · Jinifi (Seed)
MLOps & Model Management(12)
Weights & Biases (Acquired, $250M) · Neptune.ai (Acquired, $18M) · MLflow (Open Source) · Determined AI (Acquired, $13.6M) · Scale AI (Series F, $1600M) · TrueFoundry (Series A, $21M) · ZenML (Seed, $6.4M) · DagsHub (Seed, $3.6M) · Valohai (Seed, $1.8M) · Modelbit (Seed) · MLRun (Open Source) · Jozu (Seed, $7M)
AI Gateway & Inference Infrastructure(12)
Baseten (Series E, $300M) · Fireworks AI (Series C, $250M) · Together AI (Series B, $534M) · Groq (Acquired, $750M) · Modal (Series B, $87M) · Replicate (Series B, $58M) · Anyscale (Series C, $260M) · Cerebrium (Seed, $8.5M) · BentoML (Series A, $20M) · Lepton AI (Acquired, $11M) · OctoAI (Acquired, $132M) · RunPod (Seed, $22M)
AI Data Privacy & Compliance(11)
Skyflow (Series B, $97M) · Relyance AI (Series B, $32M) · Tonic.ai (Series B, $45M) · Opaque Systems (Series B, $55.5M) · Gretel (Acquired, $67M) · Private AI (Series A, $11M) · Protopia AI (Series A, $25M) · Knostic (Series A, $16M) · Wald.ai (Seed, $4M) · Privado (Series A, $17.5M) · Nightfall AI (Series B, $60.3M)
Frequently Asked Questions
- What is the LLMOps & AI Observability market map?
- The LLMOps & AI Observability market map is a curated overview of 94 startups across 8 categories : LLM Evaluation & Testing, AI Observability & Monitoring, AI Safety & Guardrails, Prompt Engineering & Management, AI Cost Optimization & FinOps, MLOps & Model Management, AI Gateway & Inference Infrastructure, AI Data Privacy & Compliance. Evaluation frameworks, production monitoring, safety guardrails, prompt management, cost optimization, and model lifecycle tools keeping AI systems reliable and secure. It is maintained by Hartmann Capital's venture research team.
- How many startups are tracked?
- This map currently tracks 94 startups across 8 categories: LLM Evaluation & Testing (18 companies), AI Observability & Monitoring (13 companies), AI Safety & Guardrails (12 companies), Prompt Engineering & Management (9 companies), AI Cost Optimization & FinOps (7 companies), MLOps & Model Management (12 companies), AI Gateway & Inference Infrastructure (12 companies), AI Data Privacy & Compliance (11 companies).
- How can I submit my startup?
- You can submit your startup for inclusion by visiting the submission page. Submissions are reviewed by Hartmann Capital's research team.
- How often is this map updated?
- The LLMOps & AI Observability market map is updated on a rolling basis as new startups emerge, companies raise funding rounds, or the competitive landscape shifts.