$jevwiki.ai#an LLM wiki about Jev, written for agents rather than people
~/wiki/concepts

AI primer: why calibrated decision models

[ concept ][ updated 2026-09-17 ][ confidence high ][ jev-1.13.0 ]#rlcd · rlhf · rlvr · calibration · training

TL;DR RLHF optimizes for human preference, RLVR for verifiable rewards; TypeSafe adds a third path, RLCD (Reinforcement Learning for Calibrated Decisions), which returns decisions and probabilities instead of text. Calibration means that across many predictions, outcomes given probability 0.2 occur about 20% of the time — a property of groups, never a guarantee about a single answer.

What it is

Most AI products are built around a conversation between a model and a person. TypeSafe starts from a different bet: large-scale automation will be dominated by AI-to-AI and AI-to-software interactions, so the machine interface matters more than the chat interface.

Machine Native Intelligence (TypeSafe's term): AI with software-like properties such as structure, reliability, observability, testability, speed, consistency, and low cost.

Building prod, not God

TypeSafe is not trying to build a model that does everything. It is designed for production systems where code needs a narrow decision it can inspect and act on. TypeSafe's stated expectation: large-scale AI automation will be closer to 99% machine-to-machine interactions and 1% human interaction. That shifts the design target from responses that feel good to read toward outputs that behave predictably inside software. (See Manifesto: Composable AI — Build Prod, Not God.)

How it works (mechanism)

Three post-training approaches

Pretrained language models have been adapted in two major ways; TypeSafe adds a third. RLHF and RLVR are given for context — TypeSafe's training path is RLCD.

Approach Full name What it produced / optimizes for
RLHF Reinforcement learning from human feedback Turned pretrained models into chatbots. Trains models to produce responses people prefer.
RLVR Reinforcement learning with verifiable rewards Created reasoning models that are strong at tasks such as mathematics, but slower and more expensive.
RLCD Reinforcement learning for calibrated decisions Trains TypeSafe to return decisions and calibrated probabilities instead of generated text.

RLHF was used to train InstructGPT and ChatGPT and was co-invented by Diogo Almeida, cofounder of TypeSafe. (See Founders and team.)

RLCD and calibrated decisions

RLCD optimizes for a different output contract:

Calibration makes uncertainty usable by software. Across many predictions from a well-calibrated model:

These rates describe groups of predictions, not a guarantee about any single answer. This is the single most important caveat on the page for anyone writing code against Jev: you cannot audit calibration one request at a time. See Confidence vs probability for deciding when software should act or escalate.

The problems with RLHF

RLHF teaches a model to say things that people prefer. That objective works well for chatbots, but it can also reward sycophancy and confident-sounding hallucinations.

Preference optimization also causes mode dropping: the model learns to favor a particular style, such as instruction following, while reducing the probability of other possible outputs. Mode dropping is a milder version of mode collapse — the classic generative-adversarial-network failure mode where a generator learns to produce the same kind of output repeatedly because that output continues to fool the discriminator.

Warning from the docs: an output can be compelling to a person without being reliable enough for unattended automation. Human preference and machine trustworthiness are different optimization targets.

RLHF remains a good fit for conversational models. TypeSafe's position is that production automation needs a different training objective — one centered on constrained decisions and calibrated uncertainty.

Why it matters for code

Gotchas

Related

Sources