Engineering

Language models are good at conversation and bad at policy. Here is how we split the two, and what it did to our error rate.

People notice a pause on the phone at around a second. This is the latency budget we work to, stage by stage.

If personal data reaches a model, no amount of filtering afterwards takes it back. Where we redact, and why it has to be first.