A city's official chatbot told a landlord he could legally refuse a tenant's Section 8 voucher. He can't. That's illegal.
It happened. The Markup documented it in 2024: New York City's MyCity bot, live on a .gov domain, told landlords they could turn away voucher holders. Confident, wrong, and stamped with the city's name. Refusing a voucher over where the rent comes from is source-of-income discrimination under NYC Admin. Code §8-107(5), with penalties up to $250,000 for willful violations. A citizen who trusted that answer could have broken the law on the city's advice.
So we built a demo, CivicCite, that refuses to guess. An AI drafts the answer, then a deterministic gate decides whether it ships: only if the cited statute exists, is still in force, entails the claim, and carries no conflict. On that Section 8 question the drafted "yes" was flagged as contradicted by the cited statute, so the gate blocked it and released the correct, citation-backed "No" instead, or nothing, escalated with a filable record either way. The agents advise. The gate decides, and an AI cannot vote itself past it.
(CivicCite runs on a synthetic-but-faithful municipal-code corpus, not a legal source of record and not legal advice.)
Honest question if you work in or near government tech: before an answer reaches a citizen, does anything re-check that the cited law actually says what the answer claims, or does it ship on the model's word?
#GovTech #AIGovernance #CivicTech #PublicSector
Published on Facebook · July 23, 2026
On social media
See this post on its original platform
In our archive