Keep pulling the thread on Jared Kaplan.
The Constitutional Classifiers++ system achieves a 40x computational cost reduction compared to a baseline exchange classifier.
The Constitutional Classifiers++ system maintains a 0.05% refusal rate on production traffic.
During 1,700 hours of red-teaming, no attack on the Constitutional Classifiers++ system successfully elicited responses to all eight target queries with detail comparable to an undefended model.
The Constitutional Classifiers++ system uses exchange classifiers that evaluate model responses in their full conversational context to address vulnerabilities in systems that examine outputs in isolation.
The Constitutional Classifiers++ system implements a two-stage classifier cascade where lightweight classifiers screen all traffic and escalate only suspicious exchanges to more expensive classifiers.
The Constitutional Classifiers++ system improves robustness and reduces computational costs by ensembling efficient linear probe classifiers with external classifiers.
The Constitutional Classifiers++ system was evaluated through over 1,700 hours of red-teaming.
Constitutional Classifiers are presented as a practical and efficient safeguard for large language models.