anthropic.com/research/provable-inference

Progress on provable inference for large language models

Anthropic researchers describe FlashProve, an open-source prototype using zkSNARKs to let users verify a response came from the claimed model without revealing its weights. For a 400B-parameter Llama 4 Maverick model, one H100 produced proofs near 110 tokens per second, with roughly 19 MB proofs per 1,024-token request.


No comments yet

Be the first to share your thoughts.