And it’s a stronger programmer, achieving 71.2% on the Codex Human Level Python coding test compared to Claude 1.3’s 56%.Ĭlaude 2 can also answer more math problems correctly, scoring 88% on the GSM8K collection of grade-school-level problems - 2.8 percentage points higher than Claude 1.3. It’s capable of passing the multiple choice portion of the U.S. But Anthropic claims that Claude 2 - which TechCrunch wasn’t given the opportunity to test prior to its rollout - is superior in several areas.įor instance, Claude 2 scores slightly higher on a multiple choice section of the bar exam (76.5% versus Claude 1.3’s 73%). Like the old Claude (Claude 1.3), Claude 2 can search across documents, summarize, write and code and answer questions about particular topics. “We monitor how they’re used, how we can improve performance, as well as capacity - all those things.” “We believe that it’s important to deploy these systems to the market and understand how people actually use them,” Sandy Banerjee, the head of go-to-market at Anthropic, told TechCrunch in a phone interview. The API pricing hasn’t changed (~$0.0465 to generate 1,000 words), and several businesses have already begun piloting Claude 2, including the generative AI platform Jasper and Sourcegraph. both on the web and via a paid API (in limited access). The successor to Anthropic’s first commercial model, Claude 2 is available in beta starting today in the U.S. Anthropic, the AI startup co-founded by ex-OpenAI execs, today announced the release of a new text-generating AI model, Claude 2.

Sonic generations model