https://techcrunch.com/2024/03/28/xs-grok-chatbot-will-soon-get-an-upgraded-model-grok-1-5/

X.ai, Elon Musk’s AI startup, has revealed its latest generative AI model, Grok-1.5. Set to power social network X’s Grok chatbot in the not-to-distant future (“in the coming days,” X.ai writes in a blog post), Grok-1.5 appears to be a measurable upgrade over its predecessor, Grok-1 — at least judging by the benchmark results and specs that X has published.

Grok-1.5 benefits from “improved reasoning,” according to X.ai, particularly where it concerns coding and math-related tasks. The model more than doubles Grok-1’s score on a popular mathematics benchmark, MATH, and scores over ten percentage points better on the HumanEval test of programming language generation and problem-solving abilities.