Article · MarkTechPost · Thursday 5 November

Together AI Releases Together Compiler: Agents Make Inference Up to 2.6x Faster

Together AI released Together Compiler, an agent-driven loop that keeps re-optimizing the inference forward pass as traffic shifts. It beat the best InferenceX configurations by up to 2.6x TPS in under 24 hours per model.

Read at marktechpost.com The opening of the article at marktechpost.com.

In this story

A tool or model opens in the Heidelberg AI Curriculum: what it does, what it costs, how to start. A repo opens on GitHub.

More from MarkTechPost

All stories

ArticleMarkTechPost

Google AI Research Releases Agile Deliberation Framework for Gray-Area Image Classifiers

Google Research released Agile Deliberation, a human-in-the-loop framework that helps users define subjective visual concepts through borderline images. In 18 live sessions, it lifted Gemini-based classifier F1 by 10.5 points over zero-shot.

Repogoogle-research/google-research

5 h ago

ArticleMarkTechPost

webAI Releases TwIL-8B, an 8.8B Reasoning Model Scoring 98.2 on MATH-500

webAI released TwIL-8B, an 8.8B reasoning model post-trained from IBM Granite 4.2 8B. It posts 98.2 on MATH-500 and 81.6 on LiveCodeBench, but trails similar-size models on knowledge benchmarks.

12 h ago

ArticleMarkTechPost

Ricursive AI Releases Ripple-65B Preview: A 65B Dense Open-Weight Model Scoring 80.5 on Terminal-Bench 2.1

Ricursive Intelligence released Ripple-65B Preview, a 65B dense open-weight LLM under Apache 2.0. It scores 80.5 on Terminal-Bench 2.1, ahead of US open models up to 15x its size.

13 h ago

ArticleMarkTechPost

Tencent WeVisOne-VL Unifies Detection, OCR, Segmentation and Matting

Tencent’s WeChat Vision team released WeVisOne-VL, an Apache 2.0 vision language model in 2B and 4B sizes. It handles detection, OCR, counting, segmentation and alpha matting in one model, with a 9.6M-parameter pixel decoder.

Repotencent/wevisone-vl

1 day ago