Article · MarkTechPost · Friday 6 November

Zyphra ZYFA: FP8 FlashAttention for AMD MI355X, Up to 1.76x Faster

Zyphra released ZYFA, open-source FP8 and BF16 prefill attention kernels for AMD Instinct MI355X. On real model activations, its FP8 kernels run 1.16-1.76x faster than AMD’s AITER, with 62-78% lower error at head dimension 128.

Read at marktechpost.com The opening of the article at marktechpost.com.

In this story

A tool or model opens in the Heidelberg AI Curriculum: what it does, what it costs, how to start. A repo opens on GitHub.

More from MarkTechPost

All stories

ArticleMarkTechPost

Thinking Machines Releases Inkling 2 Small, a 594B MoE With 17B Active

Thinking Machines Lab released Inkling 2 Small, a 594B-parameter MoE with 17B active parameters. It scores 31 on the Artificial Analysis Intelligence Index and runs on Tinker, with Apache 2.0 weights planned.

Repothinking-machines-lab/tinker-cookbook

18 h ago

ArticleMarkTechPost

Together AI Releases Together Compiler: Agents Make Inference Up to 2.6x Faster

Together AI released Together Compiler, an agent-driven loop that keeps re-optimizing the inference forward pass as traffic shifts. It beat the best InferenceX configurations by up to 2.6x TPS in under 24 hours per model.

2 days ago

ArticleMarkTechPost

Google AI Research Releases Agile Deliberation Framework for Gray-Area Image Classifiers

Google Research released Agile Deliberation, a human-in-the-loop framework that helps users define subjective visual concepts through borderline images. In 18 live sessions, it lifted Gemini-based classifier F1 by 10.5 points over zero-shot.

Repogoogle-research/google-research

2 days ago

ArticleMarkTechPost

webAI Releases TwIL-8B, an 8.8B Reasoning Model Scoring 98.2 on MATH-500

webAI released TwIL-8B, an 8.8B reasoning model post-trained from IBM Granite 4.2 8B. It posts 98.2 on MATH-500 and 81.6 on LiveCodeBench, but trails similar-size models on knowledge benchmarks.

2 days ago