Heidelberg AI News

Article · Interconnects ·

How well can we measure open model inference share?

My longest running agent testbed has been building the Interconnects Dashboard — an aggregator of all of the best data on open model adoption and performance from across the web. This dashboard is freely available and becoming quite useful.

Read at interconnects.ai The opening of the article at interconnects.ai.

More from Interconnects

All stories

ArticleInterconnects

Was I wrong about open models & cyber risks?

Last week coined the term “Black October“ after an onslaught of critical vulnerability disclosures, including PHP2Shell and GitLab, signified the moment when the cyber risks of AI models started to materialize.

ArticleInterconnects2 sources

Artificial Analysis v5 and the benchmarker's dilemma

Hill-climbing is easy, knowing what to hill-climb is hard. Making scores go up is expensive , but we have a much clearer playbook for it than we do for creating meaningful benchmarks at the true frontier of AI today.