#mlcommons

Standardize Gen AI Service Evaluation: An API-Centric Benchmarking Approach Evaluating Gen AI services across heterogeneous environments presents significant visibility gaps for developers, as traditional hardware-centric b...

1 day ago

🎤 David Kanter is speaking at #GTC2026!

"If It Has an API, We Can Measure It: MLPerf Enters the Gen AI Era"

📅 March 19 · 12–12:40 PM · San Jose Convention Center
🔗 https://bit.ly/4l5p8Uh
#MLPerf #MLCommons #GenAI

1 3 0 0

Join our AI Community | MLCommons Join the MLCommons community. As the leading AI benchmarking organization in the world, our membership spans over 125+ global organizations.

1 week ago

125+ members. Safety, inference, training, storage, automotive benchmarks & more. MLCommons exists because neutral AI measurement standards require a community. Get involved: mlcommons.org/get-involved/ #MLCommons

0 0 0 0

Standardize Gen AI Service Evaluation: An API-Centric Benchmarking Approach Evaluating Gen AI services across heterogeneous environments presents significant visibility gaps for developers, as traditional hardware-centric b...

1 week ago

AI benchmarking is moving to the API layer. MLCommons Co-Founder David Kanter presents MLPerf Endpoints at NVIDIA GTC on March 19, 12–12:40 PM PT. Worth attending if you're making decisions about AI infrastructure.
https://bit.ly/4l5p8Uh
#GTC2026 #MLCommons

0 0 0 0

2 weeks ago

Last week, Rebecca Weiss announced the AILuminate Global Assurance Program from the stage of a global AI standards panel in New Delhi. Read about the program and watch the panel below.
📖 https://bit.ly/4kIS18x
▶️ https://bit.ly/46nDtp3
#AIImpactSummit #MLCommons #AILuminate

0 0 0 0

3 weeks ago

Friday at #AIImpactSummitIndia — who controls AI matters as much as who can access it.
#MLCommons' Peter Mattson joins The Alan Turing Institute, Microsoft, Gates Foundation, GoI & more for "Trustworthy AI for All."
🕥 10:30–11:30 AM IST | Bharat Mandapam
▶️ https://bit.ly/40jS0OQ
#TrustworthyAI

1 1 0 0

1 month ago

1/4 🧵
First Qwen model in MLPerf.
40M products daily.
Real production data from Shopify's e-commerce infrastructure.
Submit by Feb 13, 2026 👇
#MLPerf #Shopify #VLM #MLCommons

0 0 1 0

MLCommons MLPerf Inference v6.0 Qwen3-VL Shopify Catalog text on a checkered background with mlcommons and shopify logos

1 month ago

🚀 NEW: MLPerf Inference v6.0 debuts Qwen3-VL + Shopify Product Catalog benchmark
40M products daily. Real production data. First Qwen model in MLPerf.
Submit by Feb 13, 2026 →
https://bit.ly/4k9F5YS
#MLPerf #VLM #Shopify #MLCommons

1 1 0 0

1 month ago

www.youtube.com

🎥 KEYNOTE: Accelerating AI Trust & Velocity

David Kanter on how we move fast AND build trust.

Spoiler: It's not either/or. Benchmarking enables both.

Watch: https://youtu.be/RkaApbTsNMc?si=FY6VbfUS74LY1N2v

#Endpoints2025 #MLCommons

0 0 0 0

MLCommons Endpoints 2025 - YouTube

1 month ago

Endpoints 2025 sessions are available on YouTube!

14 sessions on:
→ AI benchmarking
→ Agentic evaluation
→ Token economics
→ Safety & risk
→ Data quality

Valuable content if you're working on AI deployment, benchmarking, or safety.

Full playlist: https://bit.ly/4jYqlfw

#Endpoints2025 #MLCommons

2 0 0 1

1 month ago

Stay tuned for tomorrow’s roundtables, where we'll be diving deep into AI security and industry-AISI collaboration. The goal? Aligning global perspectives to ensure AI is a force for good. 🌏✨
#AISafety #TrustworthyAI #MLCommons #OpenScience

0 0 0 0

3 months ago

Best use of AI in business:
Zain- Coding Agents
Sreekanth- Human Collaboration
Naveen- Deep Research to Prometheus
Jay- Service as a Software solutions
@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025

2 0 0 0

3 months ago

"The move to AI on the edge will be driven by robotics." Naveen Rao w/ Unconventional AI
@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025

3 0 1 0

3 months ago

Microsoft M12
Scaling AI is all about the:
Tokens per dollar per Watt curve.
Right now the biggest bottleneck is memory and next is energy.

@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025

1 0 0 0

3 months ago

Microsoft M12
AI is so disruptive and evolving in a way that's so different than we thought it would it requires us to think about the future differently.
@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025

0 0 0 0

3 months ago

Currently, SaaS companies spend around 30% of top line revenue on sales and marketing.
@mlcommoms.org @neuripsconf.bsky.social
#MLCommons #Endpoints2025 #NeurIPS2025

1 0 0 0

3 months ago

One of the first examples I've seen of a potential data co-operative network infrastructure from Luis Oala Co-Founder and Chief AI Officer w/ Brickroad brickroadapp.com

@mlcommoms.org
#MLCommons #Endpoints2025

0 0 0 0

3 months ago

The AI Economy:

Luis Oala Co-Founder and Chief AI Officer w/ Brickroad brickroadapp.com

@mlcommoms.org
#MLCommons #Endpoints2025

0 0 0 0

3 months ago

Getting into Agentic capabilities w/
Deepak Nathani- @dnathani.bsky.social
My question:
Are you seeing any personal AI solutions that would allow greater control over our information instead of giving it all to a foundation model LLM?
@mlcommoms.org
#MLCommons #Endpoints2025

0 0 0 0

3 months ago

Next up:
Sean McGregor - Agentic Workstream Lead
@mlcommoms.org
#MLCommons #Endpoints2025

0 0 0 0

3 months ago

Seems like @datascienceall1.bsky.social and @mlcommons.org should be working more closely together.
@dkanter.bsky.social
#MLCommons #Endpoints2025

1 0 0 0

3 months ago

Looking forward to getting
@dkanter.bsky.social w/ @mlcommoms.org view on the velocity of LLM model releases.

TLDR: The pace is incredible and only increasing.
#MLCommons #Endpoints2025

0 0 0 0

3 months ago

Kicking things off at @mlcommoms.org Endpoints. Big thanks to @qualcomm.bsky.social for hosting!
#MLCommons #Endpoints2025

0 0 0 0

3 months ago

Hanging out at MLCommons Endpoints for the day. Taking a deep dive into the world of machine learning.
www.eventbrite.com/e/mlcommons-...

#MLCommons #Endpoints2025

0 0 0 0

From Community Benchmarks to Global Standards: MLCommons Shaping AI Governance - MLCommons MLCommons is bridging its open-source AI benchmarks with international standards (ISO/IEC JTC 1/SC 42), defining best practices for AI testing, governance, and risk management globally.

3 months ago

MLCommons benchmarks are now cited in #ISO /IEC AI testing standards - and we're helping shape what comes next. Contributing to standards on benchmark quality (42119-8) and AI management systems (42003).
Standards are made by those in the room. mlcommons.org/2025/11/iso-...
#AIStandards #MLCommons

0 0 0 0

MLCommons Releases New MLPerf Inference v5.1 Benchmark Results Sept. 9, 2025 — Today, MLCommons announced new results for its industry-standard MLPerf Inference v5.1 benchmark suite, tracking the relentless forward momentum of the AI community and its new capabil...

4 months ago

Don’t miss #MLCommons Endpoints in San Diego, Dec 1–2!
Learn, connect, and shape the future of AI with top experts at Qualcomm Hall.
🗓 Dec 1–2 | 🎟 Free tickets available now!

www.eventbrite.com/e/mlcommons-...

#AI #MachineLearning #SanDiego

2 2 0 1

Drew Jolly

@amjolly.bsky.social

6 months ago

MLCommons Releases New MLPerf Inference v5.1 Benchmark Results
ow.ly/t2pv50WU8IQ #MLCommons #MLPerf #HPCwire

1 0 0 0

TechArena.ai

@techarena.ai

6 months ago

AI Benchmarking Hits New Heights with MLPerf Inference 5.1 Release Three groundbreaking inference benchmarks debut reasoning models, speech recognition, and ultra-low latency scenarios as 27 organizations deliver record results.

@mlcommons.org dropped MLPerf inference 5.1 with three key benchmarks for enterprise AI: a reasoning model (DeepSeek-R1), speech recognition, and a smaller LLM for summarization tasks.

Catch up on this essential reading for AI decisions: www.techarena.ai/content/ai-b...

#MLCommons #MLPerf

1 1 0 0