#MLFlow

MLflow

@mlflow.org

2 months ago

𝗔𝗜 𝗢𝗯𝘀𝗲𝗿𝘃𝗮𝗯𝗶𝗹𝗶𝘁𝘆 𝗳𝗼𝗿 𝗘𝘃𝗲𝗿𝘆 𝗧𝘆𝗽𝗲𝗦𝗰𝗿𝗶𝗽𝘁 𝗟𝗟𝗠 𝗦𝘁𝗮𝗰𝗸 🚀

MLflow 3.6 brings automatic tracing to JS/TS! Get traces from Vercel AI SDK, LangChain, Mastra, Anthropic, & Gemini in the same UI as your Python services.

🔗 Read more: mlflow.org/blog/typescr...

#mlflow #opensource #oss #typescript #llm #ai

AWS Community Builder Blog Posts

@awscmblogposts.bsky.social

2 months ago

AWS Sagemaker Notebook Jobs for Accelerating Data Science Experimentation Workflows with Mlflow and Optuna Introduction Hyperparameter tuning across multiple models presents a common challenge for...

✍️ New blog post by Ryan Nazareth

AWS Sagemaker Notebook Jobs for Accelerating Data Science Experimentation Workflows with Mlflow and Optuna

#sagemaker #mlflow #optuna #aws

@techlife-blog.bsky.social

2 months ago

AI Skills 2025: LangChain, RAG & MLOps—The Complete Guide Comprehensive guide to the three critical AI competencies reshaping hiring in 2025: LangChain for orchestration, RAG for knowledge grounding, and MLOps for production deployment.

AI Skills 2025: LangChain, RAG & MLOps—The Complete Guide

techlife.blog/posts/ai-ski...

#LangChain #RAG #MLOps #LangGraph #DeepAgents #Kubernetes #VectorDatabases #ChromaDB #Weaviate #Pinecone #MLflow

MLflow

@mlflow.org

2 months ago

MLflow 3.7 Release: Key Features & Multi-turn Conversation Evaluation Demo YouTube video by MLflow

In this video, #MLflow Contributor and Staff Developer Advocate Jules Damji walks through the powerful new features in MLflow 3.7, showcasing how to gain full observability over your GenAI application traces. 🚀

🔗 Watch the full video: youtube.com/watch?v=29W0...

#GenAI #LLMOps #OpenSource

MLflow

@mlflow.org

2 months ago

MLflow Ambassador Joana Ferreira just dropped the next chapter in her GenAI series! 🚀

📖 "𝗘𝘃𝗮𝗹𝘂𝗮𝘁𝗶𝗻𝗴 𝗚𝗲𝗻𝗔𝗜 𝘄𝗶𝘁𝗵 𝗠𝗟𝗳𝗹𝗼𝘄: 𝗠𝗼𝗻𝗶𝘁𝗼𝗿𝗶𝗻𝗴 𝗶𝗻 𝗣𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻"

Learn to use MLflow’s unified evaluation framework for continuous production monitoring.

Dive in: medium.com/@joana.c.mes...

#MLflow #GenAI #OpenSource

MLflow

@mlflow.org

3 months ago

Stop the AI Agent "vibe checks" & manual labeling! 🛑🛠️

Samraj Moorjani (Databricks) shows how #MLflow accelerates high-quality, production-ready agent development. Learn the techniques leading companies use to skip the iteration loop. 🚀

🎥 Watch the full session: www.youtube.com/watch?v=qOFK...

MLflow

@mlflow.org

3 months ago

MLflow 3.7.0 is here and it brings major features and improvements for GenAI Observability, Evaluation, and Prompt Management! 🙌🥳

🔗 View the release notes: github.com/mlflow/mlflo...

Thanks to all the contributions from the community! 🙏

🚀 Try it out: pip install mlflow==3.7.0

#opensource #mlflow

lotharschulz

@lschu.bsky.social

3 months ago

guide including code on building a LLM evaluation pipeline with MLflow

Stop guessing which LLM to use! 🎯

Wrote a guide on building an evaluation pipeline with MLflow. Docker Compose + Python + Ollama = systematic model comparison.

#MLflow #AI #DevOps

www.lotharschulz.info/2025/12/08/c...

MLflow

@mlflow.org

3 months ago

Only a few days left to apply for the next #MLflow Ambassador cohort! 🚀

Join a global group of leaders advancing open source MLflow and helping teams ship high-quality #GenAI with evaluation, tracing, and prompt management. Submit your application by 𝗗𝗲𝗰 𝟭.

🔗 Apply today: forms.gle/eBEf6fTfKWNm...

hypervanse

@hypervanse.bsky.social

4 months ago

congratulations! to me #python and #vscode don't belong to the same sentence🖤 for whatever reason @openaidevs.bsky.social #chatgpt brings the whole #jupyter, @vscode.dev donmarajane pretends it is @python.org but actually @dot.net , sometimes it leaves the #heap and calls openai #mlflow, #agentos

@3g4g.bsky.social

4 months ago

Building and Scaling AI the Cloud Native Way at Singtel This blog looks at mobile network operators (MNOs), virtual operators (MVNOs), internet service providers (ISPs) and other SPs across the world.

Operator Watch Blog: Building and Scaling AI the Cloud Native Way at Singtel - www.operatorwatch.com/2025/11/buil...

#3G4G5G #OperatorWatch #FutureNetAsia #Singtel #Kubernetes #CloudNative #AIframeworks #AIplatform #KubeFlow #KubeRay #MLFLow #CICD #AIML

MLflow

@mlflow.org

4 months ago

MLflow Community Meetup | November 2025 · Luma November MLflow Community Meetup We'll dive into: 🔹 Claude Code & Claude Agent SDK Tracing Building agentic applications is complex, but it doesn't have to…

Two weeks from today — don’t miss it! 🙌

📣 Join the next 𝗠𝗟𝗳𝗹𝗼𝘄 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝘆 𝗠𝗲𝗲𝘁𝘂𝗽 on November 12 to explore the latest in AI observability and agent tracing.

Featuring two exciting talks:
🔹 𝗖𝗹𝗮𝘂𝗱𝗲 𝗖𝗼𝗱𝗲 & 𝗔𝗴𝗲𝗻𝘁 𝗦𝗗𝗞 𝗧𝗿𝗮𝗰𝗶𝗻𝗴
🔹 𝗢𝗽𝗲𝗻𝗧𝗲𝗹𝗲𝗺𝗲𝘁𝗿𝘆 (𝗢𝗧𝗘𝗟) 𝗦𝘂𝗽𝗽𝗼𝗿𝘁

🔗 RSVP: luma.com/mlflowmeetup...

#mlflow #oss

Beolle

@beolle.bsky.social

4 months ago

In part 1 of our article "Assembling MLOps practice", we discussed the definition of MLOps. This time with part 2 of the article, we move forward by exploring part of the technical stack that could be an option for implementing MLOps.

www.beolle.info/Fre0

#mlops #mlflow #devops

MLflow

@mlflow.org

4 months ago

Rapidly Prototype and Evaluate Agents with Claude Agent SDK and MLflow | MLflow How to quickly prototype an agent using the Claude Agent SDK then instrument and evaluate it with MLflow

Building agentic applications is complex, but it doesn’t have to be slow.

In this blog, Samraj Moorjani shows how to go from idea to measurable results in hours using the Claude Agent SDK with MLflow for observability and evaluation.

🔗 Dive in: mlflow.org/blog/mlflow-...

#MLflow #agentic

MLflow

@mlflow.org

4 months ago

MLflow Community Meetup | November 2025 · Luma November MLflow Community Meetup We'll dive into: 🔹 Claude Code & Claude Agent SDK Tracing Building agentic applications is complex, but it doesn't have to…

📣 Join the next 𝗠𝗟𝗳𝗹𝗼𝘄 𝗖𝗼𝗺𝗺𝘂𝗻𝗶𝘁𝘆 𝗠𝗲𝗲𝘁𝘂𝗽 on November 12 to explore the latest in AI observability and agent tracing — featuring two exciting talks:

🔹 𝗖𝗹𝗮𝘂𝗱𝗲 𝗖𝗼𝗱𝗲 & 𝗔𝗴𝗲𝗻𝘁 𝗦𝗗𝗞 𝗧𝗿𝗮𝗰𝗶𝗻𝗴
🔹 𝗢𝗽𝗲𝗻𝗧𝗲𝗹𝗲𝗺𝗲𝘁𝗿𝘆 (𝗢𝗧𝗘𝗟) 𝗦𝘂𝗽𝗽𝗼𝗿𝘁

🔗 RSVP: luma.com/mlflowmeetup...

#MLflow #opensource #oss #genai

MLflow

@mlflow.org

4 months ago

MLflow Office Hours | October 22 · Zoom · Luma

⏰ Don’t forget — MLflow Office Hours are this Wednesday, October 22 at 8AM PT on Zoom!

Come for:
🔹 Real-time MLflow troubleshooting and guidance
🔹 Best practices for managing LLM & GenAI experiments
🔹 A look ahead at new MLflow features

🔗 RSVP: luma.com/officehours1...

#opensource #oss #MLflow

MLflow

@mlflow.org

4 months ago

MLflow Office Hours | October 22 · Zoom · Luma

With that metadata—and MLflow’s MCP features released recently—the judge can make tool calls to MLflow to search spans and query different aspects of the trace.

Office Hours: Wed, Oct 22: luma.com/officehours1...

#mlflow #agenticjudges #llm #genai

MLflow

@mlflow.org

4 months ago

Missed last week’s #MLflow Community Meetup? Check out Ben Wilson on agentic judges: “The judge no longer works as an LLM as a judge—it actually works as an agent as a judge.”

🎥 Full video: www.youtube.com/live/bkMabn8...

#opensource #oss #agenticjudges

MLflow

@mlflow.org

5 months ago

Using MLflow's MCP Server for Conversational Trace Analysis A hands-on exploration of MLflow's new Model Context Protocol server that enables AI assistants to interact with MLflow traces, with setup tips for virtual environments and examples in both Claude ...

Use AI to debug AI! 👏 With MLflow 3.4’s MCP server, Claude can query MLflow traces to compare runs and identify issues. @danliden.com’s post covers setup and examples in minutes.

Learn more: www.danliden.com/posts/202510...

#opensource #mlflow #oss #MCP #claude

MLflow

@mlflow.org

5 months ago

🚨 Reminder: MLflow Community Meetup is tomorrow, Oct 8 at 4:00 PM PT!

We'll explore trace‑aware, feedback‑aligned judges and versioned eval datasets in MLflow. You don't wait to miss it!

🎥 LIVE on LinkedIn, YouTube & X
🔗 RSVP: luma.com/mlflow-1001

#opensource #oss #mlflow

MLflow

@mlflow.org

5 months ago

[Live AMA] From production tricks, labeling tips, to integrating MLflow for agent quality—ask anything MLflow! · Luma Join us for a text-based Live AMA (Ask Me Anything) with Danny Chiao, following his lightning talk at MLOps World. This is your chance to dive deeper into…

Ready to dive into #MLflow? 🚀

Join our text-based LIVE AMA with Danny Chiao & @danliden.com after Danny's MLOps World | GenAI Summit lightning talk!

🗓️ Oct 9 | 1–3pm CT
📍MLflow Slack | #General channel
🔗 RSVP: luma.com/liveama-slac...

#opensource #oss #genai #mlops #llmops

MLflow

@mlflow.org

5 months ago

🚀 Headed to MLOps World | GenAI Summit 2025 next week? Don’t miss an exciting lightning talk from Danny Chiao, Engineering Lead at Databricks!

🎤 𝗧𝗲𝗰𝗵𝗻𝗶𝗾𝘂𝗲𝘀 𝘁𝗼 𝗯𝘂𝗶𝗹𝗱 𝗵𝗶𝗴𝗵 𝗾𝘂𝗮𝗹𝗶𝘁𝘆 𝗮𝗴𝗲𝗻𝘁𝘀 𝗳𝗮𝘀𝘁𝗲𝗿 𝘄𝗶𝘁𝗵 𝗠𝗟𝗳𝗹𝗼𝘄

🗓️ October 9
📍 Austin, TX
🔗 Learn more: mlopsworld.com#agenda

#MLflow #GenAI #MLOps #LLM

MLflow

@mlflow.org

5 months ago

🚨 RESCHEDULED: Wednesday, October 8

The next MLflow Community Meetup happens NEXT Wednesday, Oct 8 at 4PM PT—and you won’t want to miss it.

RSVP here: luma.com/mlflow-1001

#opensource #oss #mlflow

MLflow

@mlflow.org

5 months ago

MLflow Community Meetup · Luma Join us for the next MLflow Community Meetup on October 1 at 4PM PT! Ben Wilson, MLflow Maintainer, will dive deep into: Building Smarter Evals with…

Our next MLflow Community Meetup is happening TODAY—Wednesday, October 1 at 4PM PT! 🙌

Don’t miss this chance to connect and learn:
🔹 Smarter Evaluations with Trace-Aware, Feedback-Aligned Judges
🔹 Keeping Eval Datasets Relevant as Your App Evolves

✅ RSVP: luma.com/mlflow-1001

#oss #mlflow #genai

MLflow

@mlflow.org

5 months ago

🚀 The fifth “Invoice Extraction with OpenAI + MLflow” session is now available! #MLflow Ambassador Shrinath Suresh dives into designing a custom scorer to evaluate invoice extraction models beyond just labels or LLM-as-a-judge.

🎥 youtu.be/SmuhOmOYXSg?...
📖 medium.com/@shrinath.su...

#opensource

MLflow

@mlflow.org

5 months ago

MLflow Community Meetup · Luma Join us for the next MLflow Community Meetup on October 1 at 4PM PT! Ben Wilson, MLflow Maintainer, will dive deep into: Building Smarter Evals with…

🚨 Just 2 days away!

The next #MLflow Community Meetup happens this Wednesday, Oct 1 at 4PM PT—and you won’t want to miss it.

We will cover:
🔹 𝗕𝘂𝗶𝗹𝗱𝗶𝗻𝗴 𝗦𝗺𝗮𝗿𝘁𝗲𝗿 𝗘𝘃𝗮𝗹𝘀 𝘄𝗶𝘁𝗵 𝗧𝗿𝗮𝗰𝗲-𝗔𝘄𝗮𝗿𝗲, 𝗙𝗲𝗲𝗱𝗯𝗮𝗰𝗸-𝗔𝗹𝗶𝗴𝗻𝗲𝗱 𝗝𝘂𝗱𝗴𝗲𝘀
🔹 𝗞𝗲𝗲𝗽𝗶𝗻𝗴 𝗘𝘃𝗮𝗹 𝗗𝗮𝘁𝗮𝘀𝗲𝘁𝘀 𝗥𝗲𝗹𝗲𝘃𝗮𝗻𝘁 𝗮𝘀 𝗬𝗼𝘂𝗿 𝗔𝗽𝗽 𝗖𝗵𝗮𝗻𝗴𝗲𝘀

RSVP 👉 luma.com/mlflow-1001

#oss

MLflow

@mlflow.org

5 months ago

#3 Prompt Engineering & MLflow Prompt Management YouTube video by TheAIGuy

Episode 3 of Invoice Extraction is live! 🚀

#MLflow Ambassador Shrinath Suresh explores prompt versioning, comparing, automating workflows, and effective reuse with MLflow’s Prompt Registry.

🎥 Watch: youtube.com/watch?v=fau8...
📖 Read: medium.com/@shrinath.su...

#opensource #oss #genai

Daniel Liden

@danliden.com

5 months ago

MLflow has added an MCP server in the most recent release, MLflow 3.4.0. You can e.g. use natural language to find and diagnose failing agent traces w Clauded Desktop. This is a huge step toward making MLflow a tool usable by agents.

Blog on setting this up coming soon.

#mlflow #ai #agents

MLflow

@mlflow.org

5 months ago

Introduction to invoice extraction using OpenAI GPT5 and MLflow 3.3 YouTube video by TheAIGuy

Businesses run on invoices. Getting structured data from them—fast and accurate—is critical.

🧩 GPT-5 is powerful for extraction
⚙️ MLflow 3 makes it repeatable & traceable

Demo + blog from #MLflow Ambassador Shrinath Suresh! 👇

▶️ youtu.be/E5GSWLhI5uA
📝 medium.com/@shrinath.su...

#opensource #oss

OSMC

@osmc.de

5 months ago

AI #observability isn't a buzzword — it's a must!

Learn how to build it right with #opensource tools like #MLflow, #Evidently & more.
Catch Samuel Desseaux at #OSMC!

osmc.de/talks/buildi...