#UnityCatalog

5 months ago

Unity Catalog AI provides standardized agent management, granular access control, and interoperability across multiple #GenAI frameworks! 🙌

🔹 Simplified Agent Authoring
🔹 Enhanced Access Control
🔹 Seamless Integrations

🔗 Get started: docs.unitycatalog.io/ai/quickstart/

#opensource #unitycatalog

1 0 0 0

7 months ago

Storing your functions in #UnityCatalog keeps your logic organized, reusable, and secure, helping teams avoid code duplication and simplifying access control. 🚀

🔗 Learn about working with functions in Unity Catalog: www.unitycatalog.io/blogs/workin...

#oss #opensource

1 1 0 0

7 months ago

Deploying Unity Catalog OSS on Kubernetes: Simplifying Infrastructure Management YouTube video by Databricks

🎥 Now Available: Deploying Unity Catalog OSS on Kubernetes

This #DataAISummit session provides a technical walk-through of deploying #UnityCatalog on #Kubernetes.

🎤 Speaker: Vasilii Bulatov, Sr. Software Engineer, Nebius

Watch the full session 👉 www.youtube.com/watch?v=cgNG...

#opensource #oss

2 1 0 0

7 months ago

Just provide the catalog, schema, and function name—and get back the full, formatted source of any registered EXTERNAL Python function. Spacing and comments are preserved, so it’s easy to copy, debug, and update.

(2/2)

#opensource #unitycatalog #ai #oss

2 1 0 0

7 months ago

Ever hit a bug and forget where the function was written? 🤯

In Unity Catalog AI 0.3.0, the new 𝚐𝚎𝚝_𝚏𝚞𝚗𝚌𝚝𝚒𝚘𝚗_𝚜𝚘𝚞𝚛𝚌𝚎 API saves you the trouble of digging through repos.

🎥 Learn more: www.youtube.com/live/XD1Vy6u...

(1/2)

#opensource #oss #unitycatalog

2 1 1 0

8 months ago

Using #LlamaIndex with #UnityCatalog helps you manage your AI functions, models, and data efficiently. Here’s why they work well together:

🌐 𝗖𝗲𝗻𝘁𝗿𝗮𝗹 𝗮𝗰𝗰𝗲𝘀𝘀 𝗳𝗼𝗿 𝗮𝗹𝗹 𝗱𝗮𝘁𝗮 𝗮𝗻𝗱 𝗔𝗜 𝗮𝘀𝘀𝗲𝘁𝘀
🔐 𝗦𝗲𝗰𝘂𝗿𝗲 𝗮𝗰𝗰𝗲𝘀𝘀 𝗰𝗼𝗻𝘁𝗿𝗼𝗹
✅ 𝗘𝗮𝘀𝗶𝗹𝘆 𝗺𝗼𝘃𝗲 𝘄𝗼𝗿𝗸 𝗮𝗰𝗿𝗼𝘀𝘀 𝗚𝗲𝗻𝗔𝗜 𝗽𝗹𝗮𝘁𝗳𝗼𝗿𝗺𝘀

Learn more 👉 www.unitycatalog.io/blogs/unity-...

0 0 0 0

8 months ago

What happens to sandboxing when your client is calling a Unity Catalog server that's running remotely❓

🎥 Watch the full video: www.youtube.com/watch?v=XD1V...

#unitycatalog #opensource #oss

2 0 0 0

Unity Catalog for AI Learn how to use Unity Catalog for AI workloads with seamless GenAI integrations. Manage and secure AI functions across tools like LangChain, LlamaIndex, and OpenAI—without rewriting code.

8 months ago

With Unity Catalog, you gain the confidence to innovate with AI, knowing your assets are protected by security and governance.

🔗 Learn more: www.unitycatalog.io/blogs/unity-...

#opensource #oss #unitycatalog #ai

2 0 0 0

8 months ago

With this integration:
✅ Define your models, functions, and security rules once
✅ Use them across multiple AI applications
✅ Skip the hassle of rewriting code or translating syntax

#opensource #oss #unitycatalog #genai #generativeai #ai

2 0 0 0

Databricksに外部リネージを持ち込む #UnityCatalog – Qiita こちらのアップデートです。独自のデータリネージを持ち込む(パブリックプレビュー)データリネージには、Databricks 外部で実行されるアセットやワークフローも含められるようになりました。Databricks 外でワークロード（たとえば、ファーストマイルの ETL やラストマイルの BI）を実行している場合でも、Unity Catalog を使えば、Databricks が自動的に取得するデータリネージに加えて、外部のリネージメタデータを追加することができ、Unity Catalog 上でエンドツーエンドのリネージビューを得ることができます。これは、Unity Catalog に取り込まれる前にデータがどこから来たのか（例：Salesforce や MySQL）や、Unity Catalog 外でどこでデータが消費されているのか（例：Tableau や PowerBI）を把握したい場合に有用です。この外部リネージメタデータ機能はパブリックプレビューです。独自のデータリネージを持ち込むをご覧ください。 Unity Catalogの外部リネージ機能を使用すると、Databricks外部で実行されるワークフローやシステムのデータリネージを手動で追加できます。この機能により、SalesforceやMySQLなどの外部データソースから、TableauやPowerBIなどのBIツールまで、エンドツーエンドのデータフローを可視化できます。外部メタデータオブジェクトを作成し、Unity Catalogのテーブルやモデルとのリネージ関係を設定することで、データの完全なライフサイクルを把握できます。現在パブリックプレビュー段階にあり、Catalog Explorer UIまたはREST APIを通じて利用可能です。これにより、データガバナンスの強化と、より包括的なデータ管理が実現できます。機能概要 Unity Catalogの外部リネージ機能は、Databricks環境外で実行されるデータ処理やワークフローを含む、包括的なデータリネージの可視化を実現する機能です。通常、Unity CatalogはDatabricks内で実行されるクエリ間のデータリネージを自動的にキャプチャしますが、多くの組織では以下のような外部システムも利用しています：データソース側 (ファーストマイル) Salesforce MySQL PostgreSQL その他のSaaSアプリケーションデータ消費側 (ラストマイル) Tableau Power BI その他のBIツール外部リネージ機能を使用することで、これらの外部システムとDatabricks内のデータアセットとの関係を明示的に定義し、完全なデータフローを可視化できます。外部リネージの構成要素要素説明外部メタデータオブジェクト外部システム内のエンティティ (例: Tableauダッシュボード) を表すオブジェクトリネージ関係外部メタデータオブジェクトとUnity Catalogオブジェクト間の接続システムタイプ外部システムの種類 (Tableau、PowerBI、カスタムなど) エンティティタイプオブジェクトの種類 (テーブル、ダッシュボードなど) …

8 months ago

Looking to build LLM-powered apps like chatbots, document summarizers, or data explorers without compromising on data governance?

This blog shows you how to use #UnityCatalog with LlamaIndex to organize, secure, and efficiently query your data for AI use cases. 🔗 www.unitycatalog.io/blogs/unity-...

0 0 1 0

@inmobi-info.bsky.social

8 months ago

Databricksに外部リネージを持ち込む #UnityCatalog – Qiita

こちらのアップデートです。独自のデータリネージを持ち込む(パブリックプレビュー)データリネージには、Databricks 外部で実行されるアセットやワークフローも含められるようになりました。Databricks 外でワークロード（たとえば、ファーストマイルの ETL やラストマイルの BI）を実行している場合でも、Unity Catalog を使えば、Databricks が自動的に取得するデータリネージに加えて、外部のリネージメタデータを追加することができ、Unity Catalog…

0 0 0 0

Unity Catalog and OpenAI Learn how Unity Catalog simplifies AI development with OpenAI by centralizing data, models, and functions—enabling faster, safer, and more scalable workflows.

8 months ago

Key benefits:
🔹 Centralized access to all your data, models, and functions
🔹 Robust access controls to keep your assets secure
🔹 Cross-platform flexibility—use your tools across LangChain, LlamaIndex, and more

🔗 Dive in: www.unitycatalog.io/blogs/unity-...

#opensource #oss #unitycatalog

3 0 1 0

8 months ago

If you’re building AI applications with OpenAI, you know the challenge: data, models, and functions scattered everywhere, each with their own access rules. 🤯 #UnityCatalog gives you a single place to manage your data and AI assets, making it easier to access, update, and secure everything you need.

1 0 1 0

@alextalksdatalakehouses.fyi

9 months ago

P.S. Want to save 50% on your Data+AI Summit pass with a special Unity Catalog community discount? Comment below and we’ll DM it to you! ⤵️

#unitycatalog #opensource #apacheiceberg

1 0 0 0

Alex Merced

9 months ago

BLOG: The Case for Apache Polaris as the Community Standard for Lakehouse Catalogs

READ HERE: drmevn.fyi/polariscase0...

#ApacheIceberg #DeltaLake #UnityCatalog #ApachePolaris #DataLakehouse #DataEngineering

0 0 0 0

Home | Databricks Data + AI Summit — the premier event for the global data, analytics and AI community. Register now to level up your skills.

9 months ago

Learn more about Data+AI Summit: www.databricks.com/dataaisummit

#opensource #oss #unitycatalog

1 0 0 0

9 months ago

FWIW there are some changes required. PRs in the works... 😊

#ApacheSpark #DeltaLake #UnityCatalog

1 0 0 0

9 months ago

Got the whole stack working! The latest versions of #ApacheSpark 4.0.0 RC6, #UnityCatalog 0.3.0-SNAPSHOT and #DeltaLake 3.4.0-SNAPSHOT all work together! 🎉

1 0 1 0

Release v4.0.0-rc6 · apache/spark Preparing Spark release v4.0.0-rc6

9 months ago

A'ha, we've got a brand new #ApacheSpark 4.0.0 RC6 that may've "broken" my local builds of #UnityCatalog and #DeltaLake! 🤨

github.com/apache/spark...

1 0 1 0

9 months ago

Want to save 50% on your Data+AI Summit pass with a special Unity Catalog community discount? Comment below and we’ll DM it to you! ⤵️

#opensource #oss #unitycatalog #dataaisummit

1 0 0 0

9 months ago

Introducing the Kuzu graph database and its Unity Catalog integration | Community Meetup YouTube video by Unity Catalog

Missed today's meetup? 👉 Catch the recording to see how Kuzu, a fast open-source graph DB, makes graph analytics easy in your data lake.

Learn about the new #UnityCatalog extension and see a live demo of seamless data movement.

🎥 Watch now: www.youtube.com/watch?v=Iwyu...

#opensource #kuzu #oss

2 0 0 0

10 months ago

📢 Join us at Data+AI Summit to learn how to deploy #UnityCatalog on #Kubernetes, leveraging its cloud-agnostic nature & efficient resource management!

Leave with the knowledge to confidently deploy & manage UC in any Kubernetes environment. 🙌

🗓️ June 9–12
🔗 REGISTER: www.databricks.com/dataaisummit

1 0 0 0

Home | Databricks Data + AI Summit — the premier event for the global data, analytics and AI community. Register now to level up your skills.

10 months ago

Join us June 9–12 in San Francisco to shape the future of open governance at Data + AI Summit!

Want to save 50% on your Data+AI Summit pass with a special #UnityCatalog community discount? Comment below and we’ll DM it to you! ⤵️

🎟️ Secure your spot: www.databricks.com/dataaisummit

#opensource

2 0 0 0

Arbisoft

@arbisoft.bsky.social

10 months ago

Unity Catalog brings the clarity and control, your team needs.
Iqra Sarwar, Software Engineer at Arbisoft, breaks down how it works.
🔗 Explore more: https://f.mtr.cool/jjgnaglypt

#DataGovernance #UnityCatalog #DataOps #ArbisoftInsights

0 0 0 0

Introducing the Kuzu Graph Database and Unity Catalog Integration · Luma In this talk, we will introduce Kuzu, an embedded, fast, scalable open source graph database and its key features that make it a great fit for graph analytics…

10 months ago

Join our #UnityCatalog Meetup to see how #Kuzu, a fast embedded open source graph database, makes it easy to work with graph data-right in your existing ecosystem! 🚀

🌟 Plus: get a first look at Kuzu’s new UC extension for effortless data movement, no heavy #ETL needed.

🔗 REGISTER 👉 lu.ma/kuzu515

0 0 0 0

10 months ago

Productivity boost arrived! 🏆

Building #UnityCatalog OSS took...1s! 🤯

Next up are #ApacheSpark 4.0.0 RC4 and #DeltaLake 3.4.0-SNAPSHOT

#macmini #m4pro

0 0 0 0

Home | Databricks Data + AI Summit — the premier event for the global data, analytics and AI community. Register now to level up your skills.

10 months ago

🎊 Unity Catalog community: Want 50% off your Data+AI Summit pass? REPLY to this post and we’ll DM you the code!

📅 June 9–12 in SF — 700+ sessions on governance, lineage & catalog-powered AI.

🎟️ Offer ends May 25!
👉 Learn more: databricks.com/dataaisummit

#opensource #oss #unitycatalog

1 0 0 0

Introducing Unity Catalog AI 0.3.0 Release A blog for the Unity Catalog-AI 0.3.0 release explaining the key features and enhancements

10 months ago

📖 Learn more about UC AI 0.3.0 in our blog: www.unitycatalog.io/blogs/introd...

#opensource #oss #unitycatalog #ai

1 0 0 0