Trending

#apacheairflow

Latest posts tagged with #apacheairflow on Bluesky

Latest Top
Trending

Posts tagged #apacheairflow

Video

We just shipped Airflow Schedule Insights v0.2.0 🚀
Ever had a DAG silently not run with zero explanation? This plugin tells you exactly why — and predicts when it will next run.
pip install airflow-schedule-insights
www.linkedin.com/posts/egorse...
#ApacheAirflow #DataEngineering #PonderLabs

1 0 0 0
Post image

Critical vulnerabilities in Apache Airflow versions <3.1.6 expose sensitive data. Upgrade immediately to protect your workflows. #CyberSecurity #ApacheAirflow #DataProtection Link: thedailytechfeed.com/apache-airfl...

0 0 0 0
Security.jpg

Security.jpg

Hardcoded credentials in your Apache workflows?

That's a security incident waiting to happen.

RBAC.
Secrets managers.
Encryption.
Governance.

Build it right → kogents.ai

#KogentsAI #DataEngineering #WorkflowAutomation #NeurIPS #ApacheAirflow

0 0 0 0

"Discover the power of Apache Airflow in data pipelines! Learn efficient techniques for creating and managing workflows. Don't miss this comprehensive guide! " #ApacheAirflow https://fefd.link/ZeGmD

0 0 0 0
Security threat visualization

Security threat visualization

HIGH severity: Apache Airflow 3.0.3 lets users with READ access see sensitive connection data via API & UI. Upgrade to 3.0.4+ and restrict access now! radar.offseq.com/threat/cve-2025-54831-cw... #OffSeq #ApacheAirflow #Security

0 0 0 0
Post image

Run Apache Hop workflows & pipelines in Apache Airflow 3.0!

🚀 Low-code pipelines + container-native runtimes + declarative DAGs = modern, scalable data orchestration.

Check the blog & let’s connect! 🔗 know.bi/blog/our-blo...

#datasky #databs #apachehop #apacheairflow

3 2 0 0
Preview
Novedades de Airflow 3.0: Principales cambios Análisis de las novedades y funcionalidades más importantes de la versión 3.0 de Apache Airflow para sacar el máximo partido a la herramienta

🚀 Descubre todos los tips, aplica estos nuevos cambios en tus procesos de #Airflow y saca el máximo partido a la herramienta

➡️ blog.damavis.com/las-novedade...

#ApacheAirflow #BigData #Software #DataEngineering

1 0 0 0
Post image

🟦 DAGs sin logical_date

🔹 #Airflow 3.0 permite la creación y ejecución de DAGs sin logical_date

🔹 Al indicar la logical_date como nula, los DAG runs ahora son separados, incluso si se ejecutan en el mismo punto en el tiempo lógico

#BigData #ApacheAirflow #Software

1 0 1 0
Post image

🟦 Backfills

🔹 Permiten reejecutar periodos pasados con facilidad

🔹 Esto es especialmente útil para reprocesar DAG runs que han fallado

#Airflow #ApacheAirflow #BigData #Software #DataEngineering

1 0 1 0
Post image

🟦 Versionamiento de DAGs

🔹Con cada lanzamiento de DAG run, #Airflow reparsea el DAG creando una nueva versión

🔹Si se modifica un DAG y se vuelve a ejecutar, se generará un nuevo DAG run asociado a una versión diferente del DAG

#BigData #ApacheAirflow #Software

1 0 1 0
Post image

📌 Principales cambios y mejoras de #Airflow 3.0

El lanzamiento oficial de la versión 3.0.0 de #ApacheAirflow ha traído consigo varias novedades interesantes en las funcionalidades y la interfaz gráfica

¿Cuáles son? 👇

#BigData #Software #DataEngineering

1 0 1 0
Preview
Tickets Get your tickets for attending Airflow Summit 2025! Ticket prices are in US dollars. What’s included in the Conference Pass? Access to full conference program- Keynotes, panels, and talks. Breakfast, ...

Join #AirflowSummit today for three days filled with workshops, networking, and sessions on Airflow 3.0. Get your Early Bird tickets today: airflowsummit.org/tickets/

📅 See you in Seattle, Oct 7-9, 2025. @airflow.apache.org

#AirflowSummit2025 #ApacheAirflow #DataEngineering

1 0 0 0
brief alt text description of the first image

brief alt text description of the first image

Astronomer lands $93M Series D to boost AI adoption via data orchestration. Their Astro platform, powered by the booming Apache Airflow, helps enterprises manage complex data pipelines needed to operationalize AI effectively.

#DataOrchestration #AI #ApacheAirflow

1 0 0 0
Preview
Apache Airflow 3.0: From Data Pipelines to AI Inference Latest edition provides DAG versioning, remote execution capabilities, range of scheduling options, and more.

New in @thenewstack! 'Apache Airflow 3.0: From Data Pipelines to AI Inference' by BBI's Jelani Harper:
bit.ly/3Ev57pr
@thenewstack.io @apache-airflow.bsky.social #ApacheAirflow #technology #data

1 1 0 0

🎤Ne manquez pas notre conférence :
Manipulation de la #GED avec Apache Airflow

🗓️ jeudi 15 mai à 12:00
📍Hôtel de la Métropole, Lyon
🙋Présentée par @jeremie-lesage.bsky.social

👉https://jeci.fr/fr/evenements/rpll-atelier-2025/
#LogicielLibre #floss #ApacheAirflow

0 0 0 0
Preview
Execute DBT with Airflow and Cloud Run 1. Explanation of the use case presented in this article

🚀 Just dropped an article to go with my recent video on running #dbt with #CloudRun + #Airflow on #GoogleCloud

Learn how to use CloudRunExecuteJobOperator or the powerful #Cosmos library with DbtTaskGroup

medium.com/@mazlum.tosu...

#ApacheAirflow #dbt #Serverless #Docker

1 1 3 0
Preview
Apache Airflow and MongoDB Tired of wrestling with ad‑hoc scripts and midnight manual fixes? Our latest video shows you how to build a bulletproof, fully automated ETL pipeline—no more guessing, no more downtime. Learn how to install and configure Apache Airflow, author reliable Python‑based DAGs, and plug directly into MongoDB for scalable, production‑ready data flows. ## What Makes This Tutorial Unmissable **Zero to Hero:** Start with a fresh Airflow install and end with a monitored, scheduled workflow you can trust. **Rock‑Solid MongoDB Integration:** Discover best practices for connecting Airflow to MongoDB Atlas—so your data lands exactly where you need it. ## Who Should Watch? Data Engineers & Backend Devs ready to level up. Tech Teams moving from brittle scripts to enterprise‑grade automation. Anyone curious how modern data ops teams streamline pipelines and eliminate toil. ## Ready to Automate? ▶️ Watch now: https://www.youtube.com/watch?v=q90W1b_MSPE 🔔 Don’t forget to subscribe for more DevOps & Cloud tutorials! Feel free to comment with your toughest ETL challenge—we’ll cover it in a future deep‑dive. Thanks for reading... **Happy Coding!**
0 0 0 0
Preview
Azure Data Factory or Apache Airflow: Which Orchestration Tool Reigns Supreme? - DS Stream Blog Explore Data Engineering and gain valuable insights from DS Stream's experts.

Azure Data Factory or Apache Airflow – which one should you choose? 🤔

Our data engineer, @ Michał Miłosz, breaks it down in his latest article. Grab a coffee ☕ and take a look: www.dsstream.com/post/azure-d...

#ReadingFriday #DataEngineering #ApacheAirflow #AzureDataFactory

0 0 0 0
Preview
March Meetup: Airflow Orchestration from zero to 100, Tue, Mar 18, 2025, 5:30 PM | Meetup **_RESCHEDULED FROM FEBRUARY_** Joining us this month will be Bonnie Why, Data Engineer at Burns & McDonnell. Bonnie will be talking about the experience of moving to a un

Looking forward to next week's #DevOps meetup (Mar 18 @5:30p), with Bonnie Why (Data Engineer at @burnsmcdonnell.bsky.social) talking about @airflow.apache.org Orchestration! Make sure to RSVP for this dive into an #ApacheAirflow use case at: www.meetup.com/devops-kansa...

0 0 0 0
Post image

Airflow – A workflow orchestration tool for managing data pipelines, supporting DAG-based task scheduling and automation. #ApacheAirflow

1 0 0 0

Relecture 🧐 : @geojulien.bsky.social & @tetranos.bsky.social

#PostgreSQL #PostGIS #GDAL #OGR #DBT #Metabase #ApacheAirflow

0 0 0 0

🔄 Migrando de AWS Glue a Apache Airflow, ahorra Costos y gana Mayor Flexibilidad
👉 ciberninjas.com/migrando-aws...

#AWSGlue #ApacheAirflow #MigraciónDeDatos #AhorroDeCostos #Flexibilidad

0 0 0 0
Post image

🚀 I created a new video 📹 that shows how to execute dbt pipelines with Airflow and Cloud Run

1️⃣ Run dbt pipelines on Cloud Run with CloudRunExecuteJobOperator
2️⃣ Use Cosmos Library to mirror dbt models in Airflow

Links in comments👇🏻

#GoogleCloud #dbt #ApacheAirflow

1 2 3 0
Easiest way to run dbt Core! How to run dbt Core in Production with Orchestra #dbt #analytics
Easiest way to run dbt Core! How to run dbt Core in Production with Orchestra #dbt #analytics YouTube video by Orchestra

Setting up #dbtcore in #apacheairflow? Stop. Another life is possible

www.youtube.com/watch?v=-XDu...

#dataengineering #analyticsengineering

0 0 0 0
Apache Airflow Template Variables and Dataset scheduled DAGs. · #TODO data engineering

Migrating to #ApacheAirflow Dataset scheduling? Be mindful of existing DAGs use of template variables.

tododataengineering.com/2024/11/26/a...

#dataengineering #data #databs #python

0 0 0 0
Preview
Machine learning development with Posit Connect and Airflow - Posit We explore how to streamline the machine learning development lifecycle by integrating Posit Connect with Apache Airflow.

This tutorial by Taylor Steinberg walks you through the full machine learning development lifecycle using Posit Connect and Apache Airflow.

Check it out on the Posit Blog: posit.co/blog/ml-posi...

#Python #ApacheAirflow #MachineLearning #ML

3 0 0 0
Preview
How we orchestrate 2000+ DBT models in Apache Airflow In recent years, DBT (Data Build Tool) has established itself as the go-to data transformation workflow, connecting to a variety of…

How we orchestrate 2000+ #DBT models in #ApacheAirflow

0 0 0 0
Programme des GeoDataDays

📣 Demandez l'programme !!!

Le programme des #geodatadays 2024 est en ligne : www.geodatadays.fr/le-programme

"Du coup", on se voit le 19 septembre aprem' en salle 200 pour parler "Modern GIS Stack", ok ?!?

D'ici là, bisous.

#PostgreSQL #PostGIS #ApacheAirflow #OGR #DBT

0 0 0 0
Preview
Login to Meetup | Meetup Not a Meetup member yet? Log in and find groups that host online or in person events and meet people in your local community who share your interests.

SF Bay Area #BigData fans: discover #Elasticsearch Ingest Node and #ApacheAirflow at tomorrow night's meetup http://meetu.ps/2X8Q1s

0 0 0 0