#apacheairflow

@dataish.bsky.social

5 days ago

We just shipped Airflow Schedule Insights v0.2.0 🚀
Ever had a DAG silently not run with zero explanation? This plugin tells you exactly why — and predicts when it will next run.
pip install airflow-schedule-insights
www.linkedin.com/posts/egorse...
#ApacheAirflow #DataEngineering #PonderLabs

1 0 0 0

The Daily Tech Feed

@thedailytechfeed.com

1 month ago

Critical vulnerabilities in Apache Airflow versions <3.1.6 expose sensitive data. Upgrade immediately to protect your workflows. #CyberSecurity #ApacheAirflow #DataProtection Link: thedailytechfeed.com/apache-airfl...

0 0 0 0

@kogents.bsky.social

1 month ago

Security.jpg

Hardcoded credentials in your Apache workflows?

That's a security incident waiting to happen.

RBAC.
Secrets managers.
Encryption.
Governance.

Build it right → kogents.ai

#KogentsAI #DataEngineering #WorkflowAutomation #NeurIPS #ApacheAirflow

0 0 0 0

fetchfeeds.com

@fetchfeeds.bsky.social

2 months ago

"Discover the power of Apache Airflow in data pipelines! Learn efficient techniques for creating and managing workflows. Don't miss this comprehensive guide! " #ApacheAirflow https://fefd.link/ZeGmD

0 0 0 0

Offensive Sequence

@offseq.bsky.social

5 months ago

Security threat visualization

HIGH severity: Apache Airflow 3.0.3 lets users with READ access see sensitive connection data via API & UI. Upgrade to 3.0.4+ and restrict access now! radar.offseq.com/threat/cve-2025-54831-cw... #OffSeq #ApacheAirflow #Security

0 0 0 0

know.bi

@know.bi

8 months ago

Run Apache Hop workflows & pipelines in Apache Airflow 3.0!

🚀 Low-code pipelines + container-native runtimes + declarative DAGs = modern, scalable data orchestration.

Check the blog & let’s connect! 🔗 know.bi/blog/our-blo...

#datasky #databs #apachehop #apacheairflow

3 2 0 0

Damavis

@damavis.bsky.social

9 months ago

Novedades de Airflow 3.0: Principales cambios Análisis de las novedades y funcionalidades más importantes de la versión 3.0 de Apache Airflow para sacar el máximo partido a la herramienta

🚀 Descubre todos los tips, aplica estos nuevos cambios en tus procesos de #Airflow y saca el máximo partido a la herramienta

➡️ blog.damavis.com/las-novedade...

#ApacheAirflow #BigData #Software #DataEngineering

1 0 0 0

Damavis

@damavis.bsky.social

9 months ago

🟦 DAGs sin logical_date

🔹 #Airflow 3.0 permite la creación y ejecución de DAGs sin logical_date

🔹 Al indicar la logical_date como nula, los DAG runs ahora son separados, incluso si se ejecutan en el mismo punto en el tiempo lógico

#BigData #ApacheAirflow #Software

1 0 1 0

Damavis

@damavis.bsky.social

9 months ago

🟦 Backfills

🔹 Permiten reejecutar periodos pasados con facilidad

🔹 Esto es especialmente útil para reprocesar DAG runs que han fallado

#Airflow #ApacheAirflow #BigData #Software #DataEngineering

1 0 1 0

Damavis

@damavis.bsky.social

9 months ago

🟦 Versionamiento de DAGs

🔹Con cada lanzamiento de DAG run, #Airflow reparsea el DAG creando una nueva versión

🔹Si se modifica un DAG y se vuelve a ejecutar, se generará un nuevo DAG run asociado a una versión diferente del DAG

#BigData #ApacheAirflow #Software

1 0 1 0

Damavis

@damavis.bsky.social

9 months ago

📌 Principales cambios y mejoras de #Airflow 3.0

El lanzamiento oficial de la versión 3.0.0 de #ApacheAirflow ha traído consigo varias novedades interesantes en las funcionalidades y la interfaz gráfica

¿Cuáles son? 👇

#BigData #Software #DataEngineering

1 0 1 0

Airflow Summit

@airflowsummit.bsky.social

9 months ago

Tickets Get your tickets for attending Airflow Summit 2025! Ticket prices are in US dollars. What’s included in the Conference Pass? Access to full conference program- Keynotes, panels, and talks. Breakfast, ...

Join #AirflowSummit today for three days filled with workshops, networking, and sessions on Airflow 3.0. Get your Early Bird tickets today: airflowsummit.org/tickets/

📅 See you in Seattle, Oct 7-9, 2025. @airflow.apache.org

#AirflowSummit2025 #ApacheAirflow #DataEngineering

1 0 0 0

Mr Tech King

@mrtechking.bsky.social

10 months ago

brief alt text description of the first image

Astronomer lands $93M Series D to boost AI adoption via data orchestration. Their Astro platform, powered by the booming Apache Airflow, helps enterprises manage complex data pipelines needed to operationalize AI effectively.

#DataOrchestration #AI #ApacheAirflow

1 0 0 0

Andrew Brust

@andrewbrust.info

10 months ago

Apache Airflow 3.0: From Data Pipelines to AI Inference Latest edition provides DAG versioning, remote execution capabilities, range of scheduling options, and more.

New in @thenewstack! 'Apache Airflow 3.0: From Data Pipelines to AI Inference' by BBI's Jelani Harper:
bit.ly/3Ev57pr
@thenewstack.io @apache-airflow.bsky.social #ApacheAirflow #technology #data

1 1 0 0

Pristy suite GED par Jeci

@pristyoss.bsky.social

10 months ago

🎤Ne manquez pas notre conférence :
Manipulation de la #GED avec Apache Airflow

🗓️ jeudi 15 mai à 12:00
📍Hôtel de la Métropole, Lyon
🙋Présentée par @jeremie-lesage.bsky.social

👉https://jeci.fr/fr/evenements/rpll-atelier-2025/
#LogicielLibre #floss #ApacheAirflow

0 0 0 0

Mazlum Tosun 💙 #GCP

@mazlumtosun.bsky.social

10 months ago

Execute DBT with Airflow and Cloud Run 1. Explanation of the use case presented in this article

🚀 Just dropped an article to go with my recent video on running #dbt with #CloudRun + #Airflow on #GoogleCloud

Learn how to use CloudRunExecuteJobOperator or the powerful #Cosmos library with DbtTaskGroup

medium.com/@mazlum.tosu...

#ApacheAirflow #dbt #Serverless #Docker

1 1 3 0

Forem

@forem.com.web.brid.gy

10 months ago

Apache Airflow and MongoDB Tired of wrestling with ad‑hoc scripts and midnight manual fixes? Our latest video shows you how to build a bulletproof, fully automated ETL pipeline—no more guessing, no more downtime. Learn how to install and configure Apache Airflow, author reliable Python‑based DAGs, and plug directly into MongoDB for scalable, production‑ready data flows. ## What Makes This Tutorial Unmissable **Zero to Hero:** Start with a fresh Airflow install and end with a monitored, scheduled workflow you can trust. **Rock‑Solid MongoDB Integration:** Discover best practices for connecting Airflow to MongoDB Atlas—so your data lands exactly where you need it. ## Who Should Watch? Data Engineers & Backend Devs ready to level up. Tech Teams moving from brittle scripts to enterprise‑grade automation. Anyone curious how modern data ops teams streamline pipelines and eliminate toil. ## Ready to Automate? ▶️ Watch now: https://www.youtube.com/watch?v=q90W1b_MSPE 🔔 Don’t forget to subscribe for more DevOps & Cloud tutorials! Feel free to comment with your toughest ETL challenge—we’ll cover it in a future deep‑dive. Thanks for reading... **Happy Coding!**

0 0 0 0

DS STREAM

@dsstream.bsky.social

11 months ago

Azure Data Factory or Apache Airflow: Which Orchestration Tool Reigns Supreme? - DS Stream Blog Explore Data Engineering and gain valuable insights from DS Stream's experts.

Azure Data Factory or Apache Airflow – which one should you choose? 🤔

Our data engineer, @ Michał Miłosz, breaks it down in his latest article. Grab a coffee ☕ and take a look: www.dsstream.com/post/azure-d...

#ReadingFriday #DataEngineering #ApacheAirflow #AzureDataFactory

0 0 0 0

DevOps KC Meetup

@devopskc.com

1 year ago

March Meetup: Airflow Orchestration from zero to 100, Tue, Mar 18, 2025, 5:30 PM | Meetup **_RESCHEDULED FROM FEBRUARY_** Joining us this month will be Bonnie Why, Data Engineer at Burns & McDonnell. Bonnie will be talking about the experience of moving to a un

Looking forward to next week's #DevOps meetup (Mar 18 @5:30p), with Bonnie Why (Data Engineer at @burnsmcdonnell.bsky.social) talking about @airflow.apache.org Orchestration! Make sure to RSVP for this dive into an #ApacheAirflow use case at: www.meetup.com/devops-kansa...

0 0 0 0

Alex Merced

@alextalksdatalakehouses.fyi

1 year ago

Airflow – A workflow orchestration tool for managing data pipelines, supporting DAG-based task scheduling and automation. #ApacheAirflow

1 0 0 0

Geotribu

@geotribu.bsky.social

1 year ago

Relecture 🧐 : @geojulien.bsky.social & @tetranos.bsky.social

#PostgreSQL #PostGIS #GDAL #OGR #DBT #Metabase #ApacheAirflow

0 0 0 0

Pablo Álvarez Corredera

@cibered.com

1 year ago

🔄 Migrando de AWS Glue a Apache Airflow, ahorra Costos y gana Mayor Flexibilidad
👉 ciberninjas.com/migrando-aws...

#AWSGlue #ApacheAirflow #MigraciónDeDatos #AhorroDeCostos #Flexibilidad

0 0 0 0

Mazlum Tosun 💙 #GCP

@mazlumtosun.bsky.social

1 year ago

🚀 I created a new video 📹 that shows how to execute dbt pipelines with Airflow and Cloud Run

1️⃣ Run dbt pipelines on Cloud Run with CloudRunExecuteJobOperator
2️⃣ Use Cosmos Library to mirror dbt models in Airflow

Links in comments👇🏻

#GoogleCloud #dbt #ApacheAirflow

1 2 3 0

Hugo Lu

@datajesus.bsky.social

1 year ago

Easiest way to run dbt Core! How to run dbt Core in Production with Orchestra #dbt #analytics YouTube video by Orchestra

Setting up #dbtcore in #apacheairflow? Stop. Another life is possible

www.youtube.com/watch?v=-XDu...

#dataengineering #analyticsengineering

0 0 0 0

Aaron D. Gonzalez | #TODO Data Engineering

@aarondgonzalez.bsky.social

1 year ago

Apache Airflow Template Variables and Dataset scheduled DAGs. · #TODO data engineering

Migrating to #ApacheAirflow Dataset scheduling? Be mindful of existing DAGs use of template variables.

tododataengineering.com/2024/11/26/a...

#dataengineering #data #databs #python

0 0 0 0

Posit

@posit.co

1 year ago

Machine learning development with Posit Connect and Airflow - Posit We explore how to streamline the machine learning development lifecycle by integrating Posit Connect with Apache Airflow.

This tutorial by Taylor Steinberg walks you through the full machine learning development lifecycle using Posit Connect and Apache Airflow.

Check it out on the Posit Blog: posit.co/blog/ml-posi...

#Python #ApacheAirflow #MachineLearning #ML

3 0 0 0

Nicolas Fränkel 🇪🇺🇺🇦🇬🇪

@frankel.ch

1 year ago

How we orchestrate 2000+ DBT models in Apache Airflow In recent years, DBT (Data Build Tool) has established itself as the go-to data transformation workflow, connecting to a variety of…

How we orchestrate 2000+ #DBT models in #ApacheAirflow

0 0 0 0

Tetranos - Michaël Galien

@tetranos.bsky.social

1 year ago

Programme des GeoDataDays

📣 Demandez l'programme !!!

Le programme des #geodatadays 2024 est en ligne : www.geodatadays.fr/le-programme

"Du coup", on se voit le 19 septembre aprem' en salle 200 pour parler "Modern GIS Stack", ok ?!?

D'ici là, bisous.

#PostgreSQL #PostGIS #ApacheAirflow #OGR #DBT