Trending

#DataEngineering

Latest posts tagged with #DataEngineering on Bluesky

Latest Top
Trending

Posts tagged #DataEngineering

⚙️ Exingenieros de Snowflake crean Tower para un punto ciego en ingeniería de datos

Asistentes de IA generan código, pero ejecutarlo con fiabilidad es otro reto.

https://thenewstack.io/tower-python-data-pipelines/

#DataEngineering #DataPipeline #Python #RoxsRoss

0 0 0 0
Post image

Stop fighting SSMS import errors. 🛠️ DataAsh makes Excel-to-SQL Server migration fast, offline, and privacy-first. Check it out at dataash.de
#DataEngineering #SQLServer #ETL #DataMigration #PrivacyFirst #ModernDataStack #DataTools #BuildInPublic #SQL #ExcelToSQL #DataSky

1 0 0 0
Preview
Let’s Get Certified — DP-700: Microsoft Fabric Data Engineer Associate Event · Luma 📅 Thursday, March 19, 2026 ⏰ 6:30 – 10:45 AM PT | 2:30 – 6:45 PM WAT | 7:00 – 11:15 PM IST 📍 Virtual Event 💰 Free About This Event The DP-700: Microsoft…

Join us for the free Let's Get Certified: DP-700 training event this Thursday, March 19, from 6:30 am - 10:45 am PT | 7 pm - 11:15 pm IST. Learn more and register at: luma.com/o9pnwc6r #MicrosoftFabric #BI #DataEngineering #DataScience #Microsoft #Data

1 0 0 0
Preview
Data quality becomes the real challenge for Australian enterprises deploying AI Australian organisations moving beyond AI experiments face a new challenge: delivering quality data to AI systems. Context engineering emerges as the critical skill.

Data quality becomes the real challenge for Australian enterprises deploying AI

#AI #Enterprise #DataEngineering #AusNews #AusTech

thedailyperspective.org/article/2026-03-15-data-...

0 0 0 0
Post image

top fighting SSMS import errors. 🛠️ DataAsh makes Excel-to-SQL Server migration fast, offline, and privacy-first. Check it out at dataash.de
#DataEngineering #SQLServer #ETL #DataMigration #PrivacyFirst #ModernDataStack #DataTools #BuildInPublic #SQL #ExcelToSQL #DataSky

5 1 0 0
Post image

dataash.de

#DataEngineering #SQLServer #DataScience #Database #ETL #PrivacyFirst #OpenSource #BuildInPublic #TechArt #DataVisualization #DataAsh #DataTools

Follow on Reddit www.reddit.com/user/data_ash

5 1 0 0
Preview
Hugging Face x dltHub: The missing data layer for ML From raw data to production ML: load, transform, embed, and publish curated datasets with declarative pipelines powered by dltHub.

Thanks to @lhoestq.hf.co and the @hf.co datasets team for the collaboration.

Launch blog:
https://dlthub.com/blog/hugging-face-dlt-ml

#DataEngineering #MachineLearning #LLMOps

2 0 0 0
Post image

🚀 Me complace compartir que he obtenido la certificación Google Cloud Digital Leader de Google Cloud ☁️

🔗 Credencial:
www.credly.com/badges/47002...

#GoogleCloud #CloudDigitalLeader #CloudComputing #DataEngineering #DigitalTransformation

0 0 0 0

Module 7 of #DEZoomcamp 2026 ✅

Real-time streaming with Apache Flink + Redpanda 🔥

Built tumbling & session windows on NYC taxi data, sinking results to Postgres via JDBC — all orchestrated with Docker Compose.

github.com/HighviewOne/...

7 modules down! 🚀
#DataEngineering #ApacheFlink

0 0 0 0

The 3 phases of a Data Engineer on Pi Day:

1. 3:14 AM - Wake up to an alert.
2. 3:14 PM - Eat pizza (it's shaped like a pie) at desk.
3. 3.14% - The query optimization you managed to squeeze out before the deadline.

What phase are you in right now? 👇
#PiDay #DataEngineering

2 1 0 0
Preview
GitHub - tarek-clarke/resilient-rap-framework: A resilient, fault‑tolerant telemetry analytics pipeline designed to validate, benchmark, and stress‑test high‑frequency sensor data streams under real‑w... A resilient, fault‑tolerant telemetry analytics pipeline designed to validate, benchmark, and stress‑test high‑frequency sensor data streams under real‑world failure conditions. Includes chaos test...

When tensor models hit the physical noise floor of the hardware, deterministic circuit breakers and DLQs must step in. Multi-layered defense is mandatory for the edge.

Sanitized repo & architecture details here:
github.com/tarek-clarke...
#DataEngineering #SportsAnalytics

1 0 2 0
Preview
Strategy for Incorporating Data Engineering for Computer Vision in Autonomous Driving Autonomous vehicle perception systems rely heavily on high-quality datasets for tasks like object detection, tracking, and segmentation. This article explores the data engineering strategies that support these systems, including setting up annotation workflows, using data augmentation and synthetic generation to expand datasets, and implementing data version control to manage massive training data pipelines.

Strategy for Incorporating Data Engineering for Computer Vision in Autonomous Driving

Autonomous vehicle perception systems rely heavily on high-quality datasets for tasks like object detection, tracking, and segmentation. This article explo…

Telegram AI Digest
#ai #computervision #dataengineering

2 0 0 0
Preview
Strategy for Incorporating Data Engineering for Computer Vision in Autonomous Driving

Стратегия внедрения инженерии данных для компьютерного зрения в автономном вождении

Системы восприятия автономных транспортных средств в значительной степени полагаются на высококачественные наборы данных для таких задач, как обнаружение о…

Telegram ИИ Дайджест
#ai #computervision #dataengineering

1 0 0 0
Preview
AI-Powered Coding: From Vibe Coding to Agent Engineering — The Practical Guide to 10× Productivit... "If you're still typing for i in range every day, brace yourself: within 24 months, the market will demand your ability to orchestrate fleets of agents — not produce loops." Introduction — T...

AI-Powered Coding

"If you're still typing for i in range every day, brace yourself: within 24 months, the market will demand your ability to orchestrate fleets of agents — not produce loops."
#AI #DataEngineering

rentry.co/svuxfxis

1 1 0 0
Post image

READ THIS BLOG

READ Here: www.dremio.com/blog/from-ra...

#ApacheIceberg #AgenticAI #DataLakehouse #DataEngineering

0 0 0 0
Preview
GitHub - CodingJhames/de-zoomcamp-james Contribute to CodingJhames/de-zoomcamp-james development by creating an account on GitHub.

Week 7 #DataEngineering Zoomcamp 🏎️
Streamed 4.4M records via #Redpanda & #PySpark on my James-T-850. Speed is nothing without logic!

Results: 📍
📏 Dist: 9506
🏙️ Zone: 74
⏳ Session: 31m
💰 Peak Tip: 10-16 18:00

Progress: github.com/CodingJhames...

#Streaming #Python #BigData #DataTalksClub

0 0 0 0
Reprise d'un projet avec récupération / "parsing" de vieux fichiers d'un jeu de simulation en biologie, et rendre résultat humainement lisible ! Dans deux langages de programmation !

#Perl #Python #Creatures #Data #DataEngineer #DataEngineering #IAGen #GenAI (aide mais recadrer)

Reprise d'un projet avec récupération / "parsing" de vieux fichiers d'un jeu de simulation en biologie, et rendre résultat humainement lisible ! Dans deux langages de programmation ! #Perl #Python #Creatures #Data #DataEngineer #DataEngineering #IAGen #GenAI (aide mais recadrer)

Reprise d'un projet avec récupération / "parsing" de vieux fichiers d'un jeu de simulation en biologie, et rendre résultat humainement lisible ! Dans deux langages de programmation !

#Perl #Python #Creatures #Data #DataEngineer #DataEngineering #IAGen #GenAI (aide mais recadrer)

1 0 1 0
Video

HAVE YOU EXPERIENCED THE AGENTIC LAKEHOUSE?

Try Dremio's Free 30 Day Trial today and experience how easy, fast, and open agentic Analytics can be!

www.dremio.com/get-started?...

#DataLakehouse #DataEngineering #AgenticAnalytics #AIAgents

0 0 0 0
Preview
The Data Lakehouse Isn’t the Silver Bullet Teams Think It Is

A data engineer breaks down why lakehouse architecture isn’t the revolution it’s marketed as—and why data modeling, quality, and ownership matter far more. #dataengineering

1 0 0 0
Post image

READ THIS BLOG

READ Here: www.dremio.com/blog/how-age...

#ApacheIceberg #AgenticAI #DataLakehouse #DataEngineering

0 0 0 0
Post image

Memorize the structure, not the syntax.
#SQL #DataEngineering #RecursiveCTE #InterviewPrep

0 0 0 0
Post image

End-to-End Data Engineering Project: Food Order ETL Pipeline using MySQL & Power BI
#dataengineering

This project shows a full ETL/analytics flow for a food‑ordering business, from raw operational data in MySQL to interactive dashboards in Power BI.

0 0 1 0
Post image

Is your Kafka lag dashboard lying? Learn how log compaction and retention silently manipulate reported timestamps and how to ensure your monitoring reflects actual system performance.
softwaremill.com/compaction-a...

#ApacheKafka #DataEngineering #DistributedSystems #EventStreaming #Observability

0 0 0 0
Post image

🚀 New Guide: Enterprise Web Scraping Architecture
How CTOs build secure, scalable scraping infrastructure while ensuring compliance and reliability.

Read here:
www.retailgators.com/enterprise-g...

#WebScraping #DataEngineering #TechArchitecture

0 0 0 0
Preview
How Data Engineering Boosts Data Integration for Insights - Koows Learn how data engineering streamlines data integration, creating unified, actionable insights for better decision-making.

Unlock the power of seamless data flow! Learn how data engineering helps integrate disparate data sources into actionable insights, driving better business decisions.

Read more: koows.com/@saniawilkin...

#DataEngineering #DataIntegration #BusinessIntelligence #TechTrends #DataDriven

1 0 0 0
Video

WHERE AM I TODAY?

I'll be traveling around the world the next several months (Australia, New Zealand, UK, France, Germany, and of course across the US)

Make sure to check out:

www.dremio.com/events?utm_s...

#DataLakehouse #DataEngineering #AgenticAnalytics #AIAgents

0 0 0 0
Preview
"Je suis chasseur de têtes, et voici mes conseils pour vous faire repérer" Réseau, LinkedIn, visibilité… Découvrez comment les chasseurs de têtes identifient les candidats et comment augmenter vos chances d’être repéré.

"Recherche d’emploi : les secrets d’un chasseur de têtes pour sortir du lot"

#Recrutement #Travail #Emploi #ChasseurDeTêtes #HeadHunter #DataEngineer #DataEngineering ...

rebondir.fr/recherche-de...

0 0 0 0
Video

Most AI projects don’t fail because of the model.
They fail because the data isn’t ready.

In this blog, we break down why clean, governed data is the real foundation for AI success.

Read more:
🔗 bit.ly/4bANx0B

#AI #DataEngineering #AITransformation #DataStrategy

0 0 0 0
Post image

Build smarter software with Python experts.

Python powers modern AI systems, data platforms, and automation tools used by fast-growing startups and enterprises.

#pythondevelopment #aidevelopment #machinelearning #dataengineering #automation #acquaintsofttech

2 1 0 0
Post image Post image Post image

Can you write a SQL query to find each product's root category and depth in an unlimited category tree?
💡 Hint: GROUP BY won't save you here. You need a Recursive CTE.
Drop your solution 👇 Answer in next tweet!
#SQL #DataEngineering #RecursiveCTE #InterviewPrep

0 0 1 0