Trending

#dataeng

Latest posts tagged with #dataeng on Bluesky

Latest Top
Trending

Posts tagged #dataeng

Preview
The Certifications Scam Why data engineers collect certificates and do you really need one?

The Certifications Scam. Why data engineers collect certificates and do you really need one. open.substack.com/pub/datagibb... by @ivanovyordan.com #Work #FutureOfWork #Certs #Certificates #Training #ProofOfWork #ShowYourWork #Git #Github #Data #DataEng #DataEngineering

1 0 0 0
Senior Software Engineer - WireScreen · AI Hacker Jobs Senior Software Engineer at WireScreen - Python, Django, FastAPI, gRPC, asyncio, Terraform, PySpark, Apache Spark, MapReduce, Databricks, Snowflake, Parquet, Backend, API, Data Pipelines, Knowledge Gr...

WireScreen hires a Senior Software Engineer in New York, NY to build scalable Python/Django/FastAPI, gRPC, asyncio, Terraform & Spark data pipelines that power a global supply‑chain intelligence platform (knowledge graph). $170K‑$210K. #TechJobs #Python #DataEng #AI aihackerjobs.com/company/wire...

0 0 0 0
We extended the deadline to give everyone a chance to settle back into the new year, but all good things must come to an end.

This Sunday, January 11th is your absolute last chance for two major opportunities:

1️⃣ Lock in the lowest ticket prices of the year:

🇦🇺 Brisbane & 🇳🇿 Auckland: $99

🇦🇺 Sydney & Melbourne: $299

2️⃣ Submit your talk for the 2026 conference

We extended the deadline to give everyone a chance to settle back into the new year, but all good things must come to an end. This Sunday, January 11th is your absolute last chance for two major opportunities: 1️⃣ Lock in the lowest ticket prices of the year: 🇦🇺 Brisbane & 🇳🇿 Auckland: $99 🇦🇺 Sydney & Melbourne: $299 2️⃣ Submit your talk for the 2026 conference

🚨 FINAL CALL! 🚨
The clock is running out on our extended Boxing Day deals.
You have until THIS SUNDAY, Jan 11th to: 🎟️ Grab the cheapest conference tickets ($99 / $299) 🗣️ Submit your talk for the CFP
Get in quick! 🏃‍♂️💨
👉 dataengbytes.com/
#DataEng #LastChance #TechSale #CFP

0 0 0 0
Don't shoot the messenger, but the Grinch is absolutely losing it. 😤

He’s demanding you all STOP buying the discounted conference tickets. He says the $99 and $299 price tags are "disgustingly cheerful."

The sale ends this Sunday (Jan 11).

Personally? I think we should buy as many as possible just to annoy him. 😈

Don't shoot the messenger, but the Grinch is absolutely losing it. 😤 He’s demanding you all STOP buying the discounted conference tickets. He says the $99 and $299 price tags are "disgustingly cheerful." The sale ends this Sunday (Jan 11). Personally? I think we should buy as many as possible just to annoy him. 😈

Don't shoot the messenger, but the Grinch is absolutely losing it. 😤
He’s demanding you all STOP buying the discounted conference tickets.
Personally? I think we should buy as many as possible just to annoy him. 😈
Grab yours here: dataengbytes.com/
#DataFam #DataEng #TechConference

1 0 0 0
We have received a formal complaint from the Grinch. 😠

Apparently, there is "too much cheering" and "too much saving" going on in the Data Engineering community right now. He is demanding that you STOP buying these bargain tickets immediately.

He finds the following prices personally offensive: 
🤢 Brisbane & Auckland: $99 
🤢 Sydney & Melbourne: $299

We have received a formal complaint from the Grinch. 😠 Apparently, there is "too much cheering" and "too much saving" going on in the Data Engineering community right now. He is demanding that you STOP buying these bargain tickets immediately. He finds the following prices personally offensive: 🤢 Brisbane & Auckland: $99 🤢 Sydney & Melbourne: $299

The Grinch has had ENOUGH! 🛑😤
He says you are all being far too cheerful about saving money.
Please, respect his wishes. Do NOT buy a ticket before the sale ends this Sunday, Jan 11th.
(Or do... and make him really mad). 😈
🎟️ Ruin his day here: dataengbytes.com/
#DataEng #Grinch

0 0 0 0
We are doing a massive sponsorship sale until the end of January. Get yourself a coffee cart of booth for just $5k + GST.

We are doing a massive sponsorship sale until the end of January. Get yourself a coffee cart of booth for just $5k + GST.

We are doing a massive sponsorship sale until the end of January.

Get yourself a coffee cart of booth for just $5k + GST.

Reach out to find out more.

#DataEng #TechSponsorship #DevRel #Auckland #Brisbane

2 0 0 0
Looking to elevate your brand visibility in the ANZ Data Engineering community to kick off 2026? 🚀 We have opened a limited-time sponsorship offer specifically for our Auckland and Brisbane chapters.

Looking to elevate your brand visibility in the ANZ Data Engineering community to kick off 2026? 🚀 We have opened a limited-time sponsorship offer specifically for our Auckland and Brisbane chapters.

⚡ SPONSOR FLASH SALE ⚡
Want to get your brand in front of Data Engineers in Auckland or Brisbane?
We are offering a Booth or Coffee Cart sponsorship for just $5k! (Single city). ☕🎪
Valid until Jan 31st only.
#DataEng #TechSponsorship #DevRel #Auckland #Brisbane

1 0 0 0
If you haven't locked in your professional development for 2026 yet, you have until the clock strikes midnight on New Year's Eve to secure our "Data Deals."

If you haven't locked in your professional development for 2026 yet, you have until the clock strikes midnight on New Year's Eve to secure our "Data Deals."

⚠️ THE COUNTDOWN IS ON! ⚠️
Don't miss the lowest prices for the 2026 Data Eng conference: 🇳🇿 AKL / 🇦🇺 BNE: $99 🇦🇺 SYD / 🇦🇺 MEL: $299
Sale ends Dec 31st. Run, don't walk! 🏃‍♂️💨
Grab tickets: www.tickettailor.com/events...
#DataEng #TechSale #DataEngineering #NYE

1 0 0 0
Did Santa forget the professional development budget under the tree? Don't worry, we've got you covered with our Boxing Day Sale! 🎁

Did Santa forget the professional development budget under the tree? Don't worry, we've got you covered with our Boxing Day Sale! 🎁

🥊 BOXING DAY DATA DEALS ARE LIVE! 🥊
🇦🇺 Brisbane OR 🇳🇿 Auckland: $99* 🇦🇺 Sydney OR 🇦🇺 Melbourne: $299*
Don't wait—this sale ends Dec 31st or until sold out! 🏃💨
🎟️ grab yours: www.tickettailor.com/events...
#DataEng #BoxingDay #TechSale #DataEngineering

1 0 0 0
Video

2025 is AI's defining moment. We're seeing incredible breakthroughs—medical research acceleration, unsolved math problems cracked, productivity gains—but also facing real challenges: energy demands, job disruption, security risks.

This is just the beginning.

#AI #DataEng #Tech

0 0 0 0
Preview
Ownership and Decentralization of Data in DePINs | Kamu Data Central role of data in DePIN rewards Challenges of DePIN data management Who owns the data? Evolution of data in DePINs Kamu: Decentralized data middleware Takeaway Decentralized Physical Infrastruc...

In our model if a company behind a DePIN fails - community can preserve all data, or even take over the data pipelines and keep the whole network operational.

This model, is how put "De" back into DePINs and make them behave more like actual DAOs.

#Web3 #DePIN #DataEng

4/4

1 1 0 0
Data Debug SF: Inaugural Happy Hour · Luma 🍻 Join us for the inaugural Data Debug SF happy hour! We're launching San Francisco's community for data engineers, analytics engineers, and data…

🍻 it's official! inaugural data debug sf happy hour is live

july 29 • 5:30-7:30pm • sf (venue tba)

for everyone who's ever said "the data looks weird" and meant it

casual networking • data war stories • good drinks (alc & non-alc) • great people

rsvp: lu.ma/g92ckftj

#datadebug #dataeng #sf #irl

0 0 0 0

Mis últimas semanas con Go me han llevado a una reflexión: ¿Son los **zero values** realmente una característica que simplifica o complican más la vida a la larga en sistemas de datos y APIs? Abro hilo para explicar mi perspectiva. 👇 #GoLang #SoftwareDesign #DataEng

1 0 1 0

Not too long ago, I wrote an article on how I leverage my GPU to run local LLM to boost my productivity. This way is free & safe.

I just updated this 💎 to show you how to achieve this using docker and thus avoiding cluttering up your system due to dependencies etc.

Enjoy!

#coding #dataeng

0 0 0 0
Preview
GitHub - arkflow-rs/arkflow: High-performance Rust stream processing engine, providing powerful data stream processing capabilities, supporting multiple input/output sources and processors. High-performance Rust stream processing engine, providing powerful data stream processing capabilities, supporting multiple input/output sources and processors. - arkflow-rs/arkflow

Rust-powered streaming at its finest! Arkflow brings speed + extensibility to your data pipelines #rustlang #dataeng #streaming https://github.com/arkflow-rs/arkflow

0 0 0 0
Post image

"A wife sends her programmer husband to the grocery store for a loaf of 🍞.
On his way out, she says, "and if they have 🥚, get a dozen."
The programmer husband returns home with 12 loaves of 🍞."

Do you believe an AI would have perceived that differently?

#developers #devfeed #dataeng #programming

0 1 0 0
How to automate integration testing using docker - In this article, we'll look at how to automate integration testing using Docker. By the end, you'll be able to set up a complete test environment

Would you like to learn how to make clean, secure and reusable integration tests that cost 0$ to run?! #dotnet #devfeed #coding #bootstrappers #azure #dataeng

Check out my new article 👇

0 0 0 0
Autocomplete with your local LLM - Code your assets This article will show how I setup autocomplete, in VSCode, using local LLM with minimal hardware requirements. Local llm hardware requirements.

𝙃𝙚𝙧𝙚 𝙞𝙨 𝙝𝙤𝙬 𝙄 𝙗𝙤𝙤𝙨𝙩 𝙢𝙮 𝙘𝙤𝙙𝙞𝙣𝙜 𝙥𝙧𝙤𝙙𝙪𝙘𝙩𝙞𝙫𝙞𝙩𝙮 𝙨𝙖𝙛𝙚𝙡𝙮 👨‍💻

Just wrote an article on how I setup autocomplete, in VSCode, using local LLM with minimal hardware requirements.

Autocomplete boosts my productivity as I don’t have to spend energy on boiler plate code 🚀

#devfeed #developers #dataeng

👇

1 1 0 0

Who here has written their own ETL / ELT just to get the knowledge on how things are working under the hood?

#dataeng

0 0 0 0

This is very true for SWE estimates, but luckily it has an effective remedy.

Never flex on deadlines.

Flex on the delivery scope.

#Developers #Promosky #indiedev #dev #dataeng

2 0 0 0

It would be a treat to work with @chris.wensel.net so if you are #DataEng with flare for #Java #opensource & #devops you may want to look into this

2 4 0 0

Hey all, I'm hiring for a #DataEng (and #DevOps) role in the SF Bay Area. Reach out directly to me for more info.

#Java background is a strong want plus AWS and a desire to work on #OpenSource stuff.

#DataBS

4 4 0 1
Preview
ArkFlow – High-performance Rust stream processing engine Comments

Arkflow: A new Rust stream processor that combines performance with simplicity. Data pipelines just got better.

#rust #streaming #dataeng https://github.com/chenquan/arkflow

0 1 0 0
Preview
Google Cloud Platform Certified Data Engineer Master data engineering on Google Cloud Platform through hands-on learning. Develop expertise in storage solutions, data pipelines, ML operations, and security best practices while building production...

🔥 Just dropped: GCP Data Engineer Certification!

⚡️ Inside scoop:
- Duke/Northwestern curriculum
- 101 hands-on lessons
- Production-ready skills

💪 From BigQuery to ML Ops in 4 weeks

🔗 ds500.paiml.com/learn/course...

#GCP #DataEng #BuildSzn

1 0 0 0
Preview
Databricks Engineering Mastery This course provides a comprehensive overview of Databricks platform capabilities for getting the Data Engineer certification. Learn to build data pipelines, use Delta Lake for data management, schedu...

🔥 Just dropped: Databricks Engineering Mastery!

⚡️ Inside scoop:
- Duke & Northwestern curriculum
- Hands-on Delta Lake mastery
- Complete cert prep

💪 From clusters to Unity Catalog in 4 weeks

🎯 85 lessons to level up!

🔗 ds500.paiml.com/learn/course...

#Databricks #DataEng #BuildSzn

1 0 0 0

I see some discussion of folks diving into #ipeds data today. I noticed the Access Files are not available just yet. I have been cooking up an idea for a #dataeng project over winter break and have been waiting for the new files.

My question: Does anyone know if the Access files are close behind?

0 0 1 0
Original post on toot.bldrweb.org

Do you know of any #rstats teams who could use some help in 2025?

I'm a freelance consultant with 10yrs of experience in #DataSci, #DataEng, #DataOps, and providing #SysAdmin for related tools. I primarily work with R, but I have enough SQL and Python knowledge to get by. I know my way around […]

3 3 1 0

i've been taking the chicago crime data and popping it through DBT as a kind of silly toy project. it's pretty neat. i have been doing manual downloads so i need to set up a daily cron thing but i like how it's shaping up.

i'll post the architecture / code on here when it's done.

#dataeng #dbt

5 0 2 0
Preview
Accelerate prototyping and development with Pinecone Local | Pinecone With Pinecone Local, you can now prototype, test, and develop AI applications locally while seamlessly integrating workflow testing into CI/CD pipelines.

I used Pinecone cloud's free tier to help with a course I ran this semester. Having a local option can help frame the development cycle for the students next year. I'm aware this is not the intended use case, but it certainly will help next year

www.pinecone.io/blog/pinecon...

#vectordb #dataeng

0 0 0 0