#DataFusion

DataEngBytes

@dataengbytes.bsky.social

1 week ago

The Native Lakehouse Is Here and Mimoune Djouallah is here to tell you all about it. - Iceberg REST Catalog is now supported across all major cloud providers — true vendor neutrality is real in 2026 - Lightweight engines like DuckDB and DataFusion can query across all of them with a single SQL interface - AI coding assistants are meaningfully accelerating lakehouse adoption and development Catch Mimoune Djouallah at DataEngBytes Brisbane on Friday, 20th of March 2026. Tickets only $175 AUD.

The Native Lakehouse Is Here and Mimoune Djouallah is here to tell you all about it.

Catch Mimoune Djouallah at DataEngBytes Brisbane on Friday, 20th of March 2026. Tickets only $175 AUD.

#lakehouse #iceberg #duckdb #datafusion

Pierre Zemb

@pierrezemb.fr

2 weeks ago

Building Index-Backed Query Plans in DataFusion What I learned about manually constructing physical query plans for secondary index queries, and the library that came out of it.

📝 The datafusion-index-provider PoC from last year is now a real library in datafusion-contrib, running in production.

🔧 New post on building secondary index queries with standard DataFusion operators

pierrezemb.fr/posts/datafu...
#Rust #DataFusion

@bfsi.bsky.social

3 weeks ago

Sensor Hub Market Size Forecast 2035 | Industry Share Report Sensor Hub Market is expected to reach USD 228.17 Billion at a CAGR of 18.09% by 2035, Global Sensor Hub Market Growth by Type, Application, and Region | Sensor Hub Industry

Sensor Hub Market Trends Analysis, Sales Revenue, Competitive Landscape and Market Expansion Strategies 2035
www.marketresearchfuture.com/reports/sens...

#SensorHubMarket #SmartSensors #IoTDevices #DataFusion

Threat Advisory Report (TAR) Network

@tar-network.bsky.social

1 month ago

ICE’s facial scanning is the tip of the surveillance iceberg Federal troops are increasingly turning to high-tech tracking tools that push the boundaries of personal privacy

ICE is normalizing facial scanning and AI-driven surveillance through immigration enforcement, exposing citizens, protesters, journalists, and bystanders to routine biometric monitoring. #ICE #Surveillance #Biometrics #FacialRecognition #Palantir #DataFusion #Protesters #Journalists #TheWeek

Papers We Love

@paperswelove.org

1 month ago

Alex Kesling on Apache Arrow DataFusion [PWL NYC] | Papers We Love Alex Kesling on Apache Arrow DataFusion [PWL NYC]

Example from the #NYC meetup: paperswelove.org/videos/alex-...

#database #compsci #datafusion #programming

DataFusion.io

@datafusionio.bsky.social

2 months ago

Wishing you a joyful holiday season and a happy New Year.
Thank you for a great year.

Happy Holidays from all of us at DataFusion.

#DataFusion #HappyHolidays #SeasonsGreetings

Dana A. Goward

@gpsbackup.bsky.social

3 months ago

Addressing the Escalation in GNSS Spoofing with Data Fusion - Cambridge Wireless - RNTF Image: Shutterstock What's new: An article, focusing on maritime, about using data fusion to help overcome spoofing. Why its important: "The prudent

“The prudent navigator will use all means available.”

As #GNSS #spoofing grows, data fusion is key to safe #maritime navigation and situational awareness.

vist.ly/4f7ms

#PNT #Cybersecurity #Resilience #GPS #Navigation #DataFusion #Jamming #CriticalInfrastructure

Novaspace

@novaspaceglobal.bsky.social

4 months ago

Earth Observation Data and Services Market - Novaspace - Market Intelligence Hub Earth Observation Data and Services Market provides a global assessment of the EO satellite-based commercial demand for imagery and value-added services.

The next frontier in EO lies in data fusion, the seamless integration of multi-sensor inputs into actionable intelligence.

ow.ly/1krf50Xn11B
#DataFusion #EO #EarthObservation

Threat Advisory Report (TAR) Network

@tar-network.bsky.social

4 months ago

ICE and CBP Agents Are Scanning Peoples’ Faces on the Street To Verify Citizenship Videos on social media show officers from ICE and CBP using facial recognition technology on people in the field. One expert described the practice as “pure dystopian creep.”

ICE and CBP agents used facial-recognition technology on Chicago streets to verify citizenship, marking DHS’s first confirmed use of biometric policing in urban areas. #Trump #DHS #ICE #CBP #FacialRecognition #Surveillance #CivilRights #DataFusion #InstitutionalAccountability #404Media

Threat Advisory Report (TAR) Network

@tar-network.bsky.social

4 months ago

A CBP Agent Wore Meta Smart Glasses to an Immigration Raid in Los Angeles Video obtained and verified by 404 Media shows a CBP official wearing Meta's AI glasses, which are capable of recording and connecting with AI. “I think it should be seen in the context of an agency t...

A CBP agent used Meta’s AI smart glasses during a Los Angeles immigration raid, highlighting DHS's move towards wearable surveillance in federal enforcement. #Trump #CBP #DHS #Meta #SmartGlasses #Surveillance #DataFusion #Immigration #CivilRights #InstitutionalAccountability #404Media

Rust NYC

@rust.nyc

4 months ago

Talks: Custom Rust Linting (ast-grep) & Geospatial DataFrame lib (SedonaDB), Thu, Nov 13, 2025, 6:30 PM | Meetup Doors open at 6:30 p.m. to give attendees plenty of time to grab pizza and socialize, and the talk begin at 7:30 p.m. **Talk #1: Custom Rust Linting** **Herrington Darkhol

Excited for the #RustNYC talks Nov. 13!

Herrington Darkholme will present a comprehensive guide to building custom linting tools for #RustLang projects.

Matt Powers will speak about #SedonaDB, a geospatial compute engine that's built on #DataFusion.

Register: www.meetup.com/rust-nyc/eve...

Novaspace

@novaspaceglobal.bsky.social

4 months ago

Earth Observation Data and Services Market - Novaspace - Market Intelligence Hub Earth Observation Data and Services Market provides a global assessment of the EO satellite-based commercial demand for imagery and value-added services.

The next frontier in EO lies in data fusion, the seamless integration of multi-sensor inputs into actionable intelligence.

ow.ly/aUpx50XkATJ
#DataFusion #EO #EarthObservation

Lorena Salgado

@lorenasalgadof.bsky.social

4 months ago

More info: meetingorganizer.copernicus.org/EGU26/sessio... #RemoteSensing #ProximalSensing #SoilMonitoring #SoilMapping #SpectralScience #UAV #EarthObservation #SAR #LiDAR #MachineLearning #DataFusion #NatureBasedSolutions #InnovationInSoils #FromWasteToSolution #GreenTechnology #Drone #SmartSoils

Mimoune Djouallah

@mimdj.bsky.social

4 months ago

Explaining how Python engines read and write #DeltaTable is not for the faint of heart.
The theory is everything will depends on the delta kernet rust for read and write, but we are not there yet
github.com/djouallah/Fa...
#duckdb #delta_rs #datafusion #chdb #daft #polars #rust #lakesail

DataFusion.io

@datafusionio.bsky.social

4 months ago

Aaron Roesser: Driving Scalable Innovation at DataFusion. From PlutoTV/Paramount to us, he's building the future. #DataFusion #Tech

Delta Lake

@deltalakeoss.bsky.social

4 months ago

Flight SQL + Delta: Building the Future of High-Speed Data Exchange · Luma Join us for an in-depth, interactive session on Flight SQL and Delta integration, showcasing how open technologies like Apache Arrow Flight, DataFusion, and…

We’re diving deep into Flight SQL + Delta to show how open technologies like Apache Arrow Flight, #DataFusion, & Delta Lake are reshaping high-performance analytics. 🚀

🗓️ Nov 11
🕝 9:00 AM PT
🔗 RSVP: luma.com/delta-1111

Get ready to see data exchange the way it should be — fast, distributed, & open.

DataFusion.io

@datafusionio.bsky.social

4 months ago

Tired of being on the sidelines?

DataFusion puts the power of sophisticated ad buying in your hands. Get big-brand results with cost-efficient campaigns, even airing during those big games. Start scoring new business today! #DataFusion #AdTech

Georg Heiler

@geoheil.com

5 months ago

#gis #medium-data #sedona #rust #datafusion sedona.apache.org/latest/blog/...

DataFusion.io

@datafusionio.bsky.social

6 months ago

Learn more at data-fusion.io
#AdTech #ProgrammaticAdvertising #DSP #CTV #DataFusion

@arxivlens.bsky.social

6 months ago

Data Fusion for High-Resolution Estimation
Amy Guan, Joshua Salomon et al.
Paper
Details
#DataFusion #HighResolutionEstimation #AmyGuanResearch

qxip

@qxip.bsky.social

8 months ago

GitHub - metrico/influxdb3-community: Community InfluxDB 3.0 "IOx" static builds + containers + Examples for Developers & Integrators. Experiment with low-cost storage, unlimited cardinality and Fligh... Community InfluxDB 3.0 "IOx" static builds + containers + Examples for Developers & Integrators. Experiment with low-cost storage, unlimited cardinality and FlightSQL APIs - metrico/i...

InfluxDB3 Community Builds are resumed for the open source community to leverage! The unlocked community releases (binary + docker) drop most of the "open core" limitations: github.com/metrico/infl...

#datafusion #arrow #flightsql #influxdb3 #iox

Cora

@corasaurus-hex.bsky.social

8 months ago

but honestly bless datafusion, truly one of the best bits of software I’ve ever used (s/o to @andrewlamb1111.bsky.social et al) #datafusion #rust

Georg Heiler

@geoheil.com

9 months ago

Building InfluxDB 3 Core: Real-Time Columnar DB & Data Processor On Object Storage YouTube video by Data Council

#influxdb #datafusion #datacouncil www.youtube.com/watch?v=8A4R...

Sylvain Wallez

@swallez.com

9 months ago

An ode to #DataFusion, an amazing piece of engineering.

I had that same experience when prototyping an integration with Elasticsearch and running a SQL join between PG and ES with filter pushdown on both sides. Combined with the Rust "if it compiles it works" experience, this was pure bliss.

Onyi Arah, MD, DSc, PhD

@oacarah.bsky.social

9 months ago

Data Fusion Using Weakly Aligned Sources We introduce a new data fusion method that uses multiple data sources to estimate a smooth, finite-dimensional parameter. Most existing methods only make use of fully aligned data sources that shar...

www.tandfonline.com/doi/full/10....

#causalinference #CausalSky #DataFusion

Delta Lake

@deltalakeoss.bsky.social

10 months ago

Using AWS Lambdas + #deltars, S&P Global cut costs from $52 → $7.30/month 💸

⚡ Spin-up time: 6 min → 1.4 sec
⚡ Job run time: 10 min → 4 min

✅ In addition to using #ApacheSpark for their large loads, they also use #pandas, #polars, #datafusion, #daft and #duckdb - all together with #DeltaLake.

Tim Saucer

@timsaucer.bsky.social

11 months ago

We're pleased to announce that Apache DataFusion in Python 46.0.0 is released! Since the last announcement post we've had a lot of great features and new contributors. Please check out the blog post with details.

datafusion.apache.org/blog/2025/03...

#DataFusion #Python #DataFrame #PyData #Apache

@dimitriprandner.bsky.social

11 months ago

Data fusion: creating new opportunities for data analysis? A study on the potential of data fusion in survey research - Quality & Quantity Primary data collection has become increasingly challenging. There are many reasons for this: Not only has the cost of conducting face-to-face interviews increased and the number of available intervie...

Last week Johann Bacher, Roman Pfeiler and myself (@jku) had a paper published in Quality & Quantity on #datafusion in the #socialsciences.

We provide insight into how we approach the fusion of two datasets and try to establish key criteria for the process ->
link.springer.com/article/10.1...

TREC at PSU

@trecpdx.bsky.social

1 year ago

PSU Transportation Seminar: Active Transportation Data Fusion: Incorporating Big Data to Estimate Volumes

We'll be getting started with today's PSU Transportation Seminar on Bike/Ped #DataFusion in about half an hour! Join us at noon, in the Vanport building or on Zoom: trec.pdx.edu/events/profe...

TREC at PSU

@trecpdx.bsky.social

1 year ago

Happening this Friday! Don't miss the latest on #DataFusion methods for estimating active transportation volumes: trec.pdx.edu/events/profe...

(Not local to PDX? You can still watch and ask questions - join us via Zoom!)