#zarr

Sentinel Online

@sentinelonline.bsky.social

3 weeks ago

An Earth-view from space showing the blue curve of the planet against a dark background. The foreground features the EOPF logo—a stylized "E" combined with a colourful cube and a cloud icon. To the right, the text reads "WEBINAR #1 EXPLORER" in orange and white. At the bottom, the ESA and EOF logos are displayed in white.

📅 Join the official launch of the #EOPF #Sentinel #Zarr Explorer: 9 March (15:00 CET)
Supported by @esa.int, this webinar demonstrates browser-based Sentinel data visualisation using Zarr/GeoZarr.
@thrivegeo.bsky.social @developmentseed.org @eox.at
🔗 Register: www.tickettailor.com/events/thriv...

Alexander Kmoch @allixender

@allixender.bsky.social

1 month ago

#zarr #geospatial #datacube the potential 🤯

Kostas Leptokaropoulos

@kostas-leptokarop.bsky.social

3 months ago

🌍 #Earth, #Ocean & #Atmospheric Scientists
Quick poll: Are you using #scientificdata formats? (#NetCDF, #HDF5, #Zarr, etc.)
✅ Takes only 5' (Required fields) to 15' (Optional fields)!
👉 Link: forms.office.com/Pages/Respon...
Please share, your input helps improve research tools!
#MATLAB #Python

Robbi Bishop-Taylor 🛰️🌏

@satellitesci.bsky.social

3 months ago

🛢️ #Zarr format (i.e. cloud friendly multidimensional arrays) seems finally poised on the cusp of widespread operational use, with huge momentum building around both the format itself and the ecosystem around it. @esa.int's #EOPF program to deliver Sentinel data in Zarr is particularly exciting!

Sabrina Szeto

@sabrinaszeto.com

4 months ago

Curious about the new #Zarr data format for #Sentinel data? Want to ask experts from @developmentseed.org and thriveGEO how to use it?

Join our Office Hours session on Nov 4, 10-11am (UTC+1):
⭐ buytickets.at/thrivegeo/19...

Everyone is welcome!

Source Cooperative

@source.coop

4 months ago

Weather data is vital but too often accessing it means reinventing the wheel. Discover how dynamical.org used Source's data publishing utility to create a common good, making petabytes of #Zarr formatted #weatherdata
✅ Easy✅ Fast ✅ Open
Read the #casestudy here: docs.source.coop/case-studies...

Element 84

@element84.com

4 months ago

Earlier this week E84-er Julia Signell visited the European Space Agency (ESA) remote sensing facility outside of Rome to hammer out the details of how to represent #Zarr data in STAC.

Expect a blog post in the next week or so summarizing the outcomes!

luke.shaw@ironarray.io

@lshaw-ironarray.bsky.social

5 months ago

📢Blosc2 3.10.2 Released! 📢

Lazy evaluation for ALL Blosc2 functions in version 3.10!

Blosc2 powers:
- Zarr/HDF5 computations (see image and blosc.org/posts/tensor...)
- Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)!

#Zarr
#HDF5
#Python

Sentinel Online

@sentinelonline.bsky.social

5 months ago

🛰 At #BigDatafromSpace2025 (BiDS’25), the EOPF Tutorial: Getting Started with Zarr showed how cloud-native tools like #Zarr & #STAC make #EarthObservation data more scalable & accessible.

Brockmann Consult

@brockmannconsult.bsky.social

5 months ago

Building Sentinel-3 Data Cubes with xcube EOPF - Welcome Jupyter notebooks showcasing the usage of EOPF Sample Zarr Service

If you wish to build analysis-ready #Sentinel-3 data cubes, why not try this newly published #JupyterNotebook? It demonstrates how to use the #xcube-eopf plugin for data analysis.
#Zarr format
#EOPFSampleService project
#datacubes

eopf-sample-service.github.io/eopf-sample-...

mdsumner

@mdsumner.bsky.social

6 months ago

This is typical from coordinate array models, they are sloppy

There are many examples, using degenerate rectilinear coordinates is always a terrible idea, sadly the loudly trumpeted successor of all formats has adopted this practice blithely from netcdf,hdf #Zarr

Brockmann Consult

@brockmannconsult.bsky.social

6 months ago

🌍 Excited for #BiDS25 in Riga!
📅 29/09 Tutorial | 30/09 Hackathon
Supported by our colleague Konstantin Ntokas, the EOPF Zarr Hackathon dives deep into #CloudNative #EO with #Zarr, STAC, Dask, Julia & more.
👉 Register here: bit.ly/4oYOJ2P

Peter Sobolewski

@psobolewskiphd.bsky.social

8 months ago

Davin Potts to the right of a poster titled "Zarr + DragonHPC can acelerate reads from large OME-Zarr microscopy datasets by 3X-300X" At the top is a screeenshot of napari. Below is a diagram of networked data access by Dragon DDict.

Favorite #SciPy2025 moment (so far?):
poster by Davin Potts on speeding up HPC file IO for #Zarr files and involving napari and the awesome @jookuma.bsky.social‬
I met Davin's son at SciPy 2024 and demo'd napari and introduced him to Jordao 🤯
Butterfly effect?

Zarr

@zarr.dev

9 months ago

Analysis-ready VCF at Biobank scale using Zarr AbstractBackground. Variant Call Format (VCF) is the standard file format for interchanging genetic variation data and associated quality control metrics.

ICYMI: Check out this alternative storage approach for variation data using #Zarr. Rather than grouping all data for a given variant together, its groups all data for a given field, and store as chunked, compressed N-D arrays (tensors). 🤩

doi.org/10.1093/giga...

Josh Moore

@joshmoore.bsky.social

9 months ago

Screenshot of the PDF available at https://cloud.gerbi-gmb.de/s/6LrYfMByymPnHP5/download/2025_OME-Zarr_sw_developer.pdf

Screenshot of the PDF available at https://cloud.gerbi-gmb.de/s/y4rBGFM6dXn8Jkr/download/2025_OME-Zarr_web_developer.pdf

🚀 We’re hiring again! Join @gerbi-gmb.de as a Software Developer!

💻 Build scalable #bioimaging solutions

🌍 Collaborate globally

🎯 Contribute to open science through #OME #Zarr

📣 Tell your #NGFF friends.

Remote, full-time. Apply by 30 June 2025: All submissions via bit.ly/gerbi-jobs-2...

Javier Santoyo

@jsantoyo.bsky.social

9 months ago

Analysis-ready VCF at Biobank scale using Zarr. #VCF #Zarr #GeneticVariants #Genomics #Bioinformatics @gigascience.bsky.social‬ 🧬 🖥️
academic.oup.com/gigascience/...

Zarr (name redirect)

@zarrdev.bsky.social

9 months ago

To all our #Zarr friends out there, a reminder that this is a placeholder. Please follow @zarr.dev for the Real Zarr ™️

Kit Macleod

@kitmacleod.bsky.social

9 months ago

"The commitment from major entities like Copernicus, USGS, and Google Earth Engine signals a paradigm shift in how we will store, access, and analyze geospatial data in the cloud... #Zarr is poised to become a cornerstone of the cloud-native geospatial ecosystem, unlocking new frontiers..."

Zarr

@zarr.dev

10 months ago

🧠 Interested in extending #Zarr?

Let us know what you think about ZEP10 "Generic extensions". Current plan is for voting on the proposal mid-June. 📅

github.com/zarr-develop...

Julius Busecke

@codeandcurrents.bsky.social

10 months ago

Some Postdoc throwback today riding the NJtransit to Princeton.

On my way to the #WCRP km scale hackathon for the week.

www.wcrp-esmo.org/activities/w...

Excited to play around with #healpix #zarr #icechunk and some super high res data.

Zarr

@zarr.dev

11 months ago

🤩 " #NASA ... leveraged #Icechunk’s virtualization capabilities to present the entire collection of over a #million files as a single analysis-ready #Zarr data cube. "

Ed Hirata

@edhirata.bsky.social

11 months ago

#sciencejobs #imageprocessing #bioimage #zarr #xarray @czbiohub.bsky.social

EOMasters

@eomasters.org

11 months ago

Supporting Open Science with the CF Metadata Conventions for NetCDF Slides for the presentation given on 11 December 2024 at the AGU Annual Meeting to the session for the AGU Open Science Recognition Prize.

𝗖𝗙 𝗠𝗲𝘁𝗮𝗱𝗮𝘁𝗮 𝗖𝗼𝗻𝘃𝗲𝗻𝘁𝗶𝗼𝗻𝘀 support #OpenScience by automating processes via metadata in #NetCDF and #Zarr files. They establish a unified language for the #weather, #climate, #ocean, and #EO community. buff.ly/Vmtz6zH
#remotesensing #EarthObs

Al Merose

@al.merose.com

1 year ago

My personal bet is that DuckDB will eventually be able to read multidimensional array data stored in EarthMover (i.e. #Zarr) via the reframing of rasters as tables and visa versa.

github.com/zarr-develop...

Zarr

@zarr.dev

1 year ago

Looking for a job where you get to play with #Zarr
🧊🧊
🧊🧊❔

👇

Zarr

@zarr.dev

1 year ago

Please help the #Zarr community welcome @normanrz.bsky.social as the newest member of the Steering Council! 👏🏼

zarr.dev/blog/steerin...

Josh Moore

@joshmoore.bsky.social

1 year ago

GitHub - grimbough/Rarr: A simple native R reader for Zarr Arrays A simple native R reader for Zarr Arrays. Contribute to grimbough/Rarr development by creating an account on GitHub.

And there's of course github.com/grimbough/Rarr if you're interested, @jerry-shannon.bsky.social. Nothing like #Zarr in #R (to make a mouthful)

Zarr

@zarr.dev

1 year ago

Tall, narrow screenshot of https://zarr.dev/implementations/ showing all the language implementations of Zarr and their current status.

Thanks to gitub.com/ldeakin the list of #zarr implementations is now shiny and new! ✨

zarr.dev/implementati... 👈

If any are missing or need updating, please let us know.

Zarr

@zarr.dev

1 year ago

#beautifuldata in #zarr 😍

Cas

@caswognum.nl

1 year ago

By building on top of #zarr (polarishub.io/blog/dataset...), Polaris already supports random access into XL datasets.

But there is a performance penalty for each chunk access (data copy + decompress). Since data access in ML is typically random, this leads to lot of wasted compute.

What can we do?