#PyArrow

Kai

@gnarly-parker.chaos.social.ap.brid.gy

8 months ago

If the purpose of a library is to "process and transport large data sets" but the code base contains an error message like "array cannot contain more than 2147483646 bytes" then there must be a big misunderstanding somewhere. #pyarrow

DIY Devs

@diydevs.bsky.social

9 months ago

Python Pandas Ditches NumPy for Speedier PyArrow Pandas 3.0 will significantly boost performance by replacing NumPy with PyArrow as its default engine, enabling faster loading and reading of columnar data.

This recent Python news was surprising. Pandas is moving from NumPy to PyArrow for its backend. Its intention is boosting performance and memory efficiency. You can read more here: thenewstack.io/python-panda...

#Pandas #PyArrow #Python

Reuven M. Lerner

@lernerpython.com

9 months ago

The PyArrow revolution in Pandas YouTube video by PyCon US

The video from my talk at #PyConUS, "The PyArrow Revolution in Pandas," is up!

Take a look, and find out about the connection between #PyArrow and #Pandas, what this means for you today, and what it means moving forward: youtu.be/Cpr0wbopYvU?...

Nic Crane

@niccrane.bsky.social

10 months ago

Currently taking a look at refreshing some of the #ApacheArrow and #PyArrow docs, so if you use Arrow in #rstats or Python and there's any areas you'd like to understand better, give me a shout, and we'll see what we can do!

Python-Job-Alert

@python-job-alert.activitypub.awakari.com.ap.brid.gy

1 year ago

Convert Struct to Map in Python for Writing to S3 in Parquet Format I am using Apache Airflow to ...

stackoverflow.com/questions/79418615/conve...

#python #python-3.x #pandas #dataframe #pyarrow

Event Attributes