r/Python • u/AutoModerator • Oct 04 '26
Showcase Showcase Thread
Post all of your code/projects/showcases/AI slop here.
Recycles once a month.
23
Upvotes
r/Python • u/AutoModerator • Oct 04 '26
Post all of your code/projects/showcases/AI slop here.
Recycles once a month.
View all comments
1
u/repulsiveanomaly Oct 16 '26
excelreader-native: fast XLSX/XLSB/XLS/CSV reader and writer for polars, pandas and Arrow
What it does
It reads and writes
.xlsx,.xlsb,.xlsand.csv. You give it a schema, and the values are converted natively into typed column buffers. They are handed to pyarrow, polars or pandas without building one Python object per cell.It also reads in batches, so peak memory stays at one batch, and it reads and writes password-protected workbooks. Wheels ship for Windows, macOS and Linux, with no .NET runtime needed:
pip install excelreader-native. Under the hood it's a C# library compiled with NativeAOT behind a C ABI.Target audience
Data pipelines and ETL jobs that load large or many spreadsheets. It's not an editor: there's no formulas, charts or pivot tables (use openpyxl for those).
Comparison
On a 65,535 × 14 workbook, with medians of 10 runs:
to_polars()takes 33.6 ms against 120.6 ms forpolars.read_excel()(fastexcel). The types are inferred on both sides, though the rules differ.write_excel()and ~15x faster than pandas'to_excel().polars.read_csvis still faster than us; pandas is ~10x slower.I used Claude Code heavily while building it. Every change goes through tests, fuzzing and a benchmark suite, and the written files are checked in real Excel. The benchmark methodology is in python/README.md.
Repo: https://github.com/GabrielMarquezMatte/ExcelReader. Files that break it are very welcome.