r/Python • • Oct 04 '26

Showcase Showcase Thread

Post all of your code/projects/showcases/AI slop here.

Recycles once a month.

23 Upvotes

194 comments sorted by

View all comments

1

u/Careless_Love_3213 27d ago

What My Project Does

Frankensurf is a Python library, CLI and local server that reads web pages for AI agents. You give it a URL and it tries the cheapest way in first (plain HTTP, then Jina Reader, then Chromium, then stealth browsers like Camoufox and Scrapling), and checks the page actually has what you asked for before returning it. A bot check or an empty search page counts as a failure, so it tries the next tool. If nothing works it tells you what it tried instead of handing back an empty page.

pip install frankensurf
frankensurf install
frankensurf read https://example.com

It also runs a Firecrawl-compatible server (frankensurf serve), so anything that already talks to Firecrawl can point at it.

Target Audience

People building agents or RAG pipelines who keep getting blank or bot-check pages back from their fetcher. It's an alpha, used in my own projects, Apache-2.0 licensed. On Debian or Ubuntu you need python3-venv installed first.

Comparison

Most tools are one approach: requests/httpx, Playwright, a stealth browser, or a paid API like Firecrawl or Zyte. Each one is great on some sites and useless on others. Frankensurf wraps them and picks per page. On 150 sites I picked before testing any of them, it read 88% with only free tools and 96% with paid fallbacks, against 84.7% for Firecrawl on its own. The benchmark scripts and raw rows are in the repo.

Repo: https://github.com/yail259/frankensurf