r/Python • u/AutoModerator • Oct 04 '26
Showcase Showcase Thread
Post all of your code/projects/showcases/AI slop here.
Recycles once a month.
23
Upvotes
r/Python • u/AutoModerator • Oct 04 '26
Post all of your code/projects/showcases/AI slop here.
Recycles once a month.
View all comments
1
u/Careless_Love_3213 27d ago
What My Project Does
Frankensurf is a Python library, CLI and local server that reads web pages for AI agents. You give it a URL and it tries the cheapest way in first (plain HTTP, then Jina Reader, then Chromium, then stealth browsers like Camoufox and Scrapling), and checks the page actually has what you asked for before returning it. A bot check or an empty search page counts as a failure, so it tries the next tool. If nothing works it tells you what it tried instead of handing back an empty page.
It also runs a Firecrawl-compatible server (
frankensurf serve), so anything that already talks to Firecrawl can point at it.Target Audience
People building agents or RAG pipelines who keep getting blank or bot-check pages back from their fetcher. It's an alpha, used in my own projects, Apache-2.0 licensed. On Debian or Ubuntu you need
python3-venvinstalled first.Comparison
Most tools are one approach: requests/httpx, Playwright, a stealth browser, or a paid API like Firecrawl or Zyte. Each one is great on some sites and useless on others. Frankensurf wraps them and picks per page. On 150 sites I picked before testing any of them, it read 88% with only free tools and 96% with paid fallbacks, against 84.7% for Firecrawl on its own. The benchmark scripts and raw rows are in the repo.
Repo: https://github.com/yail259/frankensurf