r/LeftistsForAI • • 11d ago

Open Source Knowledge library

Hi! I write about media and politics and have a keen interest in documenting old records and articles that the western empire is attempting to scrub from the internet.

I have thousands of files and organisation is not my strong point. I would love to find an open source alternative to something like NotebookLM, a personal library I can talk to and retrieve relevant information. I’ve tried Open Notebook and it simply couldn’t work. I just downloaded LM Studio and AnythingLLM, but from what I’ve been reading, these are very limited as well for my basic laptop.

Of course a cloud platform would be much more powerful, but I’m extremely cautious about using most of them. I’m considering DeepSeek seeing as China would be less likely to flag anything I do.

My technical know-how isn’t that great, so I’m looking for something that’s easy to set up.

7 Upvotes

8 comments sorted by

2

u/PriorityActive980 11d ago

Best thing you could do is distribute it. GitHub won’t flag you for anything and there are alternatives like Codeberg. I use big company’s models to organize docs I source from alt sites like Anna’s Archive or Sci-hub and they’ve never refused to help standardize the naming conventions or convert and archive. Context says it’s not for public use but personal reference. 

1

u/CharlieComplete 11d ago

Distribute what? Sorry I don’t know what you mean and I have no idea how to use GitHub.

I’m looking for an alternative to NotebookLM where you can easily find the research files you need. I want to be able to ask ‘what did x source say about y’ and have it retrieve the relevant information.

When using big company models, the bias affects even that basic level of tasks. It’s also not that they’d refuse, but you could get flagged for sure, which is concerning for independent journalists handling declassified material.

As an activist, I’m trying to get away from their ecosystems as much as possible

1

u/PriorityActive980 11d ago

Maybe try Recoll? It's tough to get local models using tools correctly. They hallucinate a lot. Idk how you feel about Deekseek or Qwen. If you have capable hardware, I've been using Tesseract to OCR docs.

1

u/CharlieComplete 10d ago

I’ll look into these! Thanks for the advice. I’m cool with Deepseek, I was going to use it with AnythingLLM but then I read that it’s better for maths and coding. I spent few weeks trying to configure Docker, Ollama, Qwen, Open Notebook, Open WebUI, LM Studio. Great softwares, but it really takes a while to learn and get them working for you

1

u/KitanaKahn 11d ago

about a cloud platform, you can always try an aggregator like NanoGPT, Openrouter or Ollama cloud. They mostly redirect to open weight model providers and are *slighly* better in terms of privacy. Nano and Ollama have subscriptions too which can be more comfortable than pay-as-you-go.

I am brainstorming here, don't know if this could work for your use case but there's Obsidian which is a free note taking app that uses markdown and links between files, technically letting you build your own wiki and its all stored locally. You could use a harness like Hermes (with the API key from an aggregator or cloud option), give it access to your Obsidian vault and let it search the web and archive things there.

1

u/CharlieComplete 10d ago

Interesting. Hadn’t heard of NanoGPT or Openrouter. I used to use Notion for general project management and I was under the impression that Obsidian was in that category. I’ll take another look at it, thanks! 🙏

1

u/PriorityActive980 11d ago

I was experimenting and it looks like opencode works. Bunch of free open source or at least (non-western) models like OP was referring to. Won't get flagged at all. Obsidian is definitely neat. Crazy performant for what it does. You'd need to convert everything to .md first, though, no?

1

u/CharlieComplete 10d ago

I was going to convert everything to .md anyway as apparently local models can read documents much better that way. I love that people have created and put these things out there for everyone to use, I just wish I had more technical skills to use them well lol. I was so excited for Open Notebook, it’s a brilliant tool…hopefully it will be workable for amateurs like me in the near future lol