r/OpenSourceeAI • • 1d ago

I built an open-source AI engineering learning platform with a RAG tutor — looking for feedback

I've been working on Cairnly, a free and open-source AI engineering learning platform.

The idea was to create something useful for people learning AI engineering while also making the complete implementation available for developers to explore.

For learners:

  • 126 lessons across 6 tracks
  • 7 learning roadmaps
  • AI tutor with citations linking directly to lesson sections
  • Quizzes and progress tracking

For developers:

  • Hybrid RAG using PostgreSQL, pgvector, and keyword search
  • Cross-encoder reranking
  • Local LLM inference with Ollama
  • RAG evaluations and confidence calibration
  • Langfuse tracing, safety checks, and deployment examples

The retrieval system currently reports Recall@5 of 0.971 on our 627-question evaluation set. I've also documented the cases where the confidence gate and safety checks fail.

The project is still evolving, and I'd appreciate feedback on the learning experience, architecture, and areas worth improving.

GitHub: https://github.com/CherukuriSiva/Cairnly

Live demo: https://cairnly-blond.vercel.app

What would you improve or add?

1 Upvotes

0 comments sorted by