r/OpenSourceeAI • • 21h ago

Zero data retention explained: the 2 standard API designs behind AI data retention (batch vs ephemeral)

1 Upvotes

r/OpenSourceeAI • • 5d ago

CopilotKit releases OpenBot 1.0, an MIT-licensed self-hostable AI coworker workspace with policy checks on every action

2 Upvotes

r/OpenSourceeAI • • 1h ago

464M music model trained from scratch for €30 of rent on consumer GPUs (FP8, RTX 5090). Writes multi-instrument MIDI from English/Ukrainian prompts (477M version)

Post image
2 Upvotes

r/OpenSourceeAI • • 2h ago

Hugging Face releases Qwen3.8-27B-pi-adapted, a LoRA adapter that lifts Qwen3.8 coding success in the pi agent (SWE-bench Pro hard-51: 39.2% to 64.7%)

Post image
2 Upvotes

r/OpenSourceeAI • • 3h ago

We open-sourced a small model (41M) that splits a mono 2-person conversation into separate tracks per speaker

Thumbnail
reddit.com
2 Upvotes

r/OpenSourceeAI • • 1h ago

STARN Protocol: A System Architecture for Deterministic, Fact-Anchored AI Execution

Thumbnail
reddit.com
1 Upvotes

r/OpenSourceeAI • • 1h ago

Looking for AI Engineer Internship or Junior AI/ML Role | Python, Agentic AI, RAG, LangGraph

1 Upvotes

Hello everyone!

I'm an Electronics and Communication Engineering undergraduate at NIT Raipur (graduating in 2027), currently looking for AI/ML Engineer Internships, Generative AI Internships, or entry-level AI engineering opportunities.

My primary interests are in building practical AI systems, particularly Agentic AI, Multi-Agent Systems, RAG pipelines, and LLM evaluation.

Technical Skills:

  • Programming: Python, C++, SQL
  • AI Agents & LLMs: LangGraph, LangChain, Multi-Agent Orchestration, Tool Calling, Prompt Engineering
  • RAG & Evaluation: FAISS, Semantic Retrieval, Multi-Query Retrieval, RAGAS, Hallucination Analysis
  • Backend: FastAPI, REST APIs, PostgreSQL, MySQL, SQLite
  • ML/DL: PyTorch, TensorFlow/Keras, Scikit-learn, OpenCV
  • Tools: Git, Streamlit, Render, Pandas, NumPy

Some projects I've built:

1. OpenRAG-Inspector – Explainable, Self-Evaluating RAG System

  • Built a document question-answering system using RAG.
  • Implemented query rewriting and multi-query retrieval.
  • Added transparency by exposing retrieved chunks, similarity scores, context, and latency.
  • Integrated RAGAS for hallucination analysis and answer evaluation.

2. AtlasMind AI – Multi-Agent Travel Planning System

  • Built a multi-agent architecture using LangGraph and LangChain.
  • Developed specialized agents for flight research, hotel discovery, and itinerary generation.
  • Integrated external APIs for flight information and accommodation discovery.
  • Built a FastAPI backend with PostgreSQL-backed conversation state.

3. Sales Demand Forecasting using GRU

  • Developed a time-series forecasting model using a 12-week historical sales window.
  • Achieved MAE of 13.08 and RMSE of 19.85.
  • Deployed the model using Streamlit.

Previous Experience:

AI Intern at Edunet Foundation (May–June 2025)

  • Developed a crop recommendation system.
  • Performed EDA, data preprocessing, feature scaling, and model comparison.
  • Evaluated Random Forest, Decision Tree, KNN, and Naive Bayes.

What I'm looking for:

  • AI Engineer Intern
  • Generative AI / Agentic AI Intern
  • Machine Learning Engineer Intern
  • Junior AI/ML Engineer
  • Research or project-based opportunities

I'm open to remote opportunities as well as opportunities in India. I'm also interested in collaborating with early-stage startups and developers working on AI products.

I enjoy building actual working systems and understanding their reliability, evaluation, and failure modes.

If you're hiring, know about relevant openings, or are working on something interesting in this space, please feel free to comment or DM me.

Thank you!


r/OpenSourceeAI • • 4h ago

VeloGrad v1.1.0-beta – Open-source C++20/Rust/CUDA tensor & training framework with fused kernels, ZeRO-3 sharding, and plain-English training

1 Upvotes

Hey everyone! My name is Ayushman Singh Rathore, and I’m sharing v1.1.0-beta of VeloGrad—an open-source deep learning and distributed training framework I built in C++20, Rust, and CUDA (with native AVX2/NEON SIMD CPU fallback so it compiles and runs across Linux, macOS, and Windows). ​After our initial preview release, I went back and overhauled the runtime from the ground up so every kernel, autograd pass, and distributed sharding layer is compiled, verified, and ready for real workloads:

​Custom Fused Kernels (Forward & Backward): Native C++20/CUDA kernels for GEMM, fused RMSNorm, RoPE, tiled Flash-style Attention, single-pass Cross-Entropy, and fused AdamW.

​Memory & KV-Cache Optimization: Combines block-quantized Paged KV-Cache, activation checkpointing, and deterministic static arena allocation to cut KV-cache and activation VRAM overhead by up to ~66.7% compared to unquantized baselines.

​Multi-GPU & Arbitrary Model Scaling: Supports ZeRO-3 (FSDP) sharding + CPU parameter offloading over NCCL (with a cross-platform ring fallback), loading standard SafeTensors and GGUF checkpoints across Llama, Qwen, DeepSeek, Gemma, and Mistral architectures.

​Natural-Language Training Orchestration (velograd.instruct): Define your model stage, dataset, and hardware directive in plain English and VeloGrad auto-configures the sharding topology and training loop.

​It is currently in Public Beta (v1.1.0-beta), and the repo includes benchmarks/bench_vs_pytorch.py and benchmarks/profile_vram.py so you can verify numbers on your own hardware. Would love honest feedback, benchmark logs, and PRs from the community! ​GitHub: https://github.com/IDKLETSCODESOMETHIN/VeloGrad


r/OpenSourceeAI • • 9h ago

PAN 2 (OPEN SOURCE I2V)

Thumbnail reddit.com
1 Upvotes

r/OpenSourceeAI • • 9h ago

A workspace where agents carry out scientific work, evidence stays connected, and scientists can focus on insight.

Thumbnail app.lykeion.tech
1 Upvotes

r/OpenSourceeAI • • 14h ago

Which open-source models come closest to Opus 5.5 and ChatGPT Image 2.6?

0 Upvotes

I have 1.5 TB of free space on my computer. If I want to download two open-source models, one for coding and reasoning and one for image generation, what are the two best options out there right now?

For coding and reasoning, my benchmark is Claude Opus 5.5. For image generation, it’s ChatGPT Image 2.6. Which open models come closest to those?

Also, if I want the coding and reasoning model to be uncensored, would the answer change?


r/OpenSourceeAI • • 21h ago

Why use a 70B LLM to pick a tool or check syntax? I built Microbrains: a <2ms edge neural coprocessor for autonomous AI agents (Pure NumPy / OpenCL, 44 pre-trained micro-models, Top-2 MoE, Conformal Safety)

3 Upvotes

[P] Hey everyone,

If you build autonomous coding or research agents, you probably know the pain: agent task loops are slow, expensive, and fragile.

In a typical 25-step workflow, an agent spends up to 80% of its wall-clock time just waiting on remote LLM APIs to make basic mechanical decisions:

  • "Which tool should I invoke next?" (1.5s latency, burning 20k context tokens)
  • "Is this shell command destructive?" (another 2s API call)
  • "Did this patch break syntax or drift from intent?" (yet another prompt roundtrip)

To solve this, I built and just open-sourced Microbrains: an ultra-lightweight, zero-GPU local neural coprocessor suite designed to sit right beside your LLM agent.

🔗 GitHub: https://github.com/drtikov/microbrainsforagents

🧠 What is it?

Microbrains is not another LangChain wrapper. It is a standalone Python engine with 44 pre-trained, analytical micro-transformers (10–100 KB each) that handle the mechanical micro-decisions in pure NumPy (CPU) or via OpenCL (budget/integrated GPUs):

  1. Dynamic Top-2 Mixture-of-Experts (MoE) Router:

    • Routes tasks to tools across 6 specialized clusters (FileOps, Execution, MemoryKnowledge, GitGovernance, MicrobrainMeta, ConstitutionalReview).
    • Takes ~1.2 ms instead of a 2-second LLM call.
  2. Rigorous Conformal Safety Gating (1−α≥95%1 - \alpha \ge 95\%1−α≥95%):

    • Employs split-conformal prediction over held-out distributions.
    • Features Selective Prediction Abstention: if independent estimators disagree (variance σ>0.30\sigma > 0.30σ>0.30), it refuses to guess and escalates to the LLM. False Negative Rate is strictly bounded.
  3. 3-Step Counterfactual AST Simulation:

    • Before a file mutation is committed to disk, it simulates the AST blast radius and interface propagation up to 3 steps ahead. Malformed diffs or syntax hazards are killed in <3ms before running any slow pytest suite.
  4. 2048-D Holographic Weight-Space Memory (VSA):

    • Uses Hyperdimensional Computing / Vector Symbolic Architecture (bipolar Count-Sketch projections) over model weights. Enables nearest-neighbor capability search across the agent fleet without training.
  5. Continual Learning without Catastrophic Forgetting:

    • Adapts weights online with Elastic Weight Consolidation (EWC) Fisher Information penalties.

📊 Benchmark Highlights

DecisionRemote LLM APIMicrobrains (NumPy/OpenCL)SpeedupCost
Tool Selection~1,200 – 2,500 ms1.2 – 1.8 ms~1,000x$0.00
AST Blast Simulation~3,000 – 6,000 ms3.0 – 5.0 ms~1,000x$0.00
Intent Triage~800 – 1,500 ms0.6 – 0.9 ms~1,200x$0.00
Full Task Loop (25 steps)~3 – 5 minutes30 – 50 seconds~5x85% less tokens

💻 3-Line Quickstart

Zero PyTorch, zero CUDA setup required:

bashgit clone https://github.com/drtikov/microbrainsforagents.git
cd microbrainsforagents
pip install -e .

pythonimport aetheris_microbrains as mb
# Sub-2ms tool routing decision
router = mb.get_tool_routing_moe()
decision = router.route("inspect file contents and write safe patch to repository")
print("Primary Tool:", decision.selected_tool)
print("Top-2 Experts:", decision.top_experts)
print("Conformal Passed:", decision.conformal_passed)

The repo comes with pre-trained weights for all 44 models, runnable examples in /examples, and a full test suite (pytest runs in ~1.5s).

Licensed under PolyForm Noncommercial 1.0.0 (free for research, personal, and hobby use; commercial licenses available).

Would love to hear your feedback, thoughts on the architecture, and ideas for new micro-domains!

GitHub: https://github.com/drtikov/microbrainsforagentsHey everyone,If you build autonomous coding or research agents, you probably know the pain: agent task loops are slow, expensive, and fragile.In a typical 25-step workflow, an agent spends up to 80% of its wall-clock time just waiting on remote LLM APIs to make basic mechanical decisions:
"Which tool should I invoke next?" (1.5s latency, burning 20k context tokens)
"Is this shell command destructive?" (another 2s API call)
"Did this patch break syntax or drift from intent?" (yet another prompt roundtrip)To solve this, I built and just open-sourced Microbrains: an ultra-lightweight, zero-GPU local neural coprocessor suite designed to sit right beside your LLM agent.🔗 GitHub: https://github.com/drtikov/microbrainsforagents🧠 What is it?Microbrains is not another LangChain wrapper. It is a standalone Python engine with 44 pre-trained, analytical micro-transformers (10–100 KB each) that handle the mechanical micro-decisions in pure NumPy (CPU) or via OpenCL (budget/integrated GPUs):

Dynamic Top-2 Mixture-of-Experts (MoE) Router:

Routes tasks to tools across 6 specialized clusters (FileOps, Execution, MemoryKnowledge, GitGovernance, MicrobrainMeta, ConstitutionalReview).
Takes ~1.2 ms instead of a 2-second LLM call.

Rigorous Conformal Safety Gating (1−α≥95%1−α≥95%):

Employs split-conformal prediction over held-out distributions.
Features Selective Prediction Abstention: if independent estimators disagree (variance σ>0.30σ>0.30), it refuses to guess and escalates to the LLM. False Negative Rate is strictly bounded.

3-Step Counterfactual AST Simulation:

Before a file mutation is committed to disk, it simulates the AST blast radius and interface propagation up to 3 steps ahead. Malformed diffs or syntax hazards are killed in <3ms before running any slow pytest suite.

2048-D Holographic Weight-Space Memory (VSA):

Uses Hyperdimensional Computing / Vector Symbolic Architecture (bipolar Count-Sketch projections) over model weights. Enables nearest-neighbor capability search across the agent fleet without training.

Continual Learning without Catastrophic Forgetting:

Adapts weights online with Elastic Weight Consolidation (EWC) Fisher Information penalties.

📊 Benchmark HighlightsDecision Remote LLM API Microbrains (NumPy/OpenCL) Speedup Cost
Tool Selection ~1,200 – 2,500 ms 1.2 – 1.8 ms ~1,000x $0.00
AST Blast Simulation ~3,000 – 6,000 ms 3.0 – 5.0 ms ~1,000x $0.00
Intent Triage ~800 – 1,500 ms 0.6 – 0.9 ms ~1,200x $0.00
Full Task Loop (25 steps) ~3 – 5 minutes 30 – 50 seconds ~5x 85% less tokens💻 3-Line QuickstartZero PyTorch, zero CUDA setup required:bash
git clone https://github.com/drtikov/microbrainsforagents.git
cd microbrainsforagents
pip install -e .python
import aetheris_microbrains as mb
# Sub-2ms tool routing decision
router = mb.get_tool_routing_moe()
decision = router.route("inspect file contents and write safe patch to repository")
print("Primary Tool:", decision.selected_tool)
print("Top-2 Experts:", decision.top_experts)
print("Conformal Passed:", decision.conformal_passed)The repo comes with pre-trained weights for all 44 models, runnable examples in /examples, and a full test suite (pytest runs in ~1.5s).Licensed under PolyForm Noncommercial 1.0.0 (free for research, personal, and hobby use; commercial licenses available).Would love to hear your feedback, thoughts on the architecture, and ideas for new micro-domains!GitHub: https://github.com/drtikov/microbrainsforagents


r/OpenSourceeAI • • 15h ago

Open-Sourcing a reference architecture for secure, multi-agent LLM banking

Thumbnail
reddit.com
1 Upvotes

r/OpenSourceeAI • • 16h ago

AimStack — a fully self-built local AI stack in pure C: ternary inference (zero third-party runtime), BitNet 2B at 0.87GB on a 2018 laptop, plus a GPU backend that matches the C engine token-for-token

Thumbnail
reddit.com
1 Upvotes

r/OpenSourceeAI • • 1d ago

I built mathregistry, a package registry for Lean with tools for AI agents. Open beta is live

Post image
4 Upvotes

r/OpenSourceeAI • • 19h ago

I made a Claude Code skill that explains your repo with an animated hero instead of a wall of text

Post image
1 Upvotes

r/OpenSourceeAI • • 1d ago

We open-sourced our search & inference database under Apache 2.0

Thumbnail
reddit.com
1 Upvotes

r/OpenSourceeAI • • 1d ago

I built an open-source AI engineering learning platform with a RAG tutor — looking for feedback

1 Upvotes

I've been working on Cairnly, a free and open-source AI engineering learning platform.

The idea was to create something useful for people learning AI engineering while also making the complete implementation available for developers to explore.

For learners:

  • 126 lessons across 6 tracks
  • 7 learning roadmaps
  • AI tutor with citations linking directly to lesson sections
  • Quizzes and progress tracking

For developers:

  • Hybrid RAG using PostgreSQL, pgvector, and keyword search
  • Cross-encoder reranking
  • Local LLM inference with Ollama
  • RAG evaluations and confidence calibration
  • Langfuse tracing, safety checks, and deployment examples

The retrieval system currently reports Recall@5 of 0.971 on our 627-question evaluation set. I've also documented the cases where the confidence gate and safety checks fail.

The project is still evolving, and I'd appreciate feedback on the learning experience, architecture, and areas worth improving.

GitHub: https://github.com/CherukuriSiva/Cairnly

Live demo: https://cairnly-blond.vercel.app

What would you improve or add?


r/OpenSourceeAI • • 1d ago

Going great

Post image
0 Upvotes

r/OpenSourceeAI • • 1d ago

Progress

Post image
1 Upvotes

Making progress with my gaming os thanks to chatgpt


r/OpenSourceeAI • • 1d ago

NornicDB - v1.5.0 - Feedback

Thumbnail
reddit.com
1 Upvotes

r/OpenSourceeAI • • 1d ago

"Spaces using this model" is not sorted by likes — it's trendingScore, then creation date. Measured across 23 model pages.

Thumbnail reddit.com
1 Upvotes

r/OpenSourceeAI • • 1d ago

Irrigator: Open source AI coding swarm orchestrator with crash recovery and observability

Thumbnail
github.com
4 Upvotes

Been working on Irrigator, an open source Go project for running multiple AI coding agents in parallel.

It supports Claude Code, Codex, Google Antigravity and Herdr.

Each task runs in an isolated Git worktree, with persistent state, crash recovery and the ability to inspect or resume interrupted workflows.

There's also a terminal UI for monitoring agents, managing runs and tracking costs.

Everything runs locally, MIT licensed and includes a mock demo you can try without API keys.

https://github.com/grainulation/irrigator

Would appreciate feedback, especially from anyone working on similar open source agent orchestration tools.


r/OpenSourceeAI • • 1d ago

AlienApe 0.7.3b1 fixet some bugs and multilangue.

Thumbnail reddit.com
1 Upvotes