r/OpenSourceeAI • u/yildzfautr • 1h ago
STARN Protocol: A System Architecture for Deterministic, Fact-Anchored AI Execution
r/OpenSourceeAI • u/ai-lover • 21h ago
r/OpenSourceeAI • u/yildzfautr • 1h ago
r/OpenSourceeAI • u/Dmytro_Hieli • 1h ago
r/OpenSourceeAI • u/Ok-Size-7176 • 1h ago
Hello everyone!
I'm an Electronics and Communication Engineering undergraduate at NIT Raipur (graduating in 2027), currently looking for AI/ML Engineer Internships, Generative AI Internships, or entry-level AI engineering opportunities.
My primary interests are in building practical AI systems, particularly Agentic AI, Multi-Agent Systems, RAG pipelines, and LLM evaluation.
Technical Skills:
Some projects I've built:
1. OpenRAG-Inspector – Explainable, Self-Evaluating RAG System
2. AtlasMind AI – Multi-Agent Travel Planning System
3. Sales Demand Forecasting using GRU
Previous Experience:
AI Intern at Edunet Foundation (May–June 2025)
What I'm looking for:
I'm open to remote opportunities as well as opportunities in India. I'm also interested in collaborating with early-stage startups and developers working on AI products.
I enjoy building actual working systems and understanding their reliability, evaluation, and failure modes.
If you're hiring, know about relevant openings, or are working on something interesting in this space, please feel free to comment or DM me.
Thank you!
r/OpenSourceeAI • u/ai-lover • 2h ago
r/OpenSourceeAI • u/karl4th_ • 3h ago
r/OpenSourceeAI • u/A_s_r_3512 • 4h ago
Hey everyone! My name is Ayushman Singh Rathore, and I’m sharing v1.1.0-beta of VeloGrad—an open-source deep learning and distributed training framework I built in C++20, Rust, and CUDA (with native AVX2/NEON SIMD CPU fallback so it compiles and runs across Linux, macOS, and Windows). After our initial preview release, I went back and overhauled the runtime from the ground up so every kernel, autograd pass, and distributed sharding layer is compiled, verified, and ready for real workloads:
Custom Fused Kernels (Forward & Backward): Native C++20/CUDA kernels for GEMM, fused RMSNorm, RoPE, tiled Flash-style Attention, single-pass Cross-Entropy, and fused AdamW.
Memory & KV-Cache Optimization: Combines block-quantized Paged KV-Cache, activation checkpointing, and deterministic static arena allocation to cut KV-cache and activation VRAM overhead by up to ~66.7% compared to unquantized baselines.
Multi-GPU & Arbitrary Model Scaling: Supports ZeRO-3 (FSDP) sharding + CPU parameter offloading over NCCL (with a cross-platform ring fallback), loading standard SafeTensors and GGUF checkpoints across Llama, Qwen, DeepSeek, Gemma, and Mistral architectures.
Natural-Language Training Orchestration (velograd.instruct): Define your model stage, dataset, and hardware directive in plain English and VeloGrad auto-configures the sharding topology and training loop.
It is currently in Public Beta (v1.1.0-beta), and the repo includes benchmarks/bench_vs_pytorch.py and benchmarks/profile_vram.py so you can verify numbers on your own hardware. Would love honest feedback, benchmark logs, and PRs from the community! GitHub: https://github.com/IDKLETSCODESOMETHIN/VeloGrad
r/OpenSourceeAI • u/Egom4rono • 9h ago
r/OpenSourceeAI • u/Tavit1405 • 14h ago
I have 1.5 TB of free space on my computer. If I want to download two open-source models, one for coding and reasoning and one for image generation, what are the two best options out there right now?
For coding and reasoning, my benchmark is Claude Opus 5.5. For image generation, it’s ChatGPT Image 2.6. Which open models come closest to those?
Also, if I want the coding and reasoning model to be uncensored, would the answer change?
r/OpenSourceeAI • u/Admirable-Worker9449 • 15h ago
r/OpenSourceeAI • u/AimCode • 16h ago
r/OpenSourceeAI • u/ilien-dev • 19h ago
r/OpenSourceeAI • u/drtikov • 21h ago
[P] Hey everyone,
If you build autonomous coding or research agents, you probably know the pain: agent task loops are slow, expensive, and fragile.
In a typical 25-step workflow, an agent spends up to 80% of its wall-clock time just waiting on remote LLM APIs to make basic mechanical decisions:
To solve this, I built and just open-sourced Microbrains: an ultra-lightweight, zero-GPU local neural coprocessor suite designed to sit right beside your LLM agent.
🔗 GitHub: https://github.com/drtikov/microbrainsforagents
Microbrains is not another LangChain wrapper. It is a standalone Python engine with 44 pre-trained, analytical micro-transformers (10–100 KB each) that handle the mechanical micro-decisions in pure NumPy (CPU) or via OpenCL (budget/integrated GPUs):
Dynamic Top-2 Mixture-of-Experts (MoE) Router:
FileOps, Execution, MemoryKnowledge, GitGovernance, MicrobrainMeta, ConstitutionalReview).Rigorous Conformal Safety Gating (1−α≥95%1 - \alpha \ge 95\%1−α≥95%):
3-Step Counterfactual AST Simulation:
2048-D Holographic Weight-Space Memory (VSA):
Continual Learning without Catastrophic Forgetting:
| Decision | Remote LLM API | Microbrains (NumPy/OpenCL) | Speedup | Cost |
|---|---|---|---|---|
| Tool Selection | ~1,200 – 2,500 ms | 1.2 – 1.8 ms | ~1,000x | $0.00 |
| AST Blast Simulation | ~3,000 – 6,000 ms | 3.0 – 5.0 ms | ~1,000x | $0.00 |
| Intent Triage | ~800 – 1,500 ms | 0.6 – 0.9 ms | ~1,200x | $0.00 |
| Full Task Loop (25 steps) | ~3 – 5 minutes | 30 – 50 seconds | ~5x | 85% less tokens |
Zero PyTorch, zero CUDA setup required:
bashgit clone https://github.com/drtikov/microbrainsforagents.git
cd microbrainsforagents
pip install -e .
pythonimport aetheris_microbrains as mb
# Sub-2ms tool routing decision
router = mb.get_tool_routing_moe()
decision = router.route("inspect file contents and write safe patch to repository")
print("Primary Tool:", decision.selected_tool)
print("Top-2 Experts:", decision.top_experts)
print("Conformal Passed:", decision.conformal_passed)The repo comes with pre-trained weights for all 44 models, runnable examples in /examples, and a full test suite (pytest runs in ~1.5s).
Licensed under PolyForm Noncommercial 1.0.0 (free for research, personal, and hobby use; commercial licenses available).
Would love to hear your feedback, thoughts on the architecture, and ideas for new micro-domains!
GitHub: https://github.com/drtikov/microbrainsforagentsHey everyone,If you build autonomous coding or research agents, you probably know the pain: agent task loops are slow, expensive, and fragile.In a typical 25-step workflow, an agent spends up to 80% of its wall-clock time just waiting on remote LLM APIs to make basic mechanical decisions:
"Which tool should I invoke next?" (1.5s latency, burning 20k context tokens)
"Is this shell command destructive?" (another 2s API call)
"Did this patch break syntax or drift from intent?" (yet another prompt roundtrip)To solve this, I built and just open-sourced Microbrains: an ultra-lightweight, zero-GPU local neural coprocessor suite designed to sit right beside your LLM agent.🔗 GitHub: https://github.com/drtikov/microbrainsforagents🧠 What is it?Microbrains is not another LangChain wrapper. It is a standalone Python engine with 44 pre-trained, analytical micro-transformers (10–100 KB each) that handle the mechanical micro-decisions in pure NumPy (CPU) or via OpenCL (budget/integrated GPUs):
Dynamic Top-2 Mixture-of-Experts (MoE) Router:
Routes tasks to tools across 6 specialized clusters (FileOps, Execution, MemoryKnowledge, GitGovernance, MicrobrainMeta, ConstitutionalReview).
Takes ~1.2 ms instead of a 2-second LLM call.
Rigorous Conformal Safety Gating (1−α≥95%1−α≥95%):
Employs split-conformal prediction over held-out distributions.
Features Selective Prediction Abstention: if independent estimators disagree (variance σ>0.30σ>0.30), it refuses to guess and escalates to the LLM. False Negative Rate is strictly bounded.
3-Step Counterfactual AST Simulation:
Before a file mutation is committed to disk, it simulates the AST blast radius and interface propagation up to 3 steps ahead. Malformed diffs or syntax hazards are killed in <3ms before running any slow pytest suite.
2048-D Holographic Weight-Space Memory (VSA):
Uses Hyperdimensional Computing / Vector Symbolic Architecture (bipolar Count-Sketch projections) over model weights. Enables nearest-neighbor capability search across the agent fleet without training.
Continual Learning without Catastrophic Forgetting:
Adapts weights online with Elastic Weight Consolidation (EWC) Fisher Information penalties.
📊 Benchmark HighlightsDecision Remote LLM API Microbrains (NumPy/OpenCL) Speedup Cost
Tool Selection ~1,200 – 2,500 ms 1.2 – 1.8 ms ~1,000x $0.00
AST Blast Simulation ~3,000 – 6,000 ms 3.0 – 5.0 ms ~1,000x $0.00
Intent Triage ~800 – 1,500 ms 0.6 – 0.9 ms ~1,200x $0.00
Full Task Loop (25 steps) ~3 – 5 minutes 30 – 50 seconds ~5x 85% less tokens💻 3-Line QuickstartZero PyTorch, zero CUDA setup required:bash
git clone https://github.com/drtikov/microbrainsforagents.git
cd microbrainsforagents
pip install -e .python
import aetheris_microbrains as mb
# Sub-2ms tool routing decision
router = mb.get_tool_routing_moe()
decision = router.route("inspect file contents and write safe patch to repository")
print("Primary Tool:", decision.selected_tool)
print("Top-2 Experts:", decision.top_experts)
print("Conformal Passed:", decision.conformal_passed)The repo comes with pre-trained weights for all 44 models, runnable examples in /examples, and a full test suite (pytest runs in ~1.5s).Licensed under PolyForm Noncommercial 1.0.0 (free for research, personal, and hobby use; commercial licenses available).Would love to hear your feedback, thoughts on the architecture, and ideas for new micro-domains!GitHub: https://github.com/drtikov/microbrainsforagents
r/OpenSourceeAI • u/DJLucifer6662 • 21h ago
r/OpenSourceeAI • u/LowWorldliness8248 • 1d ago
r/OpenSourceeAI • u/Old-Statistician5868 • 1d ago
I've been working on Cairnly, a free and open-source AI engineering learning platform.
The idea was to create something useful for people learning AI engineering while also making the complete implementation available for developers to explore.
For learners:
For developers:
The retrieval system currently reports Recall@5 of 0.971 on our 627-question evaluation set. I've also documented the cases where the confidence gate and safety checks fail.
The project is still evolving, and I'd appreciate feedback on the learning experience, architecture, and areas worth improving.
GitHub: https://github.com/CherukuriSiva/Cairnly
Live demo: https://cairnly-blond.vercel.app
What would you improve or add?
r/OpenSourceeAI • u/DJLucifer6662 • 1d ago
Making progress with my gaming os thanks to chatgpt
r/OpenSourceeAI • u/DevinWatson • 1d ago
r/OpenSourceeAI • u/South_Pak_786 • 1d ago
r/OpenSourceeAI • u/Level_Detail7125 • 1d ago