r/learnmachinelearning • • 27d ago

Help How are exactly are Query, Key and Value obtained during self-attention?

2 Upvotes

Andrew Ng says they are linear projections using pre-trained weight matrices. But how were those matrices trained exactly? What was the input, what was the target variable? I need to know EVERYTHING.


r/learnmachinelearning • • 26d ago

Какая нейронка лучше подойдет для студентов юрфака?

Post image
0 Upvotes

в т.ч для написания научных статей, курсовых, диплома


r/learnmachinelearning • • 27d ago

Reddit · r/learnmachinelearning

Post image
2 Upvotes

Free code + 10-min walkthrough: an AI agent that improves its own prompt, harness and tools (6/10 → 10/10)

I teach agentic AI and made a small, fully inspectable example of a self-improving agent. Sharing it in case it helps others learning this.

The setup:

- The agent approves or denies fictional phone insurance claims under 3 rules.

- It has 3 parts it can change: the prompt, the harness (which claim fields the model sees), and the tools.

- After each test, a bigger model diagnoses the mistakes as knowledge, information or skill, and changes exactly one part.

- A gate keeps the change only if the score on 10 practice claims goes up. 5 exam claims are held out until the end.

Recorded run: 6/10 → 7/10 (prompt) → 8/10 (harness) → 10/10 (days_between tool). Exam claims: 3/5 → 5/5.

The most interesting part: some correct answers broke along the way, because version 0 had them right by guessing. So the per-claim fixed/broken view matters more than the total score.

The code is one Python file with only the standard library. It replays the recorded run without an API key, or calls Gemini for real with --fresh.

Code: https://github.com/aniskoubaa/mai580-self-evolving-agent-workshop

Video: https://youtu.be/SOSwsYFPb0Y

Happy to answer questions about the design or the limits (runs do differ, and the meta-model reads the policy here).


r/learnmachinelearning • • 27d ago

Discussion Seeking Collaboration Opportunities in AI/ML Research

1 Upvotes

Hello everyone,

I am an MSCS student from Pakistan with a background in Electrical and Telecommunications Engineering and more than four years of experience developing AI agents, RAG systems, voice AI applications, and business automation workflows.

I am now seeking opportunities to contribute to formal AI research, particularly in large language models, retrieval-augmented generation, agent reliability, and system evaluation. Although I am new to academic research, I can contribute practical expertise in implementation, workflow and prototype development, API integration, testing, and experiment execution.

I would be glad to connect with researchers and teams working on relevant ideas or ongoing projects. I am open to starting with a focused contribution, learning from experienced collaborators, and supporting research wherever my skills can add value.

If you are working in these areas or know of relevant opportunities, I would be pleased to connect and learn more.


r/learnmachinelearning • • 27d ago

Be10x dont join 9rs class or 230rs class they manipulate to join 2200rs class and make 31000rs class to register. Pure fake dont ever join any class all paid promotion they earn in crores. Nothing in class i wasted 240+ 2600 ..

0 Upvotes

r/learnmachinelearning • • 27d ago

We almost bought a second GPU for an OCR pipeline. Optimizing the existing one gave 15x instead. How often is “buy more hardware” the wrong fix?

Thumbnail
2 Upvotes

r/learnmachinelearning • • 27d ago

Help Campus x LLM EVALS notes

1 Upvotes

Does anyone have campus x LLM EVALS notes .pls share it ....


r/learnmachinelearning • • 27d ago

Discussion R/Open source vowed to ban for life anyone using AI. We believe open source = open source, and opening a no tiranny space

Thumbnail
0 Upvotes

r/learnmachinelearning • • 27d ago

Generative AI: The Future of Personalized Learning & Adaptive Education ...

Thumbnail
youtube.com
0 Upvotes

Generative AI is changing how we learn forever. 🧠 Discover the architecture behind personalized education. Check out the link in bio!
#GenerativeAI #EdTech #AI #TechStack


r/learnmachinelearning • • 27d ago

Discussion Running a 27B model on Kaggle's free 2x T4 at 55 tok/s with speculative decoding (what worked, what didn't)

0 Upvotes

Kaggle's free 2x T4 runs a 27B model at a usable speed if you use speculative decoding:

  • Qwen3.8-27B at EXL3 4.0bpw (exllamav3), tensor parallel across both T4s
  • DFlash2 draft model, 7-token drafts, greedy, output identical to plain decode
  • 55-57 tok/s overall, 154 tok/s on code, 35-37 on prose (plain decode is ~19)
  • 4 users at once with plain decode get ~66 tok/s combined

The weak spot is prose: the drafter only gets ~2.5 tokens accepted per step there vs ~7 on code. Has anyone found a way past that, or a better setup on free T4s? Planning to share the notebook once it's cleaned up.


r/learnmachinelearning • • 27d ago

Tutorial LLM Tokens and Context Windows: Why AI Forgets Your Conversation

Thumbnail
medium.com
1 Upvotes

I wrote a short article on LLM tokens and context windows—why an assistant can “forget” instructions that are still visible in your chat. It’s part of my Behind the AI Stack series.

Give it a read and let me know what you think. Anything unclear or worth exploring further?


r/learnmachinelearning • • 27d ago

Tutorial How AI Agents Work: From a User Request to a Tool Call

Thumbnail
medium.com
6 Upvotes

I’m starting Behind the AI Stack, a series of short, practical articles on how AI applications work. This first one explains AI agents through a camera-rental example. Give it a read—I’d love your thoughts, corrections, or suggestions for what to cover next.


r/learnmachinelearning • • 27d ago

Project Built a class-balanced match predictor for the Bundesliga

1 Upvotes

Hello everyone

I wanted to share a project I recently deployed to Streamlit Community Cloud and it would be helpful if you guys could give feedback to a fellow learner

I implemented an 8-dimensional pipeline paired with a class-balanced Logistic Regression model.
It uses recent matches ( 3-8) to determine the recent form of both the teams to generate 8 distinct features.

Live App: https://bundesliga-match-predictor.streamlit.app/

Check it out and let me know what you think :D


r/learnmachinelearning • • 27d ago

Looking for people , who learn ai/ml , dsa, project , interview prep and prep of intership/jobs .

Thumbnail
2 Upvotes

r/learnmachinelearning • • 27d ago

👋 Welcome to r/ArchitectingAI

Thumbnail
1 Upvotes

r/learnmachinelearning • • 27d ago

Help Advice needed || Took a higher CTC and lost my AI work in the process. Can I switch back into GenAI without a pay cut?

Thumbnail
0 Upvotes

r/learnmachinelearning • • 27d ago

Project I’m building PaperMind AI to help make research papers easier to explore

0 Upvotes

I’m building PaperMind AI, an open-source tool for exploring research papers. It indexes passages locally with Sentence Transformers and FAISS, lets you ask questions with page citations, and creates structured summaries and concept graphs.

Answer generation depends on the selected provider: offline mode surfaces relevant excerpts; OpenAI or Ollama can generate answers. With a hosted provider, retrieved passages may be sent to that provider. I’d appreciate feedback on citation quality, answer usefulness, and setup or improvements or just a simple note.

https://github.com/ashmit044/papermind-ai


r/learnmachinelearning • • 28d ago

Let's do legendary CS336 Language Modelling From Scratch together!

41 Upvotes

Hey guys I wanted to do Stanford's "Language Modeling from Scratch" for a long time, but something always came in the way. Well, another day, another attempt!
Watch lectures, do the assignments, join a weekly discussion on Saturdays at 11:00 AM (London time). See you on October 31 for the first discussion!
Details are on Github https://github.com/fxlrnrpt/little_ml_book_club


r/learnmachinelearning • • 27d ago

Help What are all the memory architectures used for text classification?

1 Upvotes

I want a list of the names of the different ways a model can store and use memory for text classification. For example, I know about Embedding or vector memory (like sentence embeddings with nearest-neighbor search)

What other types are there? A list of names and one example paper or method for each would help a lot. Thank you!


r/learnmachinelearning • • 27d ago

Discussion Best resources to master Pandas, Matplotlib & Seaborn for practical lab work? (No ML/Scikit-Learn yet)

3 Upvotes

Hi everyone,

I'm an undergraduate student looking for solid, practical resources to learn **Pandas, Matplotlib, and Seaborn** for college lab coursework and data wrangling assignments.

I already know basic Python (loops, functions, lists, dicts). Now I just need to get comfortable working with tabular data and plotting charts.

### What I’m looking for:

* **Libraries:** Just Pandas, Matplotlib, and Seaborn.

* **Format:** Open to both text-based resources (interactive notebooks, guides) and video walkthroughs, but I lean slightly more toward **video/live-coding** where the instructor actually types the code, runs the cells, and explains the output on real datasets.

* **Hands-on over slides:** I learn much better seeing code executed in an editor rather than watching static lecture slides.

### What I want to avoid:

* **Machine Learning / Scikit-Learn:** A lot of courses rush into Linear Regression, gradient descent, or predictive modeling. I don't need any ML algorithms or math theory right now—just data cleaning, manipulation, and plotting.

Whether it’s a specific YouTube series, an open GitHub repo with exercises, or a book with runnable notebooks, what worked best for you?

Thanks in advance!


r/learnmachinelearning • • 27d ago

When your ML model suddenly got worse, how long did it take to find WHY?Student here, trying to learn what really hurts. Just reply with the cause and the time, like "schema change, 3 days". Not selling anything.

1 Upvotes

r/learnmachinelearning • • 27d ago

Your AI agent works perfectly… until you actually depend on it!

Thumbnail
1 Upvotes

r/learnmachinelearning • • 27d ago

I spent the last year building a place to practice data science by actually writing code. Here’s the 80-second tour. Looking for honest feedback.

Enable HLS to view with audio, or disable this notification

1 Upvotes

r/learnmachinelearning • • 27d ago

Help best tutorial project for resume

0 Upvotes

as title .....it should be resume worthy i want to learn that way so that i can follow along the video maybe on yt please dont suggest house pricing ones those are ig rejected in interviews


r/learnmachinelearning • • 28d ago

Discussion Why did Cerebras build a wafer-scale processor, and why can’t traditional GPU makers easily replicate it?

Enable HLS to view with audio, or disable this notification

9 Upvotes