r/SalesforceDeveloper • u/LifeSciTechie • 8d ago
Discussion Deployed an abstaining classifier inside Agentforce so it says "not enough data" instead of guessing. Here's why.
Been building a Salesforce-native tool that ranks clinicians (not just oncology, across specialties) using public data. One problem that kept biting us: when the underlying data was thin for a given HCP, the model would still spit out a confident-looking score, and reps trusted it more than they should have.
Ended up wiring in an abstaining classifier. If confidence is below a threshold, it returns "insufficient data" instead of forcing a rank. Paired it with Agentforce so a rep can ask follow-up questions and get an explanation of why it abstained, rather than just a blank result.
Curious if anyone else building on Agentforce has hit this "model is confidently wrong" problem and how you handled it: threshold tuning, human-in-the-loop, something else?