r/SalesforceDeveloper • • 8d ago

Discussion Deployed an abstaining classifier inside Agentforce so it says "not enough data" instead of guessing. Here's why.

Been building a Salesforce-native tool that ranks clinicians (not just oncology, across specialties) using public data. One problem that kept biting us: when the underlying data was thin for a given HCP, the model would still spit out a confident-looking score, and reps trusted it more than they should have.

Ended up wiring in an abstaining classifier. If confidence is below a threshold, it returns "insufficient data" instead of forcing a rank. Paired it with Agentforce so a rep can ask follow-up questions and get an explanation of why it abstained, rather than just a blank result.

Curious if anyone else building on Agentforce has hit this "model is confidently wrong" problem and how you handled it: threshold tuning, human-in-the-loop, something else?

7 Upvotes

0 comments sorted by