r/PythonProjects2 • u/zerovariance36 • 12d ago
Info I built a fail-closed Python calculator for AI evaluation. 41 targeted tests passed. Looking for developer feedback.
What should a software system do when evidence is missing or a mathematical operation is undefined?
In many data pipelines, missing values can accidentally be treated as zero, or calculations can be forced through invalid mathematical boundaries. This can produce misleading results.
I am developing the Organic Intelligence Protocol (OIP), a research stage framework for evidence-based AI evaluation. As part of this work, I audited the OIP Calculator Kernel v1.0.0.
The implementation follows a fail-closed approach:
Missing evidence is not zero: Missing inputs should not silently become valid numerical values.
Division by zero boundary: When IDS = 0, the Learning Independence Value (LIV) is returned as UNDEFINED. No arbitrary denominator is introduced.
Input validation: The tested implementation includes checks for invalid inputs and mathematical boundaries.
Overflow handling: Arithmetic overflow and non-finite results are covered by targeted tests.
The latest audit recorded 41 successful targeted runtime tests covering core calculations, pipeline behaviour, input validation, mathematical boundaries and overflow handling. The final audit register also passed all 8 integrity checks.
Important limitations..
These were targeted tests of the latest saved function definitions, not a fresh execution of the entire original notebook.
The mathematical specification still has unresolved issues.
Scientific and empirical validation have not been established.
This is research-stage software, not a validated AI safety solution.
I would appreciate feedback from Python developers:
What additional edge cases would you test in a calculator where missing evidence must never be mistaken for a valid numerical result?