https://derekwang2002.github.io/ai-intelligence/en/projects/thinkingbox/ Material changes in AI models, agents, engineering and infrastructure, with primary sources and recommendations. en Mon, 02 Nov 2026 16:56:00 GMT https://derekwang2002.github.io/ai-intelligence/en/events/ev-20261003-02/ ev-20261003-02-published Sun, 04 Oct 2026 16:02:19 GMT New TRIAL <p>Microsoft and Hugging Face made ThinkingBox runnable through OpenEnv. Its 507 stateful business workflows execute 20 trials per model and grade terminal database state and side effects rather than trusting an agent transcript. Code and data are public, and the common-set analysis covers 121,680 valid trials.</p><p><strong>Why read: </strong>ThinkingBox checks terminal database state, exposing silent failures transcript graders miss.</p><p>Recommendation: TRIAL</p><p>Sources: <a href="https://huggingface.co/blog/microsoft/thinkingbox">Microsoft and Hugging Face: ThinkingBox</a> · <a href="https://github.com/microsoft/thinkingbox">Microsoft ThinkingBox</a> · <a href="https://github.com/microsoft/thinkingbox-data/releases/tag/thinkingbox-bench-v1.0">ThinkingBox Bench v1.0 data</a></p>