AI agent starters · Rank #41
AssetOpsBench
Grade C: derived only from the two verdicts below. How grades work
AssetOpsBench - Industry 4.0: A unified benchmark and framework for building, orchestrating, and evaluating domain-specific AI agents for Industry 4.0 asset operations and maintenance, with 460+ scenarios, 5 specialist agents (IoT, FMSR, TSFM, Work Order,...), and multi-agent orchestration blueprints (MetaAgent, AgentHive) over MCP.
Why this verdict
How we check →- 162 commits by 10 contributors in the last 90 days (19 in the last 30). receipt ↗
- OpenAI SDK 1 declared; latest is 3 (2 majors behind). receipt ↗
- NumPy 1 declared; latest is 2 (1 major behind). receipt ↗
- pandas 2 declared; latest is 3 (1 major behind). receipt ↗
- On current major: Pydantic. receipt ↗
Snapshot: commit e844f64 on main, checked 2026-10-19 06:18 UTC. Receipts link to files at this exact commit.
- Two or more breaking releases behind on a core dependency.
Dependency freshness
| Package | Declared | Latest | Status |
|---|---|---|---|
| OpenAI SDK openai | 1.40.0 | 3.35.1 | 2 majors behind |
| NumPy numpy | 1.24.0 | 2.5.4 | 1 major behind |
| pandas pandas | 2.0.0 | 3.0.6 | 1 major behind |
| Pydantic pydantic | 2.12.5 | 2.14.1 | Current |
Declared = lowest version the kit's dependency file (package.json, pyproject.toml or requirements.txt) allows. Latest = the npm "latest" tag or the newest PyPI release. TypeScript, the Stripe SDK, FastAPI and other 0.x packages are shown but not counted in the verdict.
What's in the stack
- API layer
- Pydantic
Detected from declared dependencies. A listed package means it's installed, not necessarily fully wired up.
What the README says you get
- AITSFM MCP server
TSFM | Tasks/evidence: `list_tasks`, `profile_series`, `characterize_series`, `data_quality`
- AIPlan Execute framework
Plan Execute — plan-and-execute sequential workflow to work with any LLM
- AIDeep Agent framework
Deep Agent — planning, sub-agents, and virtual filesystem for long-horizon tasks
- AIClaude Agent orchestrator
Claude Agent — ReAct-based orchestrator using Claude with agent-as-tool delegation
- AIOpenAI Agent orchestrator
OpenAI Agent — ReAct-based orchestrator using OpenAI models with agent-as-tool delegation
- AnalyticsLLM Judge scoring
Trajectories scored using **LLM Judge (Llama-4-Maverick-17B)**
- APIIoT MCP server
IoT | `sites`, `asset_ids`, `asset_detail`, `assets`
- APIFMSR MCP server
FMSR | `get_failure_modes`, `generate_failure_modes`, `add_failure_modes`
- APIWork order MCP server
WO | Read: `list_workorders`, `get_workorder`, `get_workorder_tasks`
- APIVibration MCP server
Vibration | `get_vibration_data`, `list_vibration_sensors`, `compute_fft_spectrum`
- APIMCP environment
The `src/` directory contains MCP servers and a plan-execute runner built on the Model Context Protocol
- DataCouchDB work order backend
backed by CouchDB with IBM Maximo `mxwo` field names
- OtherShared utility server
Utilities | `json_reader`, `get_sensor_catalog`, `get_asset_catalog`
- OtherRead-only mode
Set `AOB_READONLY=1` to expose the 9 read tools only
Extracted from the kit's README by a local AI model (deepseek-flash) on Sep 29, 2026. Every item is checked against an exact README quote. A README claim is the maker's description, not something we tested.
Watch AssetOpsBench
Get told if it goes dormant, gets archived, falls further behind on a core dependency, or changes its license or price.
History
Sep 29, 2026 → Oct 19, 2026. One square per check, colored by maintenance status. Hover for details.
Show as a table
| Date | Maintenance | Dependencies | Commits (90d) |
|---|---|---|---|
| Oct 19, 2026 | Active | 2+ majors behind | 162 |
| Oct 12, 2026 | Active | 2+ majors behind | 260 |
| Sep 29, 2026 | Active | 2+ majors behind | 287 |
Sources
Every claim on this page comes from these public records, checked . Open them to verify.
- Commit history ↗ default branch (main) at the checked commit: pulse, contributors, last commit
- Releases ↗ latest release
- pyproject.toml ↗ declared dependency versions and stack (at commit e844f64)
- README ↗ quoted features at the checked commit
- PyPI ↗ latest versions of Python packages (each linked in the table above)