spacetime-ml/cad-cua:
3D CAD CUA & Deterministic B-Rep RLVR
The public multimodal 3D Computer-Use Agent (CUA) & Reinforcement Learning with Verifiable Rewards (RLVR) dataset and evaluation suite—pairing 62 commercial CAD episodes, 48 ISO-128 2D Reference Engineering Blueprints, and 215 mechanical CAD deliverables with verify_step.py deterministic ISO-10303-21 .STEP grading.
401 Files
15.48 GB Public HF Repo
SHA256SUMS-verified · CC BY 4.0
62 Episodes
6 Commercial/Open CAD Suites
34,551 PNGs · 260,203 GUI events
215 CAD Files
48 Submission Archives
115 native + 98 STEP + 2 mesh
85.0%+ Fail
20-Task .STEP RLVR Benchmark
Claude 4.5 (15%), GPT-5.2 & Gemini 3 (10%)
The 2D-Blueprint-to-3D B-Rep Spatial Reasoning Bottleneck
Frontier multimodal models achieve high scores on 2D browser clicking and static visual QA, but fail 85.0% to 90.0% of the time when reconstructing watertight ISO-10303-21 .STEP solids from 4-view ISO-128 engineering blueprints—suffering from missing internal counterbores, fillet self-intersections, and non-manifold open shells.
CAD-CUA: 62 Industrial 3D Trajectories, 48 Blueprints & 215 CAD Deliverables
Hosted on Hugging Face Hub across 3 configurations (default, models, and benchmark), spacetime-ml/cad-cua pairs 62 verified CAD sessions across SolidWorks (51), PTC Creo (9), AutoCAD (1), FreeCAD (1), Autodesk Fusion (1), and Autodesk Inventor (1) with 48 ISO-128 2D Reference Engineering Blueprints, 215 mechanical CAD deliverables (115 native + 98 STEP + 2 mesh), and verify_step.py.
62 Episodes
48 Model + 14 Trajectory
34,551 masked PNG frames (72,070 raw inspected; 9-pass OCR with 0 errors)
48 Blueprints
ISO-128 2D Reference Pairs
4-view Third-Angle orthographic + isometric drawings (.png & .pdf)
215 CAD Files
115 Native + 98 STEP + 2 Mesh
48 models/cad-XXXXXX.zip archives 100% paired with episodes
62 Previews
PNG + H.264 MP4 + PDF Dossiers
62 keyframes, 62 cursor-annotated MP4 videos, and 62 1-page storyboard PDFs
20-Task Frontier Model RLVR Benchmark (Watertight Manifold CLOSED_SHELL ≥ 1, OPEN_SHELL == 0 & R ≥ 0.85)
python3 verify_step.py --candidate pred.step --ground-truth gt.step| Model / Agent | Pass@1 (20 Blueprints) | Failure Rate | Mean Reward (R) | BBox IoU | Topology Score | Primary Failure Mode |
|---|---|---|---|---|---|---|
| Human CAD Engineer (Ground Truth) | 100.0% (20/20) | 0.0% | 1.000 | 1.000 | 1.000 | Watertight ISO-10303-21 B-Rep manifold solid |
| Claude 4.5 (Computer Use / CAD Code) | 15.0% (3/20) | 85.0% (17/20) | 0.463 | 0.543 | 0.415 | Missing internal counterbores, fillet self-intersections |
| GPT-5.2 (Vision + CAD Code) | 10.0% (2/20) | 90.0% (18/20) | 0.391 | 0.476 | 0.335 | 3D axis swap, non-manifold shells, bore pitch drift |
| Gemini 3 (Multimodal Spatial + CAD) | 10.0% (2/20) | 90.0% (18/20) | 0.371 | 0.449 | 0.324 | Unclosed sketch loops, missing radial hole arrays |
Inspect Real 2D Blueprints, CUA GUI Trajectories & B-Rep Rewards
Construct a watertight 3D B-Rep solid matching 2D Reference Blueprint CAD-000020 (outer envelope 100.00 × 67.50 × 35.00 mm, 78 B-Rep faces: 14 planar, 38 cylindrical) within ISO 2768-mK tolerances.
python3 verify_step.py \ --ground-truth models/cad-000020.zip \ --candidate models/cad-000020.zip
Test verify_step.py Live in Your Browser (<10ms Execution)
Select a reference blueprint below, toggle between Human Ground Truth and Frontier Model candidate .STEP files—or drag-and-drop your own .STEP / .STP file to compute exact B-Rep RLVR rewards in real time.
Tip: Try editing CLOSED_SHELL to OPEN_SHELL or modifying CARTESIAN_POINT coordinates above to watch the B-Rep reward update instantaneously.
R = 0.35·s_bbox + 0.25·s_vol + 0.20·s_top + 0.20·s_surfHeld-Out Enterprise Split: 105 Verified Sessions & 29 Multi-Trajectory Part Families
While 62 episodes are published openly in spacetime-ml/cad-cua, SpacetimeML maintains an air-gapped, continuously expanding private holdout (currently 105 verified human CAD sessions · 72.12 hours · 102,821 frames · 502,556 OS events · 0 duplicate deliverable SHA-256 hashes) featuring 29 multi-engineer part families (part_family_id) where 2–4 distinct mechanical engineers independently model the exact same 2D blueprint.
part_family_id) — Paired Human Trajectories for DPO & GRPO| Part Family ID | Blueprint Spec & Component | Engineers | Session Durations (Min) | Horizon Spread | Frames / Events | Post-Training RL / DPO Signal |
|---|---|---|---|---|---|---|
| pf_model_mania_2011 | [AX-145 / 018]Model Mania 2011 Ribbed Clevis & Boss | 4× Human | 10.4m · 13.6m · 25.2m · 46.0m | 4.4× efficiency spread | 2,309f / 15,316e | DPO Action-Horizon Pruning + Pass@4 GRPO |
| pf_ax_167 | [AX-167 / 174]Multi-Port Hydraulic Valve Block | 4× Human | 15.3m · 18.7m · 32.6m · 64.2m | 4.2× efficiency spread | 3,748f / 5,909e | Feature-Tree Ordering Preference Pairs |
| pf_model_mania_2008 | [AX-023 / 119]Model Mania 2008 Swept Bellcrank Yoke | 3× Human | 20.8m · 68.1m · 101.6m | 4.9× efficiency spread | 3,815f / 42,647e | Cross-Suite Trajectory Alignment (SolidWorks / Creo) |
| pf_handle_phase1 | [AX-123 / 106]Ergonomic Contoured Actuator Handle | 3× Human | 31.2m · 80.1m · 95.7m | 3.1× efficiency spread | 5,204f / 15,229e | Surface Fillet & Shell Recovery Trajectories |
| pf_model_mania_2014 | [AX-118 / 126]Model Mania 2014 Tri-Boss Trunnion | 3× Human | 29.5m · 49.6m · 68.1m | 2.3× efficiency spread | 4,331f / 4,364e | Multi-Datum Sketch Plane Grounding |
| pf_ax_166 | [AX-166 / 176]Slotted Eccentric Cam Housing | 3× Human | 21.4m · 37.6m · 60.6m | 2.8× efficiency spread | 3,245f / 3,504e | Concentric Bore Constraint Satisfaction |
| pf_ax_105 | [AX-105]Counterbored Bearing Pillow Block | 3× Human | 28.9m · 36.5m · 39.9m | 1.4× efficiency spread | 2,839f / 2,849e | Consistent B-Rep Topology Convergence (χ=2) |
| pf_stepped_shaft | [AX-017 / 014]Keyed Multi-Diameter Drive Shaft | 3× Human | 8.2m · 14.1m · 17.2m | 2.1× efficiency spread | 797f / 955e | Revolve vs. Stacked Extrude DPO Pairs |
Inside the 401-File Public Release
Every file in spacetime-ml/cad-cua is SHA256SUMS-verified, OCR-scrubbed for privacy, and structured for immediate Hugging Face datasets loading.
default (data/train.jsonl) — 62 Multimodal CAD Episodes
62 retained CAD sessions (48 verified_cad_model + 14 verified_trajectory) across 6 CAD software suites: SolidWorks (51), PTC Creo (9), AutoCAD (1), FreeCAD (1), Autodesk Fusion (1), and Autodesk Inventor (1). Includes 34,551 privacy-masked PNG observations and 260,203 desktop telemetry events.
models (data/models.jsonl) — 48 Archives & 215 CAD Files
48 submission archives (models/cad-XXXXXX.zip) 100% paired with episode observations (0 orphan archives). Contains 215 mechanical CAD deliverables: 115 native parametric files (.sldprt, .sldasm, .prt, .asm, .fcstd, .ipt, .dwg, .f3d), 98 ISO-10303-21 .step/.stp B-Rep solids, and 2 mesh/exchange files.
48 ISO-128 2D Reference Engineering Blueprints
48 standardized engineering drawing pairs (blueprints/cad-XXXXXX.png & blueprints/cad-XXXXXX.pdf) featuring 4-view Third-Angle orthographic projections (Front, Top, Right) + Isometric wireframe views with explicit bounding dimensions and bore callouts.
benchmark (data/benchmark.jsonl) — 20-Task Frontier RLVR Eval
20 held-out 2D-blueprint-to-3D-B-Rep reconstruction tasks evaluated with verify_step.py across principal-axis BBox IoU, closed-shell volume/area, Euler-Poincaré topology, and analytical cylindrical/conical/toroidal surface spectra.
Mathematical Verification with verify_step.py
How verify_step.py computes a continuous RLVR shaping reward R in [0, 1] directly from ISO-10303-21 .STEP files.
35% Principal-Axis Bounding Box IoU (s_bbox)
Computes rotation-invariant sorted 3D principal extents and PCA inertia moments from VERTEX_POINT and CARTESIAN_POINT coordinates, catching 3D axis swaps and dimensional tolerance violations.
25% Volume & Surface-Area Conservation (s_vol_area)
Evaluates solid packing density, 3D spatial occupancy, and closed-shell surface area conservation across MANIFOLD_SOLID_BREP and CLOSED_SHELL entities.
40% B-Rep Topology (20%) & Analytical Surfaces (20%)
Combines 20% Euler-Poincaré topological graph fidelity (faces, edges, vertices, CLOSED_SHELL ≥ 1, OPEN_SHELL == 0) with 20% analytical surface & cylindrical bore radius spectrum matching.
{
"episode_id": "cad-000001",
"cad_application": "SolidWorks",
"prompt_blueprint": "blueprints/cad-000001.png",
"ground_truth_archive": "models/cad-000001.zip",
"verifier": "verify_step.py",
"reward_weights": {
"s_bbox": 0.35, // Principal-Axis Bounding Box IoU
"s_vol_area": 0.25, // Closed-Shell Volume & Surface-Area Conservation
"s_topology": 0.20, // B-Rep Topological Graph & Euler-Poincare Fidelity (V - E + F)
"s_surface": 0.20 // Analytical Surface & Cylindrical Bore Radius Spectrum
},
"pass_criterion": {
"closed_shells_min": 1,
"open_shells_max": 0,
"min_rlvr_reward": 0.85
}
}Need 50,000+ Held-Out 2D-to-3D B-Rep Tasks & Custom Human CAD Trajectories?
Beyond the public 62-episode spacetime-ml/cad-cua release, SpacetimeML provisions private, zero-contamination parametric CAD corpora, multi-part assembly benchmarks, and high-throughput verify_step.py RL rollout clusters for frontier AI labs.
Ready to benchmark and train your 3D CAD agents?
Download the public 401-file spacetime-ml/cad-cua dataset on Hugging Face or request private enterprise CAD-RLVR benchmark access.