feat: initial commit — orchestratore presa-mano con AI assistant + dual-robot

Browse Source

Pipeline completa per calibrazione hand-eye e grasp planning su robot
Unitree G1/H1 con camera depth Nuwa-HP60C. Esposta come FastAPI + GUI vanilla
JS, con assistente AI (OpenRouter + tool calling curato) per pilotare il
sistema in linguaggio naturale.

Architettura:
- FastAPI orchestrator (porta da .env, default 8890) che coordina 4
  microservizi upstream: Nuwa-HP60C, marker-finder, YOLO, robot bridge.
- Dual-robot: services.g1 e services.h1 in config.yaml; switchabili a
  runtime via PUT /api/home/robot.
- Calibrazione hand-eye eye-to-hand split per-side (right/left).
- Marker pose: marker-finder riceve gli intrinseci RGB della Nuwa al boot,
  PnP server-side con quei dati. Nessun re-PnP locale richiesto.
- Depth-to-RGB: registrazione iterativa IR↔RGB per back-projection 3D
  corretta (Nuwa /api/measure usa coords IR; il nostro /api/perception/
  measure_rgb prende pixel RGB e ritorna 3D nel frame RGB OpenCV).
- Correzione affine sul depth bias (calibrabile via marker come
  ground-truth) — riduce errore Z da ~6% a ~1.5% nei test.
- AI assistant: 16 tool curati (move_wrist_*, hand_action, get_marker[_3d],
  detect_object, calibration_*, set_active_robot…), system prompt
  dinamico che riflette robot attivo + marker config + addendum
  customizzabile da GUI. Temperature di default 0.1 per evitare invenzioni.

GUI (7 tab):
- Home: stato comunicazione device + selettore robot attivo G1/H1
- Assistente AI: chat con OpenRouter, history persistita lato browser,
  task riutilizzabili (prompt salvati), trace tool calls
- Impostazioni AI: modello da combo curata, temperature, max iterations,
  prompt addendum, anteprima system prompt
- Calibrazione, Auto-Calibrazione, TrovaUtensile, Servo Visuale, Vista 3D,
  Movimento EE — invariate dalle versioni precedenti

Setup:
- Variabili in presa-mano/.env (template in .env.example)
- OPENROUTER_API_KEY richiesta solo per il tab Assistente AI
- PRESA_MANO_PORT configurabile

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

...

This commit is contained in:

Adriano Dal PastroandClaude Opus 4.7 committed 2026-05-06 13:28:23 +02:00

commit ac573505b7

121 files changed

+67199

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

web/assets/g1/meshes/head_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_ankle_pitch_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_ankle_roll_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_elbow_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_hand_index_0_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_hand_index_1_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_hand_middle_0_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_hand_middle_1_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_hand_palm_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_hand_thumb_0_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_hand_thumb_1_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_hand_thumb_2_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_hip_pitch_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_hip_roll_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_hip_yaw_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_knee_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_rubber_hand.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_shoulder_pitch_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_shoulder_roll_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_shoulder_yaw_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_wrist_pitch_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_wrist_roll_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_wrist_roll_rubber_hand.STL

BIN

Binary file not shown.

web/assets/g1/meshes/left_wrist_yaw_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/logo_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/pelvis.STL

BIN

Binary file not shown.

web/assets/g1/meshes/pelvis_contour_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_ankle_pitch_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_ankle_roll_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_elbow_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_hand_index_0_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_hand_index_1_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_hand_middle_0_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_hand_middle_1_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_hand_palm_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_hand_thumb_0_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_hand_thumb_1_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_hand_thumb_2_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_hip_pitch_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_hip_roll_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_hip_yaw_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_knee_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_rubber_hand.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_shoulder_pitch_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_shoulder_roll_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_shoulder_yaw_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_wrist_pitch_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_wrist_roll_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_wrist_roll_rubber_hand.STL

BIN

Binary file not shown.

web/assets/g1/meshes/right_wrist_yaw_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/torso_constraint_L_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/torso_constraint_L_rod_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/torso_constraint_R_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/torso_constraint_R_rod_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/torso_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/torso_link_23dof_rev_1_0.STL

BIN

Binary file not shown.

web/assets/g1/meshes/torso_link_rev_1_0.STL

BIN

Binary file not shown.

web/assets/g1/meshes/waist_constraint_L.STL

BIN

Binary file not shown.

web/assets/g1/meshes/waist_constraint_R.STL

BIN

Binary file not shown.

web/assets/g1/meshes/waist_roll_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/waist_roll_link_rev_1_0.STL

BIN

Binary file not shown.

web/assets/g1/meshes/waist_support_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/waist_yaw_link.STL

BIN

Binary file not shown.

web/assets/g1/meshes/waist_yaw_link_rev_1_0.STL

BIN

Binary file not shown.