Contents


<aside> 💡

This guide only covers the build of the DexWild specific part of the setup. This includes the components used for human demo collection and how to set up DexWild camera on the robot.

For robot setup please refer to:

https://bidex-teleop.github.io/

For LEAP V2 Advanced setup, please refer to:

https://v2-adv.leaphand.com/

For LEAP V1 setup, please refer to:

https://v1.leaphand.com/

</aside>

Overview

human_hardware_setup.png

DexWild-System Setup

Bill of Materials

Quantities are for(2 hands / 1 hand), depending on if you want to collect bimanual data.

Part (hyperlinked) Qty Price Notes
Parts you may already have
Manus Metagloves 2/1 $6000/3000 😭 Ask for EDU pricing
Jetson Orin NX 1 $760.99
ZED Mini 1 $399
New Parts
Short HDMI Cable 1 $10.99
5” Touch Screen 1 $39.99
20000mAh Power Bank 1 $35.99 > 36W output
USB Clicker 1 $26.99
Foot Pedal 1 $16.99
Head GoPro Mount 1 $9.99
Tripod 1 $22.99 Any Tripod Works
Tripod GoPro Mount 1 $6.99
USB-C 15v Trigger Cable 1 $14.99
USB-C Variable Voltage Trigger Cable 1 $12.99
Powered USB Hub 1 $13.46
USB extension Cable 1 $8.99
Global Shutter Arducam 8/4 $479.92/239.96
Arducam Wide Angle Lens 8/4 $119.92/59.96
Low Profile Lens Mount 8/4 $48/24
Lens Retainer Nut 8/4 $9.99 Pack of 10
USB Splitter 2/1 $11.76
Metric Bolts, Washers, Nuts Kit 1 $24.99
M2 Threaded Inserts 1 $9.98

Build Guide

<aside> 🖨️

For 3D printing, we recommend PLA, ~20% infill, and standard settings otherwise.

</aside>

Hand Sensor Pod - For left and right human hand data collection.

<aside> 🧊

3D Prints

manus_mount_left.STL

manus_mount_right.STL

aruco_cube.STL

2D Prints → make sure the scale is correct and matches the aruco cube!

dexwild_aruco_left_letter.pdf

dexwild_aruco_right_letter.pdf

dexwild_aruco_left_A4.pdf

dexwild_aruco_right_A4.pdf

</aside>

  1. The first step is to prepare the cameras. You will need a windows PC for this step.

    Download the Arducam Serial Number Tool (also at this link)

    ArducamUVCSerialNumber_Official.zip

  2. We need to give each camera an unique serial number. Plug each camera in and follow this guide to give each camera a number. e.g. “00001”, “00002”.

  3. Now follow the guide below to replace the lens on the camera to be wide angle.

    https://www.youtube.com/watch?v=w9uMe3SMGFo

  4. We need to focus the lens of the camera. Plug the camera into your computer.

    cd dexwild
    cd misc_scripts
    python3 list_cameras.py
    
    # you should see [num_a, num_b, num_c, ...] for each camera plugged in.
    
    python test_cameras.py --cameras num_a num_b num_c
    
    # Also make a note of the serial numbers of each camera.
    
  5. Now twist the lens forward and backwards until the image shown becomes clear. Then tighten the retaining nut.

    https://youtu.be/TmgDCnByI-k?si=Ii0A7NXLUerAkNbr