Pepper Robot Telepresence demo

Overview

This demo uses the Pepper robot which mimics movements made by humans. These movements are observed using a PC which is running openpose and is connected to a Kinect camera

Materials

You will need the following:

1. Pepper robot
2. Kinect for windows
3. PC with an NVIDIA graphics card (HMI-002)

All the software has been preinstalled on the HMI-002 PC

Setup

Network Setup

The pepper robot has its own dedicated wifi router that must be used with it as it struggles to connect to eduroam or other networks.

This router must be connected to an ethernet port in the wall and have internet access. The led above the planet logo should start blinking when it is connected to the internet. Next connect an ethernet cable from this router to your PC.

Kinect Setup

Start by connecting the Kinect connectors to each other, plug it into power and into the USB port.

Usage

Open the computer and login the the 'HMI' user on PC-002. The password can be requested from the admin team sitting behind the desk. Next on the desktop there are 2 programs located:

openpose.bat

pepper_mirror.bat

It is important to first start the openpose.bat and only when you see a live preview of the webcam should you start the 'pepper_mirror.bat' This will open up the 'pepper control' window. In here you can configure the IP and Port of the Pepper robot. You can find the IP of pepper by pressing the button on pepper's belly under the tablet and it will say its IP.

Next you can connect to the robot by clicking the large orange “connect” button. The you can press the “start moving” button to have pepper mimic the movements detected by OpenPose and the Kinect. Pepper should then start moving.