Preparation

We all new to the URs, so we first developed a plan and process for the entire project. After learning all the inputs from Sebastian we discussed the overall gameplay process and the components that would be used during the game. 

The gameplay process is similar to the original one. But there will be three round in the game. Every round od hide beginn with „Game start“ from speaker ,seek will be the movement from UR, camera and flashlight.

There are two parts of our UR game, a virtual part about programming and a hardware part about all the digital devices and connect, such as camera, flashlight and speaker.

The picture below shows our whole process, which has three parts.

The first part was preparation. We needed to understand how each device worked, who controlled it, and how it would connect. We controlled the camera, flashlight, and robot through computer programming. The computer and robot were connected via Wi-Fi. 3D-printed connectors were used to connect the physical devices.

The second part was the most painful and lengthy connection and testing. After the preparation, we began connecting each device step by step and testing if it works and also if it works like we need. Each connection was a challenge.

The third part was testing the entire game.

Connecting & Testing

This part is all about trying again and again. 

We first connected the computer to the UR via a Wi-Fi router and tested controlling the UR to move to a specific location through programming.

At the same time, Felix began to model and 3D print the Azure Kinect DK and UR Adapter.

Camera — Azure Kinect DK

Our second step is to connect the computer to the Azure Kinect DK, and then connect the Azure Kinect DK to the UR using the Adapter to detect players´ face and send the location information to UR and let UR move to the place.

However, the screws were not long enough to secure the Azure Kinect DK to the Adapter, so we temporarily used tape to tie the Azure Kinect DK and Adapter together for testing. Meanwhile, we ordered longer screws online, modified the Adapter's dimensions, and then 3D printed it as a plan B.

After repeated testing, we decided to use the position of the player's nose detected and send the position information to UR to catch the player's face as proof of being found by UR. The following is a small clip of the successful test.

Flashlight

The third step is to shine a beam of light on the player's face after finding them, signaling they've been found. We didn't have a flash, so we ended up using a small spotlight instead.

We first considered turning the small spotlight on and off directly from the computer, but then realized we needed a controller to turn it on and off, so we connected an Arduino board to control the small spotlight's on and off.

Below is a test clip with the small spotlight.

Speaker

As a final step, we found background music and recorded the UR interactive audio, including „Game Start“ as the signal for players to grab a chair and hide, and „I found you“ as the voiceover for players being eliminated after being discovered. We then set a time limit for each round and edited the complete gameplay audio.

The Game

Finally, we tested the entire gameplay experience. However, during our own testing, we discovered that due to our previous settings, the Azure Kinect DK would detect the position of the player's nose. We found that as long as we covered our face, the UR would never detect us. So we added a new gameplay setting. 

The game has three rounds, and each round removes a chair as an obstruction, so that the remaining player's face is visible and can be found by the camera. Each round also brings the player closer to the UR, and the remaining player in the final round has the opportunity to press the victory button and become the winner of the UR.

Then we recruited a few players to experience our game. The following clip shows Felix explaining the rules of the game to the players.

After the game starts, UR will turn its back to the player and let the player grab a chair as a cover within a limited time. Each chair can only provide cover for one player.

So the player who fails to grab a chair will be found by UR.

After UR finds the player, it will move along with the player.

When the final round of the game begins, players have the opportunity to press the UR button and win.