yanbu, I am all for that!
Shunt, does it convert to a virtual world? how would you handle the collision of balls? maybe you could have transmitters to tell how far each of the balls are apart, but you'd need a robot in the balls to move on their own to adjust locations!! hmm!
maybe there could be a 'referee' bot that would know where all the balls should be and could run around and move them.
maybe you'd have lasers shooting down on the course to know the locations of balls with vision to make sure the colors are right. if not lasers and camera, the balls could kinda sonar-locate each other to tell the game server/ref-bot where they are in respect to each other