Surgeons operate with PlayStation controller 9,300 km away

The system used in Hong Kong consisted of a robotic device and a magnetic endoscope. The second device, equipped with a series of magnets along its length, was steered by the control of an external magnetic field. The connection between the two locations was provided by a direct WebSocket protocol, to allow real-time data transfer to a control console in Zurich.

An operation 9,300 km away

The Swiss surgeon controlled the procedure using a PlayStation 3 Move controller with feedback via a live video feed. Latency remained surprisingly low, less than 300 milliseconds throughout the operation. Despite the distance, the doctor was able to react in near real time.

During the procedure, the researcher performed complex maneuvers, including bending the endoscope to make a complete U-turn. Even more impressive, he was able to take a usable biopsy of the animal's stomach wall tissue. Other demonstrations were also performed using a DualSense controller from PS5.

The feat of this experiment is in line with a broader trend of the use of robotics in surgery. Robots already assist surgeons in delicate operations, including on the heart and eyes, to improve precision.

It is important to note that surgery “from a distance” is not new. Many common operations, such as colonoscopies, are already performed with the surgeon operating far from the patient but in the same room. The feat here is the distance of 9,300 km on a global scale.

Operating in remote areas or space

This first step could revolutionize access to specialized care in remote areas where medical expertise is lacking. In the longer term, the technology could even make it possible to operate on astronauts in space from Earth.

The results of this experiment were published in the scientific journal Advanced Intelligent Systemsaccompanied by a demonstrative video of the remote surgery system in action.