← All case studiesComputer vision & software

Camera-based game control

Skeleton tracking for up to 8 people at once, in real time and on the CPU alone.

CustomerSphery AG

ScopeC++ library · Pose estimation · CPU optimisation · Real-time processing

Topics

Human interfaces

Starting point

Requirements

As an entry point into fitness games for several people at once, an innovative game control scheme was to be developed - with as little additional hardware as possible. The target audience is school classes.

Using skeleton tracking (pose estimation), every joint plus hands, feet and head had to be detected for several people simultaneously.

Latency had to be as low as possible, and only the CPU could be used, because the GPU was needed for the games.

Solution

Our approach

A Windows library (DLL) written in C++, with an AI model ported to a CPU-optimised framework.
The library needs only the camera port as input and returns joint positions in 3D space, with depth estimated by the AI model.
Camera frames are processed in real time at up to 60 fps; 8 people can be tracked simultaneously.

Result

What came out of it

Sphery could integrate the library into their game development without building up specialist know-how.
Development took only 2 months - the new setup was handed over to the first class in time for the start of the school year.

Customer

Sphery AG

Sphery develops motivating games and hardware for all-round training experiences: physical, cognitive and mental fitness through immersive game scenarios. Maximum training effect meets the ultimate motivation booster.

More projects

Electric drives & control softwareElectric fitness equipmentElectric weights that adjust the applied force precisely at every angle - instead of steel plates working against gravity.Fault analysis & retrofitMobile service liftRandom motor controller failures traced back to their root cause - energy fed back during emergency descent - and fixed in the field with a brake chopper retrofit.Medical electronicsVital scannerA compact ECG device with two electrodes instead of three, a sampling rate of 1,067 Hz and 0.7 µA standby current.Drive technology & mechanical engineering4-axis linear system with 15,000 NA complete redesign of an existing machine around the X1 controller - mechanical and electrical engineering from one team.Drive technology & automationUnderground inspectionAn automated winch system that measures the rope's slip and cancels it out - for probes up to 300 m into the duct.Access control & paymentAkrodyn SunControlAge verification, ID checking and payment for unstaffed tanning salons - as a retrofit for installations up to 30 years old.Drive technology & power electronicsEtherCAT motor controllerCustom motor controller built on Akrodyn technology with EtherCAT, Safety PLe and certification to CE, UL and CSA for global use in industrial machinery.Drive technology & embedded firmwareMotor controller for robotics actuatorsCompact circular motor controller PCBs with field-oriented control and CAN-FD for a family of dynamic robotics actuators in three form factors, including full CAN protocol documentation and an end-of-line test plan.

Engineering sparring

Tell us what you have in mind.

An idea in your head? Or still unsure which technical route is the right one? Together we work out which architecture, which components and which timeline suit your plans, and what the next step looks like.

Online via video call or in person in Zurich

Request a sparring session

+41 44 599 20 60 · info@akrodyn.com