Footstep recognition system using AI could be used for airport security

The way you walk and your footsteps could be used as a biometric at airport security instead of fingerprinting and eye-scanning. Researchers at The University of Manchester in collaboration with the University of Madrid have developed a state-of-the-art artificial intelligence (AI), biometric verification system that can measure a human’s individual gait or walking pattern. It can successfully verify an individual simply by them walking on a pressure pad in the floor and analysing the footstep 3D and time-based data.

The results, published in one of the top machine learning research journals, the IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), earlier this year, showed that, on average, the AI system developed correctly identified an individual almost 100% of the time, with just a 0.7 error rate.

Physical biometrics, such as fingerprints, facial recognition and retinal scans, are currently more commonly used for security purposes. However, so-called behavioural biometrics, such as gait recognition, also capture unique signatures delivered by a person’s natural behavioural and movement patterns. The team tested their data by using a large number of so-called ‘impostors’ and a small number of users in three different real-world security scenarios. These were airport security checkpoints, the workplace, and the home environment.

Dr Omar Costilla Reyes, from Manchester’s School of School of Electrical and Electronic Engineering and who led the research, explains: “Each human has approximately 24 different factors and movements when walking, resulting in every individual person having a unique, singular walking pattern. Therefore monitoring these movements can be used, like a fingerprint or retinal scan, to recognise and clearly identify or verify an individual.”
To create the AI system that computers need to learn such movements patterns, the team collected the largest footstep database in history (to date), containing nearly 20,000 footstep signals from 127 different individuals. To compile the samples and dataset the team used floor-only sensors and high-resolution cameras. It was this dataset, which is called SfootBD, which Dr Costilla Reyes used to develop the advanced computational models needed for automatic footprint biometric verification presented in TPAMI.

Dr Costilla Reyes added: “Focussing on non-intrusive gait recognition by monitoring the force exerted on the floor during a footstep is very challenging. That’s because distinguishing between the subtle variations from person to person is extremely difficult to define manually, that is why we had to come up with a novel AI system to solve this challenge from a new perspective.”

One of the key benefits of using footprint recognition is, unlike being filmed or scanned at an airport, the process is non-intrusive for the individual and resilient to noise environmental conditions. The person doesn’t even need to remove their footwear when walking on the pressure pads as it isn’t based on the footprint shape itself but with their gait. Other applications for the technology include smart steps that could recognise neuro degeneration which could have positive implications in the healthcare sector. This is another area that Dr. Costilla Reyes intends to advance his research with footstep recognition