Conference Presentation (After Call) FZJ-2023-02439

http://join2-wiki.gsi.de/foswiki/pub/Main/Artwork/join2_logo100x88.png
A Novel Voronoi-based Convolutional Neural Network Approach for Crowd Video Analysis and Pushing Person Detection

 ;  ;

2023

Helmholtz AI Conference 2023, HamburgHamburg, Germany, 12 Jun 2023 - 14 Jun 20232023-06-122023-06-14 [10.34734/FZJ-2023-02439]

This record in other databases:

Please use a persistent id in citations: doi:

Abstract: At crowded event entrances, some individuals attempt to push others to move quickly and enter the event faster. Such behavior can increase the density over time, which could not only threaten the comfort of pedestrians but also cause life-threatening situations. To prevent such incidents, event organizers and security personnel need to understand the pushing dynamics in crowds. One effective way to achieve this is by detecting pushing individuals from video recordings of crowds. Recently, some automatic approaches have been developed to help researchers identify pushing behavior in crowd videos. However, these approaches only detect the regions where pushing occurs rather than the pushing individuals, limiting their contribution to understanding pushing dynamics in crowds. To overcome the limitations of previous methods, this work presents a novel Voronoi-based Convolutional Neural Network (CNN) approach for pushing person detection in crowd videos. As depicted in Figure 1, the proposed approach comprises two main phases: feature extraction and labeling. In the first phase, a new Voronoi-based method is developed and utilized to identify the local regions of individuals, employing both the video and the associated trajectory data as inputs. It then uses EfficientNetB0 CNN to extract the deep features of individual behavior from the identified regions. In contrast, the labeling phase utilizes a fully connected layer with a Sigmoid activation function to analyze the extracted deep features and identify the pushing persons. Finally, this phase annotates the pushing persons in the video. Furthermore, this work produces a novel dataset using five real-world experiments with their associated ground truths, which is utilized for training and evaluating the proposed approach. The resulting dataset consists of 11717 local regions, of which 3067 represent pushing samples, and 8650 represent nonpushing samples. The experimental outcomes demonstrate that the proposed approach attained an accuracy of 83% and a f1-score of 80%.


Contributing Institute(s):
  1. Zivile Sicherheitsforschung (IAS-7)
Research Program(s):
  1. 5111 - Domain-Specific Simulation & Data Life Cycle Labs (SDLs) and Research Groups (POF4-511) (POF4-511)
  2. Pilotprojekt zur Entwicklung eines palästinensisch-deutschen Forschungs- und Promotionsprogramms 'Palestinian-German Science Bridge' (01DH16027) (01DH16027)

Appears in the scientific report 2023
Database coverage:
OpenAccess
Click to display QR Code for this record

The record appears in these collections:
Document types > Presentations > Conference Presentations
Institute Collections > IAS > IAS-7
Workflow collections > Public records
Publications database
Open Access

 Record created 2023-06-23, last modified 2023-07-14


OpenAccess:
Download fulltext PDF
External link:
Download fulltextFulltext
Rate this document:

Rate this document:
1
2
3
 
(Not yet reviewed)