Efficient architectures and algorithms for distributed video analytics for Smart Cities

Principal Investigator

Prof Bharadwaj Amrutur (Chairman, Robert Bosch Centre for Cyber-Physical Systems)

Abstract

Most of the smart city components, as articulated by the 20 candidate cities chosen for Smart City implementation by the Indian Government, can greatly benefit by the use of cameras as sensing devices. Examples include surveillance, smart parking, transit management, etc. This is not surprising as cameras are a very versatile and rich sensor and hence one can extract useful information to enable a diverse set of applications. However, the negative is the high data bandwidth required to transfer data from the cameras to the computing center. Hence it is imperative that one explore ways of analyzing the camera data at the edge so that only useful information is sent to the computing center, thus minimizing bandwidth. At the same time, the whole system needs to be flexible enough to allow programmatic control of what useful information to extract as this depends on the actual application. Hence this forms the basic premise and problem for this proposal.

We will set up a test bed for distributed video analytics on the IISc campus.

We plan to use light poles as the key infrastructure element on which the camera edge nodes and the aggregator server node will be mounted. The edge camera nodes could be made out of commodity compute hardware like the snapdragon flight. The aggregator node could have further compute accelerators like the Xilinx Zynq or the parallella core or the nvidia GPUs.  The camera network will be interconnected using either 802.11s or BATMAN-ADV protocols, both of which are based on WiFi.

We will explore concepts in both the algorithms as well as the architecture using a few of the problems from the smart city components like surveillance, smart parking, etc. The setup of using light poles is a new concept and might be a very promising approach for Smart City implementation.