Multisensors fusion and Integration

HANAMANT S KALATIPPI 4MH08EC014 EC DEPT. MIT, MYSORE

CONTENTS INTRODUCTION SENSORS MULTISENSORS FUSION AND INTEGRATION VARIOUS TYPES OF FUSION ADVANTAGES AND DISADVANTAGES APPLICATION CONCLUSION FUTURE ENHANCEMENT REFERENCE

INTRODUCTION

Multisensors fusion and integration is a rapidly evolving research area. Sensor-detector or transducer It refers to the combination of sensory data from multiple sensors . Increase capability of system System can interacts and operates unknown environment

Sensors Sensor : A device that measures a physical quantity and converts it into a signal which can be read by an Sensors classification observer or by an instrument.

Contact : physical contact -touch, force ,pressure ,temp. Non contact : electromagnetic radiation light ,x-ray, acoustic.

Sensor Types

Thermal:
-Temperature/heat sensors

Electromagnetic:
-Electrical resistance/voltage/power sensors, metal detectors, RADAR

Mechanical:
-Acceleration, position, pressure, switch, liquid sensors

Chemical:
-Odor (smell) sensor, oxygen sensors

Optical radiation:
-Light sensors, infra-red sensor, proximity sensor Acoustic: Sound sensors

Motion sensors:
- Speedometer, tachometer, radar gun Orientation sensors: Gyroscope 5/54

Multisensor fusion and integration

The operation of multisensor fusion is a process of combining data that is obtained from homogeneous or heterogeneous sensors for certain sensing tasks to gain a broader/deeper and more accurate understanding of the entities of interest than that of uni-sensor sensing. A group of sensors provide input to the integration process. In order for the data from each sensor to be used for integration, it must first be effectively modeled.

Multisensor: The Idea from Real Life Human Brain

Integrates sensory information to make inferences regarding the surrounding environment.

Types of fusion

DIRECT FUSION OF SENSORS DATA REPRESENTATION OF SENSORS DATA VIA FEATURES VECTOR AND FUSION OF FEATURES INTEGRATION OF HIGH-LEVEL INTEREFERNCE FROM EACH SENSORS

Data Level Fusion

Direct fusion of sensor data

Feature Level Fusion

Representation of sensor data via feature vector, with subsequent fusion of feature vector feature

Decision Level Fusion

Processing of each sensor to achieve high-level inferences or decisions, with subsequent combination of the high-level results

Comparison between Data, Feature and Decision Level Fusion

General pattern

Advantages of Multisensor Data Fusion

Improved system performance Improved detection, tracking, and identification Improved situation assessment and awareness Improved robustness Sensor redundancy Extended spatial and temporal coverage Shorter response time Reduced communication and computing Cost is less

Disadvantages
Error in the integration and fusion process Error in sensory Information Error in the system operation

 Robotics

Applications

-material handling -part fabrication -assembly Remote sensing -Crops -Weather patterns -Environment -Mineral resource -Buried hazardous waste Biomedical application -automatic cardiac rhythm monitoring -blood pressure -heart rate extraction

Military applications:
Location and characterization of enemy units and weapons High level inferences about enemy situation Air to air or surface to air defense Ocean monitoring Battlefield intelligence Strategic warning

Sensor Model for Smart Car

19/54

Integrated Sensors (2)

20/54

Integrated Sensors
21/54

Conclusion
Multisensor fusion and integration is a technique to get a better output or result by combining the outputs of more than one Sensors. It has a very wide range of applications and hence a require more development in this field. These sensor technologies are used in micro sensors based application in robotics ,defense, remote sensing , equipment monitoring ,biomedical engineering and transportation system.

Some Ongoing Research Projects

Video Surveillance -Tracking -Activity Recognition -Multi-modal Fusion Fusion for Detection/Classification/Tracking -Wireless Sensor Networks -Vehicle Health Management Multisensor fusion and integration target micro sensors Adaptive fusion techniques Multilevel sensor fusion.

References
[1]. Ren.C.Luo, IEEE Chin Chen Yih and Kuo Lan Su Multisensors Fusion And Integration in intelligent systems, IEEE Sensors Journal, [2]. M . Rahimi and P.A Hancock, Sensors, Integration, International

Encyclopedia of Robotics application & Automation. [3]. M . Rahimi and P.A Hancock, Sensors, Integration, International Encyclopedia of Robotics application & Automation . [4]. Kevin Hartwig, Sensors,Principles, International Encycloprdia of Robotics Application and Automation.

THANK YOU