With the fast pace of development in deep learning, object detection has gained a huge progress. Among all of the different objects, living objects are the most important ones in autonomous driving.<\/p>\n\n\n\n
However, in some real-world scenarios, object detection with RGB cameras fail to generate reasonable detection results. Moreover, we found that it is beneficial to use infrared cameras on detecting living objects according to heat emission.<\/p>\n\n\n\n
Here, we list a few cases we found in FLIR dataset which infrared camera help to improve object detections. <\/p>\n\n\n\n
Day scene<\/li><\/ul>\n\n\n\n<\/figure>\n\n\n\n
In the figure above, we can see that the people on the side walk are not detected in RGB image, yet we can easily get detection results with infrared image.<\/p>\n\n\n\n
Night scene<\/li><\/ul>\n\n\n\n<\/figure>\n\n\n\n
Night scene object detection is more challenging than day scene for RGB cameras due to insufficient illumination. Nevertheless, with infrared camera, we can detect people more easily.<\/p>\n\n\n\n
High dynamic range (HDR) scenes<\/li><\/ul>\n\n\n\n<\/figure>\n\n\n\n
During driving, it is inevitable to encounter with high dynamic range scenes. For example, driving out from a tunnel\/building, driving in dust, … etc. In the case of driving in dust shown as above, RGB camera can hardly detect objects while thermal camera has reasonable detection results.<\/p>\n\n\n\n
Motion blur<\/li><\/ul>\n\n\n\n<\/figure>\n\n\n\n
Motion blur is commonly seen with RGB cameras, especially in night scene for having longer exposure time. Yet, this problem does not exist with infrared cameras. As you can see, the image with motion blur does not detect the car and the person in the middle while infrared camera can detect them both.<\/p>\n\n\n\n
Detecting small objects<\/li><\/ul>\n\n\n\n<\/figure>\n\n\n\n
We also found that it is more difficult to detect small object with RGB cameras, but we can get detection results with infrared cameras.<\/p>\n","protected":false},"excerpt":{"rendered":"
Why Infrared Images? With the fast pace of development in deep learning, object detection has gained a huge progress. Among all of the different objects, living objects are the most important ones in autonomous driving. However, in some real-world scenarios, object detection with RGB cameras fail to generate reasonable detection results. Moreover, we found that … <\/p>\n
![\"This](\"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-content\/uploads\/sites\/33\/2020\/05\/Day_scene-1024x405.jpg\")
<\/figure>\n\n\n\n![\"This](\"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-content\/uploads\/sites\/33\/2020\/05\/Night_scene-1024x408.jpg\")
<\/figure>\n\n\n\n![\"This](\"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-content\/uploads\/sites\/33\/2020\/05\/HDR_scene-2-1024x437.jpg\")
<\/figure>\n\n\n\n![\"This](\"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-content\/uploads\/sites\/33\/2020\/05\/motion_blur-1-1024x405.jpg\")
<\/figure>\n\n\n\n![\"This](\"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-content\/uploads\/sites\/33\/2020\/05\/small_obj-1024x443.jpg\")
<\/figure>\n\n\n\n