Please use this identifier to cite or link to this item:
https://hdl.handle.net/2440/130358
Citations | ||
Scopus | Web of Science® | Altmetric |
---|---|---|
?
|
?
|
Type: | Journal article |
Title: | Motion segmentation of RGB-D sequences: combining semantic and motion information using statistical inference |
Author: | Muthu, S. Tennakoon, R. Rathnayake, T. Hoseinnezhad, R. Suter, D. Bab-Hadiashar, A. |
Citation: | IEEE Transactions on Image Processing, 2020; 29:5557-5570 |
Publisher: | IEEE |
Issue Date: | 2020 |
ISSN: | 1057-7149 1941-0042 |
Statement of Responsibility: | Sundaram Muthu, Ruwan Tennakoon, Tharindu Rathnayake, Reza Hoseinnezhad, David Suter, and Alireza Bab-Hadiashar |
Abstract: | This paper presents an innovative method for motion segmentation in RGB-D dynamic videos with multiple moving objects. The focus is on finding static, small or slow moving objects (often overlooked by other methods) that their inclusion can improve the motion segmentation results. In our approach, semantic object based segmentation and motion cues are combined to estimate the number of moving objects, their motion parameters and perform segmentation. Selective object-based sampling and correspondence matching are used to estimate object specific motion parameters. The main issue with such an approach is the over segmentation of moving parts due to the fact that different objects can have the same motion (e.g. background objects). To resolve this issue, we propose to identify objects with similar motions by characterizing each motion by a distribution of a simple metric and using a statistical inference theory to assess their similarities. To demonstrate the significance of the proposed statistical inference, we present an ablation study, with and without static objects inclusion, on SLAM accuracy using the TUM-RGBD dataset. To test the effectiveness of the proposed method for finding small or slow moving objects, we applied the method to RGB-D MultiBody and SBM-RGBD motion segmentation datasets. The results showed that we can improve the accuracy of motion segmentation for small objects while remaining competitive on overall measures. |
Keywords: | RGB-D motion segmentation; multibody structure and motion; dynamic SLAM; EVT; Kolmogorov–Smirnov test |
Rights: | © 2020 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See https://www.ieee.org/publications/rights/index.html for more information. |
DOI: | 10.1109/TIP.2020.2984893 |
Grant ID: | http://purl.org/au-research/grants/arc/LP160100662 |
Published version: | http://dx.doi.org/10.1109/tip.2020.2984893 |
Appears in Collections: | Aurora harvest 4 Computer Science publications |
Files in This Item:
There are no files associated with this item.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.