Publication:
Video object segmentation using phase-base detection of moving object boundaries

dc.contributor.author To, Thang Long en_US
dc.date.accessioned 2022-03-22T09:11:01Z
dc.date.available 2022-03-22T09:11:01Z
dc.date.issued 2005 en_US
dc.description.abstract A video sequence often contains a number of objects. For each object, the motion of its projection on the video frames is affected by its movement in 3-D space, as well as the movement of the camera. Video object segmentation refers to the task of delineating and distinguishing different objects that exist in a series of video frames. Segmentation of moving objects from a two-dimensional video is difficult due to the lack of depth information at the boundaries between different objects. As the motion incoherency of a region is intrinsically linked to the presence of such boundaries and vice versa, a failure to recognise a discontinuity in the motion field, or the use of an incorrect motion, often leads directly to errors in the segmentation result. In addition, many defects in a segmentation mask are also located in the vicinity of moving object boundaries, due to the unreliability of motion estimation in these regions. The approach to segmentation in this work comprises of three stages. In the first part, a phase-based method is devised for detection of moving object boundaries. This detection scheme is based on the characteristics of a phase-matched difference image, and is shown to be sensitive to even small disruptions to a coherent motion field. In the second part, a spatio-temporal approach for object segmentation is introduced, which involves a spatial segmentation in the detected boundary region, followed by a motion-based region-merging operation using three temporally adjacent video frames. In the third stage, a multiple-frame approach for stabilisation of object masks is introduced to alleviate the defects which may have existed earlier in a local segmentation, and to improve upon the temporal consistency of object boundaries in the segmentation masks along a sequence. The feasibility of the proposed work is demonstrated at each stage through examples carried out on a number of real video sequences. In the presence of another object motion, the phase-based boundary detection method is shown to be much more sensitive than direct measures such as sum-of-squared error on a motion-compensated difference image. The three-frame segmentation scheme also compares favourably with a recently proposed method initiated from a non-selective spatial segmentation. In addition, improvements in the quality of the object masks after the stabilisation stage are also observed both quantitatively and visually. The final segmentation result is then used in an experimental object-based video compression framework, which also shows improvements in efficiency over a contemporary video coding method. en_US
dc.identifier.uri http://hdl.handle.net/1959.4/38705
dc.language English
dc.language.iso EN en_US
dc.publisher UNSW, Sydney en_US
dc.rights CC BY-NC-ND 3.0 en_US
dc.rights.uri https://creativecommons.org/licenses/by-nc-nd/3.0/au/ en_US
dc.subject.other Boundaries en_US
dc.subject.other boundary en_US
dc.subject.other clustering en_US
dc.subject.other compression en_US
dc.subject.other object en_US
dc.subject.other objects en_US
dc.subject.other phase correlation en_US
dc.subject.other segmentation en_US
dc.subject.other spatial en_US
dc.subject.other stability en_US
dc.subject.other temporal en_US
dc.subject.other video en_US
dc.subject.other extraction en_US
dc.subject.other extract en_US
dc.subject.other images en_US
dc.subject.other integration en_US
dc.subject.other mask en_US
dc.subject.other move en_US
dc.subject.other moving en_US
dc.subject.other motion en_US
dc.title Video object segmentation using phase-base detection of moving object boundaries en_US
dc.type Thesis en_US
dcterms.accessRights open access
dcterms.rightsHolder To, Thang Long
dspace.entity.type Publication en_US
unsw.accessRights.uri https://purl.org/coar/access_right/c_abf2
unsw.identifier.doi https://doi.org/10.26190/unsworks/18093
unsw.relation.faculty UNSW Canberra
unsw.relation.originalPublicationAffiliation To, Thang Long, Information Technology & Electrical Engineering, Australian Defence Force Academy, UNSW en_US
unsw.relation.school School of Engineering and Information Technology *
unsw.thesis.degreetype PhD Doctorate en_US
Files
Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
whole.pdf
Size:
8.75 MB
Format:
application/pdf
Description:
Resource type