USPatent applicationPatented

Macroblock-based object-oriented coding method of image sequence having a stationary background

Granted 24 Jun 2003 · 1 office action

Application· this page
9497138
filed 3 Feb 2000
Publication
Not published
not published
Patent
US 6,584,229
granted 24 Jun 2003

Life of the application

17 dated events
⤢ drag to zoom20002002200420062008201020122014201620182020ProsecutionOwnershipDisputesTerm & fees
ProsecutionOwnershipDisputesTerm & feeshover for detail · click to open

Abstract

A method, for an use at an macroblock-based object oriented coding of image sequence having a stationary background comprising the steps of: dividing a background region and an object region from an inputted video; determining an coding techniques, for an individual macroblock belonging to each divided region, as a macro block-based object-oriented coding of image sequence having a stationary back ground or a discrete cosine transformation object-oriented coding of image sequence having a moving object region; coding the method information, by which each macroblock is coded, on condition that the total area of each region is identical to the area of the screen; and storing or transmitting the coded data.

Description

5 parts
›FIELD OF THE INVENTION

The present invention relates to a method and apparatus for providing macroblock-based object-oriented coding method of image sequence having a stationary background, which is capable of providing a real time coding process of the image sequence at a low-performance system and reducing the size of video information to be transmitted or stored in an effective manner.

›DESCRIPTION OF THE PRIOR ART

Since a video telephone system utilizing moving picture generally uses a communication channel having a extremely limited transmission bandwidth, it is unavoidable to compress image signals in order to reduce the size of video information to be transmitted. One of conventional video compression techniques for reducing the size of information is an object-based coding technique, by which an image is divided into a back ground region and a foreground object region and each region is encoded separately. That is, the input image signal is divided into the background region having little motion and changes, and the foreground object region having large motion and changes, wherein the input image signal includes a plurality of video frames and each frame includes a multiplicity of macro-blocks, each macroblock having 16×16 pixels. Each divided region is coded by using a conventional macro block-based image coding technique, such as known discrete cosine transformation and quantization techniques. In addition, shape information representing each divided region is separately coded and transmitted in order to reconstruct the image signal at a receive side.

Therefore, it is very important to efficiently divide the image signal into two regions and to code the shape information of each divided region at the very high compression rate in order to maximize the coding efficiency. A conventional region division technique divides the image signal in a pixel unit by use of temporal change information or spatial change information of the image signal. That is, the video is divided into a plurality of the regions according to estimating the brightness-change in the pixel unit, thereby, each pixel is estimated as a back ground region or an object region. And such a shape information of a pixel-unit is coded by the chain-type around the outline of each region.

Since very complicated processes should be executed in order to divide the video by the pixel unit in the case of using the object-based coding technique utilizing the conventional region division technique, it is difficult to embody such processes in real time. In addition, the conventional arts may reach a limitation to maximize the coding efficiency, because lots of bits are consumed in order to code and transmit the shape information of each region acquired by pixel unit. The coding rate of the shape information could not be lowered below a certain level, even though a total coding rate is lowered. Therefore, there is a problem that the merit of the object-based coding technique is not utilized efficiently in the case of coding at the low bit rate.

›SUMMARY OF INVENTION

It is, therefore, an object of the present invention to provide macroblock-based object-oriented coding method of image sequence having a stationary background which can be coded at a low coding bit rate, hereupon it is possible to embody such processes in real time at a low-performance system and to simply code the shape information of each region with the help of dividing a video not by pixel unit but by 16×16 pixels-sized macroblock-unit, and with the help of dividing the video into two regions and coding each region in order to solve the above-mentioned problems.

In order to achieve the mentioned objects, the present invention comprises: the first step, wherein the inputted video is to be divided into an background region and a foreground object region by unit of macroblock; the second step, wherein an appropriate coding technique for each macroblock, which belongs to the determined region, is to be determined; the third step, wherein a shape information of each region is to be coded according to above-determined coding technique; the forth step, wherein the pixel information of each region is to be coded after determining whether a pixel information for each macroblock is to be coded; and the fifth step, wherein the coded bitstream is to be transmitted or stored.

›BRIEF DESCRIPTION OF THE DRAWING

The objects and features of the present invention will become apparent from the following description of preferred embodiments given in conjunction with the accompanying drawings, in which:

FIG. 1 is a flow chart for illustrating a macroblock-based object-oriented coding technique of a video having a stationary background in accordance with the present invention.

›DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, a preferred embodiment of the present invention will be explained in conjunction with the accompanying drawings.

FIG. 1 is a high level flow-chart of the object-oriented coding technique in accordance with the present invention.

The input image or video signal includes a plurality of video frames and each frame includes a multiplicity of macro-blocks, each macroblock having 16×16 pixels.

First, the video signal is divided into a macroblock-based stationary back ground region and a macroblock-based moving object region by using the difference between a previous frame of the input video signal and a current frame of the input video at step 10 . An appropriate selection among the well-known techniques for such a region division technique is utilized, i.e. macroblock-based region division technique and a background mosaicking technique is utilized for the present invention. According to the above mentioned techniques, a test statistic is acquired by using the brightness difference between two input frames. And then each macroblock is divided into a changing region and a unchanging region by comparing this test statistic with the predetermined threshold value, thereon each macroblock is distinguished as a foreground object region and a back ground region. Hereby, the back ground region generated in accordance with the above mentioned technique is the mosaic of the background region.

After the region distinction is completed, a coding technique is determined for the macroblock belonging to each region at step 20 . At this step, the difference between the pixel value of the macroblock belonging to each region of the present frame and the pixel value of the macroblock belonging to the identical position of each region of the reconstructed previous frame. When this difference value is not bigger than the predetermined threshold value, it is determined that the macroblock data of the reconstructed previous frame is to be utilized. On the other hand, when this difference value is bigger than the predetermined threshold value, it is determined that the macroblock data of the current frame is to be coded by well-known macroblock coding technique.

According to each coding technique determined by the above-mentioned way, the shape information of each region is coded at step 30 . Macroblocks in the regions are categorized in three types in this shape coding technique, i.e., the pixel value of the macroblock of the current frame is to be coded for the macroblock, the pixel value of the macroblock of the reconstructed previous frame is to be reused, and the pixel value of the macroblock does not exist in the selected region. The information, that the macroblock belongs to which type among the three types, is to be coded.

The process for determining whether the coding process of the pixel value of the macroblock is to be executed or not is to be performed at step 40 . In the case of coding the pixel value, the coding process of the pixel value of each macroblock is to be executed. Hereto, a discrete cosine transformation, which is a widely used as a conventional video coding technique, i.e., a general coding technique, is executed for transformation, then quantization and variable-length coding technique is executed. Such coded data through these processes can be stored at the media, e.g., CD-Rom, or transmitted via a telecommunication network in accordance with the coding machine's purpose.

While the principal and the spirit of the present invention has been described entirely in accordance with the preferred embodiment, it is to be noticed that the embodiment is only illustrative and is not restricted to the limit. In addition, those skilled in the art would appreciate that other modification and variations may be made without departing from the spirit and scope of the present invention as set forth in the following claims.

Claims as granted

6 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

4 codes
IPC · International Patent Classification
Section G — Physics
  • G06T9/00
Section H — Electricity
  • H04N7/26
  • H04N7/36
USPC · US Patent Classification
382/243

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomJan 2000Jul 2000Jan 2001Jul 2001Jan 2002Jul 2002Jan 2003Jul 2003USPTOApplicantNon-final rejectionResponse after non-final
USPTOApplicanthover for detail · click to open
Pendency
3.4 y
1,237 days filing → grant
Office actions
1
non-final + final
Responses
1
no RCE
Examiner
Jose L. Couso
art unit 2621 · TC 2600
Citations: 3 back · 4 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom20002002200420062008201020122014201620182020Owner 1Owner 2Owner 3
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock