USPatent applicationPatented

Apparatus and method for controlling reverse-play for digital video bitstream

Granted 14 Oct 2008 · no office action yet

Life of the application

8 dated events
⤢ drag to zoom20042006200820102012201420162018202020222024ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

An apparatus and method of controlling a digital video (MPEG) player for reverse-play. The MPEG player is comprised of an I-frame buffer for storing I-pictures encoded from P-pictures by a video decoder, a B-frame buffer for storing B-pictures, and an I-frame encoder for decoding a P-picture into an I-picture. In the MPEG player, a picture group being played at present is decoded for reverse play and a previous picture group is decoded for preparation of the reverse-play. Reverse-play in soft 1-times (×1) by means of a frame memory of small capacity is achieved irrespective of the picture number and classes in picture groups.

Description

10 parts
›CROSS-REFERENCE TO RELATED APPLICATIONS

This U.S. non-provisional patent application claims priority under 35 U.S.C. § 119 of Korean Patent Application 2003-0037677 filed on Jun. 11, 2003, the entire contents of which are hereby incorporated by reference.

›BACKGROUND OF THE INVENTION · 1 of 2

The present invention relates to MPEG video players, and more particularly to apparatuses and methods of controlling buffers for reverse-play of MPEG video streams.

Generally, MPEG video players are configured to carry out operations of normal-play and reverse-play, in which compressed video bitstreams are provided from a digital video data storage media such as a digital video disc (DVD) or digital video recorder (DVR). DVRs include a hard disk drive and a large capacity memory.

According to the MPEG standard established by the International Organization of Standardization (ISO), MPEG video bitstreams are composed of a multiplicity of frame groups divided into intra-coded frames (I-frames), predictive-coded frames (P-frames), and bidirectionally predictive-coded frames (B-frames). The I-frames are independently coded and are the least efficiently coded of the three frame types. The P-frames are coded more efficiently than are the I-frames and are coded relative to the preciously coded I- or P-frame. The B-frames are coded the most efficiently of the three frame types and are coded relative to both the previous and the next I- or P-frames.

The video bitstreams in MPEG systems include more than one group of pictures (GOP), each of which is composed of a multiplicity of pictures (or frames). The picture groups are accessed in accordance with a reproducing order from the encoded I-frames to the P- or B-frames relative to the I-frames.

A typical method of reverse-play in a MPEG video player involves decoding bitstreams backwards from the reproducing order of a normal MPEG coded video bitstream. In reverse-play, it may be most desirable to reproduce the bitstreams in the direction opposite to the normal output order. However, there are practical limits to the P- or B-frames being reproduced completely unless the I-frames are not reproduced as reference frames for the associated frames (P or B).

One example of reverse-play technique for MPEG video bitstreams is proposed in Japanese Patent Application No. 06-262030 dated Sep. 29, 1994 (Japanese Publication No. 08-102913). The Japanese Application proposes decoding and playing back encoded video bitstreams in a backward order from the encoded order.

Referring to FIG. 1 , a conventional MPEG player 10 includes two switch circuits 2 and 4 and a data memory 6 at its input side. When the switch circuits 2 and 4 are connected at terminals A, an input data IN is connected to a video decoder 8 . When the switch circuits 2 and 4 are connected at terminals B, the input data IN is written into and read from the data memory 6 . In a reverse-play mode, the video decoder 8 decodes each frame and utilizing the data memory 6 and the frame memory 20 , outputs a reverse-play video data OUT. The data OUT is output in a backward direction of bitstream order. The pictures of each group are input in the forward direction and reversely played.

In more detail, when an I-picture is entered into the MPEG player 10 , the switch circuits 2 and 4 are switched to terminals A and a switch circuit 18 is closed. As a result, the I-picture is decoded by the video decoder 8 and then a reproduced I-picture data from the video decoder 8 is written into the frame memory 20 . When a P-picture is input in the same connection states of the switch circuits 2 , 4 , and 18 with the case of the I-picture, the P-picture is decoded by the video decoder 8 . Then, a differential image data decoded by the video decoder 8 and a motion vector data relative to the P-picture are applied to an adder 12 . The motion vector data is provided from a motion compensation circuit 14 . In this way, the frame memory 20 receives a predictive image data and a reproduced image data of the P-picture for storage. The predictive image data is obtained by the motion compensation circuit 14 , which is being used to obtain a reproduced P-picture data prior by one frame to a currently input P-picture or a reproduced I-picture data (e.g., the first P-picture among the group of pictures “GOPs”) by applying a frame selection data to the frame memory 20 . The reproduced image data of the P-picture is added to the decoded differential image data at the adder 12 .

When a B-picture is input, the switch circuits 2 and 4 are connected to their terminals B to transfer B-pictures among each GOP to the data memory 6 .

Thus, the MPEG video player 10 employs the data memory 6 at the front of the video decoder 8 for performing reverse-play operation. The I- and P-pictures are written into or read from the frame memory 20 , while the B-picture is written into or retrieved from the data memory 6 in a first-in last-out (FILO) fashion. The B-picture read from the data memory 6 is decoded and put into a motion compensation process with reference to the I-picture or the P-picture, and used as a reference frame corresponding to the decoded B-picture read from the memory 20 . After completing the process of motion compensation for the B-picture, the pictures are reversely reproduced in their corresponding GOPs in sequence.

However, in the conventional MPEG player 10 , reverse-play can only be performed for picture groups that have the same number of pictures. If there exists irregular numbers of pictures, information about a previous picture group is mismatched during reverse-play.

Further, in the conventional MPEG playing system, the I- and P-pictures used as reference frames are stored in the frame memory 20 in the form of raw data (YUV) while B-pictures are stored in compressed form. The pictures in proper numbers are read out from the data memory 6 to the reference frame and pictures of a previous GOP are rewritten into the read-out position of the data memory 6 . During reverse-play mode, when a current picture group is read out downwardly from the top to the bottom in the frame buffer, the next picture group is read out upwardly from the bottom to top in the sequence of first-in last-out (FILO). However, if the picture groups are different from each other in the number of pictures, it is impossible to conduct the reverse-play operation by such manner. And, as two pictures are read out for one reference frame, it is also impossible to conduct the reverse-play operation when their structures of the picture groups are different and there are continuous reference pictures.

›BACKGROUND OF THE INVENTION · 2 of 2

Accordingly, a need exists for a MPEG playing system which is capable of reverse-play for video bitstreams composed of picture groups with irregular picture numbers and/or types.

›SUMMARY OF THE INVENTION

An apparatus is provided for controlling reverse-play of a video bitstream, comprising a picture divider for classifying the video bitstream into intra-coded pictures, predictive-coded pictures, and bidirectional predictive-coded pictures, the video bitstream having a plurality of picture groups; a first frame buffer for storing the bidirectional predictive-coded pictures; a video decoder for decoding the predictive-coded pictures; a frame memory for storing the decoded predictive-coded pictures output from the video decoder; an intra-frame encoder for encoding the decoded predictive-coded pictures into an intra-coded picture format; a second frame buffer for storing the intra-coded pictures and the encoded intra-coded pictures; and a buffer controller for outputting the pictures stored in the first and second frame buffers to the video decoder in accordance with pointing information about the pictures stored in the first and second frame buffers; wherein during a reverse-play operation, a current-playing picture group is read out from the first and second frame buffers and the frame memory and then decoded, while a previous picture group of the current-playing picture group is received in a normal play direction and then decoded.

The video decoder processes the pictures stored in the first and second frame buffers in sub group units corresponding to the pointing information, each sub group including a reference picture that is associated with the pointing information.

In one embodiment, wherein the first and second frame buffers are configured to correspond with the maximum picture number of the picture group.

In another embodiment, the first and second frame buffers, and the frame memory are configured in eighteen, five, and five units, respectively, when the number of the pictures in the picture group is eighteen.

Preferably, the decoded predictive-coded pictures are encoded to have the same bit ratio as that of a first one of the intra-coded pictures of the picture group. The buffer controller processes a 1-time reverse-play operation.

A method is also provided for controlling first and second buffers for a reverse-play operation with a digital video bitstream in a MPEG system including a frame memory and a video decoder, comprising the steps of classifying the digital video bitstream having a plurality of picture groups into intra-coded pictures, predictive-coded pictures, and bidirectional predictive-coded pictures; decoding the predictive-coded pictures; storing the bidirectional predictive-coded pictures and the decoded predictive-coded pictures in the first frame buffer and the frame memory; encoding the decoded predictive-coded pictures into an intra-coded picture format; storing the intra-coded pictures and the encoded intra-coded pictures; and outputting the pictures which have been stored in the first and second frame buffers to the video decoder in accordance with pointing information about the pictures stored in the first and second frame buffers, wherein during a reverse-play operation, a current-playing picture group is read out from the first and second frame buffers and the frame memory and then decoded, while a previous picture group of the current-playing picture group is received in a normal play direction and then decoded.

The pictures stored in the first and second frame buffers are processed in sub group units corresponding to the pointing information, each sub group including a reference picture that is associated with the pointing information.

The decoded predictive-coded pictures are encoded to have the same bit ratio as that of a first one of the intra-coded pictures of the picture group.

›BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings illustrate exemplary embodiments of the present invention and, together with the description, serve to explain principles of the present invention. In the drawings:

FIG. 1 is a block diagram of a conventional MPEG player useable for reverse-play of video streams;

FIG. 2 is a block diagram of a MPEG video play system according to the present invention;

FIG. 3 is a block diagram of an MPEG player according to an exhibit of the present invention;

FIG. 4 illustrates structures of video streams for an input and reverse-play;

FIGS. 5A and 5B illustrate a configuration of using a frame buffer and a frame memory during a reverse-play of an input video stream in accordance with an embodiment of the present invention;

FIG. 6 illustrates a configuration of using the frame buffer and the frame memory during the reverse-play of an input video stream in accordance with another embodiment of the present invention; and

FIG. 7 illustrates a configuration of using the frame buffer with reference to a sequence of decoding grouped sub-pictures during a reverse-play according to an embodiment of the present invention.

›DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS · 1 of 5

Preferred embodiments of the present invention will be described below in more detail with reference to the accompanying drawings. The present invention may, however, be embodied in different forms and should not be constructed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Like numerals refer to like elements throughout the specification.

FIG. 2 is a block diagram of an MPEG system according to an embodiment of the present invention. Referring to FIG. 2 , in the MPEG system 30 , an MPEG video data storage medium 40 provides compressed video bitstreams to an MPEG player 100 . The compressed video bitstreams are restored by the MPEG player 100 and then output to the display unit 50 . If a reverse-play function key is active, the MPEG player 100 reproduces a currently played video bitstream to reverse image output data in accordance with the order of reverse-play and then sends them to the display unit 50 .

FIG. 3 shows a block diagram of the MPEG player 100 for a reverse-play operation shown in FIG. 2 . Referring to FIG. 3 , the MPEG player 100 is comprised of a B-frame buffer 150 , an I-frame buffer 160 , a buffer controller 170 , a video decoder 120 , and an I-frame encoder 140 . A picture divider 110 and a frame memory 130 are also included within the MPEG player 100 .

The picture divider 110 outputs I-, B-, and P-pictures extracted from an input video bitstream. The I-pictures are provided into the I-frame buffer 160 and the I-frame encoder 140 , while the B-pictures are provided to the B-frame buffer 150 . The P-pictures are transferred to the video decoder 120 .

The B-frame buffer 150 stores the B-pictures supplied from the picture divider 110 . The I-frame buffer 160 stores the I-pictures supplied from the picture divider 110 and I-pictures converted from the P-pictures. Here, the B- and P-pictures are stored in compressed form.

The video decoder 120 , e.g., an MPEG decoder, decodes the input video bitstreams for playing and then sends the decoded bitstreams into the frame memory 130 . During a reverse-play mode in accordance with the present invention, the video decoder 120 decodes the P-pictures and sends the decoded P-pictures to the frame memory 130 . MPEG decoders are well known to those skilled in the art.

The frame memory 130 transfers the decoded video bitstreams, provided by the video decoder 120 to the display unit 50 in sequence. In a reverse-play mode, video bitstream provided from the video decoder 120 for the reverse-play is stored in the frame memory 130 and then transferred to the display unit 50 in sequence. During this, the decoded P-pictures are applied to the I-frame encoder 140 from the frame memory 130 for the reverse-play.

The I-frame encoder 140 encodes the decoded P-pictures supplied from the frame memory 130 . The I-frame encoder 140 has a bit ratio decider 142 to determine a bit ratio corresponding to size information of the I-picture on the decoded P-picture. The decoded P-picture is encoded to an I-picture type with reference to the determined bit ratio, and then the encoded result is output to the I-frame buffer 160 . Within the same picture group, the P-picture is encoded with a target bit ratio corresponding to the size information of a heading I-picture. The reason the target bit ratio of the picture input into the I-frame encoder 140 is decided with reference to the size of the heading I-picture is because the probability of occurrence with a remarkable image transition is low in a picture group, as well as because pictures in a picture group are similar in complexity. In other words, as re-encoding the P-picture into the I-picture is encoding a similar image into the I-picture form, it is possible to obtain an efficient target bit ratio by utilizing the size information of the I-picture ahead of its picture group without additional processes or evaluation steps.

The buffer controller 170 generates a pointing information signal POINT to enable the B- and I-pictures, which are respectively stored in the B-frame buffer 150 and the I-frame buffer 160 , to be output to the video decoder 120 therefrom in the order of reverse-play. The pointing information signal POINT is used as information for indexing the order of reverse-play, by which each picture group is rearranged with sub groups, each including one reference picture, and the reverse-playing sequences for the reference pictures of the sub groups are managed to efficiently conduct a reverse-play mode for pictures groups which are different from each other in the number and types of pictures. Therefore, the I-pictures or the B-pictures are provided to the video decoder in sequence in accordance with the pointing information, and then the video decoder outputs decoded I- or B-pictures to be provided into the frame memory.

In the MPEG player 100 , if the previous picture group is arranged in the frame memory, an input video stream is introduced thereinto in the types of I-, B-, and P-pictures. The I-picture is stored in the I-frame buffer 160 without passing through the video decoder 120 . The P-picture is stored in the I-frame buffer 160 after passing through the video decoder 120 , the frame memory 130 , and the I-frame encoder 140 , in sequence. The B-picture is stored in the B-frame buffer 150 directly from the picture divider 110 .

For a picture group being played, pictures are stored in the B-frame buffer 150 nd the I-frame memory 130 . Therefore, for currently playing picture group, pictures are read out from the B-frame buffer 150 , the I-frame buffer 160 , the frame memory 130 , then decoded, and reversely played, by means of the buffer controller 170 .

In addition, to implement the soft 1-times (×1) reverse-play, a picture group just prior to a picture group currently being played must be ready for the reverse-play. Thus, in performing a reverse-play for the currently playing picture group, the previous picture group needs to be decoded. That means it is required of a frame buffer capable of storing the maximum number of pictures in a picture group, with which the 1-times reverse-play is realized by playing the pictures in the sequence opposite to that of storing therein. Here, the frame buffer is controlled to save memory space of the frame buffer. Pictures ready for the reverse-play in the frame buffer are read out therefrom by the video decoder in the reverse sequence thereof, and the position of the frame buffer, from which the pictures have been read out, is filled with new pictures provided from the previous picture group.

›DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS · 2 of 5

FIG. 4 illustrates structures of an input video bitstream provided from the digital video data storage media shown in FIG. 5 and a reverse-playing image output data. Each picture group (GOP) has a number of pictures. As an example, there is a maximum of 18 pictures in each GOP of a DVD video disc.

Referring to FIG. 4 , either the input video bitstream or the reverse-playing image output data is composed of two picture groups GOP 1 and GOP 2 . The picture groups are divided into a plurality of sub picture groups SUB 1 ˜SUB 12 in a predetermined picture cycle M, each picture group being composed of 6 sub groups. Here, the picture cycle M is 3, each sub picture group is formed of one I-picture or one P-picture, and two B-pictures.

As illustrated in FIG. 4 , the input video bitstream is entered into the MPEG player 100 in accordance with the sequence of transmission. When a reverse-play function key is activated, the reverse image output data is provided into the display unit. The MPEG player 100 decodes and reverse-plays the picture group GOP 2 introduced at present in accordance with the sequence of reverse-play, contemporaneously decoding the picture group GOP 1 (the previous picture group) that has been input earlier than GOP 2 .

If there exists irregular structures in the picture groups in the MPEG video bitstream, i.e., different numbers of pictures or various picture types in the picture groups, soft reverse-play cannot be accomplished without controlling the frame buffers dynamically and adaptively thereto in accordance with the structural varieties.

FIGS. 5A and 5B illustrate a method of controlling the frame buffers in a dynamic mode. Configurations of writing and reading with the I- and B-frame buffers and the frame memory during a reverse-play operation in the MPEG player according to an embodiment of the present invention are shown. This embodiment is applicable in the case that the picture groups have the same picture numbers and regular picture classes. The input video bitstream in FIG. 5 is composed of two picture groups, each of which is formed of 18 pictures.

If one picture group is stored in the B- and I-frame buffers 150 and 160 , a reverse-play operation is ready to begin. In the reverse-play operation, two picture groups are contemporaneously decoded, such that one of the picture group, stored in the frame buffers 150 and 160 and the frame memory 130 for reverse-play of the currently playing video, is decoded in reverse from the input sequence thereof. The other picture group is arranged in a forward direction, which is supplied from a storage medium such as a DVD medium or a hard disc. The reason of decoding cotemporaneous with the two picture groups is to prepare a reverse-play operation for a previous picture group, which is preliminarily input from a storage medium of video bitstream, while the currently playing picture group is read out from the frame buffer and the frame memory and decoded.

In efficiently controlling the frame buffers for a reverse-play mode, frames with forward directions, which are input from a storage medium of video bitstream for reverse-play, are stored in the B- and I-frame buffers in the upward direction from the bottom to the top. The reverse-play operation starts when one of picture groups is stored therein, and the sequence of playing is opposite to the sequence of storing. As the I- and B-frame buffers 160 and 150 are controlled by the pointing information of the buffer controller 170 , reverse-play operation is accomplished even for picture groups having irregular picture numbers and classes.

The I-frame buffer 160 , the B-frame buffer 150 and the frame memory 130 are associated with corresponding sizes of the picture groups. As illustrated in FIG. 5 , the procedures of writing and reading pictures in conjunction with decoding and displaying operations for the reverse-play mode are associated with structures of video bitstreams supplied from a video storage medium and video bitstreams to be displayed during the reverse-play mode. The structure shown in FIGS. 5A and 5B include five frame memories, five I-frame buffers, and thirteen B-frame buffers.

The I-frame buffer 160 and the B-frame buffer 150 are comprised in correspondence with the maximum number of pictures. In this embodiment, the frame memory 130 is associated with five frame buffers, one of which is further provided to be used for the reverse-play operation.

If a reverse-play function key is activated while the last frame P 35 of the second picture group is being played, the frames of the second picture group currently being played are read out from the frame buffers 150 and 160 and the frame memory 130 in the sequence of reverse-play and decoded. At the same time, the first picture group is stored in the frame buffers 150 and 160 and the frame memory 130 so as to be put into the reverse-play mode next to the second picture group. Therefore, after completing the reverse-play for the second picture group, the first picture group is read out from the frame memory 130 and a picture group prior to the first picture group is arranged for the reverse-play.

In operations of writing/reading the picture group in/from the frame memory 130 and the frame buffers 150 and 160 , the currently playing picture group and a previous picture group are contemporaneously decoded. While the currently playing picture group is read out from the frame memory 130 and the frame buffers 150 and 160 and then decoded, the previous picture group is received from an external storage medium for subsequent reverse-play operation. In this embodiment, a frame rate is assumed at 30 frames per second and one picture group is composed of eighteen pictures. And, as aforementioned, the MPEG player 100 is comprised of five frame memories, thirteen B-frame buffers, and five I-frame buffers. In FIG. 5 , the arrows indicating upward and downward directions denote the sequence of reading pictures by the video decoder 120 for the reverse-play operation.

›DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS · 3 of 5

Referring to FIG. 5B , I- and B-pictures in a currently playing picture group are stored in the frame memory 130 , the B-frame buffer 150 , and the I-frame buffer 160 . Empty spaces of the frame memory and buffers, after reading out the pictures, are filled with new pictures, and the frame buffers 150 and 160 is operable with writing and reading in a FILO manner. The I-pictures of the currently playing picture group, I 20 , I 23 , I 26 , and I 29 , are stored in the I-frame buffer 160 , while the B-pictures of the currently playing picture group, B 18 , B 19 , B 21 , B 22 , B 24 , B 25 , B 27 , B 28 , B 30 , B 31 , B 33 , and B 34 , are stored in the B-frame buffer 150 , in sequence.

If the reverse-play function key is activated when a current playing picture is P 35 , the frame memory 130 stores P 35 and P 32 as a reference picture of P 35 . And, a first reference picture of the previous picture group, I 2 , is decoded and then stored in the frame memory 130 . During this, the B-frame buffer 150 stores B 0 and B 1 which are grouped with I 2 when B 34 is decoded and displayed, and the frame memory 130 stores the decoded B 33 . When the B-picture B 33 is being displayed, the I-picture 129 is stored in the frame memory 130 after being read out from the I-frame buffer 160 and decoded. Then, a second reference picture of the previous picture group, P 5 , is decoded and stored in the I-frame buffer 160 .

When P-picture P 32 is being displayed, B 31 is read out from the B-frame buffer 150 , decoded, and then stored in the frame memory 130 . The P 5 is read out from the frame memory 130 and encoded into I-picture I 5 and stored in the I-frame buffer 160 . The B-frame buffer 150 stores B 3 and B 4 in sequence, which are grouped with the I-picture I 5 . When P-picture P 30 is being displayed, I 26 is read out from the I-frame buffer 160 , decoded, and then stored in the frame memory 130 . During this, P 8 of the previous picture group is decoded and stored in the frame memory 130 . As a result, I 29 , B 30 and B 31 are grouped into a single sub picture group.

When the I-picture I 29 is being displayed, P-picture P 8 is read out from the frame memory 130 and encoded to I-picture I 8 and stored in the I-frame buffer 160 . The B-picture B 28 is stored in the frame memory 130 after being read out from the B-frame buffer 150 and encoded. When B 28 is being displayed, the frame memory 130 stores B 27 and I 26 while the B-frame buffer 150 stores B 6 and B 7 which are grouped with I 8 . When the B-picture B 27 is being displayed, P 11 and I 23 of the previous picture group are decoded and stored in the frame memory 130 .

When the I-picture I 26 is being displayed, B 25 is decoded and stored in the frame memory 130 , while P 11 is decoded into I-picture I 11 and stored in the I-frame buffer 160 . When the B-picture B 25 is being displayed, B 24 is decoded and stored in the frame memory 130 . The B-frame buffer 150 stores B 9 and B 10 which are grouped with I 11 . Subsequently, when the B-picture B 24 is being displayed, I 20 is read out from the I-frame buffer 160 and then decoded, while p 14 of the previous picture group is decoded and stored in the frame memory 130 .

When I 23 is being displayed, B 22 is decoded and stored in the frame memory 130 , while P 14 is converted into an I-picture to be stored in the I-frame buffer 160 . When the B 22 is being displayed, B 21 is decoded and stored in the frame memory 130 , while B 12 and B 13 of the previous picture group are stored in the B-frame buffer 150 . When the B 21 is being displayed, P 17 of the previous picture group is decoded and stored in the frame memory 130 to prepare the reverse-play for B 18 and B 19 .

When I 20 is being displayed, B 19 is decoded and stored in the frame memory 130 . When B 19 is being displayed, B 18 is decoded and B 15 and B 16 are stored in the B-frame buffer 150 . While B 16 is being displayed, I 14 of the previous picture group is decoded and stored in the frame memory 130 for the reverse-play of the currently playing picture group, preparing the reverse-play for the previous picture group. At this time, a picture group prior to the current picture group by two picture group terms is arranged for the reverse-play. In other words, a first reference picture I (- 16 ) of the second previous picture group is decoded and stored in the frame memory 130 , while I 14 is read out from the I-frame buffer 160 and decoded to be stored in the frame memory 130 to arrange the reverse-play for B 15 and B 16 of the precious picture group.

As aforementioned, a reverse-operation mode according to embodiments of the present invention provides a simultaneous function of arranging a previous picture group for subsequent reverse-play operation while a current picture group is being reverse-played.

As an example, during reverse-play for the previous picture group with reference to FIG. 5A , when P 17 is being displayed, B 16 is decoded while the I-picture I (- 16 ) of the second previous picture group is decoded and stored in the I-frame buffer 160 . The P-picture P 17 is directly output from the frame memory 130 and then displayed. When B 16 is being displayed, B 15 is decoded and stored into the frame memory 130 while the beginning reference pictures B (- 18 ) and B (- 17 ) that belong to the second previous picture group are stored in the B-frame buffer 150 . And, when B 15 is being displayed, B 15 is decoded while the next reference picture B (- 13 ) of the second previous picture group and I 11 of the previous picture group are decoded and stored into the frame memory 130 .

When the I-picture is being displayed, P (- 13 ) is decoded into an I-picture to be stored in the I-frame buffer 160 while B 13 is decoded and stored in the frame memory 130 . When B 13 is being displayed, B 12 is read out from the B-frame buffer 150 and decoded while B (- 15 ) and B (- 14 ) of the second previous picture group are stored in the B-frame buffer 150 . When B 12 is being displayed, B 12 is read out from the frame memory 130 and I 8 is read out from the I-frame buffer 160 and decoded, while P (- 12 ) of the second previous picture group is decoded and stored in the frame memory 130 .

›DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS · 4 of 5

When the P-picture P 11 is being displayed, I 11 is output from the frame memory 130 while B 10 is read out from the B-frame buffer 150 , decoded, and stored in the frame memory 130 . During this, P (- 10 ) is read out and decoded into an I-picture to be stored into the I-frame buffer 160 . When the B 10 is being displayed, B 9 is read out from the B-frame buffer 150 and then decoded while B (- 12 ) and B (- 11 ) of the second previous picture group are stored in the B-frame buffer 150 . Next, when B 9 is being displayed, the B 9 is read out from the frame memory 130 and I 5 read from the I-frame buffer 160 is decoded and stored in the frame memory 130 , while p (- 7 ) of the second previous picture group is decoded and stored in the frame memory 130 .

When the P-picture P 8 is being displayed, I 8 is read out from the frame memory 130 , while B 7 is read out from the B-frame buffer 150 and decoded to be stored in the frame memory 130 . The P (- 7 ) of the second precious picture group is encoded into an I-picture and then stored into the frame memory 130 . When the B 7 is being displayed, B 6 is read out from the B-frame buffer 150 and decoded to be stored in the frame memory 130 , while B (- 9 ) and B (- 8 ) of the second previous picture group are stored in the B-frame buffer 150 . Continuously, when the B 6 is being displayed, I 2 of the previous picture group is read out from the I-frame buffer 160 and decoded to be stored in the frame memory 130 , while P (- 4 ) of the second previous picture group is decoded and stored in the frame memory 130 .

When P 5 is being displayed, B 4 is read out from the B-frame buffer 150 and decoded to be stored in the frame memory 130 , while P (- 4 ) read out from the frame memory 130 is encoded into an I-picture and stored in the I-frame buffer 160 . When the B 4 is being displayed, B 3 read out from the B-frame buffer 150 is decoded and stored in the frame memory 130 , while B (- 6 ) an B (- 5 ) of the second previous picture group are stored in the B-frame buffer 150 . And, when the B 3 is being displayed, the B 3 is read out from the frame memory 130 , while P (- 1 ) of the second previous picture group is decoded and stored in the frame memory 130 .

When the I 2 is being displayed, the I 2 is read out from the frame memory 130 , while B 1 is read out from the B-frame buffer 150 and decoded to be stored in the frame memory 130 . When the B 1 is being displayed, the B 1 is read out from the frame memory 130 , while B 0 is read out from the B-frame buffer 150 and decoded to be stored in the frame memory 130 . During this, the B-frame buffer 150 stores B 9 - 3 ) and B (- 2 ) of the second previous picture group. In such way, reverse-play is accomplished for a third previous picture group.

Referring to FIG. 6 , an input video bitstream includes first through third picture groups GOP 1 ˜GOP 3 having different picture numbers and classes. The first picture group GOP 1 has six pictures, the second picture group GOP 2 has four pictures, and the third picture group GOP 3 has twelve pictures. Further, the classes of the pictures throughout the groups GOP 1 ˜GOP 3 are in irregular patterns.

When the reverse-play function key is activated during a playing mode, the picture divider 110 classifies an input video bitstream into B-pictures, P-pictures, and I-pictures. The B-pictures are stored in the B-frame buffer 150 , while the I-pictures and encoded I-pictures from the P-pictures are stored in the I-frame buffer 160 . The currently playing picture group GOP 3 is read out from the frame buffers 150 and 160 and the frame memory 130 , decoded, and then reproduced in the reverse-play mode, while the previous picture groups are decoded before the reverse-play subsequent thereto. During this, the MPEG player 100 processes the reverse-play operation and manage the orders of sub picture groups composed of a reference picture (i.e., a single I-picture), B-pictures, or simply a reference picture, through the buffer controller 170 when the pictures are stored in the frame buffers 150 and 160 .

For instance, if there is an input of the reverse-play function key while B 20 of the third picture group GOP 3 is being played, a previous reference picture P 18 is encoded into I 18 to prepare a reverse-play operation for B 20 and B 19 , forming a sub picture group with P 18 , B 19 , and B 10 . Similarly, P 15 is decoded and grouped in a sub picture group to conduct a reverse-play operation for B 16 and B 17 . As the buffer controller 170 manages the reverse-playing order of the grouped sub pictures, the reverse-play operation for the picture groups different in picture numbers and classes is performed.

As aforementioned, the MPEG player reads the pictures of the picture groups which are currently being played from the frame memory and decodes them in response to an activated reverse-play function key, at the same time, pictures of the previous picture groups are read and decoded and then stored in the frame buffers for preparing successive processes of the reverse-play operation. The classified I- and B-pictures are stored in the I-frame buffer and the B-frame buffer, respectively, while the P-pictures are decoded by the video decoder and then stored in the frame memory. Subsequently, the P-pictures are converted into I-pictures by the I-frame encoder and then stored in the I-frame buffer again. Here, the pictures stored in the frame buffers are grouped with a reference picture therein to be associated with pointing information for a sequential reverse-play operation by the buffer controller.

Then, the I- and B-pictures are read out and decoded by the video decoder, and grouped with their corresponding pictures and stored in the frame memory. As a result, the pictures stored in the frame memory are output as data to be used in the reverse-play operation.

FIG. 7 illustrates a configuration of using the frame buffer with reference to a sequence of decoding the grouped sub pictures during the reverse-play according to the present invention.

›DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS · 5 of 5

Referring to FIG. 7 , the reverse-play is able to begin a first buffer state (a). On the sequence of the reverse-play, while the B-picture B 20 is the first one to be displayed, the P-pictures P 23 and P 20 should be decoded because the B 22 is the bi-directionally predictive coded picture. In other words, the converted picture I 23 is first decoded and next the I 20 is decoded. The arrows within the frame buffers in FIG. 7 denote the sequence of decoding.

An I-picture used as the reference picture on the decoding sequence is grouped with a B-picture subsequent to the next I-picture. As shown in FIG. 7 , the B-pictures accompanying with the I-picture I 14 are B 16 and B 15 consecutive to B 17 .

To process the picture groups having irregular picture numbers and classes without malfunction, linking of the decoding sequences for the pictures is arranged by means of the buffer controller shown in FIG. 1 . The buffer controller 170 makes it possible to conduct the reverse-play operation for the picture groups having irregular picture numbers and classes by managing the decoding sequence of the reference pictures of the sub picture groups between corresponding pictures.

Further referring to FIG. 7 , a sequential decoding operation with the frame buffers 150 and 160 under a second buffer state (b) is as follows.

At the beginning of a reverse-play mode, the MPEG player 100 reads a first picture of a picture group that is currently being played. In this embodiment and for illustration, it is assumed that I 14 is the first picture to be stored in the frame buffers 150 and 160 , being grouped with the B-pictures B 16 and B 15 subsequent to the next reference picture, and the buffer controller arranges the decoding sequence on I 14 —>B 16 —>B 15 . B 12 and B 13 are still not grouped at present because they will be grouped with the last reference picture of the previous picture group. The next B-picture P 17 is transformed into I 17 and then stored in the frame buffers 150 and 160 and grouped with B 19 and B 18 . During this, the buffer controller 170 arranges the decoding sequence on I 17 —>B 19 —>B 18 —>I 14 —>B 16 —>B 15 . The other pictures consecutive thereto are stored and arranged in the same manner as shown in FIG. 7 .

With such method of controlling the buffers, as the buffer controller 170 coupled the pointing information associated with the decoding sequences to the pictures even though new pictures are stored in specific positions of the frame buffers 150 and 160 , reverse-play operations are accomplished irrespective of such irregular picture numbers and classes in the picture groups.

Moreover, even if a reference picture, not a B-picture, appears again after the next reference picture, a current reference picture is not grouped with its corresponding B-pictures but independently stored in the buffer and associated with a picture to be next decoded.

Although the present invention has been described in connection with the embodiment of the present invention illustrated in the accompanying drawings, it is not limited thereto. It will be apparent to those skilled in the art that various substitution, modifications and changes may be thereto without departing from the scope and spirit of the invention.

Claims as granted

12 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

5 codes
IPC · International Patent Classification
Section H — Electricity
  • H04N5/76
  • H04N7/26
  • H04N5/783
USPC · US Patent Classification
386/68386/111

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomJul 2004Jan 2005Jul 2005Jan 2006Jul 2006Jan 2007Jul 2007Jan 2008Jul 2008Jan 2009USPTOApplicantNotice of allowanceNotice of allowance
USPTOApplicanthover for detail · click to open
Pendency
4.4 y
1,594 days filing → grant
Office actions
0
none on record
Responses
0
1 RCE
Examiner
Thai Tran
art unit 2621 · TC 2600
Citations: 6 back · 6 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom20042006200820102012201420162018202020222024Owner 1
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock