USPatent applicationPatented

System and method for processing a high definition television (HDTV) image

Granted 15 Jun 2010 · 8 office actions

Life of the application

30 dated events
⤢ drag to zoom20052010201520202025ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

The present invention provides a system and method for processing a High Definition Television (HDTV) image. Specifically, the system and method of the present invention provides a plurality of programmable encoders connected in parallel and directly (i.e., gluelessly) attached to a HDTV video source. The system and method of the present invention allows a fall HDTV image to be received by each encoder at 74.25 MHz directly from the HDTV video source. Based on programming, each encoder will process only a portion of the full image.

Description

5 parts
›BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention generally relates to a system and method for processing a High Definition Television (HDTV) image. More particularly, the present invention provides a plurality of encoders connected in parallel and directly attached to a HDTV video source for processing a HDTV image.

2. Background Art

The advent of the High Definition Television (HDTV) standard, and the requirement to perform Moving Pictures Experts Group (MPEG) video compression on images in the HDTV format, has created significant video data processing demands on MPEG-2 encoder Application Specific Integrated Circuits (ASICs). Specifically, encoders that compress video data in Standard Definition (SD) format typically process 480 active video lines (i.e., out of a total of 525 lines per video frame) consisting of 720 active luminance and chrominance pixels (i.e., out of a total of 858) at a 13.5 MHz pixel clock rate for an input rate of 30 frames per second. Conversely, a MPEG-2 encoder must typically process incoming HDTV pixel data (e.g., one luminance and one chrominance pixel data byte) 5-6 times faster to yield the same input rate of 30 frames per second. That is, 1080 or 1088 active video lines (i.e., out of a total of 1125 lines per video frame) consisting of 1920 active luminance and chrominance pixels (i.e., out of a total of 2200) per line are scanned into the encoder at a pixel clock rate of 74.25 MHz.

With present technology, it is generally not feasible to for a single MPEG-2 encoder to process/compress HDTV images at full resolution (i.e., 5-6 times faster than for Standard Definition). It is therefore necessary to have a HDTV MPEG-2 video architecture that utilizes multiple encoders to process a single HDTV image at fill resolution. With such an architecture, an image must be split horizontally or vertically into multiple portions for processing by the encoders. In splitting the HDTV image, problems arise in that a large amount of logic and memory, external to the encoders, is required. Specifically, external logic must be provided to buffer and split the HDTV image into smaller portions. The external logic would then send a particular portion of the HDTV image to each of the encoders.

An additional problem often encountered is that many encoders can accept pixel data only at the Standard Definition pixel clock rate of 13.5 MHz. As indicated above, the HDTV pixel clock rate is approximately 74.25 MHz. Thus, the external logic may be forced to accept data at 74.25 MHz, but transmit the data to the encoders at 13.5 MHz. Providing this capability adds more complexity to the external control logic as well as significantly more external memory buffers. Accordingly, the requirement for system designers to include external splitter and control logic (collectively referred to as glue logic) significantly drives up the overall system cost and complexity.

In view of the foregoing, there exists a need for a system and method for processing a HDTV image. In addition, there exists a need for a system and method for directly attaching a plurality of video encoders to a HDTV video source such that external splitter and control logic is not required. In addition, there exists a need for the encoders to be programmable so that each encoder receives an entire HDTV image from the HDTV video source, but processes only a portion thereof.

›SUMMARY OF THE INVENTION

The present invention provides a system and method for processing a HDTV image. Specifically, the present invention provides a plurality of video encoders connected in parallel and directly (e.g., gluelessly) attached to a HDTV video source. Each of the encoders receives an entire image from the HDTV video source but, through programming, processes only a portion thereof. This architecture obviates the need for splitter and control logic between the encoders and the HDTV video source. This also allows the encoders to receive the image at the HDTV rate of 74.25 MHz.

According to a first aspect of the present invention, a system for processing a High Definition Television (HDTV) image is provided. The system comprises: (1) a plurality of video encoders connected in parallel; (2) wherein each of the encoders receives an entire image from a HDTV video source; and (2) wherein each of the encoders is programable for processing only a portion of the entire image.

According to a second aspect of the present invention, a system for processing a High Definition Television (HDTV) image is provided. The system comprises: (1) a plurality of video encoders connected in parallel and directly attached to a HDTV video source; and (2) wherein each of the encoders receives an entire image from the HDTV video source, and wherein each of the encoders is programable for processing only a portion of the entire image.

According to a third aspect of the present invention, a method for processing a High Definition Television (HDTV) image is provided. The method comprises the steps of: (1) providing a plurality of video encoders connected in parallel and directly attached to a HDTV video source; and (2) programming each of the encoders to process only a portion of an entire image received from the HDTV video source.

Therefore, the present invention provides a system and method for processing a HDTV image.

›BRIEF DESCRIPTION OF THE DRAWINGS

These and other features of this invention will be more readily understood from the following detailed description of the various aspects of the invention taken in conjunction with the accompanying drawings in which:

FIG. 1 depicts a related art architecture.

FIG. 2 depicts a plurality of encoders connected in parallel and directly attached to an HDTV video source, according to the present invention.

FIG. 3 depicts an exemplary image being processed, according to the present invention.

FIG. 4 depicts an exemplary method flow diagram, according to the present invention.

The drawings are merely schematic representations, not intended to portray specific parameters of the invention. The drawings are intended to depict only typical embodiments of the invention, and therefore should not be considered as limiting the scope of the invention. In the drawings, like numbering represents like elements.

›DETAILED DESCRIPTION OF THE INVENTION · 1 of 2

In general, the present invention provides a system and method for processing a High Definition Television (HDTV) image in which a plurality of encoders are directly/gluelessly attached to a HDTV video source. As indicated above, multiple MPEG-2 encoders are generally required to process a HDTV image because no single encoder can process the entire image. Moreover, most existing MPEG-2 encoders cannot receive HDTV data signals at the HDTV rate of 74.25 MHz. Rather, most encoders must receive the HDTV data signals at the Standard Definition (SD) rate of 13.5 MHz. Accordingly, existing architectures generally require complex splitter and control logic to be interposed between the encoders and the HDTV video source. The splitter logic will partition each HDTV image into portions, and feed each encoder with a single portion. The control logic will slow the HDTV data signals down to the SD rate of 13.5 MHz so that the encoders can accurately process the images therein. As indicated above, however, such architectures are both costly and complex.

Referring now to FIG. 1 , a related art architecture 10 is shown. As depicted, architecture 10 includes encoders 26 A-F and HDTV video source 12 . In order for a HDTV image within data signal 28 from HDTV video source 12 to be processed by encoders 26 A-F, it must first be processed by buffers 18 A-B, input First In—First Outs (FIFOs) 22 A-F and pixel CMOS Programmable Logic Devices (CPLDs) 24 A-F. Specifically, as shown, data signal 28 and pixel clock signal 30 (collectively referred to as HDTV interface 14 ) are received in HD splitter card 16 from HDTV video source 12 . Splitter card 16 drives data signal 28 and pixel clock signal 30 to enable writing to input FIFOs 22 A-F. To this extent, splitter card 16 outputs a thirty-two bit HDTV video data signal 32 to the appropriate input FIFO 22 A-F (through buffers 18 A-B) and a set of control signals 34 to splitter control CPLD 20 . Specifically, splitter card 16 splits an incoming HDTV video data signal 28 (e.g., having a HDTV image) into smaller individual pieces, and feeds an output HDTV video data signal 32 to buffers 18 A-B. Buffer 18 A re-drives video data signal 32 to input FIFOs 22 A-C, while buffer 18 B re-drives video data signal 32 to input FIFOs 22 D-F.

Input FIFOs 22 A-F are read sixteen bits at a time, and video data signal 32 is input to encoders 26 A-F for compression. The reading of input FIFOs 22 A-F can be driven by either splitter card 16 or by pixel CPLDs 24 A-F (i.e., shown interposed between encoders 26 A-F and input FIFOs 22 A-F). Another function of pixel CPLDs 24 A-F would be to extract the video synch from video data signal 32 and supply the synch to encoders 26 A-F.

As shown in FIG. 1 , several intervening pieces of “glue” logic (i.e., splitter 16 , buffers 18 A-B, splitter control CPLD 20 , input FIFOs 22 A-F and pixel CPLDs 24 A-F) are required to process a HDTV data signal. Such logic ensures both that each encoder 26 A-F receives only a portion of a HDTV image to be processed (e.g., compressed), and that the image portion is received at the SD clock rate of 13.5 MHz. For example, if an image from HDTV video source 12 has a size of 900 lines and a clock rate of 74.25 MHz, the logic shown in FIG. 1 will split the image into six distinct portions (i.e., one portion for each encoder 26 A-F) that each have a size of approximately 150 lines. Each encoder 26 A-F will then receive a different 150 line portion (assuming no overlap) at a clock rate of 13.5 MHz.

Referring now to FIG. 2 , an exemplary architecture 50 according to the present invention is shown. The architecture shown in FIG. 2 allows encoders 56 A-F to receive an entire HDTV image at the HDTV clock rate of 74.25 MHz. Thus, the need for intervening glue logic (e.g., splitter and control logic) is obviated.

As depicted, MPEG-2 encoders 56 A-F are connected in parallel and are directly (e.g., gluelessly) attached to HDTV video source 52 . Under the present invention, each encoder 56 A-F receives HDTV video data signal 64 and pixel clock signal 66 (collectively referred to as Society of Moving Pictures and Television Engineers (SMPTE) 274 -M HDTV interface 54 ) directly from HDTV video source 52 . Thus, instead of receiving only a portion of a HDTV image (as in the related art), encoders 56 A-F of the present invention will receive an entire HDTV image. As such, each encoder 56 A-F will typically receive 30 frames per second of HDTV data (e.g., containing HDTV image(s)) consisting of 1080 or 1088 active video lines (i.e., out of a total of 1125 lines per video frame) having 1920 active luminance and chrominance pixels (i.e., out of a total of 2200) per line.

Although each encoder 56 A-F will receive an entire HDTV image, no single encoder can process the entire image, as explained above. Thus, the processing must be divided among encoders 56 A-F. Processing system 60 provides this functionality. Specifically, each encoder 56 A-F includes a digital video input interface 58 that includes processing system 60 , which comprises one or more programmable registers 62 . In a typical embodiment, registers 62 are programmed with processing information such as: (1) a quantity of encoders 56 A-F in the configuration; (2) a relative position of each encoder with respect to one another within the configuration; (3) whether a HDTV image is to be processed horizontally or vertically; (4) a quantity of pixels or lines that adjacent portions should overlap; and (5) an overall image size in pixels or lines based on the processing orientation. Thus, for the exemplary architecture 50 shown in FIG. 2 , the five registers 62 of encoder 56 A could be programmed as follows: (1) six; (2) first; (3) vertically; (4) 16 pixels; and (5) 1920 pixels. Once registers 62 have been programmed, internal micro-programming within encoders 56 A-F is guided by the programmed information, resulting in internal register settings that are tailored for each encoder 56 A-F. The end result is that each encoder 56 A-F processes a different section of the full HDTV image. It should be understood that separate registers have been shown for exemplary purposes only, and other variations may be implemented.

›DETAILED DESCRIPTION OF THE INVENTION · 2 of 2

Referring now to FIG. 3 , an exemplary HDTV image 100 processed under the present invention is shown. Image 100 is intended to be representative of a 1920 pixel HDTV image. If registers 62 are programmed for a vertical processing orientation and a 16 pixel overlap, each encoder 56 A-F will have the following programming:

In general, image 100 will be divided into six portions 102 A-F (i.e., one portion for each encoder 56 A-F). The portions are generally equal with the exception of any programmed overlap. Portion 102 A will be processed by encoder 56 A, while portions 102 B-F will be processed by encoders 56 B-F, respectively. As further shown in FIG. 3 , portions 102 A-F have been provided with overlap. Specifically, as indicated in the above table, an overlap of 16 pixel was programmed for encoders 56 A and 56 F, while an overlap of 32 pixels was programmed for encoders 56 B-E. The overlap refers to the amount that an image portion will overlap with an adjacent image portion. For example, portion 102 B is programmed for 32 pixels of overlap. Thus, portion 102 B overlaps with portion 102 A by 16 pixels and portion 102 C by 16 pixels (for a total overlap of 32 pixels). Since portions 102 A and 102 F are on the edge of image 100 , they will only overlap with one other portion (i.e., 102 B and 102 E, respectively). Accordingly, portions 102 A and 102 F have a total overlap of only 16 pixels. To this extent, the relative position of a particular encoder with respect to the other encoders ( e.g., first, second, etc.) is important in determining overlap.

Overlap helps ensure that motion vector(s) based on “best matched” macro blocks from adjacent portions of HDTV image 100 can be generated (i.e., motion estimation overlap in HDTV image processing). It should be understood that overlap as described herein is optional, and that image processing could be provided with no overlap. In such a case, portions 102 A-F would be contiguous. Moreover, it should be appreciated that image 100 is described herein as being processed vertically for exemplary purposes only, and that the same concepts could be applied to the horizontal processing of image 100 .

Referring now to FIG. 4 , an exemplary method flow diagram 200 according to the present invention is shown. First step 202 is to provide a plurality of encoders connected in parallel and directly attached to a HDTV video source. Next step 204 is to program each encoder 56 A-F (i.e., as described above). Once programmed, an entire HDTV image is received by each encoder 56 A-F from HDTV video source 52 at 74.25 MHz in step 206 . Based on the programming, each encoder 56 A-F will process only a portion of the entire image 208 . As described above, the portion to be processed by a particular encoder depends on the quantity of encoders in the configuration, the relative position of the particular encoder, any desired overlap, the total image size, and whether the image is processed horizontally or vertically.

It is understood that the present invention can be realized in hardware, software, or a combination of hardware and software. Specifically, it should be appreciated that encoders 56 A-F of the present invention can be programmed via a computer-based system (not shown). A typical combination of hardware and software could be a general purpose (computer) system with a computer program that, when loaded and executed, controls the computer system such that it carries out the methods described herein. Alternatively, a specific use computer system, containing specialized hardware for carrying out one or more of the functional tasks of the invention could be utilized. The present invention can also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein, and which—when loaded in a (computer) system—is able to carry out these methods. Computer program, software program, program, or software, in the present context mean any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following: (a) conversion to another language, code or notation; and/or (b) reproduction in a different material form.

The foregoing description of the invention has been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise form disclosed, and obviously, many modifications and variations are possible. Such modifications and variations that may be apparent to a person skilled in the art are intended to be included within the scope of this invention as defined by the accompanying claims.

›Tables in the description — 1
EncoderRelativeProcessingOverlapImage Size
EncoderQuantityPositionOrientation(pixels)(pixels)
56A61 STVertical161920
56B62 NDVertical321920
56C63 RDVertical321920
56D64 THVertical321920
56E65 THVertical321920
56F66 THVertical161920

Claims as granted

19 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

6 codes
IPC · International Patent Classification
Section H — Electricity
  • H04N7/50
  • H04N7/015
  • H04N7/26
  • H04N7/12
USPC · US Patent Classification
375/240.1348/446

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoom200220032004200520062007200820092010USPTOApplicantNon-final rejectionNon-final rejectionResponse after non-finalNon-final rejectionResponse after non-finalFinal rejection
USPTOApplicanthover for detail · click to open
Pendency
8.2 y
3,011 days filing → grant
Office actions
8
non-final + final
Responses
8
no RCE
Interviews
1
examiner interview summaries
Appeals
1
notices of appeal
Examiner
Behrooz Senfi
art unit 2621 · TC 2600
Citations: 38 back · 0 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom20052010201520202025Owner 1
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock