Method of reducing quantization noise
Granted 16 Feb 2010 · 1 office action
Assignee: Koninklijke Philips N.V.
Law firm: Law firm · Log in to unlock
Attorney: Attorney · Log in to unlock
Inventors: Aweke Negash Lemma, Minne Van Der Veen · Examiner: Rexford N Barnie · AU 2819 · TC 2800
Life of the application
8 dated eventsAbstract
There is described a system ( 10; 300 ) for processing an input signal ( 340 ) to generate a corresponding encoded output signal ( 380 ). The system ( 10; 300 ) includes a plurality of quantizing devices ( 30, 70; 350, 370 ) coupled in series, the system ( 10; 300 being configured in operation to reduce tandem quantization noise arising therein by: (a) analyzing the system ( 10; 300 ) to determine signal regions ( 290 ) in which tandem noise errors occur; and (b) modifying one or more earlier quantizing devices ( 30; 350 ) in the system ( 10; 300 ) with backward correction to reduce tandem noise arising therein from said determined signal regions ( 290 ), said one or more earlier quantizing devices ( 30; 350 ) not including a last quantizing device ( 70; 370 ) in series the system ( 10; 300 ).
Description
4 parts›The present invention relates to methods of reducing…
The present invention relates to methods of reducing quantization noise; for example, the invention more specifically relates to methods of reducing tandem quantization noise which arises when a plurality of signal quantizing stages are coupled together in a series arrangement. Moreover, the present invention also relates to apparatus operable to implement the aforesaid methods. Furthermore, the present invention relates to quantized output data generated by executing the methods.
Tandem coding artifacts arise when quantizers are coupled in a series arrangement. Such coding artifacts are encountered when, for example, transcoding multimedia signals, wherein a dominant component of these artifacts is known as “tandem quantization noise”.
In FIG. 1 , there is shown a contemporary music delivery system indicated generally by 10 . The system 10 comprises a data store 20 for providing pulse code modulated (PCM) programme content data x denoted by 100 . Moreover, the system 10 further comprises a first quantizing encoder EN 1 (Q 1 ) denoted by 30 which is operable to provide encoded data x b1 denoted by 110 . The system 10 includes an intermediate data store AAC denoted by 40 for stored data compressed according to a contemporary AAC compression standard. Additionally, the system 10 comprises a decoder DEC 1 denoted by 50 for generating decoded data x 1 denoted by 120 . The system 10 also comprises a watermark embedder WATMKEMB denoted by 60 . Finally, the system 10 includes a second quantizing encoder EN 2 (Q 2 ) denoted by 70 for generating an encoded output bitstream x b2 denoted by 130 .
In operation, the data store 20 outputs the content data x 100 to the encoder EN 1 (Q 1 ) 30 which quantizes and encodes the data x 100 to generate the corresponding encoded data x b1 110 for storage in the intermediate data store 40 . In response to a request for music from a consumer, the system 10 is operable to instruct the intermediate store AAC 40 to output corresponding store encoded data as a bit-stream to the decoder DEC 1 50 . The decoder DEC 1 50 partially decodes the bitstream to generate the data x 1 120 which is subsequently input to the watermark embedder WATMKEMB 60 which outputs corresponding watermarked content data to the second quantizing encoder EN 2 (Q 2 ) 70 . The encoder EN 2 (Q 2 ) 70 processes the data received from the watermark embedder WATMKEMB 60 to generate the encoded output bitstream x b2 130 for supply to the consumer.
One drawback in aforementioned operation of the system 10 involving partial decoding of encoded data followed by subsequent re-encoding is the introduction of tandem artifacts into the output bitstream x b2 130 . These artifacts are errors caused by cascading two or more audio compression algorithms, namely cascading the encoders 30 , 70 when implemented using software. The tandem artifacts, also known as tandem error, are more easily appreciated with reference to FIG. 2 in which two graphs indicated by 200 , 210 corresponding to the encoders 30 , 70 respectively. The graphs 200 , 210 include abscissa axes 250 , 270 respectively and quantization ordinate axes 260 , 280 respectively. Moreover, in this example, the encoders 30 , 70 are operable to employ words lengths w 1 =3 bits and w 2 =2 bits respectively. For these example word lengths, the system 10 is operable to transcode to a lower bitrate when generating the output data x b2 130 .
Thus, the input signal represented by data x 100 is defined as xε[0,7] after processing in the first encoder EN 1 (Q 1 ) 30 to generate the encoded data x b1 110 . This encoded data x b1 110 may, for example, be directly further encoded (without watermarking) in the second encoder EN 2 (Q 2 ) 70 to generate a output bitstream y 12 defined by Equation 1 (Eq. 1):
y 12 =Q 2( Q 1( x )) Eq. 1
for which an associated average quantization error e 12 is given by Equation 2 (Eq. 2):
e 12 = 1 N ∑ y 12 - x Eq . 2
for N samples. In comparison, quantization error generated by processing the data x directly through the second encoder EN 2 (Q 2 ) 60 wherein y 2 =Q2(x) is given by Equation 3 (Eq. 3):
In general, the quantization error of y 2 is smaller than that of y 12 , namely e 2 <e 12 . Moreover, a difference between the quantization errors of y 12 and y 2 corresponds to the aforementioned tandem error e t according to Equation 4 (Eq. 4):
e t =e 12 −e 2 Eq. 4
Referring again to FIG. 2 , in the system 10 , tandem error is generated in cross-hatched regions of the graph 200 , for example in a cross-hatched region 290 , namely:
xε[ 0.5,1] xε[ 2.5,3] xε[ 4.5,5] xε[ 6.5,7]
For example, a signal x with amplitude 2.75 is first quantized by the first encoder EN 1 (Q 1 ) to an amplitude 3 , namely 3 =Q1(2.75), and subsequently in the second encoder EN 2 (Q 2 ) to an amplitude 4 , namely 4 =Q2(Q1(2.75)). The resulting quantization error is 4−2.75=1.25. In comparison, only using the second encoder EN 2 (Q 2 ) results in a considerably smaller error, namely Q2(2.75)−2.75=0.75.
The increase in quantization error corresponding to tandem noise is generally recognized as a problem associated with transcoding. Apart from reducing signal-to-noise ratio of a signal, the tandem noise can also obscure more subtle signal features, for example audio watermark information included within an audio signal.
At least partial solutions to the problem of tandem noise have been proposed in the prior art. A first solution reduces tandem noise by cascading two quantizing encoders, namely a first encoder followed in sequence by a second encoder. The first encoder is arranged to employ a considerably higher bit rate relative to the second encoder. Such reduction can be appreciated from FIG. 2 wherein encoders with high bitrates corresponds to quantizers with larger word lengths and associated higher resolution, namely increasing the resolution of the encoder 30 . Although this approach is effective, it has a drawback that data storage space required on the intermediate data store AAC 40 for the x b1 110 is increased higher than is necessary. Other approaches are known wherein modelling techniques can be used to predict tandem noise and apply this prediction to at least partially compensate to reduce the tandem noise.
›In a published European patent application no. EP…
In a published European patent application no. EP 1 359 762, there is described a coder/decoder system and a method of encoding and decoding input data at several different quantization levels. The different quantization levels permit signal-to-noise ratio (SNR) scalability. The system comprises several quantizer units, wherein each quantizer unit operates to quantize the input data at a corresponding quantization level. Moreover, each quantizer is operable to apply a quantizing function. In the system, for achieving optimal SNR scalability, the quantizer units are arranged in a particular processing order so that a mean square error of a prediction error is minimized and so that the quantization prediction error can be perfectly reconstructed.
Thus, the inventors are concerned with a technical problem of devising a method of reducing tandem quantization noise in cascaded quantizers.
An object of the present invention is to provide a method of reducing tandem quantization noise in cascaded quantizers or cascaded quantizing encoders.
According to a first aspect of the present invention, there is provided a method of reducing tandem quantization noise in a system comprising a plurality of quantizing devices coupled in series, the method including steps of:
(a) analyzing operation of the system to determine signal regions in which tandem noise errors occur; and (b) modifying one or more earlier quantizing devices in the system with backward correction to reduce tandem noise arising therein from said determined signal regions, said one or more earlier quantizing devices not including a last quantizing device in series in the system.
The invention is of advantage in the method in that it is capable of reducing tandem quantization noise in cascaded quantizing configurations.
Optionally, the method comprises a further step of arranging for the system to process signals through the series of quantizing devices, said signals comprising one or more of: audio signals, video signals, image signals, text bearing signals. The method is of benefit in that it is capable of being applied to a wide range of different types of signal.
Optionally, the method includes a step of arranging for said plurality of quantizing devices to implement compression algorithms for compressing data processed by said quantizing devices. More preferably, said compression algorithms include at least one of: MPEG compression, AAC compression and MP3 compression. Such compression algorithms are capable of reducing data storage requirements.
Optionally, the method includes a further step of adding watermark data to data being processed through said plurality of quantizing devices. The method is of benefit in that it is capable of being used in conjunction with watermarking data content, wherein reduced tandem quantization noise provided by the method at least partially circumvents problems with such tandem noise obscuring subtle added watermark data.
Optionally, the method is applied in conjunction with implementing a multimedia signal distribution system. The method is then of benefit in improving quality of programme content delivered to users via such a distribution system.
Optionally, in the method, a last quantizer in the plurality of quantizing devices coupled in series is also modified to reduce tandem noise arising within the system.
According to a second aspect of the invention, there is provided quantized output data generated using a method according to the first aspect of the invention, said data being conveyable by way of a communication network and/or data carrier.
According to a third aspect of the invention, there is provided an apparatus for processing an input signal to generate a corresponding encoded output signal, said apparatus including a plurality of quantizing devices coupled in series, wherein said apparatus in operation is configured to reduce tandem quantization noise arising therein by:
(a) analyzing the apparatus to determine signal regions in which tandem noise errors occur; and (b) modifying one or more earlier quantizing devices in the apparatus with backward correction to reduce tandem noise arising therein from said determined signal regions, said one or more earlier quantizing devices not including a last quantizing device is series in the apparatus.
According to a fourth aspect of the present invention, there is provided a system for processing an input signal to generate a corresponding encoded output signal, said system including a plurality of quantizing devices coupled in series, wherein said system in operation is configured to reduce tandem quantization noise arising therein by:
(a) analyzing the system to determine signal regions in which tandem noise errors occur; and (b) modifying one or more earlier quantizing devices in the system with backward correction to reduce tandem noise arising therein from said determined signal regions, said one or more earlier quantizing devices not including a last quantizing device in series in the system.
Optionally, the system is operable to process signals through the series of quantizing devices, said signals comprising one or more of: audio signals, video signals, image signals, text bearing signals.
Optionally, the system is arranged such that said plurality of quantizing devices are operable to implement compression algorithms for compressing data processed by said quantizing devices. More preferably, the compression algorithms include at least one of: MPEG compression, AAC compression and MP3 compression.
Optionally, the system is operable to add watermark data to data being processed through said plurality of quantizing devices.
Optionally, the system is arranged in operation to implement a multimedia signal distribution system.
It will be appreciated that features of the invention are susceptible to being combined in any combination without departing from the scope of the invention.
Embodiments of the invention will now be described, by way of example only, with reference to the following diagrams wherein:
›FIG. 1 is a schematic diagram of a…
FIG. 1 is a schematic diagram of a known programme content distribution system employing cascaded quantizing encoders, wherein the encoders are prone to exhibiting tandem quantization noise in operation;
FIG. 2 is an illustration of quantizing steps of two example encoders employed in the system of FIG. 1 with zones in which tandem quantization noise is potentially generated;
FIG. 3 is an embodiment of the present invention, namely an illustration of double quantizers which are capable of being substantially tandem noise free;
FIG. 4 is a graph illustrating a trade-off between a first quantizing encoder word length (w 1 ) against tandem noise (e t ) for the embodiment of FIG. 3 ; and
FIG. 5 is a graph illustrating a trade-off between the first quantizing encoder word length (w 1 ) against a ratio e t /e q2 wherein e q2 is quantization noise of a second quantizing encoder.
To reduce the problem of tandem quantization noise generated when cascading quantizing encoders in a system for distributing programme content data, said data pertaining to audio and/or video programme subject matter, the inventors have devised a so-called “tandem noise free” (TNF) quantizer. Such a quantizer is susceptible, for example, to being employed in the contemporary system 10 illustrated in FIG. 1 .
An embodiment of the invention is illustrated in FIG. 3 wherein two quantizers Q′ 1 and Q 2 denoted by 350 , 370 respectively are coupled in a configuration indicated generally by 300 . The configuration 300 is preferably also provided with a watermark embedder (not shown) akin to the watermark embedder WATMKEMB 60 of FIG. 1 . Moreover, the configuration 300 optionally also operable to implement data compression algorithms include at least one of: MPEG compression, AAC compression and MP3 compression
In the configuration 300 , the quantizers 350 , 370 are for example part of a signal processing chain for distributing programme content data, for example akin to the system 10 illustrated in FIG. 1 adapted for multimedia purposes. Optionally, additional functions, for example data storage, are interposed between the quantizers 350 , 370 . The quantizers 350 , 370 in the configuration 300 would be susceptible to exhibiting tandem quantization noise in a manner akin to that illustrated in FIG. 2 , were it not for the first quantizer 350 being operable to quantize an input signal x denoted by 340 also in an opposite direction as will be herewith elucidated in further detail for purposes of reducing tandem quantization arising on account of operation of this first quantizer 350 .
In FIG. 3 , for a set of two quantizers 350 , 370 with the aforementioned opposite direction operation, an output Q 2 (Q′ 1 (x)) denoted by 380 is identical to the input signal x 340 processed by the second quantizer 370 as described by Equation 5 (Eq. 5):
Q 2 ( Q′ 1 ( x ))=Q 2 ( x ) Eq. 5
In other words, the overall tandem noise distortion generated by the configuration 300 in processing the signal x 340 to generate the output 380 corresponds to distortions introduced by the second quantizer 370 .
To illustrate such a principle further, FIG. 2 is referred to again. The input signal x 340 is, for example, such that x=2.75. In the example contemporary system 10 , this value for x 340 would be quantized to a value 4 resulting in a error of 1.25. In contradistinction to the system 10 , the configuration 300 results in the output 380 assuming a value Q′ 1 (2.75)=2 which following by the second quantizer 370 yields Q 2 (2)=2 for the output 380 . A similar result arises if the second quantizer 370 were applied directly to process the signal x 340 to generate the output 380 , namely Q 2 (2.75)=Q 2 (2)=2. In FIG. 3 , the quantizer 350 is provided with a control unit DTRD Q′ 1 denoted by 330 for supporting the aforementioned opposite direction function associated with the first quantizer 350 . “DTRD” is an abbreviation for “Derive Tandem Regions and Design Q′ 1 ” indicative that conversion characteristics of the first quantizer 350 are modified in anticipation of expected tandem noise generation within the configuration 300 .
In more general terms, the behavior of a set of two linear quantizers Q 1 , Q 2 with associated output word lengths w 1 , w 2 respectively can be analyzed. Assuming that the signal x 340 is in a range of zero as minimum and x max as maximum, namely xε[0, x max ], a quantization step ΔQ for both quantizers 350 , 370 is given by Equation 6 (Eq. 6):
ΔQ =( x max +1)*2 −w Eq. 6
The number of regions, for example the region 290 in FIG. 2 , denoted by N t in which tandem distortion can potentially occur is calculable from Equation 7 (Eq. 7):
N t =2 w2 Eq. 7
The investors have appreciated that an average tandem error per region, namely e R , is only influenced by the first quantizer 350 as provided in Equation 8 (Eq. 8):
Thus, for a uniformly distributed signal x 340 such that xε[0,x max ], the average tandem error per signal sample processed in the configuration 300 is given by Equation 9 (Eq. 9):
e t = e R · N t x max * e R = ( x max + 1 ) 2 x max * 2 ( w 2 - 2 w 1 - 2 ) Eq . 9
wherein w 2 <w 1 .
For example, in a situation wherein w 1 =3, w 2 =2 and x max =7, an average tandem noise error of e t = 1/7 occurs per input sample for signal x 340 . The average tandem error e t is presented in a graph indicated by 400 in FIG. 4 . The graph 400 includes an abscissa axis 410 denoting word length w 1 and an ordinate axis 420 denoting the aforesaid average error e t . An arrow 430 indicates a trend for the average error e t as the wordlength w 2 is increased from 1 to 8.
The inventors have appreciated that the tandem noise error is beneficially estimated by investigating the tandem noise error relative to total quantization error in the configuration 300 . When the first quantizer 350 is controlled as described in the foregoing to exhibit minimal tandem noise, the total quantization noise arising in the configuration 300 can be assumed to arise from the second quantizer 370 . In such a situation, an average error e q2 per input value in the signal x 340 is given by Equation 10 (Eq. 10):
›In FIG. 5 , a plot of total…
In FIG. 5 , a plot of total error e t and the error e q2 is presented on a graph indicated generally by 500 . The graph 500 includes an abscissa axis 510 denoting word length of the first quantizer 350 and an ordinate axis 520 denoting a ratio of the aforesaid errors e t , e q2 . From FIG. 2 , the inventors have identified that relative energy of the quantization noise is a function of a difference in the word lengths w 1 , w 2 of the first and second quantizers 350 , 370 respectively as depicted by an arrow 530 . In particular, for a given constant β, the tandem energy e t relative to the quantization noise e q2 is given by Equation 11 (Eq. 11):
From Equations 9 and 10, the constant β is found to have a numerical value of β=2. The relative energy discernible from the ordinate axis 520 increase as the word length w 2 approaches w 1 . For example, when w 2 =w 1 −1, the tandem noise e t is about 50% of the quantization noise e q2 . As a further example, w 2 =w 1 −2, the tandem noise e t is about 12.5% of the quantization noise e q2 .
The configuration 300 illustrated in FIG. 3 is susceptible to being used in the system 10 shown in FIG. 1 . In the system 10 modified according to the present invention, an audio signal is transcoded within the system 10 from 128 kbytes per second to 64 kbytes per second. For example, in the case of a 44.1 kHz signal, such transcoding corresponds to a transcoding from 3 bits/sample to 1.5 bits/sample. If linear quantizers are employed for the quantizing encoders 30 , 70 , the relative tandem noise energy becomes 25% of the total quantization noise e t . Thus, the total coding noise arising in the system 10 can be reduced by 25%.
From the foregoing, it will be appreciated that the system 10 is susceptible to being adapted according to the present invention so that tandem noise is substantially not introduced despite there being two cascaded quantizing encoders 30 , 70 , thereby improving quality of the output x b2 130 . Alternatively, for a given audio quality, the invention is capable of reducing storage space required in the data store AAC 40 for storing the encoded bitstream x b1 110 .
It will be appreciated that embodiments of the invention described in the foregoing are susceptible to being modified without departing from the scope of the invention as defined by the accompanying claims.
In the accompanying claims, numerals and other symbols included within brackets are included to assist understanding of the claims and are not intended to limit the scope of the claims in any way.
Expressions such as “comprise”, “include”, “incorporate”, “contain”, “is” and “have” are to be construed in a non-exclusive manner when interpreting the description and its associated claims, namely construed to allow for other items or components which are not explicitly defined also to be present. Reference to the singular is also to be construed to be a reference to the plural and vice versa.
›Tables in the description — 3
| e | 2 | ||||||||||||||||||||
| = | |||||||||||||||||||||
| 1 | N | | ∑ | | | y | 2 | - | x | | |||||||||||
| Eq | . | ||||||||||||||||||||
| | 3 |
| e | R | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| = | ||||||||||||
| Δ | | | Q | 1 | 2 | |||||||
| Eq | . | |||||||||||
| | 8 |
| e | t |
|---|---|
| e | |
| q | |
| | 2 |
| = | |
| β | * |
| 2 | |
| - | 2 |
| | |
| ( | |
| w | |
| | 1 |
| - | |
| w | |
| | 2 |
| ) | |
| Eq | . |
| | 11 |
Claims as granted
15 claimsLog in to read the claims of this application.
Log in to unlockClassifications
4 codes- G10L19/16
- H04N19/89
Claim changes
SoonSee which claims were amended, added or cancelled during examination, with every added and removed word marked.
The published claims of this application are not paired with the granted ones in what we hold.
File wrapper
See the full prosecution history — every USPTO and applicant action on this file, in order.
Log in to unlockDocuments
Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.
Log in to unlockChain of title
See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.
Log in to unlock