Image processing apparatus and method of the same

1. Field of the Invention

The present invention relates to an image processing apparatus and a method of the same for adjusting the saturation of an input image in a display system.

2. Description of the Prior Art

In current displays, all users can adjust color saturations via an On Screen Display for enhancing displaying effects of images. Referring to FIG. 1 through FIG. 2B , FIG. 1 is a functional block diagram of an image processing apparatus 1 according to prior art; FIG. 2A is a schematic diagram of the lightness gain look-up table 160 a shown in FIG. 1 , and FIG. 2B is a schematic diagram of the hue gain look-up table 160 b shown in FIG. 1 . The image processing apparatus 1 includes a first color space converter 10 , a hue converter 12 , a first saturation converter 14 , processing units 16 a and 16 b , multipliers 18 a and 18 b , a second saturation converter 20 , and a second color space converter 22 . The processing unit 16 a stores a lightness gain look-up table 160 a , as shown in FIG. 2A . The processing unit 16 b stores a hue gain look-up table 160 b , as shown in FIG. 2B .

The first color space converter 10 is used for converting an input image from RGB color space into Lab color space, wherein L is a lightness component, and a and b are respective color components. The hue converter 12 is used for converting the two color components a and b into a hue (H) of the input image, wherein the hue (H) is defined as H=tan −1 (b/a). The first saturation converter 14 is used for converting the two color components a and b into a saturation (S) of the input image, wherein the saturation (S) is defined as S=√{square root over (a 2 +b 2 )}.

The processing unit 16 a decides a lightness gain Gain-L in accordance with the lightness (L) of an input image and the lightness gain look-up table 160 a . The processing unit 16 b further decides a hue gain Gain-H in accordance with the hue of the input image and the hue gain look-up table 160 b . Then, the multiplier 18 a multiplies the lightness gain Gain-L by the hue gain Gain-H to generate a saturation gain Gain-S. Afterwards, the multiplier 18 b multiplies the saturation gain Gain-S by the saturation of the input image to generate an adjusted saturation.

The second saturation converter 20 is used for converting the adjusted saturation into the two color components a and b, and the second color space converter 22 then converts the input image from Lab color space into RGB color space.

Referring to FIG. 3A and FIG. 3B , FIG. 3A is a schematic diagram of Lab color space, and FIG. 3B is a schematic diagram of the saturation with different lightness and hues in Lab color space. As shown in FIG. 3A , in the Lab color space, the lightness (L) is controlled by heights, the hue (H) is controlled by angles, and the saturation (S) is controlled by radii. According to the previous description, the image processing apparatus 1 of prior art uses the lightness gain Gain-L and the hue gain Gain-H, respectively, to adjust the saturation of the input image. However, as shown in FIG. 3B , when the lightness of the input image is different, the range of hue saturation of the input image is also different. Because each of the sections with different lightness in the color space is distinct from others, and different hues (angles) have different ranges of saturation, selecting the lightness gain Gain-L in accordance with different lightness and selecting the hue gain Gain-H in accordance with different hues will cause the saturation to be uncontrollable and lead to color deviations.

Accordingly, the scope of the present invention is to provide an image processing apparatus and a method of the same to resolve the problems described above.

A scope of the invention is to provide an image processing apparatus and a method of the same. The image processing apparatus adjusts the saturation of an input image in accordance with the lightness and the hue of the input image simultaneously. By using the invention, better image quality can be achieved.

According to a preferred embodiment of the invention, the image processing apparatus according to the invention is used for adjusting a saturation of an input image which also includes lightness and hue. The image processing apparatus includes a first processing unit, a second processing unit, a third processing unit, and a first converter. The third processing unit is respectively coupled to the first processing unit and the second processing unit.

According to the embodiment described above, the first processing unit stores a first look-up table and decides a gain curve in accordance with the lightness and hue of the input image and the first look-up table. The second processing unit, storing a second look-up table, decides a normalized limit gain in accordance with the lightness and the hue of the input image and the second look-up table, and multiplies the saturation of the input image by the normalized limit gain to generate a normalized saturation. The third processing unit, storing a third look-up table, decides a set of gain parameters in accordance with the gain curve and the third look-up table, and further decides a saturation gain in accordance with the normalized saturation and the set of gain parameters. Afterwards, the first converter adjusts the saturation of the input image according to the saturation gain.

Accordingly, the image processing apparatus according the invention limits, in accordance with the lightness and the hue of the input image simultaneously, the processing of the maximum saturation, so as to prevent the occurrence of defects of hue deviation during the process of adjusting image coloring; therefore, better image quality can be achieved.

The advantage and spirit of the invention may be understood by the following recitations together with the appended drawings.

FIG. 1 is a functional block diagram of an image processing apparatus according to prior art.

FIG. 2A is a schematic diagram of the lightness gain look-up table shown in FIG. 1 .

FIG. 2B is a schematic diagram of the hue gain look-up table shown in FIG. 1 .

FIG. 3A is a schematic diagram of Lab color space.

FIG. 3B is schematic diagram of the saturation with different lightness and hues in Lab color space.

FIG. 4 is a functional block diagram of an image processing apparatus according to the first preferred embodiment of the invention.

FIG. 5 is a schematic diagram of the first look-up table shown in FIG. 4 .

FIG. 6 is a schematic diagram of gain curves in FIG. 5 .

FIG. 7 is a schematic diagram of the second look-up table shown in FIG. 4 .

FIG. 8 is a diagram showing saturation limit values corresponding to specific lightness and specific hues.

FIG. 9 is a schematic diagram of the third look-up table shown in FIG. 4 .

FIG. 10 is a schematic diagram of the third look-up table according to the second preferred embodiment of the invention.

FIG. 11 is a schematic diagram of the third look-up table according to the third preferred embodiment of the invention.

FIG. 12 is a flowchart of an image processing method according to a preferred embodiment of the invention.

Referring to FIG. 4 , FIG. 4 is a functional block diagram of an image processing apparatus 3 according to the first preferred embodiment of the invention. In this embodiment, the image processing apparatus 3 is used for adjusting the saturation (S) of an input image 5 . The input image 5 has lightness (L) and hue (H). In this embodiment, the input image 5 is in compliance with RGB color space (the first color space).

As shown in FIG. 4 , the image processing apparatus 3 includes a first converter 30 , a second converter 32 , a third converter 34 , a fourth converter 36 , a fifth converter 38 , a first processing unit 40 , a second processing unit 42 , and a third processing unit 44 . The third processing unit 44 is respectively coupled to the first processing unit 40 and the second processing unit 42 . The second converter 32 is coupled to the first processing unit 40 . The third converter 34 is respectively coupled to the second converter 32 , the first processing unit 40 , and the second processing unit 42 . The fourth converter 36 is respectively coupled to the first converter 30 , the second converter 32 , and the second processing unit 42 . The fifth converter 38 is respectively coupled to the first converter 30 and the second converter 32 .

Referring to FIG. 5 and FIG. 6 , FIG. 5 is a schematic diagram of the first look-up table 400 shown in FIG. 4 , and FIG. 6 is a schematic diagram of gain curves (GC) shown in FIG. 5 . The first processing unit 40 stores a first look-up table 400 . As shown in FIG. 5 , the first look-up table 400 records a plurality of lightness (L), a plurality of hues (H), and a plurality of gain curves (GC) which each respectively corresponds to one of the lightness (L) and one of the hues (H). A plurality of sets of gain parameters can be obtained in accordance with each gain curve (GC). Each set of gain parameters respectively includes a first gain G 1 , a second gain G 2 , and a third gain G 3 , as shown in FIG. 6 . In FIG. 6 , the vertical axis and the horizontal axis respectively represent the output value and the input value of saturation.

Referring to FIG. 7 , FIG. 7 is a schematic diagram of the second look-up table 420 shown in FIG. 4 . The second processing unit 42 stores a second look-up table 420 . As shown in FIG. 7 , the second look-up table 420 records a plurality of lightness (L), a plurality of hues (H), and a plurality pf normalized limit gains LG_nor which each respectively corresponds to one of the lightness (L) and one of the hues (H).

The normalized limit gains LG_nor described above are calculated using the following formula:

LG_nor = SV S_limit ,

wherein SV represents a sampling value associated with the gain curve (as shown in FIG. 6 ), and S_limit represents a saturation limit value obtained based on a specific lightness and a specific hue. Referring to FIG. 8 , FIG. 8 is a diagram showing the saturation limit values corresponding to specific lightness and specific hues. It should be noted that the calculation method of the saturation limits value can be easily achieved by one skilled in the art, so the details are not further described.

Referring to FIG. 9 , FIG. 9 is a schematic diagram of the third look-up table 440 shown in FIG. 4 . The third processing unit 44 stores a third look-up table 440 . As shown in FIG. 9 , the third look-up table 440 records a plurality of gain curves (GC) and a plurality of sets of gain parameters which each respectively corresponds to one of the gain curves (GC).

It should be noted that the first look-up table 400 , the second look-up table 420 , and the third look-up table 440 described above can have different settings in accordance with different applications.

Referring to FIG. 4 again, in the embodiment described above, the second converter 32 is used for converting the input image 5 from the RGB color space (the first color space) into the second color space with separated lightness and colors, wherein the second color space is one selected from a group consisting a YCbCr color space, a Yuv color space, a YIQ color space, a CIELab color space, and an Luv color space, and the second color space defines a lightness component Y and color components (C 1 ) and (C 2 ). The third converter 34 is used for converting the color components (C 1 ) and (C 2 ) into the hue (H), wherein the hue (H) is defined as H=tan −1 (C 1 /C 2 ). The fourth converter 36 is used for converting the color components (C 1 ) and (C 2 ) into the saturation (S), wherein the saturation (S) is defined as S=√{square root over (C 1 2 +C 2 2 )}.

The first processing unit 40 is used for deciding a gain curve (GC) in accordance with the lightness (L) and the hue (H) of the input image 5 and the first look-up table 400 . For example, if the lightness and the hue of the input image 5 are L 2 and H 1 respectively, the first processing unit 40 decides the gain curve is GC 12 in accordance with the first look-up table 400 .

The second processing unit 42 is used for deciding a normalized limit gain LG_nor, in accordance with the lightness (L) and the hue (H) of the input image 5 and the second look-up table 420 , and for multiplying the saturation (S) of the input image 5 by the normalized limit gain LG_nor to generate a normalized saturation S_nor. That is, S_nor=S*LG_nor. For example, if the lightness and the hue of the input image 5 are L 2 and H 1 respectively, the second processing unit 42 decides that the normalized limit gain is LG_nor 12 in accordance with the second look-up table 420 , and it multiplies the saturation (S) of the input image 5 by the normalized limit gain LG_nor 12 to generate a normalized saturation S_nor. That is, S_nor=S*LG_nor 12 .

The third processing unit 44 is used for deciding a set of gain parameters (G 1 , G 2 , G 3 ), in accordance with the gain curve (GC) and the third look-up table 440 , and for deciding a saturation gain S_gain in accordance with the normalized saturation S_nor and the set of gain parameters. For example, if the gain curve is GC 12 , the third processing unit 44 decides that the gain parameters (G 1 , G 2 , G 3 ) are (1.04, 1.14, 0.78) in accordance with the third look-up table 440 , and it further decides a saturation gain S_gain in accordance with the normalized gain S_nor and the set of gain parameters. The saturation gain S_gain is calculated using the following formula:

S_gain = S_out S_nor ,

⁢ S_out = S 1 * G 1 + S 2 * G 2 + S 3 * G 3 , and { S_nor ≤ T 1 ⇒ S 1 = S_nor S 2 = 0 S 3 = 0 T 1 < S_nor ≤ T 2 ⇒ S 1 = T 1 S 2 = S_nor - T 1 S 3 = 0 S_nor > T 2 ⇒ S 1 = T 1 S 2 = T 2 - T 1 S 3 = S_nor - T 2 .

wherein T 1 represents a first threshold, and T 2 represents a second threshold.

For example, if the normalized saturation S_nor is 100, the T 1 is set at 64, and T 2 is set at 96, then S 1 =64, S 2 =32, and S 3 =4. Because (G 1 , G 2 , G 3 ) are (1.04, 1.14, 0.78), S_out=64*1.04+32*1.14+4*0.78. That is, S_out=106.16. Therefore, the saturation gain S_gain is 1.0616.

Subsequently, the first converter 30 first converts the saturation (S) into the two intermediate color components (C 1 ″) and (C 2 ″) and multiplies the two intermediate color components (C 1 ″) and (C 2 ″) respectively by the saturation gain S_gain to obtain the two adjusted color components (C 1 ′) and (C 2 ′). In another preferred embodiment, the first converter 30 can first multiply the saturation (S) by the saturation gain S_gain, and then converts the adjusted saturation into the two adjusted color components (C 1 ′) and (C 2 ′). By doing this, the adjustment of the saturation of the input image 5 is completed. Finally, the fifth converter 38 converts the input image 5 from the second color space (such as a YCbCr color space, a Yuv color space, a YIQ color space, a CIELab color space, or an Luv color space) into a first color space (such as an RGB color space). Because the saturation (S) of the input image 5 is adjusted in accordance with the lightness (L) and the hue (H) of the input image 5 simultaneously, the color saturation of the input image 5 can be substantially improved and leads to better image quality.

Referring to FIG. 10 , FIG. 10 is a schematic diagram of the third look-up table 440 ′ according to a second preferred embodiment of the invention. The major difference between the second embodiment and the first embodiment is that each of the gain curves according to the second embodiment is respectively a polynomial function, and each set of gain parameters respectively includes n+1 coefficients G 0 ˜Gn, as shown in FIG. 10 . In this embodiment, the saturation gain S_gain is calculated using the following formula:

S_gain = S_out S_nor ,

⁢ S_out = G 0 + G 1 * S + G 2 * S 2 + Λ + G n * S n ⁢

( a ⁢ ⁢ polynomial ⁢ ⁢ function ⁢ ⁢ of ⁢ ⁢ a ⁢ ⁢ gain ⁢ ⁢ curve ) ,

wherein S_nor represents the normalized saturation, and S represents the saturation of the input image.

For example, if the gain curve is GC 10 , the third processing unit 44 decides that the gain parameters (G 0 , G 1 , G 2 , . . . , Gn) are (1, 1.18, 0.82, . . . , 0.78) in accordance with the third look-up table 440 ′ and further decides that the polynomial function of the gain curve is S_out=1+1.18*S+0.82*S 2 +Λ+0.78*S n .

Referring to FIG. 11 , FIG. 11 is a schematic diagram of the third look-up table 440 ′ according to the third preferred embodiment of the invention. The major difference between the third embodiment and the first embodiment is that each of the gain curves according to the third embodiment is respectively an exponential function, and each set of gain parameters respectively includes a base number a and an exponent G 0 , as shown in FIG. 11 . In this embodiment, the saturation gain S_gain is calculated using the following formula:

S_gain = S_out S_nor ,

⁢ S_out = a G 0 ⁢ ⁢ ( an ⁢ ⁢ exponential ⁢ ⁢ function ⁢ ⁢ of ⁢ ⁢ a ⁢ ⁢ gain ⁢ ⁢ curve ) ,

wherein S_nor represents a normalized saturation.

For example, if the gain curve is GC 21 , the third processing unit 44 decides that (a, G 0 ) are (1.08, 1.08) in accordance with the third look-up table 440 ″, and it further decides that the exponential function of the gain curve is:

S _out=(1.08) 1.08 .

In other words, the gain curve according to the invention can be designed by a designer as a look-up table, a linear function, a polynomial function, an exponential function, other correlation functions, or a combined application of the previously described functions.

Referring to FIG. 12 , FIG. 12 is a flowchart of an image processing method according to a preferred embodiment of the invention. Also referring to FIG. 4 through FIG. 11 , the image processing method, according to the invention, is used for adjusting the saturation of the input image, and the input image also includes lightness and hue. The image processing method, according to the invention, includes the steps of:

Step S 100 : Convert the input image 5 from the first color space (such as an RGB color space) into a second color space (such as a YCbCr color space, a Yuv color space, a YIQ color space, a CIELab color space, or an Luv color space);

Step S 102 : Decide the gain curve (GC) in accordance with the lightness (L) and the hue (H) of the input image 5 and the first look-up table 400 ;

Step S 104 : Decide the normalized limit gain LG_nor in accordance with the lightness (L) and the hue (H) of the input image 5 and the second look-up table 420 , and multiply the saturation (S) of the input image 5 by the normalized limit gain LG_nor to generate the normalized saturation S_nor;

Step S 106 : Decide a set of gain parameters in accordance with the gain curve (GC) and the third look-up table 440 , and further decide the saturation gain S_gain in accordance with the normalized saturation S_nor and the set of gain parameters;

Step S 108 : Convert the saturation (S) of the input image 5 into the intermediate color components (C 1 ″) and (C 2 ″);

Step S 110 : Multiply the intermediate color components (C 1 ″) and (C 2 ″) respectively by the saturation gain S_gain to obtain the adjusted color components (C 1 ′) and (C 2 ′);

Step S 112 : Convert the input image 5 from the second color space into the first color space.

In another preferred embodiment, the saturation (S) of the input image 5 can first be multiplied by the saturation gain S_gain, and then the adjusted saturation is converted into the adjusted color components (C 1 ′) and (C 2 ′).

Compared with prior art, the image processing apparatus and method of the same according to the invention adjusts the saturation of an input image in accordance with the lightness and the hue of the input image simultaneously, to increase the color saturation of the input image to obtain better image quality. Furthermore, the image processing apparatus and the method of the same according to the invention can further prevent hue deviations during the process of image adjustment, so as to further improve the image quality.

With the example and explanations above, the features and spirits of the invention will be hopefully well described. Those skilled in the art will readily observe that numerous modifications and alterations of the device may be made while retaining the teaching of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.