Method for image-based illumination effect in a three-dimensional scene

1. Field of the Invention

The present invention relates in general to a method for producing an image. In particular, the present invention relates to a method for image-based rendering of light in a virtual volume.

2. Description of the Related Art

The images of a three-dimensional object are often used in industrial design, motion pictures, and even in virtual reality and homepage making, etc. The images may be enlivened by drawing them with a lightening effect. A conventional method for providing such a lightening effect includes the following steps: setting the position and the intensity from a virtual light source in the virtual space after drawing the image of a three-dimensional object; and calculating the distribution of light intensity while the light of the virtual light source illuminating the three-dimensional object, so that the image of the three-dimensional object is redrawn to show the lightening effect. This conventional light rendering method cannot provide various lightening effects since it only provides a virtual light source and then calculates the light intensity distribution of illumination of the light source on the object. Moreover, this conventional method is only applicable in case that the light source is located in the front of the object. If the light source is located in the rear of the object, only the shadow of the object can be observed.

Accordingly, an object of the present invention is to provide a method for image-based rendering of light in a virtual volume, which can provide various illuminating effects for a virtual three-dimensional object.

Another object of the present invention is to provide a method for image-based rendering of light in a virtual volume, in which the virtual light sources can be located at arbitrary positions, so that various illuminating effects can be provided to the virtual three-dimensional object.

In order to achieve the above objects, the present invention separates the light sources in the rear of and in the front of the object into two groups. The illuminating effects of the light sources in the rear of the object are first merged one-by-one. The merged image for the illuminating effects of the light sources is then merged with the image of the three-dimensional object. Thereafter, the images for the illuminating effects of the light sources in front of the object are sequentially merged. The merged image for the illuminating effects is calculated with a special function to obtain an image having a special effect. The image having a special effect is then merged with the merged image of the object and the illuminating effect of the rear light sources in a certain merging mode.

The present invention can be more fully understood by reading the subsequent detailed description in conjunction with the examples and references made to the accompanying drawings, wherein:

FIG. 1 is a diagram illustrating the method for image-based rendering of light in a virtual volume;

FIGS. 2 a and 2 b are flow charts illustrating the method for image-based rendering of light in a virtual volume; and

FIGS. 3 a to 3 c are pictures for illustrating the method for image-based rendering of light in a virtual volume according to a preferred embodiment of this invention.

Referring to FIG. 1, according to the method for image-based rendering of light in a virtual volume of the present invention, the light sources in the virtual volume are divided into two groups, i.e., the light sources 20 a ˜ 20 e in the rear of the three-dimensional object 10 and the light sources 30 a ˜ 30 e in the front of the three-dimensional object 10 . Then, each image for the illuminating effects of the light sources 20 a ˜ 20 e are merged in sequence. For example, the image for the illuminating effect of the light source 20 e is merged with the image for the illuminating effect of the light source 20 d to form a new image. The new image is then merged with the image for the illuminating effect of the light source 20 c , and so forth. The merged image of all of the light sources in the rear of the three-dimensional object is merged with the image of the three-dimensional object. Thereafter, each image for the illuminating effects of the light sources 30 a ˜ 30 e are merged in sequence. The merged image of all of the light sources in the front of the three-dimensional object can be provided with various effects by calculated with special functions. The merged image having various effects is finally merged into the merged image of the image for the illuminating effects of the light sources in the rear of the three-dimensional object and the image of the three-dimensional object to accomplish the image-based rendering of light for the three-dimensional object.

Referring to FIG. 2, the method of this invention includes the steps of: (i) step 100 , dividing the light sources into two groups, in which the first group is in the rear of the three-dimensional object, and the second group is in the front of the three-dimensional object; (ii) step 102 , arranging the sequence of forming a two-dimensional image for the first group of light sources; (iii) step 104 , forming the two-dimensional image for the illuminating effect of each light source in the first group of light sources; (iv) step 106 , selecting a merging mode to merge the two-dimensional images for the illuminating effects of the first group of light sources and storing the merged image in the first buffer; (v) step 108 , determining whether or not each of the two-dimensional images for the illuminating effect of each of the first group of light sources are merged into the merged image stored in the first buffer, if yes go to next step, otherwise go to step 104 ; (vi) step 110 , blending the merged image stored in the first buffer and the image of the three-dimensional object to obtain a blending image and storing the blending image in the second buffer; (vii) step 112 , arranging the sequence of forming two-dimensional images for the illuminating effect of the second group of light sources; (viii) step 114 , forming the two-dimensional image for the illuminating effect of a light source in the second group of light sources; (ix) step 116 , providing a special effect to the two-dimensional image of the light source in the second group of light sources by calculated with a special function and storing the image having a special effect in the third buffer; (x) step 118 , selecting a merging mode to merge the image stored in the third buffer and the blending image stored in the second buffer; (xi) step 120 , determining whether or not the two-dimensional images for the illuminating effect of each light source in the second group of light sources have been merged, if yes go to the end, otherwise go to step 114 .

Various merging modes, such as blending mode, addition mode, lighting mode, multiple mode, inverse of multiple mode, hue mode, etc., can be used based on which effect is desired. The various merging modes are described here.

Always Mode (Blending)

Result( R )= F ( R )×Mask+ B ( R )×(1.0−Mask)

Result( G )= F ( G )×Mask+ B ( G )×(1.0−Mask)

Result( B )= F ( B )×Mask+ B ( B )×(1.0−Mask)

Addition Mode

Result( R )= F ( R )+ B ( R )

Result( G )= F ( G )+ B ( G )

Result( B )= F ( B )+ B ( B )

Lighting Mode

If (F(R)≧128)

Result( R )= B ( R )+127× F ( R )/255;

Else

Result( R )= B ( R )−127× F ( R )/255.

If ( F ( G )>128)

Result( G )= B ( G )+127× F ( G )/255;

Else

Result( G )= B ( G )−127× F ( G )/255.

If (F(B)>128)

Result( B )= B ( B )+127× F ( B )/255;

Else

Result( B )= B ( B )−127× F ( B )/255.

Multiple Mode

Result( R )= F ( R )× B ( R )/255

Result( G )= F ( G )× B ( G )/255

Result( B )= F ( B )× B ( B )/255

Inverse of Multiple Mode

Result( R )=255−(255− F ( R ))×(255− B ( R ))/255

Result( G )=255−(255− F ( G ))×(255− B ( G ))/255

Result( B )=255−(255− F ( B ))×(255− B ( B ))/255

Hue Mode

Result( H )= F ( H )

Result( S )= B ( S )

Where

F: foreground image

B: background image

R, G, B: red, green and blue

H, S, B: hue, saturation and brightness

Each image has 3 plans, that is, R, G and B plans.

0≦R, G, B≦255

0.0≦Mask≦1.0

Various merging effects can be obtained by using various merging modes. Referring to FIGS. 3 a to 3 c , FIG. 3 a is the merged image for the illuminating effects of the light sources in the rear of the three-dimensional object by using the addition mode. FIG. 3 b is the merged image of the image, which is calculated with a special function, for the illuminating effects of the light sources in the front of the three-dimensional object and the image of the three-dimensional object. FIG. 3 c is the merged image of the image of FIG. 3 a and the image of FIG. 3 b . According to FIGS. 3 a to 3 c , the method of this invention can render a light source at any position in the rear of or in the front of the three-dimensional object, and can apply various special functions to provide various lighting effects.

Various special functions can be used according to what effect is desired. For example, the special function used in the above embodiment can be a Gaussian function or a noise function to provide a halo effect or a wavelike effect to the image of the front light sources. The method of this invention can easily provide a various and lively lighting effect to the two-dimensional image of a three-dimensional object.

Finally, while the invention has been described by way of example and in terms of the preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. On the contrary, it is intended to cover various modifications and similar arrangements as would be apparent to those skilled in the art. Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.