USPatent applicationPatented

Display methods for high dynamic range images and user interfaces for the same

Granted 15 Jan 2013 · 4 office actions

Assignee: Corel Corporation

Law firm: Law firm · Log in to unlock

Attorney: Attorney · Log in to unlock

Inventors: Tsung-Wei Lin · Examiner: Daniel Washburn · AU 2628 · TC 2600

Life of the application

22 dated events
⤢ drag to zoom20082010201220142016201820202022202420262028ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

Display methods and interfaces for high dynamic range images. High dynamic range images and corresponding histograms are displayed on a display device. The histogram panel displays low dynamic range and high dynamic range data of the images simultaneously. The low dynamic range and high dynamic range data is brightness level of the image pixels.

Description

5 parts
›CROSS REFERENCE TO RELATED APPLICATIONS

This is a continuation-in-part application of copending application Ser. No. 11/030,083 filed Jan. 7, 2005 now abandoned.

›BACKGROUND

The invention relates to image display, and in particular to display methods for high dynamic range image.

The dynamic range of a scene is expressed by the contrast ratio between its brightest and darkest parts. A low dynamic range image (LDR image) can be displayed on a standard display device because of its smaller dynamic range. Due to the range limitations of LDR images, LDR images cannot represent abundant brightness of real scenes properly. Thus, high dynamic range (HDR) images are necessary. A high dynamic range image (HDR image) is typically generated by combining multiple LDR images of the same scene taken with different exposures. High dynamic range images are broadly employed in image processing systems. Rather than being displayed on a standard display device directly, high dynamic range images require a translation from high dynamic range to low dynamic range for display.

Conventionally, an image panel and histogram panel are arranged on a display device, such as a screen, to display images and corresponding histograms. The conventional histogram panel can only display the brightness of low dynamic range data of the image pixels. FIG. 1 is a diagram of an embodiment of a conventional histogram panel. The conventional histogram panel 5 can only display the brightness of low dynamic range data of the image pixels. Thus, if an image processing system processes high dynamic range images, some image parts cannot be displayed by the conventional histogram panel 5 because of the out-of-range brightness.

For example, if an image processing system comprises an image panel and a conventional histogram panel 5 as shown in FIG. 1 , an HDR image may be displayed in the image panel and the brightness data of the image pixels is displayed in the corresponding conventional histogram panel 5 . When the displayed image is modified, the histogram panel 5 will be difficult to reflect the actual transformed result due to limited input range of histogram panel.

Thus, methods and interfaces for high dynamic range image display are desirable.

›SUMMARY

In an exemplary embodiment of display methods for high dynamic range images, high dynamic range images and corresponding histograms are displayed on a display device. The histogram panel displays transformed low dynamic range and high dynamic range data of the images simultaneously. The low dynamic range and high dynamic range data are the brightness level of the image pixels.

›DESCRIPTION OF THE DRAWINGS

The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the office upon request and payment of the necessary fee.

The present invention can be more fully understood by reading the subsequent detailed description and examples with references made to the accompanying drawings, wherein:

FIG. 1 is a diagram of an embodiment of a conventional histogram panel.

FIG. 2 is a diagram of an embodiment of a histogram panel for high dynamic range images.

FIG. 3 is a diagram of an embodiment of a user interface for high dynamic range images.

›DESCRIPTION

Display methods for high dynamic range images are provided. An image and a histogram panel are displayed on a screen. The image is a high dynamic range image and the histogram panel displays low dynamic range and high dynamic range data of the image, expressed as brightness level of the image pixels. The histogram panel displays a two-dimensional histogram, comprising a first axis, such as X-axis, to display brightness, and a second axis, such as Y-axis, to display pixel counts. The histogram panel changes corresponding histogram of the image when the brightness thereof is adjusted.

FIG. 2 is a diagram of an embodiment of a histogram panel for high dynamic range images. The histogram panel is basically divided into two parts for displaying low dynamic range and high dynamic range data. As shown in FIG. 2 , part 10 displays low dynamic range data and part 12 displays high dynamic range data. According to this embodiment, the ‘low dynamic range (LDR) data’ (part 10 ) comprises data of pixels specifying brightness ranging from 0˜255, and the ‘high dynamic range (HDR) data’ (part 12 ) comprises data of pixels specifying brightness lower than 0 and/or higher than 255. When a high dynamic range image is displayed on a screen through a translation, the corresponding histogram is displayed by the histogram panel simultaneously. If the brightness of the image is adjusted, whether partially or entirely, the corresponding histogram changes accordingly. Due to the high dynamic range data display on the screen with the image, users can execute operations or manipulations on the image, such as detailed modifications, according to the high dynamic range data.

FIG. 3 is a diagram of an embodiment of a user interface for high dynamic range images. The user interface 20 comprises an image panel 22 and a histogram panel 24 . The image panel 22 displays a high dynamic range image comprising pixels specifying brightness lower than 0 and/or higher than 255. The histogram panel 24 displays low dynamic range and high dynamic range data of the high dynamic range image, expressed as brightness level of the image pixels. According to this embodiment, the ‘low dynamic range (LDR) data’ comprises data of pixels specifying brightness ranging from 0˜255, and the ‘high dynamic range (HDR) data’ comprises data of pixels specifying brightness lower than 0 and/or higher than 255. The histogram panel 24 displays a two-dimensional histogram, comprising a first axis to display brightness and a second axis to display pixel counts. In some embodiments, the first axis is X-axis and the second axis is Y-axis. The histogram panel 24 changes when the brightness of the image is adjusted. The user interface 20 is displayed on a display device, such as a screen.

When the brightness of the high dynamic range image displayed on the image panel 22 is adjusted, the histogram displayed on the histogram panel 24 changes accordingly. The displayed high dynamic range data can be provided for other operations. For example, the user interface can be integrated with an image processing system for producing and processing high dynamic range images.

Thus, display methods and interfaces of high dynamic range images may potentially resolve the inconvenience of conventional high dynamic range image display methods. The disclosed methods are particularly useful for processing system for high dynamic range images.

Methods of the present invention, or certain aspects or portions of embodiments thereof, may take the form of program code (i.e., instructions) embodied in media, such as floppy diskettes, CD-ROMS, hard drives, firmware, or any other machine-readable storage medium, wherein, when the program code is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing and embodiment of the invention. The methods and apparatus of the present invention may also be embodied in the form of program code transmitted over some transmission medium, such as electrical wiring or cabling, through fiber optics, or via any other form of transmission, wherein, when the program code is received and loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing and embodiment of the invention. When implemented on a general-purpose processor, the program code combines with the processor to provide a unique apparatus that operates analogously to specific logic circuits.

While the invention has been described by way of example and in terms of preferred embodiment, it is to be understood that the invention is not limited thereto. Those who are skilled in this technology can still make various alterations and modifications without departing from the scope and spirit of this invention. Therefore, the scope of the present invention shall be defined and protected by the following claims and their equivalents.

Claims as granted

13 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

4 codes
IPC · International Patent Classification
Section G — Physics
  • G09G5/00
  • G06K9/00
USPC · US Patent Classification
345/617382/169

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomJan 2008Jul 2008Jan 2009Jul 2009Jan 2010Jul 2010Jan 2011Jul 2011Jan 2012Jul 2012Jan 2013USPTOApplicantNon-final rejectionNon-final rejectionFinal rejectionNon-final rejectionNotice of allowance
USPTOApplicanthover for detail · click to open
Pendency
5.2 y
1,898 days filing → grant
Office actions
4
non-final + final
Responses
4
1 RCE
Examiner
Daniel Washburn
art unit 2628 · TC 2600
Citations: 25 back · 7 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom20082010201220142016201820202022202420262028Owner 2Owner 3Owner 6Owner 8liens, releases & corrections
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock