USPatent applicationPatented

System and method for reducing specular reflection

Granted 27 Nov 2012 · 6 office actions

Current assignee: Novanta Inc. · originally Jadak Technologies, Inc.

Law firm: Law firm · Log in to unlock

Attorney: Attorney · Log in to unlock

Inventors: Brian Paul Ford · Examiner: Tsung-Yin Tsai · AU 2624 · TC 2600

Life of the application

22 dated events
⤢ drag to zoom20062008201020122014201620182020202220242026ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

An imaging unit programmed to reduce specular reflection in a captured image and improve the interpretation of decodable information within the image. The imaging unit is programmed to scan a predetermined region within the image that is susceptible to specular reflection, evaluate the pixel values within the region against a threshold value that is representative of specular reflection, and then replace the pixel value found to represent specular reflection with replacement pixel values that do not corrupt interpretation of the decodable information in the predetermined region. The threshold value and replacement values may be determined on an ad hoc basis and stored in local memory, or calculated for each captured image.

Description

5 parts
›BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to image capture and data collection systems and, more specifically, to a system and method for reducing specular reflection in optical images to be interpreted and decoded.

2. Description of the Related Art

Specular reflection, or glare, often presents a problem during the interpretation of images captured by automatic identification systems, such as bar code scanners or vision processing devices. Conventional methods of reducing specular reflection involve sophisticated systems having multiple light sources and/or imagers. For example, some systems use an array of mirrors for selecting specific wavelengths of light and a detector having two charged coupled devices (CCDs) tuned to different wavelengths to take two images of a target. The detector is programmed to selectively buffer the image data and correct for any specular reflection using information obtained from both CCDs. These systems, however, require additional hardware and strategic positioning of the illumination source for proper functioning and are therefore costly and time consuming to implement.

›BRIEF SUMMARY OF THE INVENTION

It is therefore a principal object and advantage of the present invention to provide a simple system and method for reducing specular reflection.

It is an additional object and advantage of the present invention to provide a less costly system and method for reducing specular reflection.

It is a further object and advantage of the present invention to provide a less intrusive system and method for reducing specular reflection

In accordance with the foregoing objects and advantages, the present invention comprises an optical imager that has been programmed to reduce specular reflection (i.e., glare) in a captured image to reduce the negative impact of the specular reflection on image interpretation. Specular reflection in reduced by reviewing the image to be decoded on a pixel-by-pixel basis and looking at the value of each pixel in the area of interest. If the amplitude of the pixel value is greater than a threshold, the pixel value is replaced with a predetermined value that may be fixed, computed via a calibration process, or dynamically determined from frame to frame. The predetermined value may be selected by using a weighted sum of pixels around the current pixel or another image processing technique to reduce noise in the area of interest. The image produced by this process will have no values greater than the threshold and may thus be more easily decoded by barcode decoding or image processing algorithms.

›BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will be more fully understood and appreciated by reading the following Detailed Description in conjunction with the accompanying drawings, in which:

FIG. 1 is schematic of an optical imager according to the present invention.

FIG. 2 is a flowchart of a method of reducing specular reflection according to the present invention.

FIG. 3 is an image of a target object affected by specular reflection.

FIG. 4 is an image of a target object after processing according to the method of reducing specular reflection according to the present invention.

›DETAILED DESCRIPTION OF THE INVENTION · 1 of 2

Referring now to the drawings, wherein like reference numerals refer to like parts throughout, there is seen in FIG. 1 , an imaging unit 10 according to the present invention, Imaging unit 10 preferably includes an on-board illumination source 12 comprising one or more light emitting diodes (LEDs) of various wavelengths, to provide illumination of a target (not shown) to be imaged and interpreted. Alternatively, illumination source 12 may be separately attached to imaging unit 10 and positioned proximately thereto.

Imaging unit 10 further includes a microcontroller 14 for managing imaging and illumination operations, performing processing of captured images, and communicating with a remote device, such as a host computer, if desired. For example, imaging unit 10 may include a host interface 16 , such as a conventional RS232 transceiver and associated 12 pin FFC jack. Alternatively, interface 16 may comprise other conventional buses, such as USB, IEEE, 1394, IrDA, PCMCIA, or Ethernet (TCP/IP). Interface 16 may also comprise a wireless transceiver for wireless communication to a host computer and is programmed with the applicable protocols for interfacing with a host computer, such as Bluetooth(r) or 802.11 protocols.

Microcontroller 14 is interconnected to an imaging engine 18 for optically imaging a target object (not shown) and forming corresponding electrical image data. Microcontroller 14 is also interconnected to an illumination engine 20 for controlling the timing and illumination of illumination source 12 during imaging operations. Optionally, imaging engine 18 and illumination engine 20 may be provided as a single unit interconnected to microcontroller 14 .

Imaging unit 10 may comprise an IT4X10/80 SR/SF or IT5X10/80 series imager available from Hand Held Products, Inc. of Skaneateles Falls, N.Y. The IT5X10/80 series imager is a CMOS-based decoded output engine that has image capture capabilities via a 12-bit A/D converter. Imaging unit 10 obtains an optical image of the field of view and uses preprogrammed algorithms to decipher the contents of the image. For example, imaging unit 10 may be programmed to capture and interpret two-dimensional images of 1D linear barcodes, 2D stacked/matrix barcodes, standard optical character recognition (OCR) fonts, Reduced Space Symbology (RSS) barcodes, and postal barcodes. Imaging unit 10 may also provide captured images for use in a wide range of applications, such as image and shape recognition, signature capture, image capture, and non-standard optical character recognition.

Microcontroller 14 may comprise a MC9328MXL VH15 microprocessor, available from Freescale Semiconductor, Inc. of Chandler, Ariz., that is programmed prior to implementation in imaging unit 10 , or programmed anytime thereafter, such as by using interface 16 to upgrade the firmware used for microcontroller 14 . As will be explained hereinafter, imaging unit 10 may be programmed to reduce specular reflection on the target, thereby improving the interpretation of information, such as a barcode, within the image field.

Referring to FIG. 2 , imaging unit is programmed to perform specular reduction process 24 on images that are captured. Specular reduction process 24 begins after image data is captured into a buffer 26 . The boundaries for the area to be processed are then loaded 28 . The boundaries are preferably predetermined based on the image to be captured, stored in memory 30 and then retrieved. After the boundaries are loaded 28 , the specular reflection threshold 32 is loaded, preferably from memory 34 . The specular reflection threshold 32 is a predetermined pixel value within the image that will be treated as specular reflection and reduced according to the present invention. As with the boundaries 28 , the specular reflection threshold 32 is preferably predetermined based on the characteristics of the object to be imaged and the resulting image, such as one captured during a test. After retrieving the boundaries threshold 28 , specular reduction process 24 then begins a systematic routine where each pixel values within the predetermined boundaries is evaluated 36 . If a check 38 of a pixel value within the boundaries exceeds the threshold, the pixel value is replaced with a predetermined replacement value 40 , such as zero (i.e., black). Another check 42 is then performed to determine whether the last pixel within the boundaries has been evaluated and if, so, the adjusted image data is output 44 . If not, process 24 returns to step 36 and continues to evaluate pixel values within the boundaries.

As seen in FIG. 3 , specular reflection in one region of a digital image of an object captured using an optical imaging unit 10 according to the present invention distorts the overall image and adversely affects the interpretation of information contained in the image, such as the barcode. As seen in FIG. 4 , the implementation of specular process 24 using a replacement value of zero eliminates the glare that adversely affects the interpretation of the barcode and allows for decoding of the information where otherwise impossible.

Specular reflection threshold 32 may be determined through a variety of methods. For example, specular reflection threshold 32 may be a fixed number determined through experimentation and configured into unit 10 . Alternatively, specular reflection threshold 32 may be set by testing unit 10 prior to operation and allowing unit 10 to calibrate and set the most effective specular reflection threshold 32 for actual use. Finally, specular reflection threshold 32 may be implemented dynamically and determined from frame to frame as unit 10 captures images.

Whether unit 10 is precalibrated or set for dynamic application of specular reflection threshold 32 , a histogram of all pixel values in a predetermined region such as the region defined by boundaries 28 . The most frequently occurring pixels that are within ten percent of the maximum pixel value may then be thresholded. The sensitivity of unit 10 may be adjusted by varying the ten percent figure as needed. We can adjust the sensitivity of the system by adjusting that 10% number as needed.

›DETAILED DESCRIPTION OF THE INVENTION · 2 of 2

For example, where X 1 ,X 2 ,Y 1 ,Y 2 represents that pixel coordinates defining the region and MaxPixelValue is the maximum amplitude of a pixel (i.e., the most saturated pixel) in the region, the maximum pixel value and specular reflection threshold are defined as:

MaxPixelValue=MAX( X 1 ,X 2 ,Y 1 ,Y 2 )

Threshold=0.90*MaxPixelValue

Once these two values are computed, the calculations are iterated across the entire region of interest and the amplitude of any pixel above the threshold is modified to be zero (black). This process may be implemented after acquisition of a test image using various percentages. Unit 10 may then be calibrated by storing the most effective parameters in memory for application to every subsequent image captured by unit 10 . Alternatively, this process may be implemented dynamically each time that an image is captured by unit 10 .

Claims as granted

15 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

8 codes
IPC · International Patent Classification
Section G — Physics
  • G06V10/30
  • G06V10/28
USPC · US Patent Classification
382/275348/576382/117382/167348/222.1356/614

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoom2007200820092010201120122013USPTOApplicantNon-final rejectionFinal rejectionFinal rejectionNon-final rejectionFinal rejectionExaminer-initiated interview
USPTOApplicanthover for detail · click to open
Pendency
6.2 y
2,252 days filing → grant
Office actions
6
non-final + final
Responses
3
3 RCE
Interviews
1
examiner interview summaries
Examiner
Tsung-Yin Tsai
art unit 2624 · TC 2600
Citations: 13 back · 2 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom2008201020122014201620182020202220242026Owner 1Owner 2Owner 3liens, releases & corrections
TitleLienhover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock