USPatent applicationPatented

Auto-focusing camera module and auto-focusing method using same

Granted 22 Jul 2014 · 1 office action

Assignee: Foxconn Technology Group

Law firm: Law firm · Log in to unlock

Attorney: Attorney · Log in to unlock

Inventors: Sung-Ching Wu, Ting-Yuan Wu · Examiner: James Jones · AU 2872 · TC 2800

Life of the application

8 dated events
⤢ drag to zoom20122014201620182020202220242026202820302032ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

An auto-focus camera module includes an lens module, an image sensor, a color separation unit, a main processor unit and an image processing unit. The lens module captures an image of object. The image sensor receives the image captured by the lens module. The color separation unit separates the image into red, green and blue colors. The main processor unit calculates MTF values of the sensed image and determines a shooting mode of the AF camera. The image processing unit processes the image according to the MTF values to compensate for any blurring of the image caused by being out of focus. The driving unit drives the lens module to the point of optimal focus on the object according to MTF values.

Description

4 parts
›BACKGROUND

1. Technical Field

The present disclosure relates to an auto-focusing (AF) camera module and an AF method using the AF camera module.

2. Description of Related Art

Digital AF technology allows blurred images (out of focus images) to be processed by software modules, which may employ an extended depth of field (EDOF) technology, to achieve a sharper image. However, the digital AF technology does not work properly if the distance to the object is short, e.g. less than 40 cm.

What is needed therefore is an AF camera module and AF method using the camera module addressing the limitations described.

›BRIEF DESCRIPTION OF THE DRAWINGS

The components of the drawings are not necessarily drawn to scale, the emphasis instead being placed upon clearly illustrating the principles of the embodiments of the present disclosure. Moreover, in the drawings, like reference numerals designate corresponding parts throughout several views.

FIG. 1 is a schematic view of an AF camera module, according to an exemplary embodiment of the present disclosure.

FIG. 2 is a flowchart of an AF method, according to an exemplary embodiment of the present disclosure.

›DETAILED DESCRIPTION · 1 of 2

Referring to FIG. 1 , an AF camera module 100 , according to an exemplary embodiment of the present disclosure, is shown. The AF camera module 100 includes an lens module 10 , an image sensor 20 , a color separation unit 30 , a main processor unit 40 , an image processing unit 50 , and a driving unit 60 . A center of the image sensor 20 is aligned with an optical axis of the lens module 10 . The color separation unit 30 is electrically connected to the image sensor 20 , the main processor unit 40 is electrically connected to the color separation unit 30 , and the image processing unit 50 and the driving unit 60 are both electrically connected to the main processor unit 40 . The driving unit 60 is also connected to the lens module 10 .

The lens module 10 captures images of an object(s) and focuses the images onto a sensing area of the image sensor 20 . The lens module 10 includes at least one lens 101 . In this embodiment, each of the at least one lens 101 is an aspherical lens.

The image sensor 20 senses the images captured by the lens module 10 . The image sensor 20 includes a number of pixel units arranged in the sensing area, each pixel unit includes a red pixel, a green pixel and a blue pixel. In one embodiment, the number of the pixel units 20 is not less than 2048×1536. In this illustrated embodiment, the image sensor 20 can be a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS). An image sensed overall by the image sensor 20 comprises a number of image portions corresponding to the pixel units.

The color separation unit 30 separates a sensed image into red, green and blue colors. In detail, each image portion of the image is separated into a red color part, a green color part and a blue color part, the red color parts of the image portions construct the image in red, the green parts of the image portions construct the image in green, and the blue parts of the image portions construct the image in blue.

The main processor unit 40 includes a modulation transfer function (MTF) calculating module 41 , an object distance calculating module 42 , an object distance judging module 43 , a blur calculating module 44 , an offset calculating module 45 , a focus calculating module 46 and a driving distance calculating module 47 . The MTF calculating module 41 is electrically connected to the color separation unit 30 , the object distance calculating module 42 is electrically connected to the MTF calculating module 41 , the object distance judging module 43 is electrically connected to the object distance calculating module 42 , the focus calculating module 46 and the blur calculating module 44 are electrically connected to the object distance judging module 43 , the offset calculating module 45 is electrically connected to the blur calculating module 44 and the image processing unit 50 , and the driving distance calculating module 47 is electrically connected to the focus calculating unit 46 and the driving unit 60 .

The MTF calculating module 41 calculates MTF values of each image portion of an image sensed by the image sensor 20 . In this embodiment, the MTF calculating module 41 respectively calculates MTF values of the red parts, the green parts and the blue parts of each image portion.

The object distance calculating module 42 calculates an object distance of an object in each image portion of the image according to the MTF values calculated by the MTF calculating module 41 .

The object distance judging module 43 determines a shooting mode according to the object distances calculated by the object distance calculating module 41 . In detail, the object distance judging module 43 analyzes the object distances calculated by the object judging module 43 , compares the results with a predetermined distance value(s), and determines the shooting mode. In this embodiment, the object distance judging module 43 analyzes the object distances of the pixel units and generates a main object distance representing the distance-to-object distance of a main object in the image. The predetermined distance value is used for distinguishing the shooting mode of the AF camera module 100 , in this embodiment, the predetermined distance value is 40 cm, if the main object distance is more than 40 cm, the AF camera module 100 is set at a long shooting mode, and if the main object distance is equal to or less than 40 cm, the AF camera module 100 is set at a close shooting mode.

The blur calculating module 44 compares the MTF values of each image portion of the image calculated by the MTF calculating module 41 with corresponding predetermined MTF values, calculates the differences between the MTF values of each image portion and the predetermined MTF values, and generates blur quantities of each image portion of the image. The predetermined MTF values are those values applying to the object in the image which is the sharpest, and the predetermined MTF values are different corresponding to different object distances. In this embodiment, the blur calculating module 44 calculates the blur quantities of the red part, of the green part and of the blue part of each image portion. The blur calculating module 44 may select on state or off state for the blur calculating function according to the shooting manner determined by the object distance judging module 43 . In this embodiment, if the AF camera module 100 is set at a long shooting mode, the blur calculating module 44 switches on the blur calculating function, and if the AF camera module 100 is set at a close shooting mode, the blur calculating module 44 switches off the blur calculating function.

The offset calculating module 45 calculates offsets to compensate for any blurring of each image portion according to the result achieved by the blur calculating module 44 . In this embodiment, the offset calculating module 45 calculates offsets of the red part, of the green part and of the blue part of each image portion.

The focus calculating module 46 calculates an optimum focus of the lens module 10 according to the calculation of the object distance calculating module 42 . The focus calculating module 46 may select on state or off state for the focus calculating function thereof according to the shooting mode determined by the object distance judging module 43 . In this embodiment, if the AF camera module 100 is set at a long shooting mode, the focus calculating module 46 switches off the focus calculating function, and if the AF camera module 100 is set at a close shooting mode, the focus calculating module 46 switches on the focus calculating function.

›DETAILED DESCRIPTION · 2 of 2

The driving distance calculating module 47 calculates a driving distance to be applied to the lens module 10 according to the optimum focus calculated by the focus calculating module 46 .

The image processing unit 50 processes the image according to the calculation of the offset calculating module 45 to achieve a sharper processed image. In detail, the image processing unit 50 compensates for any blurring of each image portion of the image according to the offsets calculated by the offset calculating module 45 . In this embodiment, the image processing unit 50 compensates for any blurring of the red color portion, of the green color portion and of the blue color portion of each image portion.

The driving unit 60 drives the lens module 10 to the position for optimum focus according to the driving distance calculated by the driving distance calculating module 47 . In this embodiment, the driving unit 60 is a piezoelectric actuator. Alternatively, the driving unit 60 can be a voice coil motor (VCM).

Referring to FIG. 2 , an exemplary embodiment of an AF method using the AF camera module 100 is shown. The AF method includes the following steps:

In step S 01 , an image sensed by the image sensor 20 is read.

In step S 02 , the image sensed by the image sensor 20 are separated into red, green and blue colors. Each image portion of the image is separated into a red color part, a green color part and a blue color part.

In step S 03 , MTF values of each image portion of the image are calculated. The MTF values of the red part, the green part and the blue part of each image portion are calculated.

In step S 04 , the object distance of the object in each image portion is determined according to the MTF values of each image portion.

In step S 05 , a main object distance representing the object distance of a main object in the image is generated by analyzing the object distances of the image potions.

In step S 06 , a shooting mode of the AF camera module 100 is determined according to the object distance of the object in each image portion.

If the AF camera module 100 is set at a close shooting mode, the steps immediately following are executed, if not the process goes to step 8 :

In step S 07 , an optimum focusing position of the at least one lens 101 is determined according to the object distance of the object in each image portion.

In step S 08 , a driving distance of the at least one lens 101 is determined according to the optimum focusing position.

In step S 09 , the at least one lens 101 is driven to the optimum focusing position according to the driving distance. Then, the AF camera module 100 can capture a properly focused image.

If the AF camera module 100 is set at a long shooting mode, the following step are executed:

S 10 , the quantity of blurring of each image portion is calculated according to the MTF values.

S 11 , offset for compensating for the blurring of each image portion is calculated according to the quantity of blurring of each image portion.

S 12 , each image portion is processed according to the offset of each image portion. Then, the processed image can be stored as a properly focused image.

The AF camera module 100 and the AF method using the AF camera module 100 determine a shooting mode according the distance to an and either a mechanical manner or a digital manner of adjustment may be applied, thus a sharp image can be generated whether the distance to an object is short or not.

It is believed that the present embodiments and their advantages will be understood from the foregoing description, and it will be apparent that various changes may be made thereto without departing from the spirit and scope of the disclosure or sacrificing all of its material advantages, the examples hereinbefore described merely being preferred or exemplary embodiments of the disclosure.

Claims as granted

11 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

3 codes
IPC · International Patent Classification
Section G — Physics
  • G02B15/14
USPC · US Patent Classification
359/698348/345

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomJul 2012Oct 2012Jan 2013Apr 2013Jul 2013Oct 2013Jan 2014Apr 2014Jul 2014USPTOApplicantNon-final rejectionResponse after non-final
USPTOApplicanthover for detail · click to open
Pendency
2.1 y
764 days filing → grant
Office actions
1
non-final + final
Responses
1
no RCE
Examiner
James Jones
art unit 2872 · TC 2800
Citations: 1 back · 6 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom20122014201620182020202220242026202820302032Owner 1
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock