USPatent applicationPatented

Camera adjusting system and method

Granted 27 Nov 2012 · 2 office actions

Current assignee: Ingrasys Technology Inc. · originally Foxconn Technology Group

Law firm: Law firm · Log in to unlock

Attorney: Attorney · Log in to unlock

Inventors: Chang-Jung Lee, Chih-Ping Lo, Hou-Hsien Lee · Examiner: Sinh Tran · AU 2661 · TC 2600

Life of the application

10 dated events
⤢ drag to zoom20102012201420162018202020222024202620282030ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

A camera adjusting system includes a first camera, a second camera, and a control apparatus. The first camera is movably arranged on a sliding rail to monitor a locale. The second camera captures a three dimensional (3D) image of a head of a subject. The control apparatus receives the captured 3D image of the head of the subject and simulates a corresponding 3D model according to the captured 3D image, and compares the actual 3D model with a reference 3D model, to compute a compared result, and outputs a control signal to the first camera to adjust parameters of the first camera according to the compared result.

Description

6 parts
›CROSS-REFERENCE

Relevant subject matters are disclosed in three co-pending U.S. patent applications (Application Nos. 12/786,289, 12/786,291, 12/786,293) filed on the same date and having the same title, which are assigned to the same assignee as this patent application.

›BACKGROUND

1. Technical Field

The present disclosure relates to a camera adjusting system and a camera adjusting method.

2. Description of Related Art

Pan-tilt-zoom (PTZ) cameras are commonly used in security systems and, generally, are remotely controlled through the use of computers. To aim the camera and/or adjust the focus may require complex commands to be entered with a keyboard of the computer controlling the camera. This may also be slow and inconvenient. Therefore, there is room for improvement in the art.

›BRIEF DESCRIPTION OF THE DRAWINGS

Many aspects of the present embodiments can be better understood with reference to the following drawings. The components in the drawings are not necessarily drawn to scale, the emphasis instead being placed upon clearly illustrating the principles of the present embodiments. Moreover, in the drawings, all the views are schematic, and like reference numerals designate corresponding parts throughout the several views.

FIG. 1 is a schematic view of an embodiment of a camera adjusting system including a first camera and a control apparatus.

FIG. 2 is a block diagram of a first embodiment of the control apparatus of FIG. 1 .

FIG. 3 is a schematic view of a head of a subject.

FIGS. 3A and 3B are schematic views of the head of the subject of FIG. 3 tilted right and left, respectively.

FIGS. 4A and 4B are schematic views of the side of the head of the subject of FIG. 3 turned right and left, respectively.

FIGS. 5A and 5B are schematic views of the head of the subject of FIG. 3 raised and lowered, respectively.

FIGS. 6A-6C are three schematic views of the first camera of FIG. 1 in three different positions, respectively, together with corresponding actual 3D models and the corresponding postures of the head of the subject.

FIG. 7 is a block diagram of a second embodiment of the control apparatus of FIG. 1 .

FIG. 8 is a flowchart of a first embodiment of a camera adjusting method.

FIG. 9 is a flowchart of a second embodiment of a camera adjusting method.

›DETAILED DESCRIPTION · 1 of 3

The disclosure is illustrated by way of example and not by way of limitation in the figures of the accompanying drawings in which like references indicate similar elements. It should be noted that references to “an” or “one” embodiment in this disclosure are not necessarily to the same embodiment, and such references mean at least one.

Referring to FIG. 1 , an embodiment of a camera adjusting system 100 includes a first camera 10 , a control apparatus 20 , a second camera 30 , and a sliding rail 40 . The second camera 30 is a time-of-flight (TOF) camera. In one embodiment, the sliding rail 40 is circular. In other embodiments, the sliding rail 40 can be designed to be other shapes according to requirements.

The first camera 10 is used to monitor a locale such as a house. The second camera 30 is used to capture a three dimensional (3D) image of a head of a subject 50 , and send the captured 3D image to the control apparatus 20 . The control apparatus 20 receives the captured 3D image, models a corresponding 3D model according to the captured 3D image, and compares the actual 3D model with a reference 3D model, and adjusts the parameters, such as the capturing angles, the positions on the sliding rail 40 , and the zoom scales, of the first camera 10 , according to a compared result between the actual 3D model and the reference 3D model. The first camera 10 is controlled by the control apparatus 20 to move on the sliding rail 40 .

Referring to FIG. 2 , a first embodiment of the control apparatus 20 includes a head detecting module 200 , a 3D modeling module 205 , a first calculating module 210 , a second calculating module 220 , a third calculating module 230 , a fourth calculating module 250 , and a control module 260 .

The head detecting module 200 is used to receive the captured 3D image of the head of the subject 50 from the second camera 30 . In one embodiment, the head detecting module 200 may use the AdaBoost algorithm to detect the captured 3D image.

The 3D modeling module 205 is used to model a corresponding 3D model of the head of the subject 50 according to captured 3D image.

The first calculating module 210 is used to calculate the actual 3D model to compute a tilted angle of the head of the subject 50 . In one embodiment, the first calculating module 210 compares a reference 3D model with the actual 3D model, to compute the tilted angle of the head of the subject 50 . FIG. 3 shows the reference 3D model of the head of the subject 50 , which is straight. FIGS. 3A and 3B show two different tilted angles of the head of the subject 50 , one is tilted right and the other is tilted left.

The second calculating module 220 is used to calculate the actual 3D model to compute a turned angle of the head of the subject 50 . In one embodiment, the second calculating module 220 compares the reference 3D model of FIG. 3 with the actual 3D model, to compute the turned angle of the head of the subject 50 . FIGS. 4A and 4B show two different turned angles of the head of the subject 50 , one is turned right and the other is turned left.

The third calculating module 230 is used to calculate the actual 3D model to compute a raised angle or a lowered angle of the head of the subject 50 . In one embodiment, the third calculating module 230 compares the reference 3D model of FIG. 3 with the actual 3D model, to compute the raised or lowered angle of the head of the subject 50 . FIGS. 5A and 5B show the head is raised and lowered, respectively.

The fourth calculating module 250 is used to calculate the actual 3D model to compute a distance between the head of the subject 50 and the second camera 30 . In one embodiment, the fourth calculating module 250 compares the reference 3D model of FIG. 3 with the actual 3D model, to compute the distance between the head of the subject 50 and the second camera 30 . For example, the distance between the head of the subject 50 and the second camera 30 is fifty centimeters when the size ratio of the actual 3D model is the same as the size ratio of the reference 3D model of FIG. 3 .

In other embodiments, the control module 20 may further include other calculating modules to get other of characteristics of the head of the subject 50 , for example to calculate a number of times the subject 50 blinks their eyes on the actual 3D model.

The control module 260 receives the calculated results of the first to fourth calculating modules 210 , 220 , 230 , and 250 , and correspondingly outputs control signals to the first camera 10 to adjust the parameters of the first camera 10 . For example, when the first calculating module 210 calculates the head of the subject 50 is tilted right ten degrees, the control module 260 outputs a first control signal to control the first camera 10 to move ten degrees clockwise on the sliding rail 40 correspondingly. When the second calculating module 220 calculates the head of the subject 50 is turned left ten degrees, the control module 260 outputs a second control signal to control the lens of first camera 10 to turn left ten degrees correspondingly. When the third calculating module 230 calculates the head of the subject 50 is raised ten degrees, the control module 260 outputs a third control signal to control the lens of first camera 10 to rotate up ten degrees correspondingly. When the fourth calculating module 250 calculates the distance between the second camera 30 and the head of the subject 50 is reduced by ten centimeters, the control module 260 outputs a fourth control signal to control the focus of the first camera 10 to be shortened correspondingly.

In one embodiment, the first camera 10 includes a driving unit (not shown), the driving unit is used to adjust the parameters of the first camera 10 according to the control signals from the control module 260 . In other embodiments, the camera adjusting system 100 further includes a network module (not shown), which is used to transmit the control signals from the control module 260 to the driving unit.

›DETAILED DESCRIPTION · 2 of 3

An example explaining the work process of the first to fourth calculating modules 210 , 220 , 230 , and 250 is given in the next paragraph. The second to fourth calculating modules 220 , 230 , and 250 have a similar work process, therefore, no example will be given.

Example, referring to FIG. 6A , the head of the subject 50 directly faces the second camera 30 . The second camera 30 captures a 3D image of the head of the subject 50 . The control apparatus 20 receives the 3D image through the head detecting module 200 , and models a corresponding 3D model 510 through the 3D modeling module 205 . Because the 3D model 510 is the same as the reference 3D model, the first camera 10 will not be changed and is still fixed on an original position A of the sliding rail 40 . Referring to FIG. 6B , the head of the subject 50 is tilted right about forty-five degrees. The second camera 30 captures a 3D image of the head of the subject 50 . The control apparatus 20 receives the 3D image through the head detecting module 200 , and models a corresponding 3D model 520 through the 3D modeling module 205 . The first calculating module 210 compares the reference 3D model with the actual 3D model 520 , to compute the corresponding tilted angle of the head of the subject 50 . The control module 260 receives the calculated result and outputs the first control signal to control the first camera 10 to move forty-five degrees clockwise on the sliding rail 40 to a position B of the sliding rail 40 correspondingly. Referring to FIG. 6C , the head of the subject 50 is tilted left forty-five degrees. The second camera 30 captures a 3D image of the head of the subject 50 . The control apparatus 20 receives the 3D image through the head detecting module 200 , and models a corresponding 3D model 530 through the 3D modeling module 205 . The first calculating module 210 compares the reference 3D model with the actual 3D model 530 , to compute the corresponding tilted angle of the head of the subject 50 . The control module 260 receives the calculated result and outputs the first control signal to control the first camera 10 to move forty-five degrees anticlockwise on the sliding rail 40 to a position C of the sliding rail 40 correspondingly.

Referring to FIG. 7 , a second embodiment of the control apparatus 22 includes a head detecting module 200 , a 3D modeling module 205 , a first calculating module 210 , a second calculating module 220 , a third calculating module 230 , a fourth calculating module 250 , a control module 260 , and a model editing module 280 . The model editing module 280 is used to edit the 3D model modeled by the 3D modeling module 205 to simplify the 3D model. For example, the model editing module 280 cuts the arms or neck of the 3D model to leave the head of the 3D model only. After editing the 3D model, the calculating processes of the first calculating module 210 , the second calculating module 220 , the third calculating module 230 , and the fourth calculating module 250 can be simpler.

Referring to FIG. 8 , a first embodiment of a camera adjusting method includes the following steps.

In step 81 , the second camera 30 captures a 3D image of the head of the subject 50 .

In step S 82 , the head detecting modules 200 receives the captured 3D image from the second camera 30 . The head detecting module 200 may use the AdaBoost algorithm to detect the captured 3D image.

In step S 83 , the 3D modeling module 205 models a corresponding 3D model of the head of the subject 50 according to captured 3D image.

In step S 84 , the first calculating module 210 compares the actual 3D model with a reference 3D model, to compute a first result of a tilted angle of the head of the subject 50 .

In step S 85 , the second calculating module 220 compares the actual 3D model with the reference 3D model, to compute a second result of a turned angle of the head of the subject 50 .

In step S 86 , the third calculating module 230 compares the actual 3D model with the reference 3D model, to compute a third result of a raised or a lowered angle of the head of the subject 50 .

In step S 87 , the fourth calculating module 250 compares the actual 3D model with the reference 3D model, to compute a fourth result of a distance between the head of the subject 50 and the second camera 30 .

In step S 88 , the control module 260 receives the computed results of the first to fourth calculating modules 210 , 220 , 230 , and 250 , and correspondingly outputs control signals to the first camera 10 to adjust the parameters of the first camera 10 .

In other embodiments, the four steps of S 84 , S 85 , S 86 , and S 87 can be executed in any other order, such as S 85 firstly, S 87 secondly, S 84 thirdly, and S 86 lastly.

Referring to FIG. 9 , a second embodiment of a camera adjusting method includes the following steps.

In step 91 , the second camera 30 captures a 3D image of the head of the subject 50 .

In step S 92 , the head detecting modules 200 receives the captured 3D image from the second camera 30 . The head detecting module 200 may use the AdaBoost algorithm to detect the captured 3D image.

In step S 93 , the 3D modeling module 205 models a 3D model of the head of the subject 50 according to captured 3D image.

In step S 94 , the model editing module 280 edits the 3D model modeled by the 3D modeling module 205 to simplify the 3D model.

In step S 95 , the first calculating module 210 compares the edited 3D model with a reference 3D model, to compute a first result of a tilted angle of the head of the subject 50 .

In step S 96 , the second calculating module 220 compares the edited 3D model with the 3D model, to compute a second result of a turned angle of the head of the subject 50 .

In step S 97 , the third calculating module 230 compares the edited 3D model with the reference 3D model, to compute a third result of a raised or a lowered angle of the head of the subject 50 .

In step S 98 , the fourth calculating module 250 compares the edited 3D model with the reference 3D model, to compute a fourth result of a distance between the head of the subject 50 and the second camera 30 .

›DETAILED DESCRIPTION · 3 of 3

In step S 99 , the control module 260 receives the computed results of the first to fourth calculating modules 210 , 220 , 230 , and 250 , and correspondingly outputs control signals to the first camera 10 to adjust the parameters of the first camera 10 .

In other embodiments, the four steps of S 95 , S 96 , S 97 , and S 98 can be executed in any other order, such as S 98 firstly, S 96 secondly, S 97 thirdly, and S 95 lastly.

The camera adjusting method used in the camera adjusting system 100 can control the first camera 10 according to the action of the head of the subject 50 , which is very easily controlled.

The foregoing description of the exemplary embodiments of the disclosure has been presented only for the purposes of illustration and description and is not intended to be exhaustive or to limit the disclosure to the precise forms disclosed. Many modifications and variations are possible in light of the above everything. The embodiments were chosen and described in order to explain the principles of the disclosure and their practical application so as to enable others of ordinary skill in the art to utilize the disclosure and various embodiments and with various modifications as are suited to the particular use contemplated. Alternative embodiments will become apparent to those of ordinary skills in the art to which the present disclosure pertains without departing from its spirit and scope. Accordingly, the scope of the present disclosure is defined by the appended claims rather than the foregoing description and the exemplary embodiments described therein.

Claims as granted

13 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

11 codes
IPC · International Patent Classification
Section G — Physics
  • G06K9/00
Section H — Electricity
  • H04N23/13
  • H04N7/18
USPC · US Patent Classification
348/265348/262348/161382/115348/159348/143382/118348/77

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomApr 2010Jul 2010Oct 2010Jan 2011Apr 2011Jul 2011Oct 2011Jan 2012Apr 2012Jul 2012Oct 2012Jan 2013USPTOApplicantRestriction requirementResponse after non-final
USPTOApplicanthover for detail · click to open
Pendency
2.5 y
918 days filing → grant
Office actions
1
after a restriction
Responses
1
no RCE
Examiner
Sinh Tran
art unit 2661 · TC 2600
Citations: 5 back · 5 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom20102012201420162018202020222024202620282030Owner 1Owner 2
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock