USPatent publicationPublished

Systems and methods for customizing a personalized user interface using face recognition

Published 26 Jul 2018 · application patented

Current assignee: Resideo Technologies, Inc. · originally Honeywell International

Law firm: Law firm · Log in to unlock

Attorney: Attorney · Log in to unlock

Inventors: Peng Li, Jiehong Shen, Xiukuan Yang · Examiner: Creighton Smith · AU 2656 · TC 2600

Application
15/415,053
filed 25 Jan 2017
Publication· this page
US 20180213190 A1
published 26 Jul 2018
Patent
US 10,033,973
granted 24 Jul 2018
26 Jul 2018
Published
US pre-grant publication
14
Claims as published
5 independent
3
Classifications
G06F9/44, H04N7/18
3
Inventors
Peng Li
Patented
Application status
granted 24 Jul 2018
59
File wrapper
transactions

Life of the application

15 dated events
⤢ drag to zoom2018202020222024202620282030203220342036ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

Systems and methods for customizing a personalized user interface of an IP video door phone using face recognition are provided. Methods can include receiving an image of a user captured by a camera, performing face recognition processing on the image to identify an age of the user, identifying a customized user interface associated with the age of the user, and causing a display screen to display the customized user interface.

Description

5 parts
›FIELD

The present invention relates generally to IP video door phones. More particularly, the present invention relates to systems and methods for customizing a personalized user interface of an IP video door phone using face recognition.

›BACKGROUND

IP video door phones are known in the art and can include a user interface. However, depending on an age and capabilities of a user, configuration of the user interface can be inconvenient to use. Indeed, users of different ages may have different interface requirements.

In view of the above, there is a continuing, ongoing need for improved systems and methods.

›BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a flow diagram of a method in accordance with disclosed embodiments;

FIG. 2 is a flow diagram of a method in accordance with disclosed embodiments;

FIG. 3 is a block diagram of a method in accordance with disclosed embodiments;

FIG. 4 is a block diagram of a method in accordance with disclosed embodiments; and

FIG. 5 is a block diagram of a method in accordance with disclosed embodiments.

›DETAILED DESCRIPTION · 1 of 2

While this invention is susceptible of an embodiment in many different forms, there are shown in the drawings and will be described herein in detail specific embodiments thereof with the understanding that the present disclosure is to be considered as an exemplification of the principles of the invention. It is not intended to limit the invention to the specific illustrated embodiments.

Embodiments disclosed herein can include systems and methods for customizing a personalized user interface of an IP video door phone using face recognition. Advantages of the disclosed systems and methods include, but are not limited to providing an improved human user experience and preventing users of different ages from using the IP video door phone incorrectly.

In some embodiments, an IP video door phone device can include a camera, such as a CMOS camera, for video talk between different devices. The camera can capture an image of a user proximate the device, the device can perform face recognition processing on the captured image, and a user interface of the device can be customized based on results of the face recognition processing. For example, in some embodiments, the device can identify an age group of the user in the captured image and can cause a display screen of the device to display a user interface associated with the identified age group.

In some embodiments, a plurality of age groups can include an old age group, a child age group, and a middle age group. Users over a predetermined age can be associated with the old age group and be more likely to be presbyopic. Therefore, the customized user interface associated with the old age group can include fonts or icons that are amplified and/or increased in size. Similarly, users under a predetermined age can be associated with the child age group and be more likely to disturb configuration settings set by their parents. Therefore, the customized user interface associated with the child age group can include limited functionality.

FIG. 1 is a flow diagram of a method 100 in accordance with disclosed embodiments. As seen in FIG. 1 , the method 100 can include placing an IP video door phone device in a configuration mode as in 110 . Then, the method 100 can include identifying respective parameters for each of a plurality of different user interfaces as in 120 , wherein each of the plurality of different user interfaces can be associated with a respective one a plurality of age groups. It is to be understood that each of the plurality of age groups can be associated with a respective one of a plurality of roles. It is also to be understood that that the parameters associated with the plurality of different user interfaces can be stored in a local or remote memory device or database. Finally, the method 100 can include scanning a face of a user and binding or associating an image of the scanned face with one of the plurality of roles, one of the plurality of age groups, and/or one of the plurality of different user interfaces as in 130 . It is to be understood that associations between the image of the scanned face and the pluralities of user interfaces, age groups, and roles can also be stored in the local or remote memory device or database.

FIG. 2 is a flow diagram of a method 200 in accordance with disclosed embodiments. As seen in FIG. 2 , the method 200 can include scanning a face of a user as in 210 and determining whether an image of the scanned face is indicative of the user being an adult as in 220 , that is, having an age within a predetermined adult age range. If so, then the method 200 can include causing a display screen of a device to display a user interface associated with the predetermined adult age range as in 230 .

For example, as seen in the block diagram of the method 300 in FIG. 3 , the method 300 can include scanning the face of the user as in 310 , performing face recognition processing on the image of the scanned face to determine that the user is an adult as in 320 , and displaying a normal user interface associated with the predetermined adult age range as in 330 . In some embodiments, the user interface associated with the predetermined adult age range can include a capability to control a full functionality of the device.

However, when the method 200 determines that the image of the scanned face is not indicative of the user being an adult as in 220 , the method 200 can include determining whether the image of the scanned face is indicative of the user being an old person as in 240 , that is, having an age within a predetermined old person age range or having an age above a predetermined age. If so, then the method 200 can include causing the display screen of the device to display a user interface associated with the predetermined old person age range as in 250 .

For example, as seen in the block diagram of the method 400 in FIG. 4 , the method 400 can include scanning the face of the user as in 410 , performing the face recognition processing on the image of the scanned face to determine that the user is an old person as in 420 , and displaying an old person user interface associated with the predetermined old person age range as in 430 . In some embodiments, the user interface associated with the predetermined old person age range can include fonts or icons with an increased size relative to a size of the fonts or icons on the normal user interface.

However, when the method 200 determines that the image of the scanned face is not indicative of the user being an old person as in 240 , the method 200 can include determining whether the image of the scanned face is indicative of the user being a child as in 260 , that is, having an age within a predetermined child age range or having an age below a predetermined age. If so, then the method 200 can include causing the display screen of the device to display a user interface associated with the predetermined child age range as in 270 . If not, then the method 200 can include determining that the image of the scanned face is indicative of the user having another role as in 280 .

›DETAILED DESCRIPTION · 2 of 2

For example, as seen in the block diagram of the method 500 in FIG. 5 , the method 500 can include scanning the face of the user as in 510 , performing the face recognition processing on the image of the scanned face to determine that the user is a child as in 520 , and displaying a child user interface associated with the predetermined child age range as in 530 . In some embodiments, the user interface associated with the predetermined child age range can include the capability to control limited functionalities of the device.

It is to be understood that the IP video door phone device as disclosed and described above can include the camera described above, a transceiver device, and a memory device, each of which can be in communication with control circuitry, one or more programmable processors, and executable control software as would be understood by one of ordinary skill in the art. The executable control software can be stored on a transitory or non-transitory computer readable medium, including, but not limited to local computer memory, RAM, optical storage media, magnetic storage media, flash memory, and the like. In some embodiments, some or all of the control circuitry, the programmable processors, and the executable control software can execute and control at least some of the methods described above.

Although a few embodiments have been described in detail above, other modifications are possible. For example, the logic flows described above do not require the particular order described or sequential order to achieve desirable results. Other steps may be provided, steps may be eliminated from the described flows, and other components may be added to or removed from the described systems. Other embodiments may be within the scope of the invention.

From the foregoing, it will be observed that numerous variations and modifications may be effected without departing from the spirit and scope of the invention. It is to be understood that no limitation with respect to the specific system or method described herein is intended or should be inferred. It is, of course, intended to cover all such modifications as fall within the spirit and scope of the invention.

Claims as published

11 claims

Log in to read the claims of this publication.

Log in to unlock

Classifications

3 codes
IPC · International Patent Classification
Section G — Physics
  • G06F9/44
  • G06K9/00
Section H — Electricity
  • H04N7/18

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this publication are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomJan 2017Apr 2017Jul 2017Oct 2017Jan 2018Apr 2018Jul 2018USPTOApplicantNon-final rejectionResponse after non-finalResponse after non-finalNotice of allowance
USPTOApplicanthover for detail · click to open
Pendency
1.5 y
545 days filing → grant
Office actions
2
non-final + final
Responses
2
no RCE
Examiner
Creighton Smith
art unit 2656 · TC 2600
Citations: 11 back · 2 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom2018202020222024202620282030203220342036Owner 2Owner 3liens, releases & corrections
TitleLienhover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock