Face image replacement system and method implemented by portable electronic device
Granted 29 Oct 2013 · 2 office actions
Current assignee: Cloud Network Technology Singapore Pte. Ltd. · originally Foxconn Technology Group
Law firm: Law firm · Log in to unlock
Attorney: Attorney · Log in to unlock
Inventors: Chang-Jung Lee, Hou-Hsien Lee, Chih-Ping Lo · Examiner: Daniel M Pasiewicz · AU 2661 · TC 2600
Life of the application
11 dated eventsAbstract
A face image replacement system and method is implemented by an portable electronic device. The portable electronic device includes an image capturing device, a display screen, and a storage device. A person image of a user is captured by the image capturing device, and a face area of the person image is determined according to face character data stored in the storage system. The system marks the face area with a rectangle area and calculates a size of the rectangle area, obtains a special image from the storage system, and adjusts a size of the special image according to the size of the rectangle area. The face area of the person image is replaced with the special image to generate a face replacement image, and the face replacement image is displayed on the display screen of the portable electronic device.
Description
4 parts›BACKGROUND
1. Technical Field
Embodiments of the present disclosure relate to image processing systems and methods, and particularly to a face image replacement system and method implemented by a portable electronic device.
2. Description of Related Art
Portable electronic devices, such as personal digital assistants (PDA) or mobile phones, have image capturing functions and image processing functions. For example, a mobile phone can capture an image of a person with an image capturing unit of the mobile phone, and display the image on a display screen of the mobile phone. However, a face image of the image cannot be detected and used to replace the face image with another image, to protect the privacy of the person when the image is viewed by other users.
›BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a block diagram of one embodiment of a portable electronic device comprising a face image replacement system.
FIG. 2 is a flowchart of one embodiment of a face image replacement method implemented by a portable electronic device of FIG. 1 .
FIG. 3 is a detailed flowchart of block S 27 of FIG. 2 .
FIG. 4 is a schematic diagram illustrating one example of replacement of a face image captured by the portable electronic device of FIG. 1 .
›DETAILED DESCRIPTION · 1 of 2
The present disclosure, including the accompanying drawings, is illustrated by way of examples and not by way of limitation. It should be noted that references to “an” or “one” embodiment in this disclosure are not necessarily to the same embodiment, and such references mean at least one.
FIG. 1 is a block diagram of one embodiment of a portable electronic device 1 comprising a face image replacement system 12 . The face image replacement system 12 can detect a face area in an image of a person, and replace the face area with a special image (e.g., a football image) to cover the face area of the person image, to protect the privacy of the person when the person image is viewed by other users. The portable electronic device 1 further includes an image capturing device 11 , a display screen 13 , a storage system 14 , and a least one microprocessor 15 . It should be understood that FIG. 1 illustrates only one example of the portable electronic device 1 , and may include more or fewer components than illustrated, or a different configuration of the various components in other embodiments.
The image capturing device 11 is configured to capture a person image (such as the image “A” as shown in FIG. 4 ) of a user when the user presses a shutter button of the image capturing device 11 . In one embodiment, the image capturing device 11 may be a digital camera or a video capturing device.
The storage system 14 stores one or more special images predefined by the user, such as a football picture “D” as shown in FIG. 4 . Each of the special images is used to cover a face area of the image to generate a face replacement image of the user. The storage system 14 may further store different face replacement images that are covered by the special images, such as the face replacement images “B” and “C” as shown in FIG. 4 . In one embodiment, the storage system 14 may be an internal storage device, such as a random access memory (RAM) for temporary storage of information, and/or a read only memory (ROM) for permanent storage of information. In some embodiments, the storage system 14 may also be an external storage device, such as an external hard disk, a storage card, or a data storage medium.
In one embodiment, the face image replacement system 12 includes an image storing module 121 , an image analysis module 122 , an image adjustment module 123 , and an image replacement module 124 . The modules 121 - 124 may comprise computerized code in the form of one or more programs that are stored in the storage system 14 . The computerized code includes instructions that are executed by the at least one microprocessor 15 to provide functions for implementing the modules. In general, the word “module,” as used herein, refers to logic embodied in hardware or firmware, or to a collection of software instructions, written in a program language. In one embodiment, the program language may be Java or C. One or more software instructions in the modules may be embedded in firmware, such as an EPROM. The modules described herein may be implemented as either software and/or hardware modules and may be stored in any type of computer-readable medium or other storage device.
The image storing module 121 is operable to store one or more special images (e.g., a football picture “D” as shown in FIG. 4 ) to the storage system 14 . The image storing module 121 is further operable to store a face replacement image to the storage system 14 when the face area of the image is covered by a special image, such as a face replacement image “C” as shown in FIG. 4 .
The image analysis module 122 is operable to control the image capturing device 11 to capture a person image of the user, and analyze pixels of the image to determine a face area of the person image according to face character data stored in the storage system 11 . In the embodiment, the face character data may include mouth character data, eye character data, and noise character data.
The image adjustment module 123 is operable to mark the face area with a rectangle area if the image has the face image, and calculate a size of the rectangle area. In one example with respect to FIG. 4 , a length of the rectangle area is 3 cm, and a width of the rectangle area is 5 cm. The image adjustment module 123 can use the rectangle area to mark the face area in the image, such as the person image “A” marked with the rectangle area as shown in FIG. 4 .
The image adjustment module 123 is further operable to obtain a special image (e.g., a football picture “D” as shown in FIG. 4 ) from the storage system 14 , and adjust a size of the special image according to the size of the rectangle area. In the embodiment, the image adjustment module 123 adjusts a length of the special image as 3 cm, and adjusts a width of the special image as 5 cm.
The image replacement module 124 is operable to replace the face area of the person image with the special image to generate a face replacement image, such as the face replacement image “C” as shown in FIG. 4 . The image replacement module 124 is further operable to display the face replacement image on the display screen 13 when the user views the person image.
In one embodiment, the image replacement module 124 checks pixel points of the face image, and determines whether a RGB value of each pixel point of the face area is equal to a gray value. The gray value is defined according to user's requirements, for example, generally defined as R=128, G=128, and B=128. If the RGB value of a pixel point of the face area is equal to the gray value, the image replacement module 124 keeps the pixel point in the face area. Otherwise, the RGB value of a pixel point of the face area is not equal to the gray value, the image replacement module 124 replaces the pixel point of the face area with a pixel point of the special image.
FIG. 2 is a flowchart of one embodiment of a face image replacement method implemented by the portable electronic device 1 of FIG. 1 . Depending on the embodiment, additional blocks may be added, others removed, and the ordering of the blocks may be changed.
›DETAILED DESCRIPTION · 2 of 2
In block S 21 , the image storing module 121 stores one or more special images (e.g., a football picture “D” as shown in FIG. 4 ) and face character data to the storage system 14 , and stores. In the embodiment, the face character data may include mouth character data, eye character data, and noise character data.
In block S 22 , the image analysis module 122 controls the image capturing device 11 to obtain a person image of a user. In block S 23 , the image analysis image module 122 analyzes pixel points of the person image to determine a face area of the person image.
In block S 24 , the image analysis module 122 determines whether the person image has a face area according to the face character data. If the person image has the face area, block S 25 is implemented. Otherwise, if the person image has no face area, block S 22 is repeated.
In block S 25 , the image adjustment module 123 marks the face area with a rectangle area, and calculates a size of the rectangle area. In one example with respect to FIG. 4 , a length of the rectangle area is 3 cm, and a width of the rectangle area is 5 cm. The image adjustment module 123 uses the rectangle area to mark the face area in the person image, such as the image “A” marked with the rectangle area as shown in FIG. 4 .
In block S 26 , the image adjustment module 123 obtains a special image (e.g., a football picture “D” as shown in FIG. 4 ) from the storage system 14 , and adjusts a size of the special image according to the size of the rectangle area. In the embodiment, the image adjustment module 123 adjusts a length of the special image as 3 cm, and adjusts a width of the special image as 5 cm.
In block S 27 , the image replacement module 124 replaces the face area of the person image with the special image to generate a face replacement image, such as the face replacement image “C” as shown in FIG. 4 . The face replacement image is generated as described in FIG. 3 below.
In block S 28 , the image replacement module 124 displays the face replacement image on the display screen 13 when the user views the person image, to protect the privacy of the user when the person image is viewed by other users.
FIG. 3 is a detailed flowchart of block S 27 of FIG. 2 . In block 5271 , the image replacement module 124 checks pixel points of the face area. In block 5272 , the image replacement module 124 selects a pixel point of the face area, and analyzes a RGB value of the pixel point.
In block 5273 , the image replacement module 124 determines whether the RGB value of the pixel point is equal to a gray value. The gray value is defined according to user's requirements, for example, generally defined as R=128, G=128, and B=128. If the RGB value of the pixel point is equal to the gray value, block 5274 is implemented. Otherwise, the RGB value of the pixel point is equal to a gray value, block 5275 is implemented.
In block S 274 , the image replacement module 124 keeps the pixel point in the face area of the person image. In block S 275 , the image replacement module 124 replaces the pixel point of the face area with a pixel point of the special image.
In block S 276 , the image replacement module 124 determines whether any pixel point of the face area has been selected. If a pixel point of the face area has not been selected, block S 272 is repeated. Otherwise, all pixel points of the face area have been selected, the flow goes to block S 28 as described in FIG. 2 .
Although certain disclosed embodiments of the present disclosure have been specifically described, the present disclosure is not to be construed as being limited thereto. Various changes or modifications may be made to the present disclosure without departing from the scope and spirit of the present disclosure.
Claims as granted
9 claimsLog in to read the claims of this application.
Log in to unlockClassifications
6 codes- H04N5/262
- H04N5/222
Claim changes
SoonSee which claims were amended, added or cancelled during examination, with every added and removed word marked.
The published claims of this application are not paired with the granted ones in what we hold.
File wrapper
See the full prosecution history — every USPTO and applicant action on this file, in order.
Log in to unlockDocuments
Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.
Log in to unlockChain of title
See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.
Log in to unlock