USPatent applicationPatented

Eye-protection control method of mobile device

Granted 1 Jan 2019 · 2 office actions

Life of the application

10 dated events
⤢ drag to zoom20162018202020222024202620282030203220342036ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

A mobile device and an eye-protection control method thereof are provided. The mobile device includes a display screen, an image capture unit, and a processer. The display screen is for displaying information. The image capture unit is for capturing a first image. The processer is coupled to the image capture unit to obtain the first image. The processer performs a human face detection to the first image to judge whether the first image has a human face information of a user. The processer counts a plurality of time periods when the first image has the human face information and adds up the time periods to a cumulative time, and the processer judges whether to perform an eye-protection operation through the cumulative time and a time threshold. Accordingly, the mobile device can remind the user to protect eyes and avoid overuse of the eyes.

Description

8 parts
›BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a control method of a mobile device, and more particularly, to a mobile device with an eye-protection function and an eye-protection control method thereof.

2. Description of the Prior Art

With the development of the wireless communication technology and maturity of the information technology environment, more and more people use hand-held mobile device, such as mobile phone, personal digital assistant or tablet computer, to manage many things, for example, communicating with friends by the communication software, watching internet messages, image or video, playing games, etc. The user usually uses the hand-held mobile device for a prolonged time or uses the hand-held mobile device frequently because of popularization and convenience of the hand-held mobile device, thereby causing the user having diseases of civilization in relation to overuse of eyes or improper viewing posture. In other words, since the display screen of the hand-held mobile device is smaller, and the user doesn't notice the distance between the eyes and the display screen, the viewing angle of the eyes to the display screen or the user's posture, the eyes of the user may overuse, which results in the problem of gradually sore eyes and even decreased vision.

Therefore, how to remind the user to properly use the mobile device and not to overuse it through the present technology is an objective in which the field researches.

›SUMMARY OF THE INVENTION

The present invention provides a mobile device with an eye-protection function for a user and an eye-protection control method thereof, which actively detects and records time periods, viewing distance and/or eye movement, such as blink, staring at screen obliquely, etc., when the user stares at the mobile device, thereby reminding the user to protect his eyes and avoiding overusing his eyes.

The mobile device of the present invention includes a display screen, an image capture unit, and a process. The display screen is for displaying information. The image capture unit is for capturing a first image facing the display screen of the mobile device. The processer is coupled to the image capture unit to obtain the first image. The processer performs a human face detection to the first image to judge whether the first image has a human face information of a user. The processer counts a plurality of time periods when the first image has the human face information and adds up the time periods to a cumulative time. The processer performs a judgment through the cumulative time and a time threshold. The processer performs an eye-protection operation when the cumulative time is larger than the time threshold. The eye-protection operation includes displaying a reminder information or an alert information by the display screen of the mobile device, temporarily turning off the display screen or shutting down the mobile device.

An eye-protection control method of a mobile device of the present invention includes the following steps, and the mobile device includes an image capture unit. A first image is captured by the image capture unit. A human face detection performed to the first image to judge whether the first image has a human face information of a user. A plurality of time periods are counted when the first image has the human face information, and time periods are added up to a cumulative time. And, a judgment is performed through the cumulative time and a time threshold, and an eye-protection operation is performed when the cumulative time is larger than the time threshold.

A mobile device includes a display screen, an image capture unit, and a process. The display screen is for displaying information. The image capture unit captures a first image. The process is coupled to the image capture unit to obtain the first image. The processer performs a human face detection to the first image so as to obtain a human face information from the first image, detects a left face area and a right face area of the human face information, and judges that the user stares at the display screen obliquely and performs an eye-protection operation when a ratio of the left face area to the right face area is not equal to a predetermined ratio in a predetermined time.

According to the above-mentioned description, in the embodiments of the present invention, the mobile device and the eye-protection control method thereof can actively detect and record the time periods while the user uses the mobile device, the viewing angle, the viewing distance while the user stares at the display screen and even the eye movement of the user (such as blink, viewing screen obliquely, etc.), and judge whether to remind the user to protect eyes or whether to perform an eye-protection operation through adding up the time periods, so that the user's eyes is protected from overusing to achieve the reminding to use the mobile device properly and is protected from harm due to the user stares at the display screen too long and improperly. In addition, the health situation of the user can be obtained through analyzing the human face information of the user, and a corresponding advice is further provided in the embodiments of the present invention.

These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.

›BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a functional block diagram of illustrating a mobile device 100 according to an embodiment of the present invention.

FIG. 2 is a flow chart illustrating an eye-protection control method of the mobile device according to a first embodiment of the present invention.

FIG. 3A is a flowchart illustrating an eye-protection control method of the mobile device according to a second embodiment of the present invention.

FIG. 3B is a flowchart illustrating an eye-protection control method of the mobile device according to a variant of the second embodiment of the present invention.

FIG. 4A and FIG. 4B are schematic diagrams illustrating three sequential time periods while the first image in the three adjacent time periods has the human face information of the same user.

FIG. 4C is a schematic diagram illustrating four sequential time periods while the first image in the four sequential time periods has the human face information of different users.

FIG. 5 is a flowchart illustrating an eye-protection control method of the mobile device according to a third embodiment of the present invention.

FIG. 6A and FIG. 6B are schematic diagrams illustrating the calculation of viewing angle of the user staring at the display screen.

FIG. 7 is a flowchart illustrating an eye-protection control method of the mobile device according to a fourth embodiment of the present invention.

FIG. 8 is a flowchart illustrating an eye-protection control method of the mobile device according to the fifth embodiment of the present invention.

FIG. 9A and FIG. 9B are schematic diagrams illustrating the left face area and the right face area of the human face information according to the fifth embodiment of the present invention.

›DETAILED DESCRIPTION · 1 of 5

In order to remind the user not to overuse eyes, an image capture unit in a mobile device is for obtaining a human face information of the user in the embodiments of the present invention, and the viewing time of the user, the viewing angle of the user watching the display screen, the viewing distance between the user and the display screen, and an eye movement of the user, such as blink or viewing the display screen obliquely, etc., are actively detected through the image analysis technology. These parameters are considered synthetically to judge whether to perform an eye-protection operation, such as to remind the user to rest or to shut off the mobile device, and the user's eyes are accordingly prevented from overusing. The embodiments complying with the spirit of the invention is provided in the following description as a reference for applying the present invention.

FIG. 1 is a functional block diagram of illustrating a mobile device 100 according to an embodiment of the present invention. The mobile device 100 at least includes a display screen 110 , an image capture unit 120 , and a processer 130 . The processer 130 is coupled to the image capture unit 120 and the display screen 110 . The mobile device 100 may be an electronic device having the display screen 110 and being capable of being held in a user's hand, which is for example a smart mobile phone, a functional mobile phone, a tablet computer, a personal digital assistant, etc. The display screen 110 may be a liquid crystal display screen, an active matrix organic light-emitting diode (AMOLED) display screen, etc. The processer 130 may control the display screen 110 to display text information or image information.

In this embodiment, the image capture unit 120 is for capturing the face situation of the user which operates the mobile device 100 so as to judge whether the user stares at the display screen 110 , to calculate a viewing angle of the user staring at the display screen 110 and to calculate the distance between the user and the mobile device 100 . In other words, the image capture unit 120 is for capturing a first image facing the display screen 110 in the mobile device 100 , and the image capture unit 120 transmits the first image to the processer 100 for further analyzing in the following steps. Specifically, the image capture unit 120 may be a rear camera facing the user, so that the image capture unit 120 can capture the user which is staring at the mobile device 100 . In some embodiments, the mobile device 100 can include a plurality of cameras (such as a front camera and a rear camera). The rear camera of the mobile device 100 is used as the image capture unit 120 in this embodiment of the present invention. In other embodiments, the mobile device 100 may also be communicated with an external image capture unit 120 outside the mobile device 100 through wireless, thereby achieving the effect of “capturing the face situation of the user operating the mobile device 100 ” in this embodiment.

The time periods of the user using the mobile device 100 which are separated from each other can be summed up, and whether there is a need to perform an eye-protection operation due to overuse of the user's eyes is judged through the information of the cumulative time in this embodiment of the present invention. FIG. 2 is a flow chart illustrating an eye-protection control method of the mobile device 100 according to a first embodiment of the present invention. Referring to FIG. 1 and FIG. 2 together, in the step S 210 , the processer 130 takes or captures the first image through the image capture unit 120 . This is to say that the image capture unit 120 takes the first image, and the processer 130 obtains the first image from the image capture unit 120 . The image capture unit 120 may be the rear camera of the mobile device 100 that is disposed at the same side as the display screen 110 facing the user.

In the step S 220 , the processer 130 performs a human face detection to the first image so as to judge whether the first image has a human face information of the user. The named “human face detection” may also be called “facial recognition technology”. In this embodiment, whether the user is staring at the mobile device 100 can be judged according to the present facial recognition technology. If the judgment result in the step S 220 is “Yes”, which means the mobile device 100 is being used and watched by the user, the processer 130 enters the step S 230 to count a time period when the first image has the human face information of the user so as to obtain how long the user stares at the display screen 110 of the mobile device 100 .

If the time period is in excess of a predetermined threshold or a threshold set by the user (for example the threshold of each using time is set to be 30 or 60 minutes), which means the user' eyes overuse and need rest, the eye-protection operation is performed. Most of users won't use the mobile device 100 directly so long but usually use the mobile device 100 in several time periods, and a cumulative time that is the sum of the time periods is too long. However, there is no related mechanism to sum the different time periods in which the user uses the mobile device 100 . In the step S 240 , the processer 130 adds up the separated time periods in which the user stares at the display screen 110 to calculate a cumulative time, and simultaneously returns back to the step S 220 to continuously judge whether the first image has the human face information of the user thereby obtaining the cumulative time. At the same time, in the step S 250 , the processer 130 judges whether to perform the eye-protection operation through the cumulative time and the time threshold. For example, the mobile device 100 makes the cumulative time zero in a specific time every day, and when the cumulative time reaches for example two hours (time threshold) (which means the cumulative time is larger than the time threshold), the user's eyes overuse, and there's a need to perform the eye-protection operation. The time threshold can be a predetermined value when the mobile device 100 is produced or can be set by the user according to the requirements.

›DETAILED DESCRIPTION · 2 of 5

In this embodiment, the eye-protection operation for example can include the following operations, which are the processer 130 orders the display screen 110 of the mobile device 100 to display a reminder information or an alert information, or orders the mobile device 100 to generate sounds to remind the user that his eyes overuse through the audio device in the mobile device 100 . If the user has triggered the eye-protection operation many times in one day, the processer 130 can temporarily turn off the display screen 110 , enforce the mobile device 100 to enter a sleeping state or directly shut down the mobile device 100 . The eye-protection operation can be adjusted appropriately according to the user's requirements and the corresponding functional device in the mobile device 100 , only the user can be aware of the overuse of the eyes.

It is noted that the processer 130 further can judge whether the adjacent time periods are added up automatically, which is to further sum up the adjacent time periods having an interval in the range of an interval threshold to become another cumulative time TD, and the processer 130 judges whether to perform the eye-protection operation through the cumulative time TD. FIG. 3A is a flowchart illustrating an eye-protection control method of the mobile device 100 according to a second embodiment of the present invention. Refer to FIG. 1 together with FIG. 3A , in which the steps S 310 , S 320 , S 330 in FIG. 3A are the same as the steps S 210 , S 220 , S 230 in FIG. 2 .

In the step S 332 , the processer 130 judges whether an interval between one of the time periods and a former one of the time periods is in excess of the interval threshold calculated in the step S 330 (for example, the interval threshold is set to be 10 or 30 minutes). For clarity, refer to FIG. 4A and FIG. 4B together with the corresponding steps in FIG. 3A . FIG. 4A and FIG. 4B are schematic diagrams illustrating three sequential time periods while the first image in the three sequential time periods has the human face information of the same user, in which the intervals A 1 , B 1 and B 2 are respectively not in excess of the interval threshold, and the interval A 2 is in excess of the interval threshold. In detail, the process 130 judges whether the intervals A 1 , A 2 between the former time period T 1 and the present time period T 2 are in excess of the interval threshold (for example 10 or 30 minutes) after obtaining the time period T 2 calculated in the step S 330 . When the judgment result in the step S 332 is “No”, the processer 130 enters the step S 340 and adds the time period T 2 after the interval A 1 into the cumulative time TD. When no other time periods is before the time period T 1 and no interval between the time period T 2 and another time period right next to the time period T 2 is not in excess of the interval threshold, the cumulative time TD is the sum of the time period T 1 and the time period T 2 , as shown at middle part in FIG. 4A . On the contrary, when the judgment result in the step S 332 is “Yes”, as shown in FIG. 4B , which means the time period T 1 won't be added into the cumulative time, the processer 130 enters the step S 334 from the step S 332 and makes the cumulative time TD zero first, which is to set TD=0. After that, in the step S 340 , the processer 130 adds the time period T 2 after the time interval into the cumulative time TD. Accordingly, the cumulative time TD becomes the remained time period T 2 without other time periods while no interval between the time period T 2 and another time period right next to the time period T 2 is not in excess of the interval threshold. Also, the process 130 may further judge whether the intervals B 1 , B 2 between the present time period T 2 and the later time period T 3 are in excess of the interval threshold after obtaining the time period T 3 calculated in the step S 330 . When the interval B 1 between the time period T 2 and the time period T 3 is not in excess of the interval threshold, the cumulative TD is the sum of the time period T 1 , the time period T 2 and the time period T 3 , as shown at right part in FIG. 4A . When the interval B 2 between the time period T 2 and the time period T 3 is not in excess of the interval threshold, the cumulative TD is the sum of the time period T 2 and the time period T 3 , as shown at right part in FIG. 4B .

Referring back to FIG. 3A , in the step S 350 , the processer 130 judges whether to perform the eye-protection operation through the above cumulative time TD and the time threshold. For example, when the cumulative time TD of the interval less than the interval threshold (such as 10 minutes) is in excess of the time threshold (such as 60 minutes), the processer 130 performs the eye-protection operation.

In the present invention, the first image in different time periods may has the human face information of different users. While this happens, the processer 130 separately counts the time periods for each user. Specifically, refer to FIG. 3B and FIG. 4C together with FIG. 1 . FIG. 3B is a flowchart illustrating an eye-protection control method of the mobile device 100 according to a variant of the second embodiment of the present invention, and FIG. 4C is a schematic diagram illustrating four sequential time periods while the first image in the four sequential time periods has the human face information of different users. The step S 410 in FIG. 3B are the same as the step S 310 in FIG. 3A . After that, in the step S 420 , the processer 130 performs a human face detection to the first image so as to judge whether the first image has a human face information of a user. In detail, the human face detection is to judge whether the first image has a human face information of the first user or whether the image has another human face information of the second user.

In the next step S 422 , a plurality of time periods, such as first time periods T 1 ′ and T 3 ′, are counted when the first image has the human face information of a first user, and a plurality of time periods, such as second time periods T 2 ′ and T 4 ′, are counted when the first image has the human face information of a second user.

›DETAILED DESCRIPTION · 3 of 5

In the step S 424 , the processer 130 judges whether the human face information of the first image in two adjacent time periods belongs to the same user. If the judgment result in the step S 424 is “No”, the processer 130 enters the step S 426 and further judges whether the first image in another one of the time periods before the two adjacent time periods and in the later one of the two adjacent time periods has the human face information of the same user. If the judgment result in the step S 426 is “Yes”, the process 130 enters the step S 428 and judges whether an interval between the another one of the time periods before the two adjacent time and the later one of the two adjacent time periods is in excess of the interval threshold. For example, the two adjacent time periods may be the second time period T 2 ′ and the first time period T 3 ′ that doesn't belong to the same user, and the first time period T 1 ′ is before the second time period T 2 ′ and the first time period T 3 ′. Thus, the first time periods T 1 ′ and T 3 ′ belong to the first user. After obtaining the time period T 3 ′, since the human face information of the first image in the time periods T 1 ′, T 3 ′ belong to the same first user, the interval for the first user is the sum of an interval C 1 between the time periods T 1 ′, T 2 ′, the time period T 2 ′ and an interval C 2 between the time periods T 2 ′, T 3 ′, which is needed to be compared with the interval threshold. Also, if the two adjacent time periods for example are the first time period T 3 ′ and the second time period T 4 ′, and the second time period T 2 ′ is before the first time period T 3 ′ and the second time period T 4 ′, after obtaining the time period T 4 ′, the interval for the second user is the sum of an interval C 2 between the time periods T 2 ′, T 3 ′, the time period T 3 ′ and an interval C 3 between the time periods T 3 ′, T 4 ′, which is needed to be compared with the interval threshold. If the judgment result in the step S 426 is “No”, the processer 130 returns back to the step S 422 and counts the time periods when the first image has the human face information of the first user and the second user. For example, after obtaining the time period T 3 ′, if no time period of the first user is before the time periods T 2 ′, T 3 ′, the cumulative time of the first user is the time period T 3 ′, and the processer 130 continues to count the time periods.

If the judgment result in the step S 428 is “Yes”, which means the interval for the first user is in excess of the interval threshold, the processer 130 enters the step S 440 and makes a first cumulative time of the first user zero, and adds the later one of the two adjacent time periods, such as the first time period T 3 ′, after the interval into the cumulative time of the first user. Also, if the interval for the second user is in excess of the interval threshold, the processer 130 makes the cumulative time of the second user zero, and adds the time period T 4 ′ after the interval into the cumulative time of the second user. If the judgment result in the step S 428 is “No”, the processer 130 enters the step S 450 and adds the another one of the time periods and the later one of the two adjacent time periods, such as the first time periods T 1 ′ and T 3 ′ into the cumulative time of the first user. Accordingly, the first cumulative time of the first user becomes the sum of the first time periods T 1 ′ and T 3 ′. Also, if the second time period T 4 ′ is obtained after the first time period T 3 ′ and the judgment result in the step S 428 is “No”, which means the interval for the second user is not in excess of the interval threshold, the second cumulative time of the second user becomes the sum of the second time periods T 2 ′, T 4 ′. Thus, the processer 130 can separately count the first time periods T 1 ′ and T 3 ′ for the first user and the second time periods T 2 ′ and T 4 ′ for the second user. Then, in the step S 460 , the processer 130 judges whether to perform an eye-protection operation to the first user through the above first cumulative time and the time threshold, and judges whether to perform the eye-protection operation to the second user through the above second cumulative time and the time threshold. When the first cumulative time is larger than the time threshold, the eye-protection operation is performed to the first user. When the second cumulative time is larger than the time threshold, the eye-protection operation is performed to the second user.

Additionally, if the judgment result in the step S 424 is “Yes”, the processer 130 enters the step S 430 and judges whether an interval between the two adjacent time periods is in excess of the interval threshold, which is the same as the step S 332 shown in FIG. 3A .

Referring back to FIG. 1 , the processer 130 may obtain the human face information from the first image and further calculate the viewing angle of the user staring at the display screen 110 through the human face information, thereby judging the viewing angle of the user staring at the display screen 110 is in the suggested eye-protection angle range (such as from 15 degrees to 30 degrees) in order to ensure the user maintaining a right using posture. FIG. 5 is a flowchart illustrating an eye-protection control method of the mobile device 100 according to a third embodiment of the present invention. Referring to FIG. 1 and FIG. 5 , in the step S 510 , the processer 130 captures the first image through the image capture unit 120 . In the step S 520 , the processer 130 performs the human face detection to the first image to obtain the human face information from the first image. In the step S 530 , the processer 130 calculates the viewing angle of the user staring at the display screen 110 through the human face information. Next, in the step S 540 , the processer 130 judges whether the viewing angle is in the eye-protection angle range (such as in the range from 15 degrees to 30 degrees), thereby judging whether to perform the eye-protection operation. The above eye-protection angle range can be preset when the mobile device 100 is produced or can be adjusted by the user.

›DETAILED DESCRIPTION · 4 of 5

It is noted that the viewing angle of the step S 530 in FIG. 5 can be calculated through various ways. The first way is that the processer 130 analyzes eye parts of the human face information and further analyzes sclera regions and pupil regions of the eye parts so as to judge the viewing angle of the user. The second way is that the processer 130 can calculate the viewing angle of the user staring at the display screen 110 according to eye parts and ear parts in the human face information of the user. For example, when only one ear part and two eye parts of the user are shown in the first image, which means the user's eyes doesn't look at the display screen 110 of the mobile device 100 but have a line of vision toward other place. In another aspect, the processer 130 can judge the viewing angle based on the distance between any two of the human face areas, the eye parts and the ear parts after judging the eye parts and the ear parts in the human face information.

The third way to calculate the viewing angle of the user is that the processer 130 calculates the viewing angle of the user staring at the display screen 110 according to a position of the human face information in the first image. FIG. 6A and FIG. 6B are schematic diagrams illustrating the calculation of viewing angle of the user 600 staring at the display screen 110 . Referring to FIG. 6A , when the viewing angle θ 1 of the user 600 staring at the display screen 110 is substantially 90 degrees, the first image M 1 taken by the image capture unit 120 is illustrated as the left part of FIG. 6A , and the human face information 610 of the user 600 is located in the center of the first image M 1 . Referring to FIG. 6B , when the viewing angle θ 2 is ranged substantially from 15 degrees to 30 degrees, the first image M 2 taken by the image capture unit 120 is illustrated as the left part of FIG. 6B , and the human face information 620 of the user 600 is located at the bottom of the first image M 1 . Thus, the processer 130 of the mobile device 100 can calculate the viewing angle of the user 600 staring at the display screen 110 according to the position of the human face information of the user 600 in the first image.

In another aspect, the processer 130 shown in FIG. 1 can provide related health information to the user through analyzing the human face information of the user. For example, the processer 130 can obtain the distance between the user's eyes and the mobile device 100 through analyzing the human face information of the user and perform the eye-protection operation while the distance is too short. The processer 130 may further analyze a color and a distribution of blood vessels of a sclera part of the human face information to judge a liver function of the user and to provide the related suggestion, which even suggests that the user goes to sleep. The processer 130 may further analyze a profile of the human face information to judge whether a weight of the user is increased or reduced. The processer 130 may further analyze a skin of the human face information to display a suggested message of the skin for the user by the display screen 110 .

Besides using the continuous time period or the intermittent time periods and the viewing angle of the user staring at the display screen 110 as the judgment basis of judging whether the eye-protection operation is performed, through the eye movement of the user (such as the number of blink, staring at the display screen 110 obliquely, etc.), the mobile device 100 can further judge whether to remind the user by the eye-protection operation to prevent the user from incorrect posture that generates bad eyes in this embodiment.

According to the investigation done by the medicine-related research institute, the number of blink of a general person is about 15 times to 20 times per minute; the number of blink in reading book is about 10 times per minute; the number of blink in operating computer is about 4 times to 5 times per minute; and the number of blink of the user in driving car or playing game is only 2 times to 3 times per minute. If the number of blink is reduced to be about 10 times per minute, the eyes still can have the completeness of the tear film, but if the number of blink is reduced to be about 4 times to 5 times per minute, the eyes will have a symptom of dryness. As the above-mentioned data, when the concentration of the user is higher, the number of blink per minute is lower. However, the tear rapidly evaporates when the user doesn't blink for a long time, which results in over dryness of the eyes. In addition, when the eyes look at an object close thereto for a long time, the ciliary muscle will be in a strain state, and the eyes are easily fatigued, especially for a person with farsightedness or nearsightedness, it is easier to overuse the ciliary muscle. Because that, lack of the tear more easily occurs, which causes the eyes to feel sore and even more seriously to have dry eye syndrome. Hence, the processer 130 of the mobile device 100 in the fourth embodiment of the present invention may further calculate the number of blink of the user in a cumulative time that is the sum of a plurality of time periods according to the eye parts of the human face information in the first image and judge whether to perform the eye-protection operation according to the number of blink. For example, the eye-protection operation may be to remind the user of having too less number of blink. Accordingly, the user can be prevented from being too focus to remember to wink while staring at the display screen 110 .

FIG. 7 is a flowchart illustrating an eye-protection control method of the mobile device 100 according to a fourth embodiment of the present invention. Referring to FIG. 1 and FIG. 7 , in the step S 710 , the processer 130 captures the first image through the image capture unit 120 and calculates the number of blink of the user in the above-mentioned cumulative time according to the eye parts of the human face information in the first image. In the step S 720 , the processer 130 judges whether to perform the eye-protection operation according to the number of blink. The step S 720 can be consisted of the step S 722 and the step S 724 . In the step S 722 , the processer 130 judges whether the number of blink in a predetermined time is lower a predetermined value. In this embodiment, the predetermined value may be 4 times or 5 times per minute. When the number of blink is less than the predetermined value, the processer 130 enters the step S 724 from the step S 722 and performs the eye-protection operation. On the contrary, when the number of blink is larger than the predetermined value, the processer 130 returns back to the step S 710 from the step S 722 and continues to detect the number of blink in the predetermined time.

›DETAILED DESCRIPTION · 5 of 5

The “strabismus” provided herein serves as a fifth embodiment of an eye movement of the user, and the issue of the strabismus of the user is expected to be adjusted or corrected by the help of the mobile device 100 . The “strabismus” is an abnormal condition of the eyes. Both eyes of the person with strabismus are prevented from aiming at the same point in space, so that the vision of both eyes and the perception to depth of field of the person are lower than that of a person with normal vision. The strabismus results in a more serious vision problem, such as low vision. For preventing acquired strabismus, the processer 130 in the mobile device 100 of the fifth embodiment of the present invention may calculate a left face area and a right face area of the human face information in the first image, and when the left face area and the right face area are not symmetric to each other in a predetermined time (which means a ratio of the left face area to the right face area is too large), the user stares at the display screen obliquely for a long time, and there is a need to perform the eye-protection operation to prevent the user from the acquired strabismus.

FIG. 8 is a flowchart illustrating an eye-protection control method of the mobile device 100 according to the fifth embodiment of the present invention. FIG. 9A and FIG. 9B are schematic diagrams illustrating the left face area and the right face area of the human face information according to the fifth embodiment of the present invention. Referring to FIG. 1 and FIG. 8 , in the step S 810 , the processer 130 captures the first image through the image capture unit 120 and calculates the left face area and the right face area of the human face information in the first image. In the step S 820 , the processer 130 judges whether a ratio of the left face area to the right face area is equal to the predetermined ratio in the predetermined time. For example, referring to FIG. 9A , when the user doesn't squint the display screen 110 , the image 910 captured by the image capture unit 120 is shown in FIG. 9A , and the ratio of the right face area 920 to the left face area 930 is ideally close to 1:1 (which is the predetermined ratio). In practicality, an area among a side of the right face, the right eye and the nose serves as the right face area 920 , and an area among a side of the left face, the left eye and the nose serves as the left face area 930 . However, when the user stares at the display screen 110 obliquely, the image is shown in FIG. 9B , and the ratio of the right face area 920 to the left face area 930 is not close to 1:1 (for example, the predetermined normal value of the ratio of the left face area to the right face area can be set in a range from 0.9 to 1.1), which means a face area seen from a squint direction (such as the left face area 932 ) is larger than another face area seen from the squint direction (such as the right face area 922 ). For example, the ratio of the right face area 922 to the left face area 932 may be 2:3 or 1:2. Hence, when the ratio of the left face area 932 to the right face area 922 is not equal to the predetermined ratio in the predetermined time, the processer 130 enters the step S 830 from the step S 820 , and the processer 130 judges that the user stares at the display screen 110 obliquely and performs the eye-protection operation. On the other hand, when the ratio of the left face area to the right face area is equal to the predetermined ratio in the predetermined time, the processer 130 returns back to the step S 810 from the step S 820 and continues detecting whether the user stares at the display screen 100 . In another embodiment, when the ratio of the left face area 932 to the right face area 922 is not equal to the predetermined ratio in the predetermined time, the processer 130 may inform the user the ratio and/or the using time, such as show the result, when the user ends the usage or the user uses it next time.

As the above-mentioned description, in the embodiments of the present invention, the mobile device and the eye-protection control method thereof can actively detect and record the time periods while the user uses the mobile device, the viewing angle and the viewing distance while the user stares at the display screen, and judge whether to remind the user to protect eyes or whether to perform an eye-protection operation through the cumulative time periods, so that the user's eyes is protected from overuse to achieve the reminding to use the mobile device properly and is protected from harm due to the user staring at the display screen too long and improperly. In addition, the health situation of the user can be obtained through analyzing the human face information of the user, and a corresponding advice is further provided in the embodiments of the present invention.

Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.

Claims as granted

10 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

2 codes
IPC · International Patent Classification
Section G — Physics
  • G06K9/00
Section H — Electricity
  • H04N5/232

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomJul 2016Oct 2016Jan 2017Apr 2017Jul 2017Oct 2017Jan 2018Apr 2018Jul 2018Oct 2018Jan 2019USPTOApplicantRestriction requirementNon-final rejectionResponse after non-finalNotice of allowance
USPTOApplicanthover for detail · click to open
Pendency
2.4 y
862 days filing → grant
Office actions
1
after a restriction
Responses
1
no RCE
Examiner
Sahlu Okebato
art unit 2625 · TC 2600
Citations: 3 back · 0 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom20162018202020222024202620282030203220342036Owner 1
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock