USPatentGranted
B2

Electronic apparatus and displaying method

Granted 28 Jun 2016 · 2 office actions

Current assignee: TOSHIBA CLIENT SOLUTIONS CO., LTD. · originally Toshiba

Law firm: Law firm · Log in to unlock

Attorney: Attorney · Log in to unlock

Inventors: Shigeru Motoi · Examiner: Aneeta Yodichkas · AU 2624 · TC 2600

Life of the patent

9 dated events
⤢ drag to zoom20142016201820202022202420262028203020322034ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

According to one embodiment, an electronic apparatus is capable of drawing a line corresponding to contact on a sensor surface of a display. The apparatus includes a display processor. The display processor displays a plurality of lines in accordance with a locus of a single contact point on the sensor surface, and displays an object in a region near a position of the single contact point, at least part of the object overlapped with the plurality of lines, a color of the object corresponding to a color of the plurality of lines, wherein widths of the plurality of lines are varied in accordance with a pressure on the single contact point.

Description

7 parts
›CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based upon and claims the benefit of priority from Japanese Patent Application No. 2013-258312, filed Dec. 13, 2013, the entire contents of which are incorporated herein by reference.

›FIELD

Embodiments described herein relate generally to technology of displaying a line by handwriting.

›BACKGROUND

Recently, various electronic apparatuses such as tablets, PDAs and smartphones have been developed. To facilitate users' input operations, most of the electronic apparatuses comprise a contactscreen display. In addition, electronic apparatuses capable of inputting a line, etc. by a stylus have also been developed recently.

When a line is input by a stylus, the line drawn on a contactscreen display can be modified by designating a pen type. For example, a line color, a line width or a line type can be changed.

When the user is drawing the line on the contactscreen display, the user often feels uncomfortable on appearance of a middle part of the line which is being displayed on the contactscreen display, depending on the pen type.

›BRIEF DESCRIPTION OF THE DRAWINGS

A general architecture that implements the various features of the embodiments will now be described with reference to the drawings. The drawings and the associated descriptions are provided to illustrate the embodiments and not to limit the scope of the invention.

FIG. 1 is an exemplary perspective view showing a structure of an electronic apparatus of an embodiment.

FIG. 2 is an exemplary block diagram showing a system configuration of the electronic apparatus of the embodiment.

FIG. 3 is an exemplary block diagram showing a functional configuration of a handwriting note application program executed by the electronic apparatus of the embodiment.

FIG. 4 is an exemplary illustration showing a line drawn when a line type is a brush.

FIG. 5 is an exemplary illustration showing a mask object drawn when a line type is a brush.

FIG. 6 is an exemplary illustration showing a mask object and a line drawn when a line type is a brush.

FIG. 7 is an exemplary illustration showing a state of finishing writing a line.

FIG. 8 is an exemplary illustration of a character drawn by a brush.

FIG. 9 is an exemplary illustration of a character drawn by a brush.

FIG. 10 is an exemplary illustration of a character drawn by a brush.

FIG. 11 is an exemplary illustration of a line drawn when a curvature of a curve is greater than a threshold value.

FIG. 12 is an exemplary illustration of a line drawn when a curvature of a curve is not greater than a threshold value.

FIG. 13 is an exemplary flowchart showing steps of drawing a line when a brush is selected as a line type.

›DETAILED DESCRIPTION · 1 of 3

Various embodiments will be described hereinafter with reference to the accompanying drawings.

In general, according to one embodiment, an electronic apparatus is capable of drawing a line corresponding to contact on a sensor surface of a display. The apparatus comprises a display processor. The display processor is configured to display a plurality of lines in accordance with a locus of a single contact point on the sensor surface, and to display an object in a region near a position of the single contact point, at least part of the object overlapped with the plurality of lines, a color of the object corresponding to a color of the plurality of lines, wherein widths of the plurality of lines are varied in accordance with a pressure on the single contact point.

FIG. 1 is a perspective view showing an appearance of an electronic apparatus according to the embodiment. The electronic apparatus is, for example, a portable electronic apparatus in which handwritten characters can be input by using a stylus (pen) or a finger. The electronic apparatus can be implemented as a tablet computer, a notebook-type personal computer, a smartphone, a PDA, etc. In the following descriptions, it is assumed that the electronic apparatus is implemented as a tablet computer 10 . The tablet computer 10 is a portable electronic apparatus which may also be called a tablet or a slate computer, and comprises a main body 11 and a contactscreen display 17 as shown in FIG. 1 . The contactscreen display 17 is mounted to be overlaid on a top surface of the main body 11 .

The main body 11 comprises a housing shaped in a thin box. A flat panel display and a sensor (position detecting device) configured to detect a position designated on a screen of the flat panel display by a stylus or a finger are incorporated in the contactscreen display 17 . The flat panel display may be, for example, a liquid crystal display (LCD). As the sensor (position detecting device), for example, a capacitive contactpanel, an electromagnetic induction type digitizer, etc., can be employed, and the sensor detects the position which the stylus or finger is in contact with or in proximity to. In the following descriptions, it is assumed that both of two types of sensors, i.e., a digitizer and a contactpanel, are incorporated in the contactscreen display 17 .

Each of the digitizer and the contactpanel is provided to cover the screen of the flat panel display. The contactscreen display 17 can detect not only a contact operation using the finger on the screen, but also a contact operation on the screen using a stylus 100 . The stylus 100 may be, for example, an electromagnetic induction type stylus. The user can perform a handwriting input operation using an external object (stylus 100 or finger), on the contactscreen display 17 . A tip of the stylus 100 makes point contact with a single contact point on a surface (sensor surface) of the contactscreen display 17 .

FIG. 2 is a diagram showing a system configuration of the tablet computer 10 according to the embodiment.

As shown in FIG. 2 , the tablet computer 10 comprises a CPU 101 , a system controller 102 , a main memory 103 , a graphics controller 105 , a BIOS-ROM 105 , a storage device 106 , a wireless communication device 107 , an embedded controller (EC) 108 , etc.

The CPU 101 is a processor for controlling operations of various modules in the tablet computer 10 . The CPU 101 executes various programs loaded into the main memory 103 from the storage memory 106 . The programs executed by the CPU 101 include an operating system (OS) 201 and various application programs such as a handwriting input program 202 . The application programs 203 include, for example, a handwriting character recognition program, a browser program, an image editing program, a document generating program, etc.

The CPU 101 implements not only a function of generating note data (page data (time-series information)) in accordance with the handwriting input operation using the stylus 100 and a page editing function of editing a page included in a note file, but also various functions related to the generation and edition of the note file (or page), by executing the handwriting input program 202 .

In addition, the CPU 101 also executes a Basic Input/Output System (BIOS) stored in the BIOS-ROM 105 . The BIOS is a program for hardware control.

The system controller 102 is a device configured to make connection between a local bus of the CPU 101 and various components. A memory controller configured to control access to the main memory 103 is also built in the system controller 102 . The system controller 102 also has a function of executing communication with the graphics controller 104 via a serial bus, etc.

The graphics controller 104 is a display controller configured to control an LCD 17 A which is utilized as a display monitor of the tablet computer 10 . A display signal generated by the graphics controller 104 is sent to the LCD 17 A. The LCD 17 A displays a screen image in accordance with the display signal. On the LCD 17 A, a contact panel 17 B and a digitizer 17 C are arranged as position detecting devices. The contact panel 17 B is a capacitive pointing device configured to input data on the screen of the LCD 17 A. A contact position on the screen contacted by a finger, movement of the contact position, etc. are detected by the contact panel 17 B. The digitizer 17 C is an electromagnetic induction-type pointing device configured to input data on the screen of the LCD 17 A. A contact position on the screen contacted by the stylus 100 , movement of the contact position, etc. are detected by the digitizer 17 C.

The wireless communication device 107 is a device configured to execute wireless communication such as wireless LAN or 3G mobile communication.

The EC 108 is a one-chip microcomputer comprising an embedded controller for power management. The EC 108 has a function of powering on or off the tablet computer 10 in accordance with a user operation of a power button.

›DETAILED DESCRIPTION · 2 of 3

FIG. 3 is a block diagram showing a configuration of the handwriting input program 202 .

The handwriting input program 202 comprises a pen type selection processor 301 , a display processor 302 , etc.

The pen type selection processor 301 detects a pen type selected by using a user interface displayed on the LCD 17 A and notifies the handwriting input program 202 of the detected pen type.

The display processor 302 executes processing of displaying a line corresponding to the notified pen type, based on coordinates of the contact position detected by the digitizer 17 C.

The display processor 302 comprises a brush drawing processor 302 A, a mask drawing processor 302 B, etc.

The brush drawing processor 302 A executes processing of drawing a line as drawn with a brush, in accordance with the detected position. If the tip of the stylus 100 contactes the surface (sensor surface) of the contactscreen display 17 , the brush drawing processor 302 A executes processing of drawing a line 401 as drawn with a brush, based on a position of the contact point detected by the digitizer 17 C and a locus of the contact point.

The brush drawing processor 302 A draws a plurality of lines parallel to a proceeding direction of the tip of the stylus, to draw the line 401 as drawn with a brush, as shown in FIG. 4 . The brush drawing processor 302 A determines widths of a plurality of lines in accordance with a pressure on the contact point (writing pressure). Each of the lines is drawn more widely by the brush drawing processor 302 A as the writing pressure becomes higher. If the width of each line is equal to or greater than a half of an interval of adjacent lines, adjacent lines are drawn in a shape of a single line since they are drawn to be overlaid on each other. If the width of each line is smaller than a half of the interval of adjacent lines, a gap is formed between the adjacent lines and a plurality of lines are drawn to be blurred.

In addition, an outer line, of a plurality of lines, may be drawn narrowly as the writing pressure becomes lower. By drawing the lines in this manner, a central line is drawn to the end even if the writing pressure becomes gradually smaller while the tip of the stylus is in contact with the contactscreen display 17 .

Incidentally, when a line is drawn in a state in which the writing pressure is low, drawn lines corresponding to respective brush bundles are seen around the narrow tip of the stylus 100 , unlike an actual brush, and the user feels uncomfortable on appearance of the tip and a middle part of the line which the user is drawing.

The mask drawing processor 302 B executes processing of drawing a mask object 402 to mask leading end portions of a plurality of lines on a layer above a layer where a plurality of lines are drawn, as shown in FIG. 5 . A color of the object 402 corresponds to a color of a line 401 in accordance with movement of a position of the line end. For example, the color of the object 402 is the same as the color of the line 401 .

The display processor 302 draws the mask object 402 on the end of the line 401 , as shown in FIG. 6 . The position of the drawn mask object is changed. The mask object 402 is drawn on at least some lines, of a plurality of lines. A shape of the mask object 402 is, for example, a circle slightly smaller than a thickness of the line 401 .

If the tip of the stylus 100 is so remote from the surface of the contactscreen display 17 that the contact position on the surface of the contactscreen display 17 cannot be detected, the display processor 302 does not draw the mask object 402 on the line 401 as shown in FIG. 7 . In other words, if the tip of the stylus 100 is so remote from the surface of the contactscreen display 17 that the contact position on the surface of the contactscreen display 17 cannot be detected, the display processor 302 stops the display of the mask object 402 .

When the mask object 402 which aims to hide the leading end portion of the line 401 is drawn at the end of the line, a single line seems to flow and the uncomfortable feeling is reduced. Since the mask object 402 drawn at the end of the line is temporarily displayed and since the mask object 402 is not drawn on the display when writing the line is finished, a blurred state, split, etc. of the line can be easily expressed.

The brush drawing processor 302 A displays a first line and a second line, of a plurality of lines, by lines of different thickness, in accordance with a shape of a locus of the contact point of the tip of the stylus 100 on the surface of the contactscreen display 17 . For example, if the locus of the tip draws a curve, the brush drawing processor 302 A determines the thickness of each line in accordance with a curvature of the curve. The mask drawing processor 302 B determines the size and the display position of the object, in accordance with density of a display region of a plurality of lines (i.e., ratio of a line width to a region where the lines are displayed).

As shown in FIG. 8 and FIG. 9 , if the curvatures of the curves surrounded by broken lines, inner lines of the curves are drawn narrowly. As shown in FIG. 10 , if the curvature of the curve surrounded by a broken line is not great, an outer line of the curve is drawn narrowly.

In this case, a figure assembling a plurality of blurred lines is drawn as shown in FIG. 11 and FIG. 12 . If a line is blurred or split, the mask object is drawn in a region where the density of the line displaying region is higher than a threshold value. In addition, the mask object is not drawn in a region where the density of the line displaying region is not higher than a threshold value. In other words, the position where the object 402 is displayed and the shape of the object 402 are determined in accordance with the intervals of the positions where a plurality of lines are drawn or the density of a plurality of lines.

FIG. 11 shows a line drawn when the curvature of the curve is greater than a threshold value. FIG. 12 shows a line drawn when the curvature of the curve is not greater than a threshold value.

›DETAILED DESCRIPTION · 3 of 3

FIG. 13 is a flowchart showing steps of drawing a line when a brush is selected as the line type.

First, when the brush is selected as the line type and the tip of the stylus 100 contactes the surface (sensor surface) of the contactscreen display 17 , the brush drawing processor 302 A executes processing of drawing the line 401 as drawn by the brush, based on the position of the contact point detected by the digitizer 17 C and the locus of the contact point. In addition, the mask drawing processor 302 B executes processing of drawing the mask object 402 near the tip, in accordance with the position detected by the digitizer 17 C (step B 11 ). The display processor 302 draws graphics formed by drawing the mask object 402 on the line 401 . The graphics drawn by the display processor 302 is drawn on the LCD 17 A.

The display processor 302 discriminates whether the tip of the stylus 100 is in contact with the surface of the contactscreen display 17 (step B 12 ). If the display processor 302 discriminates that the tip of the stylus 100 is in contact with the surface of the contactscreen display 17 (Yes in step B 12 ), the line 401 and the mask object 402 are drawn in accordance with the contact position of the tip of the stylus 100 . If the display processor 302 discriminates that the tip of the stylus 100 is not in contact with the surface of the contactscreen display 17 (No in step B 12 ), the mask drawing processor 302 B stops the processing of drawing the mask object 402 (step B 13 ). Since the mask object 402 is not drawn, the mask object 402 is erased in the graphics displayed on the LCD 17 A.

The intervals of the adjacent lines may be varied in accordance with the shape of the locus of the contact point of the tip of the stylus 100 on the surface of the contactscreen display 17 . For example, if a plurality of lines includes a first line, a second line adjacent to the first line, and a third line adjacent to the third line, the brush drawing processor 302 A may display an interval between the first line and the second line and an interval between the second line and the third line as intervals having different lengths.

According to the present embodiment, if the pen type is a brush, the line which is being drawn can be clearly seen by displaying the object on the leading end portion of the line. Therefore, uncomfortable feeling on the tip and the line which is being drawn can be suppressed.

In addition, since various types of processing of the present embodiment can be carried out by a computer program, the same advantages as those of the present embodiment can be easily achieved by merely installing the computer program in a general computer by means of a computer-readable storage medium which stores the computer program and executing the program,

The various modules of the systems described herein can be implemented as software applications, hardware and/or software modules, or components on one or more computers, such as servers. While the various modules are illustrated separately, they may share some or all of the same underlying logic or code.

While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the scope and spirit of the inventions.

Claims

8 · 4 independent · depth 2
12345678
8 granted claims

Classifications

5 codes
IPC · International Patent Classification
Section G — Physics
  • G06T11/20
  • G06F3/041
  • G06F3/0354
  • G06F3/0488
  • G06F3/04883

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this patent are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoomJul 2014Oct 2014Jan 2015Apr 2015Jul 2015Oct 2015Jan 2016Apr 2016Jul 2016USPTOApplicantNon-final rejectionResponse after non-final
USPTOApplicanthover for detail · click to open
Pendency
1.9 y
701 days filing → grant
Office actions
1
non-final + final
Responses
1
no RCE
Examiner
Aneeta Yodichkas
art unit 2624 · TC 2600
Citations: 7 back · 0 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Chain of title

⤢ drag to zoom20142016201820202022202420262028203020322034Owner 1Owner 2
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock

Term & fees

See the term timeline — pendency span, in-force span, the maintenance fees paid and both computed expiry dates.

Log in to unlock

Priority chain

1 priority documents
›Priority documents — 1
TypeDocumentDate
related publicationUS 20150170383 A118 Jun 2015

Worldwide family

4 members · 2 offices
US2JP2
this patentIP5 & PCTother officessolid = grantedhover for detail · click to open
Members
4
DOCDB simple family 53369102
Offices
2
US · JP
Granted
2 of 4
grant date present
Non-English titles
1
shown as filed, never translated
›IP5 & PCT — 4 members
OfficePublicationKindPublishedFiledStatusTitle
USUS-2015170383-A1A118 Jun 201528 Jul 2014publishedElectronic apparatus and displaying method
USthis patentUS-9378568-B2B228 Jun 201628 Jul 2014grantedElectronic apparatus and displaying method
JPJP-2015114975-AA22 Jun 201513 Dec 2013publishedElectronic device and display method
JPJP-6151166-B2B221 Jun 201713 Dec 2013granted電子機器および表示方法ja

Validity challenges

See the validity challenges on record — reexaminations, IPRs and PGRs, with their institution decisions and outcomes.

Log in to unlock

Citations

See every patent this one cites and every patent that cites it back — publication, assignee, and how each one was found.

Log in to unlock