USPatent applicationPatented

Methods and system for recognizing names in a computer-generated document and for providing helpful actions associated with recognized names

Granted 4 May 2010 · 4 office actions

Application· this page
10/426,446
filed 29 Apr 2003
Publication
Not published
not published
Patent
US 7,711,550
granted 4 May 2010

Life of the application

20 dated events
⤢ drag to zoom20042006200820102012201420162018202020222024ProsecutionOwnershipTerm & fees
ProsecutionOwnershipTerm & feeshover for detail · click to open

Abstract

Methods and systems are provided for recognizing names entered into a computer-generated document in the context of a plurality of spoken languages and for providing helpful actions to users upon the recognition of the entered names.

Description

10 parts
›FIELD OF THE INVENTION

The present invention relates generally to text recognition in computer-generated documents. More particularly, embodiments of the present invention relate to methods and systems for recognizing names from a plurality of languages entered into computer-generated documents and for providing helpful actions for use in association with recognized names.

›BACKGROUND OF THE INVENTION

Since the advent of the computer and software age, software developers have attempted to provide helpful functionality to software users that is contextual in nature. For example, software has been developed for detecting that a user is entering a date into a computer-generated document as the user is typing the date. Before the user can complete the date, the software application popsup today's date to the user and offers to automatically complete the date for the user. Other software has been developed for offering users helpful actions in response to certain data entered by the user. For example, if the user's word processor application recognizes that the user has entered a date, the user may be offered an action that will launch the user's electronic calendar to allow the user to check appointments or to verify information in her calendar for the entered date.

It would be helpful to users to provide them with actions applicable to names entered in computer-generated documents such as contacts documents, word processing documents, spreadsheet documents, slide presentation documents, calendaring documents, and the like. Unfortunately, names are very difficult to recognize because often names are not distinguishable from any other word in a sentence. And, often names have particular meaning in a relation to the language context in which they are entered. Because of the great diversity of name origins, names may be typed into a document written in one language, for example English, but the name may have its origins in a separate language, for example Chinese.

In addition, modern desktop operating systems are provided with various localization features for improving usability for users throughout the world. For instance, some desktop operating systems provide support for multiple user interface languages. Through this type of support for multiple user interface languages, users can configure the user interface of the operating system, for example, a keyboard, to operate in any of a number of languages supported by the host operating system. Additionally, many application programs also support the use of multiple languages for international users. For example, a word processing program or spreadsheet application program may allow a user to create documents in English, Thai, Vietnamese, or other languages installed in the operating system and enabled by the user. Documents may also be created that contain text or other information in a combination of languages. In fact, international users of such applications frequently create documents that include text in more than one language. Different languages often have vastly different grammatical rules for presenting names. For example, some languages commonly place certain titles before names. Some languages commonly place province or location designation after names.

Accordingly, there is a need for a method and system for recognizing names entered into computer-generated documents according to a variety of different languages and language grammatical rules and for providing helpful actions to a user associated with recognized names. It is with respect to these and other considerations that the present invention has been made.

›SUMMARY OF THE INVENTION

Embodiments of the present invention provide methods and systems for recognizing names entered into a computer-generated document in the context of a plurality of spoken languages and for providing helpful actions to users upon the recognition of the entered names.

Generally, a user enters text using a host software application such as a word processor application, a spreadsheet application, a contacts application, a calendaring application, a slide presentation application, and the like. Text entered by the user is passed to a recognizer application. Along with the text, a language designation for the text is passed by the host application if a language designation is known. The recognizer application may be a dynamically-linked library (DLL) application. At the recognizer application, the text is passed to a name recognizer application. The name recognizer may be a separate application plug-in that is associated with the recognizer application, or the name recognizer application may be integrated with the recognizer application.

If the language of text is known, the name recognizer application first breaks the text into words. If the text is not already set out in separate words by known delimiters such as spaces or punctuation marks associated with the known language, the name recognizer may pass the text to a word breaker application for breaking the text into words. According to an embodiment of the present invention. The word breaker application may be integrated with the name recognizer application. Alternatively, the word breaker application may be a separate application that may be called by the name recognizer application when needed.

Once the text is broken into separate words, the name recognizer application applies the grammatical rules of the known language to isolate names from the other words of the text. If one or more names are isolated, they are compared against the user's local or remote contact list for matching names. If the isolated names do not match names contained in a contacts list, the words may be compared against a larger database of names including, for example, names particular to the known language. Alternatively, words of the text may be confirmed as names where the analysis of the words based on the grammatical rules of the known language provides a high probability that a given word or words is a name. Once a word is confirmed as a name, by one of these comparisons or analyses, the name is returned by the recognizer application to the host application. The host application may then tag the name and call on the services of one or more action applications for providing helpful actions to the user when the user subsequently focuses her computer cursor or mouse pointer on the tagged name. For example, the user may be provided actions such as adding the name to a contacts list, deleting the name from a contacts list, sending an email message to the name, and the like.

If the language of the text passed to the recognizer application is not known, the text is broken into words as described above, and each word of the text may be compared directly against a contacts list or larger database of names to determine whether any of the words or combination of words comprise a name. If it may be determined that one or more of the words do comprise a name, the name is returned to the host application, as described above, and helpful actions may be provided in association with the name.

These and other features and advantages, which characterize the present invention, will be apparent from a reading of the following detailed description and a review of the associated drawings. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention as claimed.

›BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing the architecture of a personal computer that provides an illustrative operating environment for embodiments of the present invention.

FIG. 2 is a block diagram that shows software architecture for recognizing, labeling, and performing actions on strings of text according to various embodiments of the present invention.

FIG. 3 illustrates a simplified block diagram showing interaction between a host application and a recognizer application and action application for recognizing, labeling, and performing actions on names entered into text according to embodiments of the present invention.

FIG. 4 is a screen diagram showing an exemplary host application text entry screen and showing text entered and recognized as a name according to embodiments of the present invention.

FIGS. 5 and 6 are flow diagrams showing an illustrative routine for recognizing a name in text entered into a computer-generated document and for providing helpful actions associated with the recognized name.

›DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT · 1 of 6

As described briefly above, embodiments of the present invention are directed to methods and systems for recognizing names entered according to a variety of different languages and grammatical rules and for providing helpful actions to a user associated with recognized names. In the following detailed description, references are made to the accompanying drawings that form a part hereof, and in which are shown by way of illustrations specific embodiments or examples. These embodiments may be combined, other embodiments may be utilized, and structural changes may be made without departing from the spirit or scope of the present invention. The following detailed description is therefore not to be taken in a limiting sense and the scope of the present invention is defined by the appended claims and their equivalents.

Referring now to the drawings, in which like numerals represent like elements through the several figures, aspects of the present invention and the exemplary operating environment will be described. FIG. 1 and the following discussion are intended to provide a brief, general description of a suitable computing environment in which the invention may be implemented. While the invention will be described in the general context of program modules that execute in conjunction with an application program that runs on an operating system on a personal computer, those skilled in the art will recognize that the invention may also be implemented in combination with other program modules. Additional aspects of an illustrative operating environment and software architecture for implementing the various embodiments of the present invention are described in U.S. patent application Ser. No. 09/588,411, entitled “Method and System for Semantically Labeling Strings and Providing Actions Based on Semantically Labeled Strings”, which is expressly incorporated herein by reference.

Generally, program modules include routines, programs, components, data structures, and other types of structures that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that the invention may be practiced with other computer system configurations, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, and the like. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote memory storage devices.

Turning now to FIG. 1 , an illustrative computer architecture for a personal computer 2 for practicing the various embodiments of the invention will be described. The computer architecture shown in FIG. 1 illustrates a conventional personal computer, including a central processing unit 4 (“CPU”), a system memory 6 , including a random access memory 8 (“RAM”) and a read-only memory (“ROM”) 10 , and a system bus 12 that couples the memory to the CPU 4 . A basic input/output system containing the basic routines that help to transfer information between elements within the computer, such as during startup, is stored in the ROM 10 . The personal computer 2 further includes a mass storage device 14 for storing an operating system 16 , application programs, such as the application program 205 , and data.

The mass storage device 14 is connected to the CPU 4 through a mass storage controller (not shown) connected to the bus 12 . The mass storage device 14 and its associated computer-readable media, provide non-volatile storage for the personal computer 2 . Although the description of computer-readable media contained herein refers to a mass storage device, such as a hard disk or CD-ROM drive, it should be appreciated by those skilled in the art that computer-readable media can be any available media that can be accessed by the personal computer 2 .

By way of example, and not limitation, computer-readable media may comprise computer storage media and communication media. Computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD-ROM, DVD, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by the computer.

According to various embodiments of the invention, the personal computer 2 may operate in a networked environment using logical connections to remote computers through a TCP/IP network 18 , such as the Internet. The personal computer 2 may connect to the TCP/IP network 18 through a network interface unit 20 connected to the bus 12 . It should be appreciated that the network interface unit 20 may also be utilized to connect to other types of networks and remote computer systems. The personal computer 2 may also include an input/output controller 22 for receiving and processing input from a number of devices, including a keyboard or mouse (not shown). Similarly, an input/output controller 22 may provide output to a display screen, a printer, or other type of output device.

As mentioned briefly above, a number of program modules and data files may be stored in the mass storage device 14 and RAM 8 of the personal computer 2 , including an operating system 16 suitable for controlling the operation of a networked personal computer, such as the WINDOWS XP operating system from MICROSOFT CORPORATION of Redmond, Wash. The mass storage device 14 and RAM 8 may also store one or more application programs. In particular, the mass storage device 14 and RAM 8 may store an application program 205 for creating and editing an electronic document 24 . For instance, the application program 205 may comprise a word processing application program a spreadsheet application, a contact application, and the like. Application programs for creating and editing other types of electronic documents may also be used with the various embodiments of the present invention.

›DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT · 2 of 6

Embodiments of the present invention provide program modules for use in conjunction with the application program 205 that recognize names in entered text and provide helpful actions on the recognized names. In particular, embodiments of the invention provide a recognizer plug-in 220 and an action plug-in 225 . As will be described in greater detail below, the recognizer plug-in 220 recognizes names in an electronic document 24 and labels the names with semantic information. The name recognizer plug-in 220 A then passes this information to the application program 205 for use by the action plug-in 225 . The action plug-in 225 performs actions on the recognized names.

According to various embodiments of the present invention, the action plug-in 225 may also generate a list of actions that may be performed on a given name. As a part of this process, the action plug-in 225 may query language settings 26 of the application program 205 or operating system 16 . The language settings 26 specify the current user interface language and the currently installed and enabled languages for the application program 205 and the operating system 16 . The list of actions may then be customized based on the current user interface language and the installed languages. Additional details regarding the operation of the recognizer plug-in 220 and the action plug-in 225 , including the use of the language settings 25 will be described in greater detail below.

Referring now to FIG. 2 , an illustrative software architecture for use in conjunction with the various embodiments of the present invention will be described. The architecture shown in FIG. 2 includes an application program 205 , such as a word processor application program, a spreadsheet application program, or other type of application program for creating and editing electronic documents. The application program 205 may also comprise a Web browser.

The application program 205 is able to communicate with a recognizer dynamically linked library (“DLL”) 210 and an action DLL 215 . As will be described in greater detail below, the recognizer DLL 210 controls one or more recognizer plug-ins 220 A- 220 N and the action DLL 215 controls one or more action plug-ins 225 A- 225 N.

According to one embodiment of the invention, the recognizer plug-ins 220 A- 220 N and the action plug-ins 225 A- 225 N are automation servers. Automation servers are well-known software components that are assembled into programs or add functionality to existing programs running on the WINDOWS XP operating system from MICROSOFT CORPORATION of Redmond, Wash. Automation servers may be written in a variety of computing languages and can be plugged and unplugged at runtime without having to recompile the host program.

The recognizer DLL 210 handles the distribution of text strings from an electronic document being edited by the application program 205 to the individual recognizer plug-ins 220 A- 220 N. The recognizer plug-ins 220 A- 220 N recognizes particular strings in an electronic document, such as a word processing document or a spreadsheet document. The recognizer plug-ins 220 A- 220 N may be packaged with the application program module 205 or they may be written by third parties to recognize particular strings of interest. Typically, the recognizer DLL 210 passes strings to the recognizer plug-ins 220 A- 220 N in single paragraphs or cell value increments. However, strings may be passed to the recognizer plug-ins 220 A- 220 N in other sizes and formats.

As part of recognizing certain strings as including semantic information, the recognizer plug-ins 220 A- 220 N determine which strings are to be labeled and how they are to be labeled. After receiving these results from the various recognizer plug-ins 220 , the recognizer DLL 210 sends semantic categories to the application program module 205 . According to one actual embodiment of the invention, a name recognizer plug-in 220 A is provided for recognizing strings as containing names. Additionally, the recognizer plug-in 220 may return information identifying the location of the name within the text string, including the length of the name.

It should be appreciated that each of the recognizer plug-ins 220 A- 220 N are executed separately. The recognizer DLL 210 is responsible for handling the asynchronicity that results from different recognizer plug-ins 220 A- 220 N returning results at different times. In this manner, various types of data may be recognized within a text string and different actions provided for each semantically labeled string. Additional details regarding the operation of the recognizer plug-in 220 for recognizing numbers will be described below with reference to FIGS. 3-6 .

After a string is labeled by a recognizer plug-in 220 A- 220 N, schema information is sent to the application program module 205 . A user of the application program module 205 may then execute actions that are associated with the schema information on the recognized string. The action DLL 215 manages the action plug-ins 225 A- 225 N that are executed in order to perform the actions. As with the recognizer plug-ins 220 A- 22 N, the action plug-ins 225 A- 225 N may be packaged with the application program module 205 or written by third parties to perform particular actions that are of interest. The action plug-ins 225 A- 225 N provide possible actions to be presented to the user based upon the schema information, or type label, associated with the string. As will be described in greater detail below, the list of actions provided to the user is dynamically generated for each schema type. This information is then provided to the application program 205 that displays the list of actions to the user when the string is selected.

After an action has been chosen from the list of actions, the action DLL 215 manages the appropriate action plug-in 225 A- 225 N and passes the necessary information between the action plug-in and the application program module 205 so that the action plug-in may execute the desired action. Typically, the application program module 205 sends the action DLL 215 an automation request to invoke the action the user has selected. As will be described in greater detail below, according to one embodiment of the invention, an name action plug-in 225 A is provided that provides actions on recognized names. Addition details regarding the operation of the action plug-in 225 will be described in greater detail below with reference to FIGS. 3-6 .

›DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT · 3 of 6

FIG. 3 illustrates a simplified block diagram showing interaction between a host application, a recognizer application and an action application for recognizing, labeling, and performing actions on names entered into text according to embodiments of the present invention. According to embodiments of the present invention, and as briefly described above, text entered using the host application 205 is passed to the recognizer DLL 210 that serves as a distribution point for passing text to other recognizer functionality such as the recognizer plug-ins 220 A through 220 N. According to embodiments of the present invention, the text passed from the host application is directed from the recognizer DLL 210 to a name recognizer 220 A. As described above with reference to FIG. 2 , the name recognizer 220 A may be a plug-in module that is plugged into the recognizer DLL 210 for providing particular functionality, in this case, recognition of names written using a variety of languages.

Referring still to FIG. 3 , the name recognizer DLL 220 A may compare words in the text received from the host application against a contacts list 330 or against a larger name database 340 to find a matching name. A suitable contacts list database 330 is provided by the Outlook® software application provided by Microsoft Corporation of Redmond, Wash. The name database 340 may include a large database of known names used according to a variety of different languages. Additionally, the name database 340 may also include a list of predictable names associated with particular languages. For example, as is well known to those skilled in the art, certain countries and associated languages have small numbers of names distributed among the populations of those countries. According to embodiments of the present invention, as described in detail below, if the language in which the text is entered is known, that information may be utilized by the name recognizer DLL 220 A to compare words against names contained in the database 340 where it is known that certain names associated with the language in which the text is written are common.

Also shown in FIG. 3 is a word breaker application 320 . According to embodiments of the present invention, the text received by the name recognizer DLL 220 A may be broken into words according to the language in which the text is written. That is, as is well known to those skilled in the art, some languages such as English, Arabic, Hebrew and Hindi use spaces and other delimiters such as punctuation marks to separate words. If text is received by the name recognizer DLL 220 A that is already broken into discrete words, the name recognizer 220 A may use those words to compare against the contacts list 330 and the name database 340 . If the text received by the name recognizer DLL 220 A is not broken into discrete words according to the language in which the text has been created, the name recognizer DLL 220 A may pass the text to a word breaker application 320 to break the text into discrete words that may be used by the name recognizer DLL 220 A for comparison against the contacts list 330 and the name database 340 . According to one embodiment of the present invention, the word breaker application 320 may be integrated with the name recognizer DLL 220 A. Alternatively, the word breaker application 320 may be a separate application that may be called by the name recognizer application 220 A when needed.

According to an embodiment of the present invention, if the language in which the text is created is known, the name recognizer DLL 220 A may utilize the grammatical rules and sentence structure rules of the known language to assist the name recognizer DLL 220 A in determining which words, if any, in the text received from the host application 205 comprise names. As is known to those skilled in the art, computer operating systems may be configured to allow computers to receive user input and to provide data output according to a variety of different languages. Likewise, host applications 205 often may be configured to receive data input and to provide data output according to a variety of different languages. Accordingly, if the user of the host application 205 configures her computer and the host application 205 to receive data input and to provide data output in a language such as Vietnamese, for example, the host application 205 may pass the designated language to the recognizer DLL 210 along with the text for determining whether any words in the text comprise a name. If the language is known by the name recognizer 220 A, the rules of that language may be utilized by the name recognizer 220 A to determine whether a word or words comprise a name. For example, if a particular language requires or commonly presents a standard word immediately preceding a name, such as a title noun like “Mr., Ms., Mrs.,” and the like, the name recognizer 220 A may utilize that rule in association with the known language to determine that a high probability exists that the word or words immediately following the title noun comprise a name.

Generally, a variety of different grammatical and sentence structure rules exist for many different languages utilized by users of the host application 205 . Some languages including English, Arabic, Hebrew and Hindi, utilize word delimiters such as spaces and punctuation marks to separate one word from another. However, these languages don't require or predominately utilize specific grammatical or sentence structure rules relative to names, such as the formal inclusion of a title noun prior to a name, or the inclusion of a province or a location designator after a name. For languages such as these, the name recognizer DLL 220 A may know the designated language, but in the absence of specific name oriented rules to the assist the name recognizer DLL, the individual words of text for these languages is compared against the name databases, such as the contacts list 330 and the larger name database 340 .

›DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT · 4 of 6

Other languages such as the That language are very formal in nature and typically require or predominately utilize name prefixes or title nouns prior to names, such as Mr. Mrs., Miss, boy, girl, or greeting. For languages such as the That language, the word breaker application 320 may be programmed with a dictionary of the name prefixes or title nouns so that the word breaker application 320 in conjunction with the name recognizer DLL 220 A may isolate name prefixes or title nouns in text provided by the host application 205 in order to track a word or words following the name prefix to determine whether those words comprise a name. Other indicators may be utilized by the name recognizer 220 A such as the common or maximum numbers of characters, such as vowels and consonants, utilized by a language such as the That language for construction of a name. Inclusion of certain words in some languages may also be used to create an ambiguity by the name recognizer 220 A and thus reject a word or words as a name. For example, if a conjunctive word such as “and” or “or” is utilized between two words following a name prefix, for example “Mr. Joe & Sara Smith,” the inclusion of the conjunctive word “and” may be utilized by the name recognizer 220 A to determine that the words following the name prefix do not comprise a whole name. Accordingly, nothing will be returned by the name recognizer to the host application 205 .

Other languages require or commonly utilize province or location designations immediately following a name. For example, “send this document to Joe Smith of Atlanta” includes a province or location designator of “of Atlanta” immediately following the name. In the case of royal descendents in certain languages, province names such as “Duke of York” or “Prince of Wales” immediately follow names. In either of these cases, the name recognizer 220 A may be programmed in conjunction with the word breaker application 320 to recognize province or location designations and then to look to a word or words immediately preceding the province or location designation as having a high probability of comprising a name.

Still other languages, such as the Vietnamese language, typically include family clan names such as “Bui”, or “Phong” immediately preceding a name. Because the number of family clan names is relatively small, the known clan names associated with the language, such as Vietnamese, may be utilized by the word breaker application 320 and the name recognizer 220 A for determining whether words immediately following a known clan name comprise a name. In many Far East languages, a relatively small number of common names are held by a majority of the populations originating under those languages. For example, the name “Kim” is a very common name in the Korean population and under the Korean language. Accordingly, common names utilized in such languages may be stored in memory and may be utilized by the word breaker application 320 in conjunction with the name recognizer 220 A to quickly compare words of text received from the host application 205 to a list of known common names associated with a known language. In any of the above cases, other general rules may apply. For example, in many languages names are capitalized. Such general rules may be used in conjunction with other more particular rules to assist the name recognizer 220 A in confirming that a word of text received from the host application 205 comprises a name.

FIG. 4 is a screen diagram showing an exemplary host application text entry screen and showing text entered and recognized as a name according to embodiments of the present invention. As shown in the exemplary text entry screen 400 of a host application 205 , a text string 410 including “please send this document to Joe Smith” is provided. According to embodiments of the present inventions, this text string is passed to the name recognizer 220 A via the recognizer DLL 210 . According to embodiments of the present invention, the word breaker application 320 is utilized by the name recognizer DLL 220 A to parse the text string into individual words. If need be, the word breaker application 320 may parse the text string one character at a time by passing combinations of characters back to the name recognizer DLL 220 A for comparing against the databases 330 , 340 . The word breaker application may also use delimiters such as spaces between the combinations of characters to determine the beginning and ending of individual words. The name recognizer DLL 220 A recognizes that the words “Joe Smith” comprise a name and passes those words back to the host application 205 tagged as a name. In response, the words “Joe Smith” in the text string are marked in some manner, such as the underlined marking shown in FIG. 4 , to indicate to the user that these words have been associated with some type of additional functionality.

According to an embodiment of the present invention, once the user focuses her computer cursor or mouse pointer over the tagged words, the action DLL 225 A associated with names may cause the action window 420 to be opened to provide actions to the user in association with the tagged name. As shown in FIG. 4 , the action window 420 includes two actions including “send mail” and “add to contacts.” Accordingly, the user may select one of the provided actions to launch the functionality associated with the action. For example, if the user selects the “add to contacts” action, the user's contacts list provided by the user's calendaring program may be launched to allow the user to add the name “Joe Smith” to the user's contacts list.

Referring still to FIG. 4 , a second text string 430 “pleasesendthisdocumenttoJoeSmithofAtlanta” is provided. According to the illustration shown in FIG. 4 , this text string has been created according to a language that does not use any type of word delimiters such as spaces or punctuation marks to separate words in the text string. Additionally, the text string 430 includes a province designator “of Atlanta” immediately following the name “Joe Smith”. According to embodiments of the present invention, the word breaker application 320 is utilized by the name recognizer DLL 220 A to parse the text string into individual words. If need be, the word breaker application 320 may parse the text string one character at a time by passing combinations of characters back to the name recognizer DLL 220 A for comparing against the databases 330 , 340 . Moreover, as described above with reference to FIG. 3 , the name recognizer DLL 220 A may have received with the text string an indication of the language in which the text string has been created. The name recognizer DLL 220 A then may determine that the language in which the text string is created commonly requires or presents province or location identifiers such as “of Atlanta” immediately following a name. The name recognizer DLL 220 A then may use this information to determine that the words “Joe Smith” immediately preceding the province or location identifier “of Atlanta” comprise a name. Because the words “Joe Smith” are passed back to the host application 205 as a name, the action DLL 225 A causes the action window 440 to be presented to the user when the user focuses on the marked name “Joe Smith” in the text string 430 , as described above. As should be understood, the action items shown in the action windows 420 and 440 are only a small sampling of the actions that may be made available to the user. Other actions include “scheduling and meeting”, “inserting address”, and the like.

›DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT · 5 of 6

FIGS. 5 and 6 are flow diagrams showing an illustrative routine for recognizing a name in text entered into a computer-generated document and for providing helpful actions associated with the recognized name. The method 500 begins at start step 505 and moves to step 510 where a database of names is built for use by the name recognizer 220 A in resolving names in text passed to the name recognizer from the host application 205 . According to embodiments of the present invention, the database of names may include a contacts list 330 and a separate name database 340 , as described above. At step 512 , text is input by a user at the host application 205 . As described above, the host application 205 may be one of a number of software applications capable of receiving text input from the user. Moreover, the host application 205 may be an application allowing the user to input text according to a variety of languages by selecting an input language using the host application 205 and/or selecting an alternate language user interface via the operating system 16 of the user's computer two.

At step 514 , text entered by the user via the host application 205 is passed to the recognizer DLL 210 . As should be understood by those skilled in the art, text may be passed to the recognizer DLL in sentences, paragraphs, or other discrete text fractions. Alternatively, text may be passed to the recognizer DLL each time the users goes idle, for example where the user pauses between keystrokes for more than a set time duration.

At step 520 , a determination is made as to whether the language of the text passed from the host application 205 is determinable. As described above, if the language of the text passed from the host application 205 has been set by the user via the host application 205 or via the user interface, such as a keyboard, via the user's computer operating system, that information may be passed along with the text selection to the recognizer DLL 210 . If the language is determinable, the method proceeds to step 540 , and the recognizer DLL passes the text selection and language indicator data to the name recognizer DLL 220 A.

At step 540 , the text received by the name recognizer 220 A is broken into words for the eventual determination as to whether any of the words comprise a name. As described above, according to some languages, the text may already be broken into readily definable words by use of word delimiters such as spaces and punctuation marks. For example, referring back to FIG. 4 , the text selection 410 includes a set of words that are separated by spaces. On the other hand, a text selection 430 , illustrated in FIG. 4 may be presented to the name recognizer 220 A that is created using a language that does not use word delimiters, such as spaces or punctuation marks, where each character is run together in side-by-side orientation. In either case, if necessary, the word breaker application 320 is utilized by the name recognizer 220 A for separating the text into words that may be compared against language rules or databases to determine whether any of the words comprise a name. In the case of the text string 430 where the text string is not already broken into definable words, the word breaker 320 may, if necessary, parse the text string one character at a time forming combinations of characters that may be compared against the databases or language rules to determine whether the combinations of characters are words that comprise a name.

At step 542 , because the language of the text selection is known, the name recognizer DLL 220 A applies the rules of the known language in an attempt to isolate names contained in the text selection passed from the host application 205 . For example, referring to the text string 430 , illustrated in FIG. 4 , if the language of the text string requires or commonly uses a province or location designation immediately after a name, the name recognizer 220 A may locate and recognize the phrase “of Atlanta” as a province name or location designator that commonly or by requirement immediately follows a name according to the language of the text selection. Accordingly, the name recognizer 220 A may then look to words immediately preceding the phrase “of Atlanta” to determine that a high probability exists that the words immediately preceding the location designator comprise a name.

At step 544 , after the name recognizer 220 A has applied the rules of the known language to the text selection, a determination is made as to whether the rules comparison allows the name recognizer 220 A to resolve any of the words as names. If not, the method may proceed to step 524 where the words of the text selection are compared against the databases 330 , 340 in the same manner, as would be words of a text selection where the language of the text selection is not known. If the name recognizer 220 A is able to resolve names from the text selection by analyzing the rules of the known language, the method proceeds to step 546 . As should be understood by those skilled in the art, the names resolved by the name recognizer 220 A by analysis of the rules of the language may not result in an absolute confirmation that a given word or words is a name, but may result in a high probability that a given word or words is a name, and confirmation may be achieved by comparing such words to the user's contact's list 330 or to the other name databases 340 . Alternatively, once the name recognizer 220 A determines that a sufficient probability exists that a given word or words is a name based on an analysis of the language rules associated with the words, the method may proceed directly to step 534 , and the words may be returned to the host application 205 as a name, as will be described in further detail below.

At step 546 , the words resolved as a name by the name recognizer by analyzing the language rules associated with the words is compared against the user's contacts list 330 . It is useful to compare the words against the user's contacts list 330 because if the words match a name in the user's contact lists 330 , actions may ultimately be provided to the user such as sending an email message to the named person. At step 548 , FIG. 6 , a determination is made as to whether the word or words matches a name contained in the user's contact's list 330 . If the words do match a name contained in the user's contacts list 330 , the method proceeds to step 534 , and the name is returned to the host application 205 as a name, as will be described in detail below. If the words do not match a name contained in the user's contacts list 330 , the method proceeds to step 550 and the words are compared against a language-specific name set to determine whether the words match names that are commonly used in the language in which the text string has been created.

›DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT · 6 of 6

At step 552 , if the words match names contained in the language-specific set of names, the method proceeds to step 534 , and the name is returned to the host application, as described below. If no match is achieved, at step 552 , the method proceeds to step 554 and the words are compared against a general database of names 340 where the words are compared against a database containing an exhaustive list of known names. At step 556 , if the words match names contained in the general name database, the method proceeds to step 534 , and the names are returned to the host application, as described below. If the words do not match any of the databases 330 , 340 , the method may end at step 595 . It should be understood by those skilled in the art that the rules analysis and the comparisons to the databases described above may be done simultaneously or in the order described above. According to an exemplary embodiment of the present invention, the order described above allows for better efficiency in terms of processing time because the words are first compared against databases with the strongest likelihood of matching names.

Referring back to step 520 , if the text selection originally passed to the recognizer DLL 210 from the host application 205 does not have an associated known language, the method proceeds to step 520 and the text string is broken into words either using word delimiters such as spaces and/or punctuation marks or by using the word breaker application 320 , as described above. As should be understood, a language designation may not have been passed to the recognizer DLL, or the name may be included in a mixed language document. For example, the user may create the document in the English language, but the user may insert Vietnamese based names, for example, throughout the document. In this case, because no particular language is associated with the text passed to the name recognizer 220 A, at step 524 , each word broken from the text selection is first compared against the user's contacts list 330 . At step 526 , if any of the words from the text selection match a name or names contained in the user's contacts list 330 , the method proceeds to step 534 , and the names are passed to the host application 205 , as described below. If words broken from the text string do not match names contained in the user's contacts list 330 , the method proceeds to step 530 , and the words are compared against names contained in a general database 340 .

At step 532 , FIG. 6 , a determination is made as to whether any of the words from the text string passed to the name recognizer 220 A match any names contained in the general names database 340 . If not, the method may end at step 595 . If the words match names contained in the general name database 340 , the method proceeds to step 534 , and the name is returned to the host application 205 .

At step 536 , the host application 205 calls the action DLL 215 for actions on the returned name. As illustrated in FIG. 2 , according to an embodiment of the present invention, the action DLL 215 may utilize a name action plug-in 225 A for providing name-oriented actions on the returned name. At step 538 , actions from the action DLL 215 are provided for the returned name. For example, referring to the text string 410 , illustrated in FIG. 4 , the name “Joe Smith” is marked with an underline or other indicator that the name has been tagged for actions associated with the name. Upon focusing on the tags name by placing the computer cursor or mouse pointer in the tagged name, the action window 420 is made available to the user so that the user can select available actions. As should be understood, the actions made available to the user may be provided dynamically based on the name returned. For example, if the name returned from the name recognizer DLL 220 A is a name that matched a name in the user's contacts list 330 , an action such as “send mail” may be provided because the electronic mail address associated with the name may be available in the contacts list 330 . If the name returned by the name recognizer DLL was not located in the contacts list 330 , but was located in a general database 340 , an action such as “add to contacts” may be provided to allow the user to add the returned name to the user's contacts list. As should be understood, selection of one of a number of available actions provided to the user may cause some other action, such as the launching of a user interface to allow the user to send an email message, edit a contacts list, prepare a memo, and the like. After actions are provided to the user for the returned name at step 538 , the method ends at step 595 .

As described herein, methods and systems are provided for recognizing names in a text string entered according to a variety of languages and for providing helpful actions on the recognized name. It will be apparent to those skilled in the art that various modifications or variations may be made in the present invention without departing from the scope or spirit of the invention. Other embodiments of the invention will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein.

Claims as granted

23 claims

Log in to read the claims of this application.

Log in to unlock

Classifications

6 codes
IPC · International Patent Classification
Section G — Physics
  • G06F40/00
  • G06F17/27
  • G06F17/21
USPC · US Patent Classification
704/9704/10704/1

Claim changes

Soon
Coming soonHow the claims changed between publication and grant

See which claims were amended, added or cancelled during examination, with every added and removed word marked.

AmendedAddedCancelledUnchanged

The published claims of this application are not paired with the granted ones in what we hold.

File wrapper

⤢ drag to zoom20032004200520062007200820092010USPTOApplicantNon-final rejectionResponse after non-finalRequest for continued examinationNotice of allowanceResponse after non-finalNotice of allowance
USPTOApplicanthover for detail · click to open
Pendency
7.0 y
2,562 days filing → grant
Office actions
4
non-final + final
Responses
4
3 RCE
Examiner
Richemond Dorvil
art unit 2626 · TC 2600
Citations: 738 back · 260 forward

See the full prosecution history — every USPTO and applicant action on this file, in order.

Log in to unlock

Documents

Log in to open the documents of this file: the application as filed, every office action and response, the notice of allowance.

Log in to unlock

Chain of title

⤢ drag to zoom20042006200820102012201420162018202020222024Owner 1Owner 2
Titlehover for detail · click to open

See the full assignment history — every owner this patent has passed through, with recordation dates and reel/frame numbers.

Log in to unlock