Data retrieval apparatus for selecting geographical location information on a globe

There are 6 COMPARE activities. While awaiting player's action on this game, the pen 200 will play the voice instruction “To compare the population/Area/Currency/Time/Flying Time”, “First location” and “Second location”.

To start the COMPARE game, the player should tap any one of the COMPARE buttons 162 on the globe base 120 , whereby the type of information to compare is determined, and then select two locations on the world map 150 (or the local map 140 ). During selection, the pen 200 will announce the name of the first location immediately upon tapping, then play “second point” to request a second location, and subsequently announce the name of second location immediately upon tapping.

Taking China/India, Japan/Italy and United States/Japan as examples, the following table lists the corresponding voice segments that the pen 200 will play in respect of all of the 6 data types to compare. Different player age groups “5-8”, “9-14” and “15+” share the same voice segments.

There are 6 FIND activities, some having three rounds of increasing challenge levels, for up to four players. To start the game, any one of the FIND buttons 163 should be tapped, whereupon the pen 200 will ask a question as shown in the table below and then await an answer. A certain length of time will be given for the player to tap the right place on the globe body 110 , namely 90 seconds for the age group “5-8”, 60 seconds for the age group “9-14” and 45 seconds for the age group “15+”.

In general, ten questions will be asked for each round, except the subject type “Continent” for which there will only be seven questions.

To play the Amazing Facts, the upper KNOWLEDGE button 164 should be pressed using the pen 200 , and then the first/next fact will be played. There are up to 20 facts, which will be updated monthly or bi-weekly. The button 164 is touched once for each new fact. The fact will not repeat until the last one has been played. All the age groups are given access to this activity but with different types of data.

To play the World News, the middle KNOWLEDGE button 164 should be pressed using the pen 200 , and then the first/next news will be played. There are up to 10 facts, which will be updated monthly or bi-weekly.

To play the Earth Facts, the lower KNOWLEDGE button 164 should be pressed using the pen 200 , and then the first/next news will be played. There are up to 20 facts, which will be updated monthly or bi-weekly.

In this particular embodiment, a globe ( 100 ) is employed as the base unit of the subject data retrieval apparatus such that the users can have a feel of geographical locations and directions around the planet. It is envisaged that the base unit can take the form of a book or bound charts, such as a world atlas (akin to the local map 140 ) so that more encoded index information can be packed into a smaller size.

It should be noted that any other suitable coding schemes for the index information may be adopted, which do not require electrical wire/cable connection of the handheld operator to the base unit.

The subject matter of the data handled by the subject apparatus is unlimited. For example, the base unit can depict a zoo/jungle or animals around a globe, in that the animals are encoded with respective indexes for selective input to the handheld operator to prompt the operator to retrieve and play the relevant pre-recorded voice information relating to those animals, such as their names and habitat.

The pen 200 communicates with the PC 10 via USB connection. It is envisaged that the communication can be implemented using wireless connection technologies, such as the 2.4 GHz radio frequency protocol or the Bluetooth technology, in which case the bridge 260 is replaced by a suitable RF transceiver or Bluetooth module.

The invention has been given by way of example only, and various other modifications of and/or alterations to the described embodiment may be made by persons skilled in the art without departing from the scope of the invention as specified in the appended claims.

Referring to the FIG. 9 and FIG. 10 , in another aspect of the invention, there is shown a data retrieval apparatus which comprise a base unit in the form of a geographic globe 100 and a handheld pen-shaped operator or a pen 200 in short that is wireless and separate from and is co-operable wirelessly with the globe 100 . The globe 100 has a spherical body 110 whose outer surface bears a map of the world 150 which is encoded with a predetermined set of index information each corresponding to preassigned geographical location on the globe. The globe 100 includes a curved base 120 which supports the spherical body 110 for free 360° spinning in all directions on two, vertical and horizontal axes by means of a cross-pivot system 130 as is generally known in the art. In the front part of the base 120 , there is also a Liquid Crystal Display (LCD) screen 190 on the incaved region of the base 120 . In the embodiment shown, the LCD screen 190 is a 3.5″ Thin Film Transistor (TFT) LCD screen. The base 120 further includes a horizontal board 124 which is slidable into and out of the bases' body like a drawer. The base 120 further includes an internal speaker (not shown) and an associated speaker jack 172 at the back, as well as a cradle 180 for locating the pen 200 upright on the base 120 .

The world map 150 is printed on the globe body 110 employing a dot coding scheme using four colors which are red, blue and yellow for the various pictorial graphical features of the map 150 and include black as dots printed on the red, blue and yellow layers. The black dots are arranged in repeating patterns to form codes, i.e. the index information, which are readable by the pen 200 to identify the various locations i.e. continents, countries, capitals and cities, etc. for data retrieval. The layer of index dots has a tone that is tuned as light as possible to be indiscernible so as not to affect the original picture colors of the map 150 .

In FIG. 11 , the globe base 120 has, on its front part, a horizontal board 124 which bears an operation panel 160 and a local map 140 . The upper surface of the board 124 has a label stuck thereon, which is printed with the local map 140 using the same dot coding scheme as the world map 150 , as well as operation panel 160 does, for reading by the pen 200 likewise in the same manner. The local map 140 and the operation panel 160 are normally hidden but it may be revealed by pulling out the board 124 .

Compared with the world map 150 , the local map 140 shows more detailed geographical information about the country in which the subject data retrieval apparatus is marketed (and used), for example information about the member states for the United States of America. The local map 140 offers an alternative to the world map 150 , providing a set of additional index information for data retrieval at the pen 200 .

As shown in the embodiment of FIG. 12 , the panel 160 is provided by a label printed with a pattern of four groups of game/information activity buttons i.e. TOUCH, COMPARE, FIND and KNOWLEDGE buttons 161 to 164 , six control keys 166 , using the same dot coding scheme as the world map 150 for reading by the pen 200 in the same manner, and a separate button 165 which is for real-time retrieval. The activity buttons 161 to 165 are named according to the categories or types of data that the corresponding activities are to perform upon as shown in FIG. 12 , and are encoded individually for user's selection to input the chosen activity commands with desired data types to the pen 200 . Similarly, the control keys 166 are named as shown, and encoded, to indicate the control to implement at the pen, namely Player (for user's age group selection), Pause, Demo, Repeat and Volume up and down.

As shown in FIGS. 13 a and 13 b , the pen 200 has an elongate casing 210 for holding by a user and an optical ID image sensor module 220 located within the tip (i.e. lower end) of the casing 210 for image capturing. Turning now to FIG. 14 , the sensor module 220 is formed by a CMOS sensor 221 , a camera lens 222 , a filter 223 between the sensor 221 and the lens 222 , and a pair of infra-red (IR) light emitting diodes (LEDs) 224 on opposite sides of the lens 222 . The IR LEDs 224 are arranged to emit IR light at a surface bearing an image close to which the lens 222 is pointed at, with the IR light reflected from the surface detected by the sensor 221 through the lens 222 and filter 223 , whereby the image is captured. The pen 200 also includes an image processor 240 for processing (e.g. decoding or recognizing) an image captured by the sensor module 220 . The pen 200 also has a wireless transmitter 245 which is preferably a 2.4 GHz wireless transmitter to transmit the index information decoded by the image processor 240 to the globe.

The globe 100 includes, as housed or supported within the base 120 , an MCU (microprocessor control unit) 230 for control and operation of other system components, a 2 GB NAND flash memory 250 for storing data information and connected to the MCU 230 , a wireless receiver 246 to receive the index information from the pen 200 , a wireless WiFi Module 248 for connecting to a remote network, and a speaker 270 and the LCD screen 190 connected to the MCU 230 for announcing and/or displaying the data information stored in the memory 250 . The data information stored in the memory 250 can be video and voice or other data that comprises texts, images, animations, video clips, sound effects, human voices and music data. The flash memory 250 also serves to store the appropriate programs, codes and data, etc., such as system music and sounds, as required for the operation and functioning of the pen 200 . There is a real time clock 280 connected to the MCU 230 , which keeps the real time for the system.

The USB ISP bridge 260 is an in-system programming chip for USB downloading of program to nonflash memory. In the operating circuitry of the globe 100 , the bridge 260 is connected as an interface in circuit with the MCU 230 and the flash memory 250 for the MCU 230 to receive data from the memory 250 . More importantly, the bridge 260 also enables connection of the globe 100 using a USB cable to a user's PC (personal computer) 10 which is in turn connected to the Internet such that updated data information and programs, etc. can be downloaded, to update the content of the flash memory 250 , via the PC 10 and the Internet from a remote server which runs an online website/platform to serve and provide supports to general users of the subject data retrieval apparatus. The time kept by the pen's clock 280 can also be synchronized by or via the PC 10 , preferably automatically each time when the pen 200 is connected to the PC 10 .

The WiFi module 248 , on the other hand, is an alternative communication module to the USB ISP bridge 260 . The WiFi module 248 can connect to any external WiFi network, and even to the Internet ultimately, and any updated data information and programs, etc. can be downloaded, to update the content of the flash memory 250 . The WiFi module includes but not limited to the module using 802.11a/b/g/n technologies.

In operation, when the user points the pen 200 at a desired geographic location of the world map 150 , or the local map 140 , the sensor module 220 at the pen tip captures the index dots printed over that position and then outputs the associated 8-bit raw data through a 2-bit data bus from the CMOS sensor 221 to the image processor 240 . In response, the image processor 240 decodes the raw data received from the sensor module 220 using a specific signal processing algorithm and then passes the decoded data to the wireless transmitter 245 . The wireless transmitter 245 will then transmit the decoded data to the wireless receiver 246 and the data will finally be transmitted to the MCU 230 .

The user can also select the desired activity and data type by tapping the pen 200 at the relevant button 161 / 162 / 163 / 164 / 165 on the operation panel 160 . In doing so, the pen's sensor module 220 captures the associated dot code and outputs the corresponding raw data to the image processor 240 and then the image processor 240 decodes the raw data and passes the decoded data to the wireless transmitter 245 . The wireless transmitter 245 will then transmit the decoded data to the wireless receiver 246 and the data will finally be transmitted to the MCU 230 .

The aforesaid selections of geographic location and of activity and data type can be performed in the reversed order. At the completion of these two user's actions, the MCU 230 will recognize and act on the command and data received from the wireless receiver 246 by executing the chosen activity function and retrieving the appropriate text/audio/video/image data file from the flash memory 250 and finally announcing or playing the corresponding video, images, text or audio segment at the speaker 270 and/or the LCD screen 190 .

The operation of the subject data retrieval apparatus will now be described in further detail.

There are 31 activities, namely TOUCH (×15), COMPARE (×6), FIND (×6), World News (×1), Amazing Facts (×1), Earth Facts (×1), and Real-time Retrieval (×1) all of which are selectable using the activity buttons 161 to 165 . For a first time user, the default age group is “5-8”. Upon tapping the Player key 166 , the pen 200 will play “To change the number of player, press this button again” and then “Player+One, Two, Three, Four”. Upon tapping the “Time” button 161 of the TOUCH activity, the pen 200 will play “Time hasn't been set yet. Please connect to your PC to download our latest information.”

Each product of the subject data retrieval apparatus is accompanied by an installation CD for installation before use, including installing an associated operation program and relevant drivers, etc. on the PC 10 for use with the pen 200 and loading an initial set of data information (from the CD) into the pen's flash memory 250 . A unique access code is assigned to the apparatus, as appearing on the CD cover. The user should initially enter the access code into the operation program and then follow the on-screen instructions to register and activate the code. In particular, the user will be asked to select his/her age group and to press a download button to start download.

In one embodiment, the data retrieval apparatus is accompanied with a “coded” keyboard that can be made from any material, such as paper, rubber or plastic. This optical keyboard can replace a real keyboard, as it is printed with the characters that can be selected, together with the same type of indexed information used for the locations indicators described above for the globe. The characters may be anything that the device manufacturer wishes the user to learn and/or communicate such as letters, numbers, pictures or other symbols and images. Because each character is printed with a corresponding indexed information code that is recognizable with the system, the user can user the pen 200 to scan the characters (i.e. the corresponding indexed information) printed on the paper keyboard. Each scan is equivalent to the inputting of the selected character. If the characters are the same as a traditional keypad or keyboard, then it can be used as such but the hardware cost for the device can be greatly saved while providing the user with full capability of inputting text information. When the user is inputting the access code, he can use the pen 200 and the paper keyboard. In other circumstances such as inputting the SSID and password for the Wifi network, or inputting any information/command to the data retrieval apparatus, the user can always use the optical keyboard and the pen 200 . On the other hand, if other types of characters such as images are also provided on the optical keyboard, such as national flags and colours then this optical keyboard becomes a far more useful, versatile and interactive part of the present device and system than merely a replacement of a conventional electronic keyboard. The user can then try to match national flags to geographic areas on the globe, or select the right colours for various national flags. The images provide a substitute for traditional alphanumeric characters, such that even those who do not know the spelling of certain desired input may also be able to do so with a “one-click” action. This is particularly important for the learning convenience and enjoyment of small children or people who speak a different language.

In general, upon connection of the globe 100 to the PC 10 that is in turn connected to the Internet, the operation program automatically runs and pops up a data update screen ( FIG. 15 ) on the PC 10 and automatically checks for update on the server by sending information to the server to verify the content version and data specification. The relevant age group for the player is shown or can be selected on screen. The update checking process is run behind the screen. In case there is update information, the PC 10 will prompt and instruct the user to start download. If update is not necessary, the globe 100 will display on the LCD screen 190 “No new data available”. In an alternative way, upon the connection of the globe 100 to a remote WiFi network that is in turn connected to the Internet via the WiFi module 248 , the build-in update program in the globe 100 can directly connects to the Internet and performs updating process similar to the one described above.

There are 15 TOUCH activities. While awaiting player's instructions on this game, the globe 100 will play, as appropriate, “Pick an activity, then touch the Globe for more information”, “To start your game, press any button to select an activity” and “Then, touch the Globe for more information”.

To start the TOUCH game, the player should tap any one of the TOUCH buttons 161 on the globe base 120 and then select a location on the globe body 110 . Taking New York as an example, the globe 100 will play the relevant voice segment as indicated in the following table, which shows the voice segments for all of the 15 data types or topics relative to different player age groups “5-8”, “9-14” and “15+” (i.e. age 15 or above).

The topic can be changed at any time by tapping another activity button 161 , or a different country can be picked by tapping a new location on the world map 150 , whereupon the associated new piece of information is announced.

To start the COMPARE game, the player should tap any one of the COMPARE buttons 162 on the globe base 120 , whereby the type of information to compare is determined, and then select two locations on the world map 150 (or the local map 140 ). During selection, the pen 100 will announce the name of the first location immediately upon tapping, then play “second point” to request a second location, and subsequently announce the name of second location immediately upon tapping.

Taking China/India, Japan/Italy and United States/Japan as examples, the following table lists the corresponding voice segments that the globe 100 will play in respect of all of the 6 data types to compare. Different player age groups “5-8”, “9-14” and “15+” share the same voice segments.

There are 6 FIND activities, some having three rounds of increasing challenge levels, for up to four players. To start the game, any one of the FIND buttons 163 should be tapped, whereupon the globe 100 will ask a question as shown in the table below and then await an answer. A certain length of time will be given for the player to tap the right place on the globe body 110 , namely 90 seconds for the age group “5-8”, 60 seconds for the age group “9-14” and 45 seconds for the age group “15+”.

In general, ten questions will be asked for each round, except the subject type “Continent” for which there will only be seven questions.

To play the Amazing Facts, the upper KNOWLEDGE button 164 should be pressed using the pen 200 , and then the first/next fact will be played. There are up to 20 facts, which will be updated monthly or bi-weekly. The button 164 is touched once for each new fact. The fact will not repeat until the last one has been played. All the age groups are given access to this activity but with different types of data.

To play the World News, the middle KNOWLEDGE button 164 should be pressed using the pen 200 , and then the first/next news will be played. There are up to 10 facts, which will be updated monthly or bi-weekly.

To play the Earth Facts, the lower KNOWLEDGE button 164 should be pressed using the pen 200 , and then the first/next news will be played. There are up to 20 facts, which will be updated monthly or bi-weekly.

Now the function of retrieving real-time city scenes, or called City on Demand on the data retrieval apparatus, will be introduced. Referring to FIG. 16 , a system for retrieving real-time city scenes includes a central server 300 , a first communication network 310 , a second communication network 320 , a plurality of cameras 330 , and at least one geographic globe 100 . The first communication network 310 and the second communication network 320 are preferably the Internet. The globe 100 is connected to the first communication network 310 via wired or wireless connection, i.e., through its USB ISP bridge and a PC, or directly though its WiFi module. The globe 100 is communicable with the central server 300 . On the other hand, a plurality of cameras 330 are connected through the second communication network 320 to the central server.

The cameras 330 may be installed in different locations in different cities around the world. For example, such cameras can be installed on a bridge, on a city street lamp pole, on a tower, etc. The purpose of these cameras is to capture the scene of the specific city, either in a real-time way or periodically recording.

In operation, when the user of the globe 100 wants to see the real-time or latest scenes of cities around the world, he need to use the pen to point to the city he is interested in on the globe 100 , or point to the name of a country if he wish to randomly view the scenes of cities in that country. In the next step, the button 165 should be pressed using the pen, and then the globe 100 will connect to the Internet and access the server 300 to search and download the camera video or still images for the selected city. Alternatively, the globe 100 can also download the camera video, still images or any other data information through the USB ISP bridge 260 which further connected to the PC 10 and thus ultimately connected to the Internet.

There are many ways for the central server 300 to store the camera video or still images collected from different cameras 330 around the world. For example, the server 300 can use real-time streaming technology and provide the globe 100 a streaming connection to view the real-time scenes from the cameras, upon user's selection of a specific city. Alternatively, the central server can obtain from all the cameras 330 over the world periodically by itself. When there is a user request come to the central server 330 , the central server 330 will provide a uploading connection for the globe 100 , and the globe 100 can download the latest video clip or still images through the internet.

When the globe 100 obtained the video or still images content through the central server 330 , it will display these contents on the LCD screen and/or play the audio through the audio speaker. Thus, the user can view the real-time scenes of any city in the world at any time, which is an intuitive and educational way to learn the knowledge of the world's cities.

There could be many ways of how the user viewing the scenes of a city on the globe 100 . If there are many cameras 330 located in different place of the city, the user can view the camera videos which are automatically switched periodically such that all the cameras videos can be viewed. Alternatively, the user can even choose which(s) camera's video he wishes to watch on the globe 100 .

In one exemplary embodiment, the globe 100 can further download other types of contents related to the specific city the user selected through the Internet. For example, photographs, articles, tour guides, etc, can be downloaded to the globe 100 and the user of the globe 100 can view them.

In another embodiment, the globe 100 is capable of receiving the input from the user as to control the angle/orientation of the specific camera that he is currently watching. Such input commands will be transmitted to the camera 330 via the central server 300 , and the camera 330 will acts according to the command by its mechanical device.

The exemplary embodiments of the present invention are thus fully described. Although the description referred to particular embodiments, it will be clear to one skilled in the art that the present invention may be practiced with variation of these specific details. Hence this invention should not be construed as limited to the embodiments set forth herein.

In this particular embodiment, a globe ( 100 ) is employed as the base unit of the subject data retrieval apparatus such that the users can have a feel of geographical locations and directions around the planet. It is envisaged that the base unit can take the form of a book or bound charts, such as a world atlas (akin to the local map 140 ) so that more encoded index information can be packed into a smaller size.

It should be noted that any other suitable coding schemes for the index information may be adopted, which do not require electrical wire/cable connection of the handheld operator to the base unit.

In the preferred embodiment described above, both the first communication network 310 and the second communication network 320 are the Internet. However, one skilled in the art should realize that these two networks might not be necessarily the same network as the Internet. Other types of networks, such as WAN (Wide Area Network), MAN (Metropolitan Area Network), etc, can be used as the first communication network or second communication network.

The subject matter of the data handled by the subject apparatus is unlimited. For example, the base unit can depict a zoo/jungle or animals around a globe, in that the animals are encoded with respective indexes for selective input to the handheld operator to prompt the operator to retrieve and play the relevant pre-recorded voice information relating to those animals, such as their names and habitat.

The globe 100 communicates with the PC 10 via USB connection. It is envisaged that the communication can be implemented using wireless connection technologies, such as the 2.4 GHz radio frequency protocol or the Bluetooth technology, in which case the bridge 260 is replaced by a suitable RF transceiver or Bluetooth module. In a similar way, the WiFi module 248 could be replaced by any other viable technologies such as cellular network module, Wi-max module or UWB module to provide network connection to the remote network.