Information display apparatus, information display method, information display program, graphical user interface, music reproduction apparatus, and music reproduction program

The present invention contains subject matter related to Japanese Patent Application JP 2006-019289 filed in the Japanese Patent Office on Jan. 27, 2006, the entire contents of which being incorporated herein by reference.

1. Field of the Invention

The present invention relates to an information display apparatus, information display method, information display program, graphical user interface, music reproduction apparatus, and music reproduction program, and is suitable for applications where a plurality of objects are presented for user selection.

2. Description of the Related Art

An image-information-type graphical user interface (GUI) has been widely used as a display interface for computer operations. Since the GUI displays a GUI screen and uses icons (visual representations, graphic symbols, etc.) as well as text to represent the contents of files, functions, and operations, it permits a user to perform visual, intuitive operations and provides higher user-friendliness than a textual-information-type character user interface (CUI).

The GUI screen generally offers multiwindow capability, which simultaneously displays a plurality of windows, thereby allowing the user to perform a plurality of operations in a parallel manner.

A list display mode is widely used in the GUI screen to let the user select a desired selectable object from a plurality of candidate objects. The list display mode simultaneously presents a plurality of candidate objects to the user by arranging the information about candidate object files and pieces of content (e.g., icons and names) in a vertical or horizontal direction within a list display section.

In the list display mode, a selected candidate object by user (that is, the selected object) is displayed in a manner different from the manner in which the other candidate objects are displayed in the list display section (e.g., by changing the display color). This makes it possible to visually distinguish the selected object from the candidate objects.

The list display mode also scrolls the contents displayed in the list display section in a vertical or horizontal direction depending on a user operation. This makes it possible to sequentially display hidden candidate objects that are currently positioned outside a display range of the list display section.

When the list display section is scrolled, the selected object moves together with the candidate objects. Therefore, the selected object disappears from the list display section so that the user may not confirm the already selected object.

The present invention has been made in view of the above circumstances, and proposes an information display apparatus, information display method, information display program, graphical user interface, music reproduction apparatus, and music reproduction program that provide increased ease of operation.

According to an embodiment of the present invention, there is provided an information display apparatus includes: candidate object display means configured to display selectable candidate objects in a first display layer; and selected object display processing means configured to display a selected object, which is selected by user from the candidate objects, in a second display layer, which is superposed over the first display layer.

According to another embodiment of the present invention, there is provided an information display method including the steps of: displaying selectable candidate objects in a first display layer; and displaying a selected object, which is selected by user from the candidate objects, in a second display layer, which is superposed over the first display layer.

According to yet another embodiment of the present invention, there is provided an information display program that causes an information processing apparatus to execute the steps of: displaying selectable candidate objects in a first display layer; and displaying a selected object, which is selected by user from the candidate objects, in a second display layer, which is superposed over the first display layer.

According to further embodiment of the present invention, there is provided a graphical user interface that presents selectable candidate objects and allows a user to select an object from the candidate objects, the graphical user interface including the steps of: displaying the candidate objects in a first display layer; and displaying a selected object, which is selected by user from the candidate objects, in a second display layer, which is superposed over the first display layer.

According to yet further embodiment of the present invention, there is provided a music reproduction apparatus includes: candidate object display means configured to display selectable candidate objects in a first display layer; selected object display processing means configured to display a selected object, which is selected by user from the candidate objects, in a second display layer, which is superposed over the first display layer; playlist creation means configured to create a playlist in accordance with selected objects displayed in the second display layer; and reproduction means configured to reproduce music in accordance with the playlist.

According to another embodiment of the present invention, there is provided a music reproduction program that causes a music reproduction apparatus to execute the steps of: displaying selectable candidate objects in a first display layer; displaying a selected object, which is selected by user from the candidate objects, in a second display layer, which is superposed over the first display layer; creating a playlist in accordance with selected objects displayed in the second display layer; and reproducing music in accordance with the playlist.

The above and other features and advantages of the present invention will become apparent from the following description when taken in conjunction with the accompanying drawings which illustrate preferred embodiments of the present invention by way of example.

FIG. 1 is a block diagram illustrating the hardware configuration of a personal computer;

FIG. 2 is a block diagram illustrating the software configuration of a music player;

FIG. 3 is a schematic diagram illustrating the screen configuration of the music player;

FIG. 4 is a schematic diagram illustrating a playlist creation procedure;

FIG. 5 is a schematic diagram illustrating a playlist creation procedure;

FIG. 6 is a schematic diagram illustrating a playlist creation procedure;

FIG. 7 is a timing diagram illustrating a song selection/deselection/deletion procedure;

FIG. 8 is a schematic diagram illustrating a playlist creation procedure;

FIG. 9 is a schematic diagram illustrating a playlist creation procedure;

FIG. 10 is a schematic diagram illustrating a playlist creation procedure; and

FIG. 11 is a schematic diagram illustrating a playlist operation procedure.

The embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

(1) Personal Computer Configuration

FIG. 1 shows the configuration of a personal computer 1 , which is used as an information display device and music reproduction apparatus that implements a graphical user interface according to an embodiment of the present invention. The personal computer 1 includes a CPU (Central Processing Unit) 2 , which provides overall control. The CPU 2 is connected via a bus 3 to a ROM (Read Only Memory) 4 , a RAM (Random Access Memory) 5 , a hard disk drive 6 , a display 7 , an operation section 8 , and a speaker 9 . In reality, the operation section 8 includes a keyboard and a mouse.

The hard disk drive 6 stores a base program (operating system) and various application programs. When the personal computer 1 starts up, the CPU 2 reads the base program from the hard disk drive 6 and executes the base program in the RAM 5 . Further, under the control of the base program, the CPU 2 reads an appropriate application program from the hard disk drive 6 in accordance with a user operation, which is input from the operation section 8 , executes the read application program in the RAM 5 , and displays the resulting processing results on the display 7 .

(2) List Display Method According to an Embodiment of the Present Invention

(2-1) Music Player Configuration

A music player is cited as an example to describe a list display method according to an embodiment of the present invention. The list display method according to an embodiment of the present invention can be applied to various list display screens such as a display screen for a file management program and file selection screens for various programs. However, the description given below relates to a case where the present invention is applied to a music player, which reproduces musical content (hereinafter referred to as songs), and a list display mode is used for allowing the user to select desired songs and create a playlist. The music player starts running when a music player program, which is an application program for music reproduction and information display, is read from the hard disk drive 6 and executed in the RAM 5 by the CPU 2 .

As shown in FIG. 2 , the music player program causes an operation determine section 11 to receive an input signal S 1 from the user via the mouse or keyboard in the operation section 8 , generate various operation signals S 2 corresponding to the input signal S 1 , and supply the generated operation signals to an operation execution section 12 .

The operation execution section 12 includes a music reproduction management section 12 A, a list management section 12 B, and a search operation management section 12 C. These management sections operate in accordance with the operation signals S 2 . For example, the music reproduction management section 12 A, configured to as a reproduction section, reproduces musical content stored on the hard disk drive 6 in accordance with various music reproduction procedures performed by the user, such as a reproduction procedure, outputs the reproduced content from the speaker 9 , and transmits reproduction-related display information to a display processing section 13 .

The list management section 12 B, configured to as a playlist creation section, performs a playlist creation, deletion, or other process in accordance with various listing operations performed by the user for musical content listing, playlist creation, and the like, and transmits the process-related display information to the display processing section 13 . For example, the list management section 12 B temporarily stores a selected object by user in the RAM 5 , generates display information for displaying the selected object in a three-dimensional display mode, which uses a plurality of layers as described later, and transmits the generated display information to the display processing section 13 . Further, when the user inputs an instruction for deleting a selected object, the list management section 12 B erases the selected object from the RAM 5 and transmits display information for changing the display of the selected object in the three-dimensional display mode. Furthermore, when the user inputs an instruction for creating a playlist, the list management section 12 B creates the playlist in accordance with the selected object stored in the RAM 5 and transmits to the display processing section 13 the display information for displaying the creation of the playlist with a plurality of layers in the three-dimensional display mode.

The search operation management section 12 C searches for musical content stored on the hard disk drive 6 in accordance with a user's musical content search operation, and transmits display information about the result of the search to the display processing section 13 .

In accordance with the display information supplied, for instance, from the music reproduction management section 12 A, list management section 12 B, and search operation management section 12 C, the display processing section 13 determines the contents to be three-dimensionally displayed with a plurality of layers, which will be described later, generates a video signal S 3 for the contents to be displayed, and displays the generated video signal S 3 on the display 7 .

(2-2) Music Player Screen Configuration

FIG. 3 shows the configuration of a main screen 100 that is to be displayed on the display 7 by the music player. A toolbar 101 is displayed at the top of the screen. A list display section 102 is displayed in the lower right-hand area below the toolbar 101 . Further, a playlist display section 103 is displayed to the left of the list display section 102 .

A mouse pointer 100 A, which is moved on-screen by the mouse, is also displayed in the main screen 100 . When the left or right mouse button is single-clicked or double-clicked, the music player executes a function appropriate for the location of the on-screen mouse pointer 100 A (e.g., button, icon, or character string).

A plurality of operating buttons 101 A for entering various operations, for instance, for music reproduction and skipping, are displayed in the toolbar 101 . The displayed operating buttons 101 A vary depending on the operation of the music player.

The list display section 102 contains song text 102 A that is displayed and arranged in a vertical direction to convey information (five pieces of information) about individual songs stored on the hard disk drive 6 . From left to right, the song text 102 A in each line includes a track name (song name) 102 B, time (song length) 102 C, an artist name 102 D, an album name 102 E, and a genre 102 F.

The rightmost edge of the list display section 102 is provided with a scroll bar 102 G. When a scroll pointer 102 H is vertically dragged with the mouse pointer 100 A, the contents of the list display section 102 are vertically scrolled to display hidden song text 102 A.

The music player reproduces a desired song when the user places the mouse pointer 100 A over the song text 102 A for the desired song within the list display section 102 and double-clicks the left mouse button on it (hereinafter referred to as “double-clicking a song”). The music player also reproduces the desired song when the user selects the desired song by single-clicking the left mouse button on its song text 102 A (hereinafter referred to as “left-clicking a song”) and then clicks a reproduction button in the toolbar.

Playlist icons 103 A are displayed in the playlist display section 103 to represent playlists for reproducing a plurality of songs.

The user can select a desired song from a plurality of pieces of song text 102 A, which serve as candidate objects displayed in the list display section 102 , and register the selected song in an existing playlist as a selected object or create a new playlist. The user can also delete registered songs from an existing playlist.

When a reproduction procedure is performed with a desired playlist selected, the music player sequentially reproduces only the songs registered in the playlist. The music player is provided in advance with an “ALL” playlist, which includes all songs as registered songs. The “ALL” playlist enables the user to exercise a playlist function without creating a playlist.

(2-3) The Three-Dimensional Structure of List Display Section

As described above, the list display section 102 permits the user to select desired songs and register them in a playlist.

A list display method in related art displays selected objects by user in a different manner so that the selected objects are visually differentiated from the candidate objects. When the list display section is scrolled, the selected objects are scrolled off the screen together with the candidate objects. Therefore, the selected objects are no longer visible.

On the other hand, the list display method according to an embodiment of the present invention uses the three-dimensional display mode in which the candidate objects and selected objects are displayed in different display layers. Consequently, the candidate objects and selected objects are separately displayed within the same screen so that both objects are constantly visible.

The music player, configured to as a candidate object display section, displays the song text 102 A for the candidate objects in a rear hierarchical layer of a virtual hierarchical display structure of the list display section 102 . The rear hierarchical layer is referred to as the 2D layer. Further, the music player, which also serves as a selected object display section, displays the selected objects, which are selected from the song text 102 A for the candidate objects, in a front hierarchical layer of the virtual hierarchical display structure of the list display section 102 . The front hierarchical layer is referred to as the 3D layer.

As described above, a plurality of hierarchical display layers are set in a superposing manner from the front to rear of the same screen, that is, in the direction of a user's sight line, and the display styles of objects displayed in the hierarchical display layers are changed in compliance with user instructions concerning the individual hierarchical display layers that are set.

The procedure for displaying and selecting the above three-dimensionally displayed objects will now be described with reference to a display example of the main screen 100 and a timing diagram shown in FIG. 7 .

When a desired song is to be selected from a plurality of pieces of song text 102 A displayed in the list display section 102 and registered in a playlist as a registered song, the user uses the mouse pointer 100 A as indicated in FIG. 4 and selects the desired song by single-clicking the right mouse button on its song text 102 A (hereinafter simply referred to as “right-clicking on a song”).

When the “right-clicking on a song” operation is detected ( FIG. 7 , step SP 1 ), the music player erases the selected song text 102 A from the 2D layer as indicated in FIG. 5 ( FIG. 7 , step SP 2 ) and displays a character string having the same contents as the erased song text in the 3D layer, which is positioned in front of the 2D layer in which the song text 102 A is displayed, as selected song text 110 for the selected song ( FIG. 7 , step SP 3 ). Consequently, the selected song text 102 A is moved from the 2D layer to the 3D layer as the selected song text 110 .

In this instance, the music player displays the selected song text 110 so that the displayed selected song text 110 is slightly displaced from its original display position of the song text 102 A, and oscillates the selected song text 110 gently in both vertical and horizontal directions. This causes the user to recognize that the selected song text 110 is floating above the other song text 102 A due to the use of the three-dimensional display mode. The user is also compelled to recognize that the selected song text 110 is waiting for the user's next operation. In the above instance, the selected song text 110 may oscillate at a low speed and at a small amplitude so that the user can recognize that the selected song text 110 is displayed in front of the other song text 102 A.

In the above instance, the music player displays the selected song text 110 and also displays a new playlist creation icon 103 B, which creates a new playlist, and a deletion icon 103 C, which deletes the selected song, in the 2D layer of the playlist display section 103 .

The song selection procedure described above can be repeated any number of times. Each time a new song is selected by right-clicking on it, the associated selected song text 110 is displayed in the 3D layer. In this instance, the display position of the selected song text 110 in the 3D layer can be changed as desired by dragging the selected song text 110 with the mouse pointer 100 A.

(2-4) 3D Layer Display During Scrolling

If there are too many pieces of song text 102 A, which are selectable objects, so that the entire song text 102 A does not fit into the display region of the list display section 102 , the contents displayed in the list display section 102 can be vertically scrolled by dragging the scroll pointer 102 H with the mouse pointer 101 A as described earlier. This makes it possible to display hidden song text 102 A.

When the above scrolling operation is performed, the music player scrolls only the song text 102 A displayed in the 2D layer and does not move the selected song text 110 displayed in the 3D layer, which is positioned in front of the 2D layer.

If, for instance, the scroll pointer 102 H is dragged downward as shown in FIG. 6 , the song text 102 A displayed in the 2D layer scrolls upward; however, the selected song text 110 displayed in the 3D layer remains unaffected by scrolling and stays put. In this manner, the music player uses a 3D display mode to constantly display the selected song text 110 , which represents the selected objects.

(2-5) Selecting, Deselecting, or Deleting Selectable Song Text

The selected song text 110 , which is selected as described above, can be deselected on an individual song basis or entirely deselected.

When the selected song text 110 is to be deselected on an individual song basis, the user uses the mouse pointer 100 A and right-clicks a desired piece of selected song text 110 . When the above “right-clicking a desired piece of selected song text” operation is detected ( FIG. 7 , step SP 4 ), the music player erases the associated selected song text 110 from the 3D layer ( FIG. 7 , step SP 5 ) and redisplays the original song text 102 A for the selected song text 110 in the 2D layer ( FIG. 7 , step SP 6 ). Consequently, the selected song text 110 reverts to the song text 102 A and is moved from the 3D layer to the 2D layer. This song deselection procedure can be repeated any number of times as far as the selected song text 110 is displayed in the 3D layer.

When the selected song text 110 is to be entirely deselected, the user uses the mouse pointer 100 A and left-clicks a cancel area, which is an unoccupied area in the playlist display section 103 where no icon is displayed, or left-clicks unselected song text 102 A.

When the “left-clicking the cancel area” operation or “left-clicking unselected song text” operation is detected ( FIG. 7 , step SP 7 ), the music player erases the entire selected song text 110 from the 3D layer ( FIG. 7 , step SP 8 ) and redisplays the original song text 102 A for the selected song text 110 in the 2D layer ( FIG. 7 , step SP 9 ). When the selected song text 110 is entirely deselected, the music player erases the new playlist creation icon 103 B and deletion icon 103 C from the 2D layer of the playlist display section 103 .

Further, when the deletion icon 103 C is left-clicked while the selected song text 110 is displayed, the original song text 102 A for the selected song text 110 is deleted from the list display section 102 .

When the above “left-clicking the deletion icon” operation is detected ( FIG. 7 , step SP 10 ), the music player erases the entire selected song text 110 from the 3D layer ( FIG. 7 , step SP 11 ) and entirely erases the song text 102 A corresponding to the selected song text 110 from the 2D layer ( FIG. 7 , step SP 12 ).

(2-6) Registering Selected Song Text in a Playlist

The selected song text 110 , which is selected as described above, can be registered in a new playlist as registered songs or added to an existing playlist as registered songs.

First of all, the procedure for registering the selected song text 110 in a new playlist will be described. In this case, while desired selected song text 110 is selected and displayed in the 3D layer, the user uses the mouse pointer 100 A and left-clicks the new playlist creation icon 103 B displayed in the 2D layer of the playlist display section 103 ( FIG. 8 ).

When the “left-clicking the new playlist creation icon” operation is detected ( FIG. 11 , step SP 21 ), the music player erases the entire selected song text 110 from the 3D layer as indicated in FIG. 9 ( FIG. 11 , step SP 22 ) and redisplays the original song text 102 A for the selected song text 110 in the 2D layer ( FIG. 11 , step SP 23 ). Further, the music player erases the new playlist creation icon 103 B and deletion icon 103 C from the 2D layer of the playlist display section 103 , creates a new playlist icon 103 An, displays it in the 2D layer of the playlist display section 103 ( FIG. 11 , step SP 24 ), and performs a process for collectively registering the entire selected song text 110 , which is displayed in the 3D layer, as registered songs for the new playlist icon 103 An.

The procedure for additionally registering selected song text 110 in an existing playlist will now be described. In this case, while desired selected song text 110 is selected and displayed in the 3D layer, the user uses the mouse pointer 100 A, right-clicks a playlist icon 103 A for additional registration to select a 3D mode, and left-clicks the playlist icon 103 A.

When the “right-clicking a playlist icon” operation is detected ( FIG. 11 , step SP 25 ), the music player moves the playlist icon 103 A for additional registration to the 3D layer and displays it as a selected playlist icon 103 S ( FIG. 11 , step SP 26 ) as indicated in FIG. 10 .

When the “left-clicking the selected playlist icon” operation is detected ( FIG. 11 , step SP 27 ), the music player erases the entire selected song text 110 from the 3D layer ( FIG. 11 , step SP 28 ) and redisplays the original song text 102 A for the selected song text 110 in the 2D layer ( FIG. 11 , step SP 29 ). Further, the music player erases the new playlist creation icon 103 B and deletion icon 103 C from the 2D layer of the playlist display section 103 , moves the selected playlist icon 103 S to the 2D layer, redisplays it as an original playlist icon 103 A ( FIG. 11 , step SP 30 ), and registers the entire selected song text 110 displayed in the 3D layer as registered songs for the playlist icon 103 A.

(2-7) Maintaining the 3D Layer Display Status at the Time of a List Display Section Display Change

Further, the contents displayed in the 3D layer of the list display section 102 are maintained without regard to a change in the contents displayed in the 2D layer of the list display section.

When, for instance, the playlist icon 103 B displayed in the 2D layer of the playlist display section 103 is left-clicked, the music player detects the “left-clicking the playlist icon” operation ( FIG. 11 , step SP 31 ), erases the song text 102 A from the list display section 102 , and displays the songs registered for the left-clicked playlist icon 103 B in the 2D layer of the list display section 102 as song text 102 A in the form of a list ( FIG. 11 , step SP 32 ). In this instance, the music player maintains the display status of the selected song text 110 displayed in the 3D layer of the playlist display section 103 .

Consequently, the user can sequentially switch to display the songs registered in a desired playlist in the list display section 102 while maintaining the selected state of the selected song text 110 .

(3) Operations and Advantages

The music player, which is configured as described above, displays the song text 102 A, which represents the user-selectable candidates, in the 2D layer of the list display section 102 .

When particular song text 102 A is selected by the user, the music player moves it from the 2D layer to the 3D layer, which is positioned in front of the 2D layer, and displays it as selected song text 110 .

The 2D layer and 3D layer are set as different display hierarchical layers. Therefore, when a user instruction is input in relation to the 2D layer, only the display style of the 2D layer changes, and the display style of the 3D layer remains unchanged without regard to the user instruction. When, for instance, the song text 102 A displayed in the 2D layer is scrolled, the selected song text 110 displayed in the 3D layer remains unaffected by scrolling and stays put. This enables the user to perform an operation while constantly confirming the song text 110 selected by user.

When the playlist icon 103 A is left-clicked while the selected song text 110 is displayed in the 3D layer as shown in FIG. 9 , the music player displays the song text 102 A for the songs registered for the playlist icon 103 A in the 2D layer of the list display section 102 .

As described above, even when the contents displayed in the 2D layer are changed, the selected song text 110 displayed in the 3D layer remains unaffected by such a change and stays put. This enables the user to perform an operation while constantly confirming the song text 110 selected by user.

As mentioned earlier, the 2D layer and 3D layer are set as different display hierarchical layers. Therefore, when a user instruction is input in relation to the 3D layer, only the display style of the 3D layer changes, and the display style of the 2D layer remains unchanged without regard to the user instruction. When, for instance, the selected song text 110 displayed in the 3D layer is dragged with the mouse pointer 100 A, the music player changes the display position of the selected song text 110 in the 3D layer, but the song text 102 A displayed in the 2D layer remains unaffected by such a change and stays put. This enables the user to freely move the selected song text 110 , which is displayed over the song text 102 A, and perform an operation while confirming the song text 102 A, which is displayed in the lower layer.

When user instructions are input for the 2D and 3D layers, the display styles of the 2D and 3D layers are changed respectively. When, for instance, the selected playlist icon 103 S displayed in the 3D layer is left-clicked as shown in FIG. 10 , the music player erases the selected playlist icon 103 S from the 3D layer and redisplays its original playlist icon 103 A in the 2D layer. Further, the music player additionally registers the entire selected song text 110 displayed in the playlist display section 103 as registered songs for the playlist icon 103 A, and erases the selected song text 110 from the 3D layer. The music player then displays the song text 102 A for the songs registered for the playlist icon 103 A in the 2D layer of the list display section 102 .

The use of the above configuration makes it possible to display the selected song text 110 , which represents selected objects by user, in a layer different from the layer for the song text 102 A, which represents selectable candidate objects, thereby providing increased ease of object selection operation.

(4) Other Embodiments

The embodiment described above uses two different layers: 2D layer for displaying candidate objects and 3D layer for displaying selected objects. However, the present invention is not limited to the use of two different layers. Alternatively, three or more layers may be used for information display purposes. For example, enhanced ease of object selection operation is provided if reselected objects, which are selected from selected objects, are displayed in a new layer or if objects selected from candidate objects are displayed in different user-specified layers.

The embodiment described above assumes that the present invention is applied to a list display screen of the music player, which reproduces musical content. However, the present invention may also be applied to various other list display screens such as a display screen for a file management program and file selection screens for various programs.

The embodiment described above assumes that a mouse is employed as a device for inputting various selection commands and used to perform selection and deselection procedures, for instance, by right-clicking, left-clicking, or double-clicking the mouse. However, the present invention is not limited to the use of the mouse as an input device. Alternatively, various other input devices such as a keyboard, trackball, or touch panel may be used to input the various selection commands.

The embodiment described above assumes that the CPU 2 of the personal computer 1 executes the music player program as an information display program to implement the list display method according to an embodiment of the present invention. However, the present invention is not limited to the use of such a configuration. Alternatively, various other circuit configurations may be used to implement the list display method according to an embodiment of the present invention.

The embodiment described above assumes that the CPU 2 of the personal computer 1 executes the music player program as an information display program to implement the list display method according to an embodiment of the present invention. However, the present invention is not limited to the use of such a configuration. An alternative is to install the information display program on the personal computer 1 via a CD-ROM (Compact Disc Read Only Memory), DVD (Digital Versatile Disc), semiconductor memory, or other storage medium on which the information display program is stored, and implement the above list display method.

It should be understood by those skilled in the art that various modifications, combinations, sub-combinations, and alterations may occur depending on designs and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.