JP7689802B2 - DISPLAY CONTROL PROGRAM, DISPLAY CONTROL METHOD, AND INFORMATION PROCESSING APPARATUS - Google Patents

Description

The present invention relates to a display control program, a display control method, and an information processing device.

For example, there are various codified texts that describe causal relationships, such as the course of events over time and the logical course of events. For example, there are various texts related to myths, legends, folklore, and folklore throughout the country. By reading such codified texts, one can learn about the history and land of each region, and satisfy one's spiritual and intellectual curiosity. Another example of such codified texts is a cooking recipe.

Technologies related to display control are also known (e.g., Patent Documents 1 to 4).

Special Publication No. 2011-521325 JP 2005-100376 A JP 2010-176204 A Japanese Unexamined Patent Publication No. 11-191029

For example, while a codified text can be enjoyed by itself, it can be more enjoyable and more useful when viewed in conjunction with other related texts. For example, when viewing a piece of folklore about a certain person, being able to view other pieces of folklore related to that person can help one to learn more about that person. Or, for example, when viewing a recipe, being able to view other recipes that use the same ingredients or have the same cooking steps can help one to make multiple dishes more efficiently. However, it can be difficult to organize and present the causal relationships, such as the chronological and logical progressions, described in such codified texts.

In one aspect, the present invention aims to present the relationships between sentences describing causal relationships in an easy-to-understand manner.

An information processing device according to one embodiment of the present invention includes an output unit that outputs display information for displaying a node icon associated with a node from a graph in which the node includes information indicating a person, object, event, place, or time, the node includes information describing the node, and the edge includes a codified sentence indicating a logical causal relationship or a temporal causal relationship between the node and the destination node, and a change unit that changes the display information to display the node information associated with the node when the node icon is selected, changes the display information to display the node information associated with the node, changes the display information to display the connection icon associated with the edge connecting the node to the destination node connected to the node icon associated with the node when the node icon is selected, changes the display information to display the sentence included in the edge when the connection icon is selected, and changes the display information to display the node icon and the destination node icon associated with the destination node connected to the edge icon when the sentence associated with the connection icon has been viewed.

The relationships between sentences describing causal relationships can be clearly presented.

FIG. 2 is a diagram illustrating two related sentences according to an embodiment. FIG. 13 illustrates another example of two related sentences according to an embodiment. FIG. 1 is a diagram illustrating a functional block configuration of an information processing device according to an embodiment. 1 is a diagram illustrating the generation of a graph structure from a sentence according to an embodiment. FIG. 13 is a diagram illustrating a graph according to an embodiment. FIG. 10 is a diagram illustrating graph information according to the embodiment. FIG. 10 is a diagram illustrating an example of a graph structure generated from graph information. FIG. 4 is a diagram illustrating node detail information according to the embodiment. FIG. 13 is a diagram illustrating a display of a graph according to the embodiment. FIG. 13 is a diagram illustrating a display of a graph according to the embodiment. FIG. 13 is a diagram illustrating a display of a graph according to the embodiment. FIG. 13 is a diagram illustrating a display of a graph according to the embodiment. FIG. 13 is a diagram illustrating a display of a graph according to the embodiment. FIG. 11 is a diagram illustrating an operation flow of a display process according to the embodiment. FIG. 13 is another diagram illustrating bidirectional connection of edges according to an embodiment. FIG. 11 is another diagram illustrating a display of a graph according to the embodiment. FIG. 11 is another diagram illustrating a display of a graph according to the embodiment. FIG. 11 is another diagram illustrating a display of a graph according to the embodiment. FIG. 11 is another diagram illustrating a display of a graph according to the embodiment. FIG. 11 is a diagram illustrating a further example of display control according to the embodiment. 1A to 1C are diagrams illustrating an example in which graph display control according to an embodiment is applied to a game. 11A to 11C are diagrams illustrating an example of control of graph display in a game according to an embodiment. 11A to 11C are diagrams illustrating an example of control of graph display in a game according to an embodiment. 11A to 11C are diagrams illustrating an example of control of graph display in a game according to an embodiment. 11A to 11C are diagrams illustrating an example of control of graph display in a game according to an embodiment. FIG. 2 is a diagram illustrating an example of a hardware configuration of a computer for implementing the information processing device according to the embodiment.

Several embodiments of the present invention will be described in detail below with reference to the drawings. Note that the same reference numerals are used to designate corresponding elements in multiple drawings.

As mentioned above, there are various codified texts that show causal relationships. For example, various episodes such as myths, legends, folklore, and other stories have been preserved as texts all over the country. These myths, legends, folklore, and other stories can be enjoyed by themselves, but there may also be other related texts.

FIG. 1 is a diagram illustrating two related sentences according to an embodiment. FIG. 1(a) shows a sentence about the episode "Yaohibikuni and the Beast Camellia", and FIG. 1(b) shows a sentence about the episode "Yaohibikuni's Rock". For example, when reading a sentence about "Yaohibikuni and the Beast Camellia", one can also read "Yaohibikuni's Rock", another sentence about the same Yaobikuni, and thereby deepen one's understanding of Yaobikuni.

Furthermore, FIG. 2 is a diagram illustrating two other related sentences according to the embodiment. FIG. 2(a) shows the episode "Yaobikuni and the Bake Tsubaki", and FIG. 2(b) shows the episode of "Bake Tsubaki" that appears in "Yaobikuni and the Bake Tsubaki". In this way, when reading the episode about "Yaobikuni and the Bake Tsubaki", one can also read "Bake Tsubaki", which is an episode about "Bake Tsubaki" that appears in "Yaobikuni and the Bake Tsubaki", and thus deepen understanding of the episode of "Yaobikuni and the Bake Tsubaki".

However, because the relationships between sentences, including causal relationships, are complex, it can be difficult to efficiently organize the relationships between sentences and present them in an easy-to-understand manner.

In the embodiment described below, sentences including causal relationships are treated as edges in a graph structure, and nodes connected by edges are extracted from the sentences. This makes it possible to present the relationships between sentences in an easy-to-understand manner. Note that in the embodiment described below, for example, text showing causal relationships is used as the sentence. For example, sentences that do not include causal relationships, such as simple greetings, may be excluded from the generation of the graph structure in the embodiment. The embodiment will be described in more detail below.

Figure 3 is a diagram illustrating an example of a functional block configuration of an information processing device 300 according to an embodiment. The information processing device 300 includes, for example, a control unit 301, a storage unit 302, and a communication unit 303. The control unit 301 includes, for example, an output unit 311 and a change unit 312, and may also include other functional units. The storage unit 302 of the information processing device 300 may store information such as graph information 600 and node detailed information 800, which will be described later. The communication unit 303 may communicate with other devices, for example, according to instructions from the control unit 301. Details of each of these units and details of the information stored in the storage unit 302 will be described later.

Figure 4 is a diagram illustrating the generation of a graph structure from a sentence according to an embodiment. As shown in Figure 4, in the embodiment, sentences are used as edges in the graph structure, and a source node that is the starting point of the edge and a node to which the edge is connected are extracted from the sentence.

For example, sentences that include causal relationships that describe a temporal or logical progression are generally expressed using the 5W1H. Of the 5W1H, why and how tend to be easily codified (episodicized). In this embodiment, sentences that correspond to why and how are extracted and used as edges when generating a graph. In addition, the remaining 4Ws in the description of the sentence - person (who), thing/event (what), time (when), and place (where) - are used as nodes.

For example, in FIG. 4, the sentence "Yaobikuni and Baketsubaki" is an edge, and three nodes, "Yaobikuni", "Baketsubaki", and "Manganji", are extracted from the sentence. For example, the control unit 301 may analyze the sentence of the episode and extract words corresponding to a person (who), thing/event (what), time (when), and place (where) as nodes. The extraction of the nodes may be performed, for example, using a natural language processing technique, or may be performed using a trained model generated by machine learning. In one example, the control unit 301 may extract nodes from the sentence using a trained model that has been machine-learned to extract words corresponding to a person (who), thing/event (what), time (when), and place (where) from the sentence. Furthermore, in another embodiment, the extraction of nodes from the sentence may be performed using other algorithms, such as extracting words included in a word dictionary prepared in advance as nodes. In Figure 4, three nodes, "Yabikuni," "Baketsubaki," and "Manganji," have been extracted from the sentence "Yabikuni and the Baketsubaki."

When a large number of nodes are extracted from a sentence, the graph structure becomes complex. Therefore, in one embodiment, the control unit 301 may execute a process of thinning out the nodes extracted from the sentences. For example, the control unit 301 may execute a process of extracting nodes for each of a plurality of sentences prepared for generating a graph, and execute a process of thinning out, from among the plurality of extracted nodes, nodes that have been extracted few times as nodes and that satisfy a predetermined condition (for example, a predetermined number or less).

The control unit 301 also determines an original node that is the starting point of the edge from among the extracted nodes. The determination of the original node may also be performed, for example, using natural language processing technology, or may be performed using a trained model generated by machine learning. In one example, the control unit 301 may determine the node that appears frequently in a sentence or is used frequently as a subject as the original node.

The control unit 301 may also determine, among the extracted nodes, other nodes than the node determined as the source node as destination nodes indicating the connection destination of the edge. In the example of FIG. 4, of the three nodes "Yaoibikuni," "Baketsubaki," and "Manganji" extracted from the sentence "Yaoibikuni and Baketsubaki," "Yaoibikuni" is determined as the source node, and the remaining nodes "Baketsubaki" and "Manganji" are determined as destination nodes.

For example, by using sentences as edges in the above manner and extracting multiple nodes from the sentences to determine the source node and destination node, it is possible to generate a graph structure from the sentences as shown in Figure 5.

Figure 5 is a diagram illustrating a graph according to an embodiment. As shown in Figure 5, node 1 is connected to node 2 through node 4 with sentence 1 as an edge. Also, node 1 is connected to node 5 with sentence 2 as an edge. In this way, by extracting nodes from sentences, it is possible to generate a graph structure using sentences as edges.

FIG. 6 is a diagram illustrating graph information 600 according to an embodiment. In the graph information 600, for example, information on nodes and edges of a graph structure is registered in association with each other. In the nodes of the graph information 600, for example, identification information for identifying a source node that is the starting point of an edge corresponding to a sentence is registered. In addition, the edges of the graph information 600 may include, for example, information on the sentence and an analysis result of the sentence. As the analysis result of the sentence, for example, the connection destination nodes extracted from the sentence may be classified and registered as people, places, things, events, and times.

For example, in FIG. 6, the sentence "Yaoibikuni and the monster camellia" and the sentence "Yaoibikuni's rock" are registered as edges in the graph information 600. In addition, in the graph information 600, a connection node is registered for each edge between the sentence "Yaoibikuni and the monster camellia" and the sentence "Yaoibikuni's rock".

Figure 7 shows an example of a graph structure generated for the sentence "Yaoibikuni and the Baketsubaki" and the sentence "Yaoibikuni's Rock" in the graph information 600 of Figure 6. As shown in Figure 7, the node icon 701 for "Yaoibikuni" is connected to the destination node icon 701 by an edge icon 703 via a connection icon 702 indicating the sentence based on the information in the graph information 600. In this way, a graph can be generated based on the information in the graph information 600.

In some embodiments, for example, node detail information 800 that provides more detailed information about the nodes in the graph information 600 may be stored in the storage unit 302.

8 is a diagram illustrating node detail information 800 according to an embodiment. In the node detail information 800, for example, a record that associates a node with node information is registered. For example, identification information that identifies a node corresponding to a record may be registered in a node in the node detail information 800. Detailed information on a node corresponding to a record may be registered in the node information in the node detail information 800. For example, the node information may include information that explains the node. In the example of FIG. 8, since the node identified by "Yaobikuni" is a node indicating a person, detailed information on the person's birth, genealogy, main characteristics, and other items is registered in the body of the node information. Note that the node information may be collected, for example, from the sentence from which the node was extracted, or may be collected from another sentence. Similarly, detailed information on each of the multiple nodes may be registered in the node detail information 800.

Next, the graph display process according to the embodiment will be described. For example, as described above, when generating a graph structure based on sentences, the number of sentences can be enormous, and the graph can also become complicated. Therefore, the embodiment provides a technology that clearly presents the relationship between sentences that describe the causal relationships contained in the graph. Below, an example of the graph display process according to the embodiment will be described.

Figure 9 is a diagram illustrating the display of a graph according to the embodiment. The display screen in Figure 9 (a) shows node icons 701 corresponding to several nodes. For example, the node icons 701 that are first displayed on a display screen such as an initial screen may be carefully selected as predetermined nodes. In one example, the predetermined nodes may be nodes that satisfy a predetermined condition. For example, when a graph structure is generated by collecting multiple sentences from a certain region and the graph is displayed, the predetermined condition may be a predetermined number of nodes that are popular from the perspective of tourism, etc., among the source nodes collected from the sentences. Also, as shown in Figure 9 (a), a connection icon 702 indicating the codified sentence from which the node was extracted as the source node is connected to the node icon 701.

For example, the control unit 301 generates display information for connecting and displaying a node icon 701 of a specific node in a graph generated based on the graph information 600 with a connection icon 702 indicating a codified sentence corresponding to each node of the specific node. Then, for example, when the control unit 301 generates the display information, it may output the display information to a display device. When the display device receives the display information, it may display the specific node icon 701 on the display screen connected to the connection icon 702, as shown in FIG. 9(a).

For example, suppose that the user inputs an operation such as pinching out to get a closer look at the area of a certain node icon 701. In this case, the control unit 301 may change the display information so that the node icon 701 is displayed enlarged, for example, by zooming in on the node icon 701 so that the node icon 701 is easier to see on the display screen, as shown in FIG. 9(b).

Next, for example, assume that the user selects the enlarged node icon 701 by tapping it. In this case, as shown in FIG. 10, the control unit 301 may change the display information so that node information 1002 for the selected node icon 701 is displayed on the display screen of the display device. Then, for example, when the control unit 301 changes the display information, it may output the changed display information to the display device. In the example of FIG. 10, the node information 1002 for the selected node icon 701 is read from the node detail information 800 and displayed on the display screen. This allows the user to obtain knowledge about the node.

Furthermore, when viewing of the node information of the selected node icon 701 is completed, the control unit 301 further changes the display information so that the display format of the node icon 701 indicates that it has been viewed. For example, the control unit 301 may change the display information so as to change the color of the display format of the node icon 701 as shown in FIG. 10. This allows the user to know by looking at the color whether or not the node icon 701 has already been viewed. Note that the control unit 301 may determine that viewing of the node information 1002 is completed when, for example, the node information 1002 is displayed, when the node information 1002 has been displayed for a predetermined period of time or longer, or when the user inputs an indication that viewing of the node information 1002 is completed.

Furthermore, when the user has finished viewing the node information corresponding to the node icon 701, the user may input an operation to the information processing device 300 to delete the node information 1002 corresponding to the node icon 701. When an operation to delete the node information 1002 is input, the control unit 301 may change the display information so as to delete the node information 1002 from the display screen.

Next, for example, assume that the user selects a connection icon 702 connected to the node icon 701, for example by tapping on it. In this case, as shown in FIG. 11, the control unit 301 may change the display information so that text corresponding to the selected connection icon 702 is displayed on the display screen. In the example of FIG. 11, text 1102 corresponding to the selected connection icon 702 is read from the graph information 600 and displayed on the display screen of the display device. This allows the user to read the text 1102 related to the node of the node icon 701, and deepen their knowledge about the node of the node icon 701.

Furthermore, when viewing of the text corresponding to the selected connection icon 702 is completed, the control unit 301 further changes the display information so that the display format of the connection icon 702 indicates that it has been viewed. For example, as shown in FIG. 11, the control unit 301 may change the display information so as to change the color of the display format of the connection icon 702. This allows the user to know by looking at the color whether or not the connection icon 702 is a text for which viewing has already been performed. Note that the control unit 301 may determine that viewing of the text 1102 is completed when, for example, the text 1102 is displayed, the text 1102 is displayed for a predetermined period of time or longer, or the user inputs a completion of viewing of the text 1102.

Furthermore, when the user has finished viewing the text corresponding to the connection icon 702, the user may input an operation to the information processing device 300 to erase the text 1102 corresponding to the connection icon 702. When an operation to erase the text 1102 corresponding to the connection icon 702 is input, the control unit 301 may change the display information so as to erase the text 1102 from the display screen.

Next, suppose that an operation to reduce the display is input to the information processing device 300, such as by pinching in on the node icon 701 that was enlarged and displayed on the display screen of the display device. In this case, the control unit 301 may, for example, reduce the node icon 701 and expand the display area as shown in FIG. 12, and change the display information so that the node icons 701 of more nodes are displayed. In FIG. 12, the pinch-in operation reduces the area on the display screen and multiple node icons 701 are displayed.

The control unit 301 may also change the display information so that, for example, the node icon 701 is displayed connected to the node icon 701 of the destination node via the connection icon 702 by an edge icon 703. For example, in FIG. 12, the node icon 701 of the destination node of the connection icon 702 indicating a sentence selected by the user and completed viewing is displayed, and the connection icon 702 indicating the sentence is connected to the node icon 701 of the destination node by an edge icon 703. Note that the node icon 701 of the destination node may be a node that was displayed on the display screen, but may be displayed when viewing of the sentence corresponding to the connection icon 702 is completed.

Similarly, for example, when the user selects a connection icon 702 indicating another sentence and completes viewing of the connection icon 702 indicating the sentence, the control unit 301 may change the display information so that the connection icon 702 indicating the sentence is connected to the node icon 701 of the destination node via an edge icon 703. For example, in FIG. 13, the connection icon 702 indicating the sentence "Yaobikuni's Rock" is further selected and the display format is changed, and the connection icon 702 indicating the sentence "Yaobikuni's Rock" is connected to the node icon 701 of the destination node via an edge icon 703. Note that in the example of FIG. 13, only the node icon 701 of the destination node of the "Stone Raising Festival" is displayed in the display range, but the connection icon 702 of "Yaobikuni's Rock" may also be connected to the node icons 701 of the destination nodes of "Omiya Sengen Shrine", "Yaobikuni's Rock", and "Owari Fuji" via edge icons 703.

As described above, according to the display process of the embodiment, for example, when a connection icon 702 indicating a sentence is selected and viewing of the content is completed, the node icon 701 related to the sentence of the connection icon 702 can be presented to the user. Therefore, the user can efficiently collect knowledge related to the sentence corresponding to the connection icon 702 according to his/her own interests.

In addition, according to the embodiment, a connection icon 702 indicating a sentence related to the node icon 701 is connected to the node icon 701, so that a user can deepen his/her knowledge about the node of the node icon 701 by viewing the connection icon 702 connected to the node icon 701 and the corresponding sentence.

In addition, in this embodiment, the graph structure is generated using sentence information as edges. Therefore, it is possible to clearly express and present the relationships between sentences that describe causal relationships using the graph structure.

Next, we will show an example of the operation flow of the display process according to the embodiment.

FIG. 14 is a diagram illustrating an example of an operational flow of a display process according to an embodiment. For example, the control unit 301 of the information processing device 300 may start the operational flow of FIG. 14 when an instruction to display a graph structure generated from a connection icon 702 indicating a sentence is input.

In S1401, the control unit 301 outputs display information for displaying a node icon 701 to, for example, a display device connected to the information processing device 300. The display device displays the node icon 701 on a display screen according to, for example, the received display information. For example, the control unit 301 may output display information for displaying a plurality of node icons 701 as shown in FIG. 9(a) based on the graph information 600. Note that, for example, the node icon 701 that is first displayed on a display screen such as an initial screen may be a carefully selected predetermined node.

In S1402, the control unit 301 determines whether an operation to change the display area has been input. For example, if a pinch out operation is input to enlarge a portion of the display area as illustrated in FIG. 9, or a pinch in operation is input to reduce the display and widen the display range as illustrated in FIG. 12, the control unit 301 may determine YES in S1402. If an operation to change the display area has been input in S1402 (YES in S1402), the flow proceeds to S1403.

In S1403, the control unit 301 changes the display information so that the display on the display screen changes in accordance with the input change operation, for example, and the flow proceeds to S1410.

In S1410, the control unit 301 outputs the display information, and the flow returns to S1402. Note that the display device may, for example, update the display on the display screen according to the received display information.

If no operation to change the display area has been input in S1402 (S1402 is NO), the flow proceeds to S1404.

In S1404, the control unit 301 determines whether or not a selection operation of the node icon 701 has been input. For example, as illustrated in FIG. 10, when a selection operation of the node icon 701 is input by the user tapping, the control unit 301 may determine YES in S1404. If a selection operation of the node icon 701 has been input in S1404 (YES in S1404), the flow proceeds to S1405.

In S1405, the control unit 301 changes the state of the selected node icon 701 to "viewed" and changes the display information so that the information of the node icon 701 is displayed on the display screen, and the flow proceeds to S1410. For example, as shown in FIG. 10, the control unit 301 may change the display format of the selected node and change the display information so that the node information 1002 for the selected node icon 701 is displayed. Note that here, when the control unit 301 displays the node information 1002 corresponding to the node icon 701, it executes a process of changing the display format of the node icon 701 as if the node information 1002 has been viewed, but in another embodiment, the user may input whether or not viewing of the displayed node information 1002 is complete.

If no selection operation of the node icon 701 is input in S1404 (S1404 is NO), the flow proceeds to S1406.

In S1406, the control unit 301 determines whether or not a selection operation of the connection icon 702 indicating a sentence has been input. For example, as illustrated in FIG. 10, when a selection operation of the connection icon 702 indicating a sentence is input by the user tapping, the control unit 301 may determine YES in S1406. If a selection operation of the connection icon 702 indicating a sentence has been input in S1406 (YES in S1406), the flow proceeds to S1407.

In S1407, the control unit 301 changes the state of the selected connection icon 702 to "viewed", connects the connection icon 702 to the destination node using the edge icon 703, and changes the display information to display the text corresponding to the connection icon 702, and the flow proceeds to S1410. For example, as shown in FIG. 11, the control unit 301 may change the display format of the selected connection icon 702, connect the connection icon 702 to the destination node using the edge icon 703, and change the display information to display the text 1102 corresponding to the selected connection icon 702. Note that here, when the control unit 301 displays the information on the text corresponding to the connection icon 702, it executes a process of connecting the connection icon 702 to the destination node as if the text has been viewed, but in another embodiment, the user may input whether or not viewing of the displayed text has been completed.

If no selection operation is input for the connection icon 702 indicating the sentence in S1406 (S1406 is NO), the flow proceeds to S1408.

In S1408, the control unit 301 determines whether an operation to erase the display has been input. For example, assume that the user has input an operation to erase the display of the node information 1002 for the node icon 701 in FIG. 10, and the text 1102 corresponding to the connection icon 702 in FIG. 11, etc. In this case, the control unit 301 may determine YES in S1408, and the flow proceeds to S1409.

In S1409, the control unit 301 changes the display information so as to erase the display of the object for which the operation to erase the display has been input, and the flow proceeds to S1410. For example, the control unit 301 may change the display information so as to erase objects such as the node information 1002 for the node icon 701 in FIG. 10 that is to be erased, and the text 1102 corresponding to the connection icon 702 in FIG. 12, from the display screen. Also, if the operation to erase the display has not been input in S1408 (NO in S1408), the flow proceeds to S1410, and the display information may be output with the current settings.

As described above, according to the embodiment, for example, when a connection icon 702 is selected and viewing of the text corresponding to the connection icon 702 is completed, the display information is changed so that the connection icon 702 is displayed connected to a destination node related to the text of the connection icon 702 using an edge icon 703. Therefore, information on the node icon 701 corresponding to the text of the connection icon 702 can be presented to the user. This allows the user to efficiently collect knowledge related to the text corresponding to the connection icon 702 according to his or her own interests.

Furthermore, according to the embodiment, a connection icon 702 indicating a sentence related to the node of the node icon 701 is connected to the node icon 701. Therefore, a user can deepen his/her knowledge about the node of the node icon 701 by viewing the connection icon 702 connected to the node icon 701 and the corresponding sentence.

In addition, in this embodiment, the graph structure is generated using sentence information as edges. Therefore, it is possible to clearly express and present the relationships between sentences that describe causal relationships using the graph structure.

Although the above describes an embodiment, the embodiment is not limited to this. For example, the above-described operation flow is an example, and the embodiment is not limited to this. If possible, the operation flow may be executed by changing the order of the processes, may include additional processes, or may omit some processes.

In the above-described embodiment, examples are given in which the texts are various texts related to myths, legends, and folklore. However, the embodiment is not limited to this. For example, the embodiment may be applied to other codified documents such as cooking recipes, musical pamphlets, and game texts. As a result, for example, in the case of cooking recipes, when viewing a certain recipe, it is possible to view other recipes that use the same ingredients or have the same cooking steps.

In addition, in the above embodiment, an example is described in which the information processing device 300 outputs display information to a connected display device for display, but the embodiment is not limited to this. In another embodiment, the information processing device 300 may operate as a server and accept requests from other client terminals. In this case, the control unit 301 of the information processing device 300 may, for example, generate display information according to a request from the terminal and output the display information to the terminal. The terminal can present information using a graph according to the embodiment by displaying the display device according to the received display information.

In addition, in the above embodiment, text data is used as an example of text, but the embodiment is not limited to this. For example, in another embodiment, the text may include other data, such as image data.

In the above embodiment, it is also possible to connect edges to each other. For example, assume that there are multiple edges that connect a specific node and a specific destination node according to graph theory. If the sentence associated with an edge among the multiple edges is based on the perspective of the node side, the edge is regarded as an edge associated with the node. Also, if the sentence associated with an edge among the multiple edges is based on the perspective of the destination node side, the edge is regarded as a destination edge associated with the destination node. Then, for example, if the degree of agreement between the sentence associated with the edge and the sentence associated with the destination edge is equal to or greater than a predetermined degree of agreement, the control unit 301 presumes that the sentence associated with the edge and the sentence associated with the destination edge are related, and outputs display information in which the connection icon associated with the edge and the destination connection icon associated with the destination edge are connected. This allows related sentences among the sentences associated with the multiple edges according to graph theory to be organized and output.

FIG. 15 is a diagram illustrating the connection between edges according to an embodiment. For example, suppose there is a sentence that corresponds to a connection icon 1511 of an edge that connects a node icon 1501 to a destination node icon 1502. For example, the sentence that corresponds to the connection icon 1511 of this edge may be written from the perspective of the node icon 1501. For example, suppose that a node is Matthew extracted from a sentence that describes the miracles of Jesus Christ from Matthew's perspective.

Also, assume that there is a sentence that corresponds to the connection icon 1512 of the edge that connects this destination node icon 1502 to a certain node icon 1501. For example, the sentence that corresponds to the connection icon 1512 of this edge may be written from the perspective of the destination node icon 1502. For example, assume that the destination node is Luke, extracted from a sentence that describes the miracles of Jesus Christ from Luke's perspective.

These two sentences are written from different perspectives and therefore have different contents, but on the other hand, since they are written about the same miracle, they may contain similar contents. For example, when the control unit 301 evaluates the similarity of the sentences, the similarity may be highly evaluated as being equal to or higher than a predetermined threshold. In this case, the control unit 301 may output display information that connects two connection icons 702 corresponding to two sentences whose similarity is equal to or higher than the predetermined threshold with one edge icon 1503. FIG. 15(b) shows an example of two connection icons 702 connected by one edge icon 1503 in this case.

The control unit 301 assumes that the text of the connection icon 1512, which is connected to the destination node and corresponds to the destination edge that connects the destination node to the node, has been viewed. In this case, the control unit 301 may change the display information so that the node and the destination node are connected in both directions by one edge icon 1503, for example, via the node's connection icon 1511 and the destination node's connection icon 1512. The edge icon 1503 that connects in both directions may be a bidirectional edge, for example.

By combining edges in this way, edge connections can be consolidated and simplified, improving the readability of the display on the screen. In addition, it is possible to organize and output related sentences among those that correspond to multiple edges according to graph theory. Furthermore, because sentences that are codified from different perspectives on a single subject can be related, it becomes possible to learn more about that subject.

Note that such a bidirectional connection between connection icons 702 using edge icons 703 may be executed, for example, when both connection icons 702 have been viewed. For example, the control unit 301 may execute a bidirectional connection using one edge icon 703 when one connection icon 702 has already been viewed and the other connection icon 702 has been viewed. In another embodiment, for example, when one connection icon 702 has been viewed, a connection icon 702 may also be displayed on the other node icon 701 side, and the two connection icons 702 may be connected to each other using one edge icon 703.

As described above, for example, when a second connection icon corresponding to a second edge connecting from a destination node to a node and connected to the destination node has been viewed, the text associated with the connection icon of the node is considered to have been viewed. In this case, in an embodiment, the control unit 301 may change the display information so that the node and the destination node are connected by one edge icon via the connection icon of the node and the second connection icon of the destination node.

In the example of FIG. 15, the node icon 1501 and the connection icon 1511 are directly connected, and the connecting line is omitted. In this way, the connection between the node icon 1501 and the connection icon 1511 may be clearly indicated by any expression.

Furthermore, the above-mentioned display screen transitions are merely examples, and the embodiment is not limited to the above-mentioned display screen transitions. For example, in another embodiment, the display screen transitions may be as shown in the following Figures 16 to 19.

FIG. 16 is a diagram illustrating an example of a display screen that is displayed when a user selects a node. For example, when a user taps the node icon 701 of the "Yaobikuni" node, the control unit 301 may output display information for displaying the display screen of FIG. 16.

16 shows a node icon 701 of the "Yaobikuni" node and a connection icon 702 linked to that node. Also, in FIG. 16, node information 1002 of the node icon 701 of the "Yaobikuni" node is displayed. Note that in the example of FIG. 16, since the node information 1002 has not yet been viewed, the connection icon 702 connected to the node icon 701 does not display a title and is displayed as "?", and may be in a state where it cannot be selected (for example, in an inactive state). Then, for example, when viewing of the node information 1002 is completed by receiving an input from the user indicating that it has been viewed, the control unit 301 may output display information in which the color of the display format of the node icon 701 has been changed to indicate that it has been viewed.

Figure 17 shows a display screen in which the connection icons 702 have been changed to be selectable. For example, in Figure 17, the node icons 701 are displayed in inverted colors, indicating that they have been viewed. The control unit 301 may change and output the display information so that the connection icons 702 can be selected (active state). In the example of Figure 17, the connection icons 702 may be displayed with a title and in a state in which they can be selected (active state). For example, when viewing of the node information 1002 has been completed, the control unit 301 may output display information that allows each connection icon 702 to be individually selected. Then, when a connection icon 702 is selected, the control unit 301 may change the display information so that text related to the connection icon 702 is displayed.

18 is a diagram illustrating a display screen when the connection icon 702 of "Yaobikuni and the Baketsubaki" is selected. For example, the control unit 301 may change the display information to display the text 1102 related to the connection icon 702 selected by the user. Then, for example, when the user inputs an operation indicating that the text 1102 has been viewed, the control unit 301 may output display information in which the display format of the connection icon 702 has been changed to indicate that the text 1102 has been viewed. For example, in FIG. 19, the connection icon 702 of "Yaobikuni and the Baketsubaki" is displayed in inverted color, and it is clear that the connection icon 702 has been viewed. Also, when the connection icon 702 has been viewed, the control unit 301 may change the display information to display a link 1801 of a character string indicating the destination node to which the connection icon 702 is connected (for example, a character string indicating the name of the destination node) together with the edge icon 1802 indicating the destination. This allows the user to easily access the information of the destination node.

As shown in the transitions of display screens in Figures 16 to 19, graphs according to the embodiment can be displayed in a variety of display formats.

Furthermore, the embodiment may perform further display control. FIG. 20 is a diagram illustrating further display control according to the embodiment. For example, the connection icon 702 may be masked until a given edge icon 703 is connected to the node icon 701. For example, in FIG. 20(a), the connection icon 702 of "C" that is connected to the node icon 701 of node Y is masked and not displayed.

For example, in this case, assume that the connection icon 702 of "A" connected to the node icon 701 of node X has been viewed. Then, as shown in FIG. 20(b), the control unit 301 changes the display format of the connection icon 702 of "A" to indicate that it has been viewed, and also displays an edge icon 703 corresponding to the connection icon 702 of "A", changing the display information so that the connection icon 702 of "A" is connected to the destination node Y.

In addition, when the destination node Y is connected to the connection icon 702 of "A" by the edge icon 703, the control unit 301 displays the connection icon 702 of "C" of the destination node Y. In this manner, in the embodiment, when an edge is connected to a destination node, the control unit 301 may display the edge (e.g., the connection icon 702) of the destination node associated with the edge (e.g., the connection icon 702 or the edge icon 703). For example, the control unit 301 may change the display information so that the masked connection icon 702 of the node icon 701 is dynamically displayed when a specific edge icon 703 is connected to the node icon 701. Note that the connection icon 702 of "C" of the node Y may be called the third connection icon, for example, and the edge corresponding to the connection icon 702 of "C" of the node Y may be called the third edge.

The display of the masked connection icons 702 may be controlled, for example, in a one-to-many and many-to-many relationship. For example, when a specific edge icon 703 is connected to a node icon 701, the control unit 301 may cause the node icon 701 to display a plurality of masked connection icons 702 corresponding to the specific edge icon 703. Alternatively, for example, the control unit 301 may cause the masked connection icon 702 of a certain node icon 701 to be displayed when a plurality of specific edge icons 703 are connected. Furthermore, when a certain node icon 701 is connected to a certain edge icon 703, the control unit 301 may cause the node icon 701 to display a plurality of masked connection icons 702 corresponding to the certain edge icons 703.

In addition, in the embodiment, for example, when the corresponding sentence has been viewed, the connection icon 702 does not necessarily have to be connected to another destination node icon 1502. For example, as described above, when multiple sentences are analyzed to extract nodes, the destination node may be thinned out from the nodes because the number of times it has been extracted is small enough to satisfy a predetermined condition. For example, in such a case, the connection icon 702 does not have to be connected to the destination node. FIG. 20(c) illustrates a case in which the connection icon 702 is not connected to the destination node icon 1502 when the sentence corresponding to the connection icon 702 has been viewed. In FIG. 20(c), even if the connection icon 702 of "D" has been viewed, the edge icon 703 to the destination node is not displayed and the connection is not connected to the destination node.

Note that even if the connection icon 702 is not connected to the destination node icon 1502, the connection icon 702 is associated with the own node. Therefore, when the text corresponding to the connection icon 702 has been viewed, the connection icon 702 may be connected to the node icon 701 of the own node by the edge icon 703. FIG. 20(d) illustrates an example of the connection of the connection icon 702 to the node icon 701 of the own node by the edge icon 703 in this case. The connection of the edge icon 703 to the own node can also be used to display another connection icon 702. For example, in FIG. 20(d), when the text of the connection icon 702 has been viewed and an edge icon 703 (optional) from the connection icon 702 of "D" is connected to the node Z, the control unit 301 may display the connection icon 702 of "E" associated with the connection icon 702 of "D". Also, the edge icon 703 to the own node may be omitted. This can prevent the graph display from becoming complicated. In addition, node Z may be called, for example, a second node. In addition, the connection icon 702 and edge icon 703 of "D" of node Z may be called, for example, a second connection icon and a second edge icon. The edge corresponding to the connection icon 702 and edge icon 703 of "D" of node Z and the sentence of that edge may be called, for example, a second edge and a second sentence.

The embodiment can also be applied to games, for example. FIG. 21 is a diagram illustrating a case where the graph display control according to the embodiment is applied to a game. Also, FIGS. 22 to 25 are diagrams illustrating the control of graph display in a game according to the embodiment.

In the graph of FIG. 21, the control unit 301 may display the node icon 701 for "Event: Incident" at the beginning of the game. Then, as shown in FIG. 22, the control unit 301 may display the connection icon 702 for "A" when the node icon 701 for "Event: Incident" is selected.

Next, when the connection icon 702 for "A" is read, the control unit 301 connects the edge icon 703 to the node icon 701 for "Matter: Incident" and displays the connection icon 702 for "B" based on that connection. In this way, the masked connection icon 702 for "B" is displayed by connecting the edge icon 703 from the connection icon 702 for "A" that is associated with the connection icon 702 for "B," thereby controlling the flow of the user's browsing. This makes it possible to provide information in a variety of formats, for example, in a format that is easier for the user to understand.

Here, the connection icon 702 of "B" is displayed by connecting the edge icon 703 of the connection icon 702 of "A" to its own node. In this way, when the text of the connection icon 702 of "A" has been viewed, the edge icon 703 is connected to its own node, making it possible to control the provision of information in a more diverse manner. Note that the display of the edge icon 703 connected to the own node may be omitted. This makes it possible to prevent the graph display from becoming too complicated.

The flow of graph display thereafter is illustrated in Fig. 22 to Fig. 25. The control unit 301 may control the display of the graph in Fig. 21, for example, by performing the control shown in Fig. 22 to Fig. 25. This makes it possible to provide information efficiently in line with the user's interests. Note that in Fig. 21 to Fig. 25, the masked connection icon 702 is shown shaded.

As described above, for example, the display information is changed so that the node icon 701 and the connected node icon 701 are connected by the edge icon 703 indicating an edge via the connection icon 702. In this case, the control unit 301 may further change the display information so that another connection icon 702 corresponding to another edge of the connected node icon 701 associated with the edge is also displayed. Note that, in one example, this connection icon 702 and the other connection icon 702 may be associated in advance in the storage unit 302, and the control unit 301 may change the display information so that the other connection icon 702 is displayed when the edge icon 703 corresponding to the edge is connected from the connection icon 702 associated with the other connection icon 702.

In an embodiment, the graph may also include edges that do not connect a node to other nodes. In this case, the control unit 301 may further change the display information so that when a sentence corresponding to an edge that does not connect a node to other nodes has been viewed, the display format of the connection icon corresponding to the edge indicates that the edge has been viewed, without changing the display information to display the edge icon corresponding to the edge. In another embodiment, the control unit 301 may change the display information so that when a sentence corresponding to an edge that does not connect a node to other nodes has been viewed, the control unit 301 displays the connection icon 702 of the edge to the edge icon 703 that connects the control unit 301 to the own node.

In the above-described embodiment, the graph may be defined by, for example, nodes and edges for connecting the nodes to destination nodes. The nodes may include information indicating, for example, a person (who), an object/event (what), a place (where), or a time (when), and the nodes may be associated with node information including information that describes the node. The edges may include codified sentences indicating a logical causal relationship or a temporal causal relationship between the node and the destination node.

The control unit 301 may output display information for displaying a node icon 701 associated with a node from the graph, for example. When the node icon 701 is selected, the control unit 301 may change the display information to display the node information associated with the node. When the node information has been viewed, the control unit 301 may change the display information to display the connection icon 702 associated with the edge connecting the node to the destination node connected to the node icon 701 associated with the node. When the connection icon 702 is selected, the control unit 301 may change the display information to display the text included in the edge. When the text associated with the connection icon 702 has been viewed, the control unit 301 may change the display information to display the node icon 701 and the destination node icon 701 associated with the destination node connected to the edge icon 703 via the connection icon 702.

In the above embodiment, for example, in the processes of S1401 and S1410, the control unit 301 operates as the output unit 311. Also, for example, in the processes of S1402 to S1409, the control unit 301 operates as the change unit 312.

Fig. 26 is a diagram illustrating an example of the hardware configuration of a computer 2600 for realizing the information processing device 300 according to the embodiment. The hardware configuration for realizing the information processing device 300 of Fig. 26 includes, for example, a processor 2601, a memory 2602, a storage device 2603, a reading device 2604, a communication interface 2606, an input/output interface 2607, and a display device 2611. The processor 2601, the memory 2602, the storage device 2603, the reading device 2604, the communication interface 2606, and the input/output interface 2607 are connected to each other, for example, via a bus 2608.

The processor 2601 may be, for example, a single processor, or a multi-processor or multi-core. The processor 2601 provides some or all of the functions of the control unit 301 described above by using the memory 2602 to execute a program that describes, for example, the steps of the above-mentioned operation flow. For example, the processor 2601 operates as the output unit 311 and the change unit 312 by reading and executing a program stored in the storage device 2603.

The memory 2602 is, for example, a semiconductor memory, and may include a RAM area and a ROM area. The storage device 2603 is, for example, a semiconductor memory such as a hard disk or a flash memory, or an external storage device. Note that RAM is an abbreviation for Random Access Memory. Also, ROM is an abbreviation for Read Only Memory.

The reader 2604 accesses the removable storage medium 2605 according to instructions from the processor 2601. The removable storage medium 2605 is realized by, for example, a semiconductor device, a medium where information is input and output by magnetic action, or a medium where information is input and output by optical action. The semiconductor device is, for example, a Universal Serial Bus (USB) memory. The medium where information is input and output by magnetic action is, for example, a magnetic disk. The medium where information is input and output by optical action is, for example, a CD-ROM, DVD, Blu-ray Disc, etc. (Blu-ray is a registered trademark). CD is an abbreviation for Compact Disc. DVD is an abbreviation for Digital Versatile Disk.

The storage unit 302 includes, for example, a memory 2602, a storage device 2603, and a removable storage medium 2605. For example, the storage device 2603 stores the graph information 600 and the node detail information 800.

The communication interface 2606 communicates with other devices according to instructions from the processor 2601. The communication interface 2606 is, for example, an example of the communication unit 303.

The input/output interface 2607 may be, for example, an interface between an input device and an output device. The input/output interface 2607 is connected to, for example, a display device 2611. The display device 2611 may display a display screen according to the above-mentioned embodiment in accordance with instructions from the processor 2601. The input/output interface 2607 may also be connected to, for example, an input device such as a keyboard, a mouse, or a touch panel that accepts instructions from a user. The output device is, for example, an audio device such as a speaker, a printing device, etc.

Each program according to the embodiment is provided to the information processing device 300 in the following form, for example.
(1) It is pre-installed in the storage device 2603.
(2) Provided by a removable storage medium 2605.
(3) Provided from a server such as a program server.

The hardware configuration of the computer 2600 for realizing the information processing device 300 described with reference to FIG. 26 is an example, and the embodiment is not limited to this. For example, part of the above-mentioned configuration may be deleted, or a new configuration may be added. In another embodiment, for example, part or all of the functions of the above-mentioned control unit 301 may be implemented as hardware using an FPGA, SoC, ASIC, PLD, or the like. Note that FPGA is an abbreviation for Field Programmable Gate Array. SoC is an abbreviation for System-on-a-chip. ASIC is an abbreviation for Application Specific Integrated Circuit. PLD is an abbreviation for Programmable Logic Device.

In the above, several embodiments are described. However, the embodiments are not limited to the above-mentioned embodiments, and should be understood to include various modified and alternative forms of the above-mentioned embodiments. For example, it will be understood that the various embodiments can be embodied by modifying the components without departing from the spirit and scope of the embodiments. It will also be understood that various embodiments can be implemented by appropriately combining multiple components disclosed in the above-mentioned embodiments. Furthermore, it will be understood by those skilled in the art that various embodiments can be implemented by deleting some components from all the components shown in the embodiments, or by adding some components to the components shown in the embodiments.

300: Information processing device 301: Control unit 302: Storage unit 303: Communication unit 311: Output unit 312: Change unit 701: Node icon 702: Connection icon 703: Edge icon 1501: Node icon 1502: Destination node icon 1503: Edge icon 1511: Connection icon 1512: Connection icon 1801: Link 1802: Edge icon 2600: Computer 2601: Processor 2602: Memory 2603: Storage device 2604: Reading device 2605: Removable storage medium 2606: Communication interface 2607: Input/output interface 2608: Bus 2611: Display device

Claims (8)

A graph defined by nodes and edges connecting the nodes to destination nodes,
The node includes information indicating a person, an object, an event, a place, or a time, and the node is associated with node information including information explaining the node;
The edge includes a codified sentence indicating a logical or temporal causal relationship between the node and the connected node.
outputting display information for displaying a node icon associated with the node in the graph;
When the node icon is selected, the display information is changed to display the node information associated with the node;
When the node information has been viewed, the display information is changed so that a connection icon corresponding to an edge connecting the node to the destination node is connected to the node icon corresponding to the node, and displayed;
When the connection icon is selected, the display information is changed so that the text included in the edge is displayed;
when the text corresponding to the connection icon has been viewed, the display information is changed so that the node icon and a destination node icon corresponding to the destination node are connected to each other by an edge icon via the connection icon and displayed.
A display control program that causes an information processing device to execute the process. When the text has been viewed, the display information is changed so that the display format of the connection icon corresponding to the text indicates that the text has been viewed.
The display control program according to claim 1 , further comprising: a display control unit for controlling a display of a display image; When viewing of the node information is completed, the display format of the node icon is changed to indicate that the node information has been viewed.
The display control program according to claim 1 , further comprising: causing the information processing device to execute a process. a second connection icon corresponding to a second edge connecting the destination node to the node, and when the second connection icon connected to the destination node has been viewed, when the text corresponding to the connection icon has been viewed, the display information is changed so that the node and the destination node are connected by one edge icon via the connection icon of the node and the second connection icon of the destination node.
The display control program according to claim 1 , further comprising: causing the information processing device to execute a process. the graph includes a second node and a second edge that does not connect the second node to any other node;
Furthermore, when a second sentence corresponding to the second edge has been viewed, the display information is changed so that a display format of a second connection icon corresponding to the second edge indicates that the second sentence has been viewed, without changing the display information so as to display a second edge icon corresponding to the second edge.
The display control program according to claim 1 , further comprising: causing the information processing device to execute a process. when the display information is changed so that the node icon and the destination node icon are connected by the edge icon via the connection icon, the display information is further changed so that a third connection icon corresponding to a third edge of the destination node icon associated with the edge is also displayed.
The display control program according to claim 1 , further comprising: causing the information processing device to execute a process. A display control method executed by an information processing device, the information processing device comprising:
A graph defined by nodes and edges connecting the nodes to destination nodes,
The node includes information indicating a person, an object, an event, a place, or a time, and the node is associated with node information including information explaining the node;
The edge includes a codified sentence indicating a logical or temporal causal relationship between the node and the connected node.
outputting display information for displaying a node icon associated with the node in the graph;
When the node icon is selected, the display information is changed to display the node information associated with the node;
When the node information has been viewed, the display information is changed so that a connection icon corresponding to an edge connecting the node to the destination node is connected to the node icon corresponding to the node, and displayed;
When the connection icon is selected, the display information is changed so that the text included in the edge is displayed;
when the text corresponding to the connection icon has been viewed, the display information is changed so that the node icon and a destination node icon corresponding to the destination node are connected to each other by an edge icon via the connection icon and displayed.
A display control method comprising: A graph defined by nodes and edges connecting the nodes to destination nodes,
The node includes information indicating a person, an object, an event, a place, or a time, and the node is associated with node information including information explaining the node;
The edge includes a codified sentence indicating a logical or temporal causal relationship between the node and the connected node.
an output unit that outputs display information for displaying a node icon associated with the node in the graph;
When the node icon is selected, the display information is changed to display the node information associated with the node;
When the node information has been viewed, the display information is changed so that a connection icon corresponding to an edge connecting the node to the destination node is connected to the node icon corresponding to the node, and displayed;
When the connection icon is selected, the display information is changed so that the text included in the edge is displayed;
when the text corresponding to the connection icon has been viewed, the display information is changed so that the node icon and a destination node icon corresponding to the destination node are connected to each other by an edge icon via the connection icon and displayed.
A modification unit;
An information processing device comprising:

Images