JP6138709B2 - Life log linkage dialogue system, life log linkage dialogue method and program - Google Patents

Description

  The present invention relates to a life log cooperative dialogue system, a life log cooperative dialogue method, and a program using a life log that records user actions and the like.

  Conventionally, there is a known system that predicts the content of a user's subsequent utterance based on the label (dialogue action) that expresses the meaning and content of the utterance for each utterance of the dialogue recorded in the dialogue between the system and the user. (For example, Patent Document 1). On the other hand, there is also a technique for collecting media information such as photographs, videos, recordings, etc., and sensor data acquired from sensors that are reduced in size and power consumption as life logs (for example, Non-Patent Document 1 and Non-Patent Document 2). . The collected life log is used for, for example, improving service usability and providing various services with predicted behaviors in order to know the user's behavior and provide a better service. On the other hand, automatic response systems using voice have been studied for a long time, and reservation sales such as tickets using telephones and primary support at a support desk (for example, Non-Patent Document 3) and dialogue with home appliances and robots (For example, Non-Patent Document 4) is widely used. Today, in the Internet and the cloud, the disclosure range of information is limited from the world to a specific individual, and the information is not structured at all and the information is in tabular form. is there.

JP 2011-108055 A

Kenji Mase, “Experience Sharing Communication Based on Interaction”, IEICE Technical Report PRMU2005-143 / HIP2005-113, January 2006 Haruma Noma et al., “Development of small wearable devices for measuring individual behavior in sensor networks”, IPSJ Research Report 2007-UBI-15 (6), July 20, 2007 Komagaya Kazunori et al., “Spoken Dialogue System Using Utterance Action Level Information for Interpreting User Utterances”, IPSJ Journal VOL. 52, no. 12, 3374-3385, December 2011 Osamu Sugiyama et al., “Extraction of Speech and Gesture Assignment Patterns for Communication Robots and Proposal of an Advanced Development Method”, IEICE Transactions A. Vol. J95-A No. 1, pp. 46-59, 2012

  Although various sensor data can be easily collected, the usefulness is low if the sensor data is simply a sequence of numerical values. Sensor data can be used as useful data if it is given some meaning. If it is very characteristic data, it may be possible to automatically add a meaning label and use the life log as useful data, but in other cases, manually label it. It is necessary and it takes a lot of labor, so it doesn't progress easily. There is a method of automating labeling by a system, but since 100% accuracy cannot be obtained, incorrect labeling or labeling with insufficient accuracy may be performed.

  An object of the present invention made in view of such a point is to provide a lifelog cooperative dialogue system and lifelog that can correct a contradiction accurately through dialogue with the user even if a conflict between the lifelog and the user's recognition occurs. It is to provide a cooperative dialogue method and program.

  In order to solve the above problems, a lifelog cooperative dialogue system according to the present invention includes a lifelog information management unit, a topic management unit, an utterance generation unit, and a response analysis unit, and the lifelog information management unit includes: Storing life log information about the user, the topic management unit generates an utterance topic from the life log about the user, the utterance generation unit generates an utterance based on the generated utterance topic, and the response The analysis unit performs a dialog including the generated utterance with the user, generates a response topic from the acquired response content, and the topic management unit further compares the utterance topic with the response topic, and compares the comparison If there is a contradiction as a result of the update, the life log may be updated by at least one of correction, addition, or deletion based on the response topic. The features.

  In addition, in order to solve the above-described problem, the lifelog cooperative dialogue method according to the present invention includes a step of storing lifelog information about the user by the lifelog information management unit, and an utterance from the lifelog about the user by the topic management unit. A step of generating a topic, a step of generating an utterance based on the generated utterance topic by an utterance generation unit, and an interaction including the utterance generated by a response analysis unit with the user, and an obtained response A step of generating a response topic from the contents, and a topic management unit further compares the utterance topic with the response topic, and if there is a contradiction as a result of the comparison, the life log is corrected based on the response topic And updating by at least one of addition and deletion To.

  In order to solve the above problems, a program according to the present invention includes a procedure for storing life log information about a user in a computer, a procedure for generating an utterance topic from the life log about the user, and the generated utterance topic. A procedure for generating an utterance based on the above, a procedure for performing an interaction including the generated utterance with the user, generating a response topic from the acquired response content, comparing the utterance topic and the response topic, If there is a contradiction as a result of the comparison, a procedure for performing an update by at least one of correction, addition, or deletion on the life log based on the response topic is executed.

  According to the present invention, even if a contradiction between the life log and the user's recognition occurs, the contradiction can be corrected through the dialogue with the user.

It is a figure which shows schematic structure of the life log cooperation dialogue system which concerns on one Embodiment of this invention. It is a functional block diagram of the life log server in the life log cooperation dialogue system concerning one embodiment of the present invention. It is a functional block diagram of a user terminal in a life log cooperation dialogue system concerning one embodiment of the present invention. It is a figure which shows the operation | movement flow of the life log cooperation dialogue system which concerns on one Embodiment of this invention. It is a figure which shows the operation | movement flow of the life log cooperation dialogue system which concerns on one Embodiment of this invention. It is a figure which shows the operation | movement flow of the life log cooperation dialogue system which concerns on 1st embodiment of this invention. It is a figure which shows the operation | movement flow of the life log cooperation dialogue system which concerns on 2nd embodiment of this invention. It is a figure which shows the operation | movement flow of the life log cooperation dialogue system which concerns on 3rd embodiment of this invention. It is a figure which shows the operation | movement flow of the life log cooperation dialogue system which concerns on 4th embodiment of this invention. It is a figure which shows the operation | movement flow of the life log cooperation dialogue system which concerns on 5th embodiment of this invention. It is a figure which shows the operation | movement flow of the life log cooperation dialogue system which concerns on 6th embodiment of this invention. It is a figure which shows the operation | movement flow of the life log cooperation dialogue system which concerns on 7th embodiment of this invention. It is a figure which shows an example of life log information DB in the life log cooperation dialog system which concerns on one Embodiment of this invention.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[System configuration]
FIG. 1 is a diagram showing a schematic configuration of a life log cooperative dialogue system according to an embodiment of the present invention. It should be noted that the schematic configuration illustrated in FIG. 1 is an example, and each configuration can be arbitrarily combined. In this embodiment, the life log server 1 and the user terminal 2 are connected via the network NW. The number of life log servers and user terminals connected to the network NW is not limited to one each. The terminal may be a stationary terminal as shown in FIG. 1 or a portable terminal that can be carried by a user.

  Hereinafter, the configuration of the life log server 1 and the user terminal 2 will be described more specifically.

  FIG. 2 is a functional block diagram of the life log server 1 in the life log cooperation dialogue system according to the embodiment of the present invention. The life log server 1 includes a control unit 11, a communication control unit 12 that constitutes an interface for performing life log communication with the user terminal 2, an information analysis unit 13, a life log information management unit 14, and a storage unit 15. Is provided. Furthermore, the information analysis unit 13 includes an Internet information analysis unit 13a, a sensor information analysis unit 13b, a personal information analysis unit 13c, and a media information analysis unit 13d. Although each function of the life log server 1 according to the present invention will be described, it should be noted that it is not intended to exclude other functions of the life log server 1.

  The life log server 1 can be configured as a computer. The life log server 1 realizes the functions of a control unit 11, a communication control unit 12 that configures an interface for performing life log communication with the user terminal 2, an information analysis unit 13, and a life log information management unit 14. It can be realized by storing a program describing processing contents in the storage unit 15 of the computer, and reading and executing the program by a central processing unit (CPU) of the computer.

  The control unit 11 controls various operations of the life log server 1. For example, the control unit 11 controls the communication control unit 12 to transmit the life log information stored in the life log information DB 14a.

  The communication control unit 12 configures an interface that performs communication with the user terminal 2. Communication is performed by at least one of wired or wireless.

  The information analysis unit 13 analyzes and / or extracts information. Specific examples are shown below.

  When the Internet information analysis unit 13a acquires (receives) the search condition from the life log information management unit 14, the Internet information analysis unit 13a searches for information such as the SNS write, blog, and homepage of the user of the user terminal 2 using the search condition. Then, the retrieved information is transmitted to the life log information management unit 14. Moreover, the internet information analysis part 13a can also extract content from information, such as SNS writing, a blog, and a homepage, and can transmit the extracted information to the life log information management part 14 as life log information.

  The sensor information analysis unit 13b acquires information on a user's motion sensor (position information sensor (GPS), acceleration sensor, orientation sensor, etc.) of the user terminal 2 and vital sensors such as a pulse, analyzes the contents, Life log information based on date and time, sensor information, tag information (label), and the like is transmitted to the life log information management unit 14. Further, when the sensor information analysis unit 13 b acquires the search condition from the life log information management unit 14, the sensor information analysis unit 13 b searches for information such as a motion sensor and a vital sensor, and transmits the searched information to the life log information management unit 14. You can also.

  When the personal information analysis unit 13c acquires the search condition from the life log information management unit 14, the personal information analysis unit 13c searches the information of the user of the user terminal 2 such as mail and schedule under the search condition, It is transmitted to the log information management unit 14. In addition, the personal information analysis unit 13 c can acquire text information and the like of the user of the user terminal 2 such as mail and schedule, and can transmit the contents to the life log information management unit 14. The personal information analysis unit 13c may be provided in the user terminal 2.

  The media information analysis unit 13d acquires media information such as photos, videos, and audio files of the user of the user terminal 2 and transmits the acquired information to the life log information management unit 14. When the media information analysis unit 13d acquires a search condition from the life log information management unit 14, the media information analysis unit 13d searches for media information such as a photo, a video, and an audio file under the search condition, and manages the searched information as life log information management. To the unit 14. Also, the media information analysis unit 13d changes the media analysis parameter according to an instruction from the life log information management unit 14 when the topic management unit 23 determines that a contradiction has occurred between the result of analyzing the media information and the user's response. .

  The information analysis unit 13 may transmit the information to the life log information management unit 14 every time each information analysis unit such as the Internet information analysis unit 13a acquires the information, or a predetermined amount of information is stored. Each time it is stored in the unit 15, it may be transmitted to the life log information management unit 14 or may be transmitted to the life log information management unit 14 at a predetermined time in one day.

  For example, the life log information management unit 14 transmits search conditions to the Internet information analysis unit 13a, the personal information analysis unit 13c, and the media information analysis unit 13d, and acquires search results by the information analysis units as search contents. The life log information management unit 14 generates tag information based on the search contents and corrects the life log information. The tag information includes a label and contents. For example, the tag information in the case where it is determined from the position information that the user is in the company is “location label: company”. The life log information management unit 14 can also accumulate the search contents acquired from the information analysis unit 13 in the life log information DB 14a by using a method such as morphological analysis. An example of the life log information DB 14a is shown in FIG. Further, when the life log information management unit 14 receives the life log information (correction) and the correction content from the topic management unit 23, the life log information management unit 14 corrects the life log information (accumulation) based on the received content. Further, when the life log information management unit 14 receives the life log information (parameter change) and the change content from the topic management unit 23, the life log information management unit 14 issues a parameter change instruction to the corresponding information analysis unit based on the change content.

  FIG. 3 is a functional block diagram of the user terminal 2 in the life log cooperation dialogue system according to the embodiment of the present invention. The user terminal 2 includes a control unit 21, a communication control unit 22, a topic management unit 23, an utterance generation unit 24, an interface control unit 25 that controls input and output of an interface 25a operated by the user, and a response. An analysis unit 26 and a storage unit 27 are provided. The topic management unit 23 further includes a response topic DB 23a and an utterance topic DB 23b. In this embodiment, the response topic DB 23a and the utterance topic DB 23b are provided in the topic management unit 23, but they may be provided outside the topic management unit 23 and read by the topic management unit 23 as necessary. it can. The place where they are provided is not limited to the inside of the user terminal 2. Although each function of the user terminal 2 according to the present invention will be described, it should be noted that it is not intended to exclude other functions of the user terminal 2.

  The user terminal 2 can be configured as a computer. The user terminal 2 includes a control unit 21, a communication control unit 22, a topic management unit 23, an utterance generation unit 24, an interface control unit 25 that controls input and output of an interface 25a operated by the user, and a response. This is realized by storing a program describing the processing contents for realizing each function of the analysis unit 26 in the storage unit 27 of the computer, and reading and executing the program by a central processing unit (CPU) of the computer. Can do.

  The control unit 21 controls various operations of the user terminal 2. For example, the control unit 21 controls the communication control unit 22 to transmit a life log information correction instruction to the life log server 1.

  The communication control unit 22 configures an interface that performs communication with the life log server 1. Communication is performed by at least one of wired or wireless.

  The topic management unit 23 includes a response topic DB 23a and an utterance topic DB 23b. For example, in the response topic DB 23a and the utterance topic DB 23b, the life log cooperation dialogue system has information equivalent to the response topic or the utterance topic (for example, “behavior label: meal”, “location label: ●●● eaves (ramen store)”. Alternatively, a plurality of information (structured information such as “meal label: ramen”) can be stored. First, the topic management unit 23 transmits a search condition to the life log information management unit 14 in order to generate an utterance topic used for utterance generation. The topic management unit 23 then receives life log information from the life log information management unit 14 and generates an utterance topic based on the life log information. The topic management unit 23 transmits the generated utterance topic to the utterance generation unit 24. When the topic management unit 23 receives the response topic from the response analysis unit 26, the topic management unit 23 compares the response topic with the utterance topic and determines whether or not a contradiction has occurred. As a specific comparison method, it is determined whether there is something with the same label but different contents, and if there is a different one, a contradiction occurs, or a label that is not in the utterance topic is included in the response topic There is a technique to make contradiction occur.

  In the case of “occurrence of contradiction”, the topic management unit 23 can take at least one of the following three measures. The first is (A) rewriting the value of the tag information in which the problem has occurred. In this case, the topic management unit 23 transmits life log information (correction) and the details of the correction to the life log information management unit 14. Secondly, (B) the value of the tag information is exchanged by performing the analysis again using an analysis method that is not normally used due to the reason that there are too many processing targets. In this case, the topic management unit 23 transmits life log information (search) and the search contents to the life log information management unit 14. The third is (C) to change the analysis parameter for the information analysis unit that has performed the analysis causing the problem. In this case, the topic management unit 23 transmits life log information (parameter change) and the contents of the change to the life log information management unit 14.

  The utterance generation unit 24 acquires an utterance topic from the topic management unit 23 and generates an utterance based on the acquired utterance topic. For speech generation, a conventional method such as a method using a virtual agent with a smartphone or the like, or a method using a robot or the like is used. The utterance generation unit 24 transmits the generated utterance to the interface control unit 25.

  The interface control unit 25 presents the utterance content generated by the utterance generation unit 24 to the user by voice, image / video, or the like via the interface 25a. If there is a display device, an image or video related to the utterance topic may be displayed. Examples of the image related to the utterance topic include “ramen image” in a case where “ramen” is included in the utterance topic. Further, when there is a display device, a virtual agent may be displayed on the display device to perform an operation (animation) that looks like a smile. In addition, if there is a device such as a robot, it can be operated to look like laughing while tilting the head in accordance with the utterance “Did you like it?”. Further, the interface control unit 25 converts the response voice of the user into a response content using a conventional method such as voice recognition and transmits the response content to the response analysis unit 26.

  The response analysis unit 26 acquires the response content from the interface control unit 25, analyzes the content using a technique such as morphological analysis, and converts the response content into a response topic in the same format as the utterance topic. The format includes the label and its contents.

  The number of functional blocks described above is not limited, and a plurality of functional blocks may be provided to divide the processing. Some of the functional blocks may be integrated. Furthermore, for example, the user terminal 2 is provided with at least a part of the functions of the life log server 1 such that the information analysis unit 13 and the life log information management unit 14 are provided in the user terminal 2 instead of the life log server 1. It can also be made. The reverse is also true.

[System operation]
4 and 5 are diagrams showing an operation flow of the life log cooperative dialogue system according to the embodiment of the present invention.

  FIG. 4 is a diagram illustrating a flow in which the life log information management unit 14 of the life log server 1 accumulates the information acquired by the information analysis unit 13 in the life log information DB 14a.

  Referring to FIG. 4, the information analysis unit 13 of the life log server 1 acquires information from a motion sensor, a vital sensor, or the like used by the user (step S31). Next, the information analysis unit 13 analyzes the acquired information and extracts information such as date information, sensor information, and tag information (label). (Step S32). A specific example is shown in FIG. The analysis and extraction may be performed by the life log information management unit 14 instead of the information analysis unit 13. Then, the information analysis unit 13 transmits the extracted information to the life log information management unit 14. As described above, the information analysis unit 13 may transmit a predetermined amount of information to the life log information management unit 14 every time the information analysis unit 13 accumulates information, or at a predetermined time of the day. You may transmit to the life log information management part 14. FIG. The life log information management unit 14 accumulates the acquired information as life log information in the life log information DB 14a (step S33).

  In FIG. 5, the user terminal 2 generates an utterance topic based on the life log information, and compares the utterance topic with a response topic obtained as a result of the dialogue with the user to determine whether or not a contradiction has occurred. It is a figure which shows a flow.

  Referring to FIG. 5, the topic management unit 23 of the user terminal 2 transmits a search condition to the life log information management unit 14 of the life log server 1 in order to generate an utterance topic used for utterance generation. (Step S40). The search condition may be a search condition determined in advance by the user, may be randomly selected from a search condition candidate list determined in advance by the user, or some statistical processing is performed using the user's search history so far. Or may be determined according to the response topic generated from the already made dialogue. The life log information management unit 14 of the life log server 1 selects life log information according to the search condition acquired in step S40, and transmits it to the user terminal 2 (step S41). The process of step S40 and step S41 is called a life log information acquisition process.

  The topic management unit 23 of the user terminal 2 transmits the acquired life log information as an utterance topic to the utterance generation unit 24 (step S42). The utterance topic is stored in the utterance topic DB 23b. The interface control unit 25 interacts with the user via the interface 25a and acquires response contents. When the response content is transmitted to the response analysis unit 26, the response analysis unit 26 analyzes the response content by a technique such as morphological analysis and converts it into a response topic (step S43). The response topic is transmitted to the topic management unit 23. The topic management unit 23 acquires a response topic from the response analysis unit 26, and then compares it with the utterance topic (step S44). The response topic may be stored in the response topic DB 23a. As a comparison method, it is determined whether there is something with the same label but different contents, and if there is something different, a contradiction occurs, or a label that is not in the utterance topic is included in the response topic In some cases, there is a method of inconsistency.

  When it is determined that a contradiction has occurred (Yes in step S45), the user terminal 2 transmits to the life log server 1 a command for instructing correction of life log information based on the response topic (step S46). The life log server 1 that has acquired the command corrects the contradictory portion and updates the life log information DB 14a. There are three countermeasures when it is determined that a contradiction has occurred, but here, as an example, a case where life log information is corrected is shown. Specific examples of other measures will be described in detail with reference to FIGS. In addition, those measures may be used independently and may be combined. Further, which countermeasure is applied may be determined in advance for each type of tag information, or may be preferentially selected as a countermeasure that is estimated to have a good user impression by analyzing a response topic from the user. Good. If it is not determined that a contradiction has occurred, the process returns to the initial process in order to continue the dialog with the user (No in step S45). The processing from step S42 to step S45 is called dialogue / comparison processing.

  In the present embodiment, since life log information is corrected through dialogue with the user, the life log information and the user's recognition contradiction are not burdened to the user as compared with the case where the user is inquired by a method such as e-mail. It can be corrected. Moreover, since it is highly likely that the fact that the user is speaking is related to high interest, it can be considered that the priority of correction is automatically determined.

  FIG. 6 is a diagram showing an operation flow of the lifelog cooperative dialogue system according to the first embodiment of the present invention.

  Referring to FIG. 6, the topic management unit 23 of the user terminal 2 transmits a search condition “action label: meal” to the life log information management unit 14 (step S50). The life log information management unit 14 selects life log information with “behavior label: meal” from the life log information DB 14a and transmits it to the topic management unit 23 (step S51). For example, it is assumed that “place label: ●●● eaves (ramen store)” and “meal label: ramen” are further added to the life log information. The topic management unit 23 transmits “behavior label: meal”, “place label: ●●● eaves (ramen store)” and “meal label: ramen” to the utterance generation unit 24 as utterance topics (step S52). . The utterance generation unit 24 generates utterance contents based on the utterance topic. For example, the utterance content “Is ramen delicious?” Is generated (step S53). As a result of the utterance, if a response “I ate Tianjin rice” is made, the response content is transmitted to the response analysis unit 26 (step S54). The response analysis unit 26 obtains “behavior label: meal” and “meal label: Tianjin rice” by a technique such as morphological analysis, and transmits them to the topic management unit 23 (step S55). The topic management unit 23 compares the utterance topic and the response topic, and determines whether there are items having the same label but different contents. In this example, since the “meal label” is different between “ramen” and “Tianjin rice”, the topic management unit 23 determines that a contradiction has occurred (step S56).

  One countermeasure when it is determined that a contradiction has occurred will be described. The topic management unit 23 rewrites the tag information of the meal label (step S57), and utters the utterance topics “behavior label: meal”, “location label: ●●● eaves (ramen store)” and “meal label: ramen” as the utterance generation unit. 24 (step S58). Based on this, the utterance generation unit 24 generates the utterance “Tianjin rice was delicious?” And utters (inquires) for confirmation via the interface 25a (step S59). When the interface 25a obtains a response “yes” from the user, the response content is transmitted to the response analysis unit 26 (step S60), and a response topic indicating that the user has agreed is transmitted to the topic management unit 23 ( Step S61). In this case, the topic management unit 23 transmits a meal label correction instruction for life log information to the life log information management unit 14 (step S62). On the other hand, when the response content is a response that “Tianjin rice is not eaten”, it is considered that the user's misunderstanding, the voice recognition error of the interface 25a, or the analysis error of the response analysis unit 26, the life log information Will not be corrected. In this case, for example, an utterance such as “I'm sorry, I made a mistake” was made. When the user does not confirm, when the user does not correct the utterance (confirmation), or when a reply to the utterance (for example, “That's right, it's okay.”) The topic management unit 23 instructs the life log information management unit 14 to correct “meal label: ramen” in the life log information to “meal label: Tianjin rice”.

  In this embodiment, since an inquiry is made only when a contradiction occurs between the utterance topic and the response topic, it is possible to prevent the burden on the user from becoming heavy due to an excessive inquiry.

  FIG. 7 is a diagram showing an operation flow of the life log cooperative dialogue system according to the second embodiment of the present invention.

  Referring to FIG. 7, as in the case of FIG. 6, the life log information management unit 14 and the topic management unit 23 perform a life log information acquisition process (step S70 and step S71). Based on the life log information acquired in this process, the topic management unit 23 sends an utterance topic (“action label: meal”, “place label: ●●● eaves (ramen store)” and “meal” to the utterance generation unit 24. Label: Ramen ") is transmitted (step S72). The utterance generation unit 24 generates an utterance “Did you enjoy lunch?” And utters it to the user via the interface 25a (step S73). When the response “I don't eat” is acquired for the utterance (step S74), the response analysis unit 26 sends a response topic (“action label: (unknown)” and “location label: ●” to the topic management unit 23. ●● eaves (ramen store) ”) (step S75). The topic management unit 23 determines that a contradiction has occurred (step S76), and instructs the life log information management unit 14 to “behavior label: (unknown), previous value: meal” and “location label: ●●● eaves ( (Ramen shop), a correction to “accuracy: low” and deletion of “meal label: ramen” are instructed (step S77). Causes of inconsistency include errors due to manual input of life log information, life log information from the sensor information analysis unit 13b ("location label: ●●● eaves (ramen store)"), and from the Internet information analysis unit 13a. The life log information management unit 14 automatically selects “meal label: ramen” for “location label: ●●● eaves (ramen store)” based on the life log information (write to SNS that “Ramen was delicious”) ”Can be considered a mistake. Since the accuracy of each information analysis unit is not 100%, these mistakes can occur.

  FIG. 8 is a diagram showing an operation flow of the life log cooperative dialogue system according to the third embodiment of the present invention.

  Referring to FIG. 8, as in the case of FIG. 6, the life log information management unit 14 and the topic management unit 23 perform a life log information acquisition process (steps S80 and S81). Based on the life log information acquired in this process, the topic management unit 23 sends an utterance topic (“action label: meal”, “place label: ●●● eaves (ramen store)” and “meal” to the utterance generation unit 24. Label: Ramen ") is transmitted (step S82). The utterance generation unit 24 generates an utterance “Did you enjoy lunch?” And utters to the user via the interface 25a (step S83). When acquiring a response “not eating because of illness” to the utterance (step S84), the response analysis unit 26 sends a response topic (“action label: (unknown)”, “location label” to the topic management unit 23. : ●●● eaves (ramen store) ”and“ physical condition label: bad ”) (step S85). The topic management unit 23 determines that a contradiction has occurred (step S86), and notifies the life log information management unit 14 of “behavior label: (unknown), previous value: meal” and “location label: ●●● eaves (ramen). It is instructed to correct the “store: accuracy: low”, delete “meal label: ramen”, and add “physical condition label: bad” (step S87).

  FIG. 9 is a diagram showing an operation flow of the life log cooperative dialogue system according to the fourth embodiment of the present invention.

  Referring to FIG. 9, as in the case of FIG. 6, the life log information management unit 14 and the topic management unit 23 perform a life log information acquisition process (step S90 and step S91). Based on the life log information acquired in this processing, the topic management unit 23 transmits the utterance topic (“the person who was with: Denka Hanako, Denden Taro”) to the utterance generation unit 24 (step S92). The unit 24 generates an utterance “Did you know, Mr. Hanako Denden, Mr. Taro Denden, how are you?” And utters to the user via the interface 25a (step S93). When the response “Tayo” is acquired (step S94), the response analysis unit 26 transmits a response topic (“person who was with: Taro Denden”) to the topic management unit 23 (step S95). 23 determines that a contradiction has occurred (step S96), and transmits the search condition “Denka Hanako” to the life log information management unit 14 (step S96). S97) The life log information management unit 14 searches for an email that is one of personal information through the personal information analysis unit 13c, and as a result, finds an email from Hanako Denden saying “I will be resting with a cold”. Therefore (step S98), the life log information management unit 14 transmits the search result “physical condition: cold” to the topic management unit 23 (step S99), and the topic management unit 23 confirms the authenticity of the utterance generation unit 24. (Step S100) The utterance generation unit 24 utters the utterance “It is better to get rid of the cold sooner” (Step S101) When receiving a response “Yes” from the user to the utterance (Step S100) In step S102, the response analysis unit 26 transmits a response topic (“People who were together: Taro Denden)” to the topic management unit 23 (step S10). Since the topic management unit 23 confirmed that Mr. Hanako Denden was absent, the life log information management unit 14 corrected the life log information ("People who were with: Denden Taro, previous price : Denka Hanako, Denden Taro ") (step S104).

  In this embodiment, in order to perform a search or a re-search using only a necessary portion as a search condition based on a dialogue with the user, all information including personal information is searched and processed from a plurality of search conditions. Compared to the case, the processing amount of the lifelog cooperation dialogue system itself can be reduced.

  FIG. 10 is a diagram showing an operation flow of the life log cooperative dialogue system according to the fifth embodiment of the present invention.

  Referring to FIG. 10, as in FIG. 6, the life log information management unit 14 and the topic management unit 23 perform a life log information acquisition process (step S110 and step S111). Based on the life log information acquired in this process, the topic management unit 23 sends an utterance topic (“date / time label: 2013/12/25 11:00” and “location information label: Midoricho X, Musashino City” to the utterance generation unit 24. -X-XX ") is transmitted (step S112). It is assumed that the utterance generation unit 24 utters without touching the person who was together (step S113) because it is “the person who was together: (none)”. When a response saying “I was happy to be friends” is acquired from the user (step S114), the response analysis unit 26 responds to the topic management unit 23 with a response topic (“People who were with: (unknown)”. The topic management unit 23 determines that a contradiction has occurred (step S116), and transmits a search request to the life log information management unit 14 (step S117). As a result of searching through the Internet information analysis unit 13a, the date and time is close to 2013/12/25 11:00, and the location is Musashino, among the writings of friends included in the friend list in the SNS account of the user who is interacting I found a writing (Denka Hanako: “It was delicious”, Denden Taro: “It was fun”) that was XX This is transmitted to the pick management unit 23 (steps S118 and S119) In response to the result, the topic management unit 23 generates an utterance topic (“the person who was with: Denka Hanako, Denden Taro”), and the utterance generation unit (Step S120) The utterance generation unit 24 generates the utterance “Denden Hanako-san and Denden-Taro-san?” Via the interface 25a (step S121), and “Yes” as a response to the utterance. Is obtained from the user (step S122), the response analysis unit 26 generates a response topic ("person who was with: Denka Hanako, Denden Taro") and transmits it to the topic management unit 23 (step S123). In response to this, the topic management unit 23 instructs the life log information management unit 14 to correct the life log information (" Bell: Denden Hanako, Denden Taro, previous value: (none) ”) (step S124).

  FIG. 11 is a diagram showing an operation flow of the lifelog cooperative dialogue system according to the sixth embodiment of the present invention.

  Referring to FIG. 11, as in the case of FIG. 6, the life log information management unit 14 and the topic management unit 23 perform a life log information acquisition process and acquire a user response (not shown). When the response analysis unit 26 detects “stuffed toy” from the response content of the user, the response analysis unit 26 generates a response topic (“target label: stuffed toy”) and transmits it to the topic management unit 23 (step S130). The topic management unit 23 requests the life log information management unit 14 to search for the latest media information of the user by “stuffed toy” (step S131). The topic management unit 23 that has acquired the information “stuffed (frog)” as a result of the search through the media information analysis unit 13d from the life log information management unit 14 (step S132 and step S133), the utterance topic “target label: stuffed toy (Frog) "is generated and transmitted to the utterance generation unit 24 (step S134). After the utterance generation unit 24 utters “It is a cute frog” via the interface 25a (step S135), a response “No frog, duck” is acquired from the user (step S136). In this case, the response analysis unit 26 generates a response topic (“target label: stuffed toy (duck)”) and transmits it to the topic management unit 23 (step S137). The topic management unit 23 determines that a contradiction has occurred (step S138), and corrects the life log information to the life log information management unit 14 as “target label: stuffed toy (duck), previous value: stuffed toy (frog)”. Is instructed (step S139). In this case, since the media analysis parameter is assumed to be incorrect, the life log information management unit 14 causes the media information analysis unit 13d to correct the media analysis parameter (step S140). As a result, what was previously recognized as a “frog” will be recognized as a “duck” in the future.

  In this embodiment, since the media analysis parameter causing the contradiction is corrected, it is possible to expect an improvement in analysis accuracy thereafter.

  FIG. 12 is a diagram showing an operation flow of the lifelog cooperative dialogue system according to the seventh embodiment of the present invention.

  Referring to FIG. 12, as in FIG. 6, the life log information management unit 14 and the topic management unit 23 perform a life log information acquisition process (step S150 and step S151). Based on the life log information acquired in this process, the topic management unit 23 transmits the utterance topic (“address label: Hikarino Yokosuka XX”) to the utterance generation unit 24 (step S152). The utterance generation unit 24 utters while touching the address (step S153). As a result, it is assumed that the response analysis unit 26 acquires a response to which “position information: Midorimachi XX-XX, Musashino City” is added from the user (step S154). When the response analysis unit 26 transmits the response topic (“address label: Midorimachi XX-XX, Musashino City”) to the topic management unit 23 (step S155), the topic management unit 23 determines that a contradiction has occurred (step S155). S156). The topic management unit 23 transmits the utterance topic (confirmation) to the utterance generation unit 24 in order to confirm the authenticity (step S157). The utterance generation unit 24 utters content for confirming whether or not Musashino City Midorimachi XX-XX is a correct address (step S158). When a response indicating that the address is a correct address (true value) is acquired from the user with respect to the utterance (step S159), the response analysis unit 26 transmits a response topic to that effect to the topic management unit 23 (step S159). S160). The topic management unit 23 that has determined that the value is true presents (notifies) a voice, text, or the like that “the position information sensor seems to be in error” to the user via the interface 25a (from step S161 to step S161). S163), correction of life log information to the life log information management unit 14 (“address label: Midorimachi XX-X, Musashino City, previous value: Hikarino Yokosuka XX, additional notes: poor accuracy of location information acquisition” ") Is instructed (step S164). In addition, when it is difficult to determine the failure of the position information sensor from a single information, other information provided by the information analysis unit that provided the life log information that is the basis of the utterance topic, or a different information analysis unit The information provided by may be determined in combination.

  When the life log server 1 and the user terminal 2 according to the present invention are configured by a computer, a program describing processing contents for realizing each function is stored in an internal or external storage unit of the computer, This can be realized by reading and executing this program by a central processing unit (CPU) of the computer. In addition, such a program can be distributed by selling, transferring, or lending a portable recording medium such as a DVD or a CD-ROM, and such a program is stored in a storage unit of a server on a network, for example. And the program can be distributed by transferring the program from the server to another computer via the network. In addition, a computer that executes such a program can temporarily store, for example, a program recorded on a portable recording medium or a program transferred from a server in its own storage unit. As another embodiment of the program, the computer may directly read the program from a portable recording medium and execute processing according to the program, and each time the program is transferred from the server to the computer. In addition, the processing according to the received program may be executed sequentially. Therefore, the present invention is not limited to the above-described embodiments, and various modifications can be made by combining or partially deleting the same without departing from the spirit of the present invention.

DESCRIPTION OF SYMBOLS 1 Life log server 2 User terminal 11 Control part 12 Communication control part 13 Information analysis part 13a Internet information analysis part 13b Sensor information analysis part 13c Personal information analysis part 13d Media information analysis part 14 Life log information management part 14a Life log information DB
15 Storage Unit 21 Control Unit 22 Communication Control Unit 23 Topic Management Unit 23a Response Topic DB
23b Utterance topic DB
24 utterance generation unit 25 interface control unit 25a interface 26 response analysis unit 27 storage unit

Claims (8)

In a life log cooperative dialogue system having a life log information management unit, a topic management unit, an utterance generation unit, and a response analysis unit,
The life log information management unit stores life log information about a user,
The topic management unit generates an utterance topic from a life log related to the user,
The utterance generation unit generates an utterance based on the generated utterance topic,
The response analysis unit performs a dialog including the generated utterance with the user, generates a response topic from the acquired response content,
The topic management unit further compares the utterance topic with the response topic, and if there is a contradiction as a result of the comparison, the topic log is modified, added, or deleted based on the response topic. Lifelog linkage dialogue system characterized by updating. In the life log cooperation dialogue system according to claim 1,
The topic management unit adds the information to the life log when the response topic includes information that is inconsistent as a result of the comparison and is not included in the utterance topic. In the life log cooperation dialogue system according to claim 1 or 2,
When there is a contradiction as a result of the comparison, the topic management unit changes the utterance topic based on the response topic, and further, there is a contradiction as a result of the dialogue with the user performed based on the utterance topic after the change. A life log cooperation dialog system, wherein the life log is updated when it is confirmed. In the life log cooperation dialogue system according to claim 3,
The utterance topic after the change was acquired as a result of a search performed on the life log through at least one of a personal information analysis unit, an Internet information analysis unit, or a media information analysis unit after acquiring the response topic. A life log cooperative dialogue system characterized by being determined based on information. In the life log cooperation dialogue system according to claim 1,
The topic management unit, when there is a contradiction as a result of the comparison, corrects an information analysis parameter of an information analysis unit that acquires and analyzes the life log from the user. In the life log cooperation dialogue system according to claim 1,
The topic management unit further notifies the user that there is an error in the information added to the user's answer when there is a contradiction as a result of the comparison. . In the life log linkage dialogue method by the life log information management unit, the topic management unit, the utterance generation unit, and the response analysis unit,
Storing life log information about the user by the life log information management unit;
Generating an utterance topic from the life log related to the user by the topic management unit;
Generating an utterance based on the utterance topic generated by the utterance generation unit;
Performing a dialogue with the user including the generated utterance by the response analysis unit, and generating a response topic from the acquired response content;
The topic management unit further compares the utterance topic with the response topic, and if there is a contradiction as a result of the comparison, the life log is modified, added, or deleted based on the response topic A step of updating,
A life log cooperative dialogue method characterized by comprising: On the computer,
A procedure for storing life log information about the user;
Generating an utterance topic from the lifelog for the user;
Generating an utterance based on the generated utterance topic;
A step of performing a dialogue with the user including the generated utterance and generating a response topic from the acquired response content;
A step of comparing the utterance topic with the response topic, and if there is a contradiction as a result of the comparison, updating the life log based on the response topic by at least one of correction, addition, or deletion;
A program for running

Images