JP6848276B2 - Information sharing device, information sharing method, program and information sharing system - Google Patents

Description

The present invention relates to an information sharing device, an information sharing method, a program, and an information sharing system suitable for, for example, a support robot that watches over an elderly person living in a remote place.

Conventionally, with regard to watching over guardians such as the elderly and the sick, technology for reliably delivering information related to safety confirmation and life support from a remote location to the watched person and quickly detecting the reaction of the watched person. Has been proposed. (For example, Patent Document 1)

Japanese Unexamined Patent Publication No. 2015-069485

In the system that confirms the safety of the watched person from the usage status of the electric kettle and city gas, etc., which is widely used at present, including the technology described in the above patent document, the thing itself is "watching over" the watched person. It is clear that the purpose is, and for the guardian himself, there are not a few people who get discomfort due to the constant monitoring of their behavior, so resistance to the widespread use of those services. It has become.

The present invention has been made in view of the above circumstances, and an object of the present invention is an information sharing device that can be used more easily and naturally in daily life by a person being watched over. And to provide an information sharing system.

One aspect of the present invention, there is provided an information sharing apparatus, an acquisition unit for acquiring schedule information of different predetermined subject from the user of the information sharing apparatus, based on the acquired said schedule information by the acquiring means, said information entering a question preparing means creates information interrogation for the user of the sharing device, and output means for outputting said question information created by the interrogation creating means, a response of the user with respect to the question information output by the output means It is provided with an input means, a determination means for determining whether or not the response of the user input by the input means is appropriate for the question information, and a notification means for notifying the determination result by the determination means. It is a feature.

According to the present invention, a person who is watched over can use it more easily and naturally in daily life.

The figure which shows the structure of the whole system which concerns on one Embodiment of this invention. The block diagram which shows the functional structure of the electronic circuit inside the communication robot which concerns on this embodiment. The figure which illustrates the content of the schedule information registered in the server apparatus which concerns on the same embodiment. The flowchart which shows the processing content of the conversation operation executed by the communication robot which concerns on the same embodiment. The figure which illustrates the creation of the question voice and the response thereof which concerns on the same embodiment.

Hereinafter, an embodiment in the case where the present invention is applied to a system for sharing information between an elderly household and a child household thereof will be described in detail with reference to the drawings.

FIG. 1 shows the configuration of the entire system. In the figure, the elderly household HM1 and the child household HM2 are connected by a network NW including the Internet. Further, although not shown, by constructing an Internet connection environment including a wireless LAN router in both households HM1 and HM2, for example, according to the IEEE802.11a / 11b / 11g / 11n standard in both households HM1 and HM2. Wi-Fi (registered trademark) equipment can be connected.

In the elderly household HM1, in addition to the grandfather PS11 and grandmother PS12 who are to be watched over, there is a communication robot 10 presented by the father PS21, which will be described later. In the process of having a conversation with the grandfather PS11 and the grandmother PS12, the communication robot 10 appropriately notifies the people living in the child household HM2 via the network NW of the status of the grandfather PS11 and the grandmother PS12.

A family consisting of a father PS21, a mother PS22, an older sister PS23, and a younger brother PS24 lives in the child household HM2. The father PS21 and the mother PS22 have smartphones T21 and T22 as personal information terminals, respectively. In addition, older sister PS23 and younger brother PS24 also have feature phones T23 and T24 as personal information terminals, respectively.

A server device SV for managing the operation of the communication robot 10 of the elderly household HM1 is connected to the network NW.

This server device SV receives schedule information input from the smartphone T21 possessed by the father PS21 of the child household HM2 and the smartphone T22 possessed by the mother PS22 according to the application program pre-installed in those devices, and receives the above-mentioned communication robot. The schedule information required for 10 is transmitted.

Further, the server device SV receives necessary voice information from the communication robot 10 in the process of the communication robot 10 having a conversation with the grandfather PS11 and the grandmother PS12, and transmits the necessary voice information to the smartphones T21, T22, and the feature phones T23, T24. ..

Next, with reference to FIG. 2, the functional configuration of the internal electronic circuit constituting the communication robot 10 will be described. In the figure, the character drive unit 11, the voice recognition unit 12, the voice processing unit 13, the motion sensor PE, the CPU 14, and the communication unit 15 are connected to the bus B.

The character drive unit 11 operates externally as a robot character of the communication robot 10, for example, a display drive of a display unit at a head position for displaying a face image, a rotation drive of a stepping motor built in a joint position of a limb, and the like. To execute.

The voice recognition unit 12 executes voice recognition processing on the input voice information and converts it into character text information at the time of conversation with the grandfather PS11 and the grandmother PS12, which will be described later.

The voice processing unit 13 is provided with, for example, a PCM sound source, converts voice data such as a message given via the bus B into an analog signal, and makes the speaker unit 17 loud and emit a loud sound, while at the ear position of the communication robot 10. The voice signal input from the provided microphone unit 16 is digitized and transmitted to the voice recognition unit 12 via the bus B.

The motion sensor PE is, for example, a sensor composed of a pyroelectric element and a drive detection circuit thereof, and detects the presence of a person in front of the communication robot 10.

The CPU 14 executes the control operation of the entire communication robot 10, and the work memory 18 and the program memory 19 are directly connected to the CPU 14. That is, the CPU 14 reads the program data and various fixed data stored in the program memory 19 and expands them on the work memory 18, and executes the program data expanded in the work memory 18 at any time via the bus B. Controls the operation of each other circuit.

Further, the operation signal from the operation unit 20 is directly input to the CPU 14. The operation unit 20 includes a power key switch and, for example, a pressure-sensitive switch arranged on the crown of the communication robot 10, and outputs a signal corresponding to the operation state to the CPU 14.

As described above, the communication unit 15 transmits / receives data to / from the nearest wireless LAN router or the like via the antenna 21 in accordance with the IEEE802.11a / 11b / 11g / 11n standard.

Next, the operation of the above embodiment will be described.
FIG. 3 shows the schedule information for the entire family of the child household HM2, which is input by the smartphone T21 possessed by the father PS21 and the smartphone T22 possessed by the mother PS22 and registered in the server device SV via the network NW. It is an example of a part.

Here, the schedule information shall consist of the date and time of the schedule, the type of content, the schedule content, the relationship of the terminal owner as seen from the watch target, and the degree of familiarity.

FIG. 4 shows the processing contents of the conversation operation executed by the communication robot 10. The processing of this conversation operation is executed after the operation program read from the program memory 19 by the CPU 14 and various fixed data are expanded and stored in the work memory 18.

At the beginning of the process, the CPU 14 determines a preset schedule information acquisition timing, for example, whether or not it is 0:00 in the middle of the night every day (step S101). If it is determined that this is not the case (No in step S101), the CPU 14 determines whether or not it is time to ask the next question (step S102).

The timing of asking a question here is that the time information added to the created and unoutput question voice has passed, and the question is asked in front of the communication robot 10 by the above motion sensor PE. Judgment is made on the condition that there is a person who becomes.

When it is determined that it is not the timing to ask a question (No in step S102), the CPU 14 returns to the process from step S101.

In this way, the processes of steps S101 and S102 are repeatedly executed, and the process waits for the timing of acquiring schedule information or the timing of asking a question.

When it is determined in step S101 that it is time to acquire schedule information (Yes in step S101), the CPU 14 accesses the server device SV via the communication unit 15 and the antenna 21, and schedule information addressed to the communication robot 10. (Step S103).

When the schedule information is obtained, the CPU 14 prepares a large number of conversation data sets in advance based on the schedule information and the relationship information, specifically, the terminal owner information and the familiarity information in the schedule information. An appropriate one is selected from the above (step S104).

FIG. 5 shows, for example, the creation of a question voice and its response when the first schedule information of FIG. 3 is acquired from the server device SV. In this case, as shown in FIG. 5 (I), the owners of the party terminals are the father PS21 who is the "son" of the grandfather PS11 and the grandmother PS12, and the schedule type is "business trip" as shown in FIG. 5 (II). ".

For this "business trip", as shown in FIG. 5 (III), it is assumed that a plurality of conversation data sets including the three illustrated are prepared in advance. In any conversation data set, the terminal owner "son" is entered in the "○○" part, and the place name "Nagoya" of the business trip destination is entered in the "**" part.

Therefore, the questions created are as shown in FIG. 5 (IV). Here, as shown by adding (A) to (C), questions are created according to the degree of familiarity. If the familiarity of the "son" dad PS21 is set to "B", the second conversation data set is selected as the question, and the synthesis "son is on a business trip to Nagoya. Go to Nagoya." Have you ever been asked? "

The CPU 14 creates a questioning voice by voice synthesis processing from the questioning text data created in this way, and time information before a predetermined time of the scheduled time "October 20th 8:00", for example, "October 19th" 24 hours ago. After adding "8 o'clock", the work memory 18 is temporarily held in a preset area (step S105), and then the process returns to the process from step S101.

Further, in step S102, when it is determined that it is time to ask a question, that is, the time information added to the created and unoutput question voice has passed, and the communication robot 10 is subjected to the human sensor PE. Before, when it is determined that there is a person to be watched over by asking a question (Yes in step S102), the CPU 14 then reads the corresponding questioning voice from the work memory 18 and communicates with the voice processing unit 13 and the speaker unit 17. A loud sound is emitted toward the front of the robot 10 (step S106).

Further, the CPU 14 inputs the voice through the microphone unit 16 and converts it into data in order to acquire the response voice from the person to be watched located in front of the communication robot 10 in response to the question output (step S107). It is determined whether or not a certain time, for example, 60 seconds has elapsed from the timing when the above question is output (step S108).

If it is determined that the fixed time has not elapsed (No in step S108), the CPU 14 continues the voice acquisition in step S107.

In this way, the processes of steps S107 and S108 are repeatedly executed, and the response voice for a certain period of time to the question is acquired.

In step S108, when it is determined that a certain time has elapsed from the timing when the question is output (Yes in step S108), the CPU 14 transfers the response voice data for a certain time to the voice recognition unit 12, and the corresponding text information. After being converted to, analysis processing is performed as a response to the above question by parsing processing or the like (step S109).

As a result of the analysis process, the CPU 14 determines whether or not the response to the question is established as a conversation (step S110).

If it is determined that the response to the question is established as a conversation, the CPU 14 assumes that there is no abnormality and transfers only the input voice information to the corresponding terminal owner together with a notification that the response has been received as it is. (Step S111), the process returns to the process from step S101.

Further, in step S110, when it is determined that the response to the question is not established as a conversation, the CPU 14 assumes that some abnormality has occurred in the person to be watched over, and inputs a notification indicating that the abnormality has occurred. At the same time, the broadcast is forwarded to all households including the corresponding terminal owner (step S112), and then the process returns to the process from step S101.

FIG. 5 (V) shows an example of a communication robot 10 conversation based on the schedule information. Here, the voice from the communication robot 10 saying "My son is on a business trip to Nagoya. Have you been to Nagoya?" Issued in Fig. 5 (IV) above is emitted, and in response to this, the grandfather PS11 or grandmother An example is shown when PS12 responds, "Hey Nagoya is rare. Red circles are good for souvenirs."

In this case, assuming that the conversation has been established and no abnormality has occurred, only the voice information of the obtained response is transferred to the smartphone T21 of the father PS21 who is the party via the server device SV. become.

In addition, if the grandfather PS11 or grandmother PS12 responds to the schedule information of the father PS21 that has nothing to do with "the son's business trip to Nagoya", it is assumed that the conversation has not been established and some abnormality has occurred. , Notification indicating that an abnormality has occurred and voice information will be transmitted to the smartphones T21, T22, and feature phones T23, T24 of all the child households HM2 via the server device SV.
Further, in step S106, even after a certain period of time has elapsed from the timing of outputting the question, even if there is no response from the person to be watched over, it is considered that some abnormality has occurred, and a notification indicating that the abnormality has occurred is sent. It may be sent.

In the above embodiment, the degree of familiarity of each person PS21 to 24 on the child household HM2 side, the time width when the schedule information is output in advance on the elderly household HM1 side, the case where no abnormality has occurred, and the abnormality. When this occurs, the parties can arbitrarily select the setting of each notification destination from a certain number of options.
Further, in the above embodiment, the schedule information of each person PS21 to 24 on the child household HM2 side has been described as being stored and managed by the server device SV, but the storage and management is performed on the communication robot 10 side without the intervention of the server device SV. May be used.

Further, in the above embodiment, it has been described that the communication robot 10 performs the voice recognition process and the determination of the notification, but the following flow of the voice recognition is performed on the server device SV side or a plurality of computers connected to the network NW. It may be performed by the distributed processing in.

As described in detail above, according to the present embodiment, the person to be watched over can use the communication robot 10 more easily and naturally in daily life.

In addition, in the above embodiment, it is determined whether or not the response to the question of the grandfather PS11 or the grandmother PS12 in the elderly household HM1 is appropriate, and the determination result is notified to the child household HM2 side at any time. Household HM2 can continue to watch over with peace of mind.

Further, in the above embodiment, since the question is created according to the relationship between the person who is watching over and the user who is actually being watched using the communication robot 10, it is extremely natural for the person who receives the question. It will be easy to respond.

In particular, in the above embodiment, the communication robot 10 existing in the elderly household HM1 acquires the schedule information of each person PS21 to 24 of the child household HM2, which is a relative, and provides the schedule information to the communication robot 10. The side receiving the watch over of the household HM1 can respond to the communication robot 10 with more familiarity, and the burden required for contacting the child household HM2 side can be reduced.

Further, in the above embodiment, the determination result when the content of the response to the question posed by the communication robot 10 on the elderly household HM1 side is appropriate and when it is not appropriate is notified to the child household HM2 side at any time. Therefore, each person PS21 to 24 on the child household HM2 side can continue to watch over with peace of mind.

Further, in the above embodiment, since the question is output corresponding to the date and time included in the schedule information, the question based on the schedule information can be output at a more appropriate timing depending on the setting method.

Needless to say, the shape and size of the communication robot 10, the added functions, and the like are not limited to the present embodiment.

In addition, the present invention is not limited to the above-described embodiment, and can be variously modified at the implementation stage without departing from the gist thereof. In addition, the functions executed in the above-described embodiment may be combined as appropriate as possible. The above-described embodiments include various steps, and various inventions can be extracted by an appropriate combination according to a plurality of disclosed constitutional requirements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, if the effect is obtained, the configuration in which the constituent requirements are deleted can be extracted as an invention.

The inventions described in the claims of the original application of the present application are described below.
[Claim 1]
An acquisition means for acquiring schedule information of a pre-registered person who exists in a place different from the place where the device exists, and
A question creation means that creates question information for the user of the device based on the schedule information acquired by the acquisition means, and a question creation means.
An output means that outputs a question based on the question information created by the above question creation means, and an output means.
An input means for inputting the user's response to the question output by the above output means, and
An information sharing device characterized by being equipped with.
[Claim 2]
A determination means for determining whether or not the response of the user input by the input means is appropriate for the question, and
A notification means for notifying the judgment result of the above judgment means, and
The information sharing device according to claim 1, further comprising.
[Claim 3]
The acquisition means acquires the schedule information of the person registered in advance and the relationship information indicating the relationship between the person and the user.
The question creation means creates question information for the user based on the schedule information and the relationship information.
The information sharing device according to claim 1.
[Claim 4]
The acquisition means acquires the schedule information of the relatives of the user, and obtains the schedule information.
The notification means notifies the information terminal owned by the relative of the user of the determination result by the determination means.
2. The information sharing device according to claim 2.
[Claim 5]
The second aspect of claim 2, wherein the notification means notifies the user that an abnormality has occurred when the determination means determines that the user's response is not appropriate for the question. Information sharing device.
[Claim 6]
The fourth or fifth aspect of claim 4 or 5, wherein the notification means notifies the user that there is no abnormality when the determination means determines that the response of the user is appropriate for the question. Information sharing device.
[Claim 7]
The above acquisition means acquires schedule information including a date, and
The output means outputs a question based on the created question information on the day corresponding to the date included in the schedule information.
The information sharing device according to any one of claims 1 to 6, wherein the information sharing device is characterized by the above.
[Claim 8]
The above acquisition means acquires schedule information including the date and time, and
The output means outputs a question based on the created question information at a time corresponding to the date and time included in the schedule information.
The information sharing device according to any one of claims 1 to 6, wherein the information sharing device is characterized by the above.
[Claim 9]
The acquisition process for acquiring the schedule information of a pre-registered person, which exists in a place different from the place where the device to output in the following output process exists, and
A question creation process for creating question information for the user of the device based on the schedule information acquired in the acquisition process, and a question creation process.
An output process that outputs a question based on the question information created in the above question creation process, and
An input process for inputting the user's response to the question output in the output process, and
An information sharing method characterized by having.
[Claim 10]
A program executed by a computer built in a device that outputs by the following output means, and the above computer is
An acquisition means for acquiring schedule information of a pre-registered person who exists in a place different from the place where the above device exists.
A question creation means that creates question information for the user of the device based on the schedule information acquired by the acquisition means.
An output means for outputting a question based on the question information created by the above-mentioned question-creating means, and an input means for inputting the user's response to the question output by the above-mentioned output means.
A program characterized by functioning as.
[Claim 11]
An information sharing system including a first device and a second device used by a pre-registered person, which exists in a place different from the place where the first device exists.
The second device includes an acquisition means for acquiring the schedule information of the person registered in advance.
The system includes a question creation means for creating question information for the user of the first device based on the schedule information acquired by the acquisition means.
The first device is
An output means that outputs a question based on the question information created by the above question creation means, and an output means.
An input means for inputting the user's response to the question output by the above output means, and
With
Furthermore, the above system
A determination means for determining whether or not the response of the user input by the input means is appropriate for the question, and
A notification means for notifying the second device of the determination result by the determination means, and
To prepare
An information sharing system characterized by this.

10 ... Communication robot,
11 ... Character drive unit,
12 ... Voice recognition unit,
13 ... Voice processing unit,
14 ... CPU,
15 ... Communication Department,
16 ... Microphone section,
17 ... Speaker section,
18 ... Working memory,
19 ... Program memory,
20 ... Operation unit,
21 ... Antenna,
B ... Bus,
HM1 ... Elderly households,
HM2 ... Child household,
NW ... Network,
PE ... Motion sensor,
PS11 ... Grandpa,
PS12 ... Grandma,
PS21 ... Dad (son),
PS22 ... Mom (bride),
PS23 ... Sister (grandchild),
PS24 ... Brother (younger brother),
SV ... Server device,
T21, T22 ... Smartphone,
T23, T24 ... Feature phone.

Claims (10)

In the information sharing device
An acquisition means for acquiring schedule information of a predetermined target person different from the user of the information sharing device, and
Based on the obtained said schedule information by the acquiring means, a question preparing means creates information interrogation for the user of the information sharing apparatus,
An output means that outputs the above question information created by the above question creation means, and
Input means for inputting a response of the user with respect to the question information output by said output means,
A determination means for determining whether or not the response of the user input by the input means is appropriate for the question information, and
A notification means for notifying the judgment result of the above judgment means, and
An information sharing device characterized by being equipped with. It said interrogation creation means, based on the relationship information indicating the relationship between the user and the subject included in the content and the schedule information of the schedule included in the schedule information, creates the inquiry information to said user The information sharing device according to claim 1, wherein the information sharing device is characterized by the above. The acquisition means acquires the schedule information of the relatives of the user, and obtains the schedule information.
The information sharing device according to claim 1 or 2, wherein the notification means notifies an information terminal used by a relative of the user of a determination result by the determination means. Said notifying means according to claim 1, characterized in that reply the user if it is determined in not appropriate when the determining means with respect to the interrogation information, notifying an abnormality related to the user is generated The information sharing device according to any one of 3 to 3. The notification unit, when the reply of the user is determined by the determination means to be appropriate with respect to the interrogation information, 1 to claim, characterized in that notifying no abnormality regarding the above user 4 The information sharing device according to any one of them. Said output means, on the day that has been set in advance for the date of the schedule included in the schedule information, the information sharing apparatus according to any one of claims 1 to 5, wherein the outputting the question information. It said output means, the date and time set in advance for the date and time of the schedule included in the schedule information, the information sharing apparatus according to any one of claims 1 to 5, wherein the outputting the question information. It is an information sharing method in an information sharing device.
An acquisition process for acquiring schedule information of a predetermined target person different from the user of the information sharing device, and
Based on the obtained the schedule information in the acquiring step, a question generating step generates information interrogation for the user of the information sharing apparatus,
An output process that outputs the above question information created in the above question creation process, and
An input step of inputting a response of the user with respect to the question information output by said output step,
A determination step of determining whether or not the user's response input in the input step is appropriate for the question information, and
A notification process for notifying the determination result in the above determination process, and
An information sharing method characterized by having. The computer of the information sharing device,
An acquisition means for acquiring schedule information of a predetermined target person different from the user of the information sharing device.
Based on the obtained said schedule information by the acquiring means, question preparing means creates information interrogation for the user of the information sharing apparatus,
An output means that outputs the above question information created by the above question creation means,
Input means for inputting a response of the user with respect to the question information output by said output means,
A determination means for determining whether or not the response of the user input by the input means is appropriate for the question information.
Notification means for notifying the judgment result by the above judgment means,
A program characterized by functioning as. A first device, an information sharing system including a second device to be used is different predetermined subject from the user of the first device,
The second device includes a second input means for inputting the schedule information of the target person.
The first apparatus includes an acquisition means for acquiring the schedule information input by the second input means of the second apparatus, and an acquisition means for acquiring the schedule information.
Based on the obtained said schedule information by the acquiring means, a question preparing means creates information interrogation for the user of said first device,
An output means that outputs the above question information created by the above question creation means, and
First input means for inputting a response of the user with respect to the question information output by said output means,
A determination means for determining whether or not the response of the user input by the first input means is appropriate for the question information, and
An information sharing system including a notification means for notifying the second device of a determination result by the determination means.

Images