JP6986147B2 - Biometric information acquisition system, electronic device, biometric information acquisition method, and biometric information acquisition program - Google Patents

Description

The present disclosure relates to a biometric information acquisition system, an electronic device, a biometric information acquisition method, and a biometric information acquisition program.

Conventionally, as a technique for managing the health of a user, for example, Patent Document 1 describes a technique for using a virtual pet. In the technique described in JP-A-2010-21409, the health of the user is improved by raising the virtual pet according to the behavior of the user.

Further, conventionally, for the purpose of managing the health of the user, biometric information such as the body temperature of the user has been acquired.

The technique described in JP-A-2010-21409 promotes the behavior of the user by raising a virtual pet, and does not acquire the biometric information of the user and perform health management.

On the other hand, when managing the health of a user by using biological information, it is desired to acquire highly accurate biological information rather than simply acquiring biological information. However, when the user himself / herself measures the biometric information and records the measurement result, it is difficult to measure the biometric information in an appropriate state satisfying the appropriate measurement conditions, and the accuracy of the measured biometric information is low. was there. Further, when the user himself / herself measures the biological information and records the measurement result, it is difficult to continuously measure the biological information, and there is a case that appropriate information for health management or the like cannot be obtained.

Therefore, there is a demand for a technique for appropriately and continuously acquiring user's biometric information.

The present disclosure provides a biometric information acquisition system, an electronic device, a biometric information acquisition method, and a biometric information acquisition program capable of appropriately and continuously acquiring the biometric information of a user.

The first aspect of the present disclosure is a biological information acquisition system, in which information representing a virtual favorite food supplied to a virtual life form is transmitted to an electronic device representing the virtual life form in response to a user's instruction. A favorite food supply device having a favorite food supply unit, a recognition unit that recognizes the user, a biometric information acquisition unit that acquires the user's biometric information, and a condition regarding the user when the biometric information acquisition unit acquires the biometric information are set in advance. Information representing a favorite food transmitted from a favorite food supply device when the specified conditions for acquiring biometric information and the biometric information acquisition condition, which is at least one of the same conditions as when the biometric information was acquired last time, are satisfied. It comprises a receiving unit for receiving and an electronic device having.

In the second aspect of the present disclosure, in the first aspect, the receiving unit may include a guiding unit that guides the user to a state in which the biometric information acquisition condition is not satisfied.

A third aspect of the present disclosure is, in the first aspect or the second aspect, a requesting unit that requests the user to supply a favorite food when the electronic device is at the timing of acquiring the biometric information of the user. You may also have more.

A fourth aspect of the present disclosure is, in the third aspect, the requesting unit is based on at least one piece of information representing a change in the state of the electronic device, information representing time, and information representing the current position of the own device. The timing may be determined.

In a fifth aspect of the present disclosure, in the first to fourth aspects, the receiving unit may respond to the user when the favorite food is received.

The sixth aspect of the present disclosure may further include an analysis device for analyzing the biological information acquired by the biological information acquisition unit in the first to fifth aspects.

In the seventh aspect of the present disclosure, in the sixth aspect, the analysis device may have at least one of a favorite food supply device and an electronic device.

In the eighth aspect of the present disclosure, in the sixth or seventh aspect, the favorite food supply device comprises a purchasing unit for purchasing information representing the favorite food, and the analysis device includes the favorite food received by the receiving unit. It may have a providing unit that provides the user with the analysis result of analyzing the biometric information according to the purchase price corresponding to the information to be represented.

In the ninth aspect of the present disclosure, in the first to eighth aspects, the favorite food may be virtual food.

In the tenth aspect of the present disclosure, in the first to eighth aspects, the favorite food may be a virtual gold item.

The eleventh aspect of the present disclosure is a biological information acquisition system, in which information representing a virtual favorite food supplied to a virtual life form is transmitted to an electronic device representing the virtual life form in response to a user's instruction. A favorite food supply device having a favorite food supply unit, a recognition unit that recognizes the user, a biometric information acquisition unit that acquires the user's biometric information, and a condition regarding the user when the biometric information acquisition unit acquires the biometric information. An electronic device having a predetermined condition for acquiring biometric information and a guiding unit that guides the user to a state that satisfies the condition for acquiring biometric information, which is at least one of the same conditions as when the biometric information was acquired last time. And.

A twelfth aspect of the present disclosure is an electronic device, in which information representing a virtual favorite to be supplied to a virtual life form is transmitted to the electronic device representing the virtual life form in response to a user's instruction. The recognition unit that recognizes the user, the biometric information acquisition unit that acquires the biometric information of the user, and the condition regarding the user when the biometric information acquisition unit acquires the biometric information of the supply device are for biometric information acquisition. And the receiving unit that receives the information representing the favorite food transmitted from the favorite food supply device when the biometric information acquisition condition, which is at least one of the same conditions as the case where the biological information was acquired last time, is satisfied. Have.

A thirteenth aspect of the present disclosure is an electronic device, in which information representing a virtual favorite to be supplied to a virtual life form is transmitted to the electronic device representing the virtual life form in response to a user's instruction. When the recognition unit that recognizes the user, the biometric information acquisition unit that acquires the biometric information of the user, and the biometric information acquisition unit of the supply device acquire the biometric information, the conditions related to the user are predetermined biometric information acquisition. It has a condition for guiding the user to a state in which the biometric information acquisition condition, which is at least one of the same conditions as the case where the biometric information was acquired last time, is satisfied.

A fourteenth aspect of the present disclosure is a method for acquiring biometric information, in which information representing a virtual favorite food supplied to a virtual life form is transmitted to a computer in an electronic device representing the virtual life form according to a user's instruction. When the condition regarding the user when the user is recognized, the user's biometric information is acquired, and the biometric information is acquired in the favorite food supply device to be transmitted to the user, the condition for acquiring the biometric information and the case where the biometric information is acquired last time. When at least one of the same conditions as the above is satisfied, the process of receiving the information representing the favorite food transmitted from the favorite food supply device is executed.

A fifteenth aspect of the present disclosure is a method for acquiring biometric information, in which information representing a virtual favorite food supplied to a virtual life form is transmitted to a computer in an electronic device representing the virtual life form according to a user's instruction. When recognizing the user, acquiring the user's biometric information, and acquiring the biometric information of the favorite food supply device to be transmitted to the user, the conditions related to the user are the predetermined conditions for acquiring the biometric information and the biological body in the previous time. A process is executed that guides the user to a state that satisfies the biometric information acquisition condition, which is at least one of the same conditions as when the information is acquired.

A sixteenth aspect of the present disclosure is a biometric information acquisition program, in which information representing a virtual favorite food supplied to a virtual life form is transmitted to a computer in an electronic device representing the virtual life form according to a user's instruction. The conditions regarding the user when the user is recognized, the user's biometric information is acquired, and the biometric information is acquired by the favorite food supply device to be transmitted to the user are the predetermined conditions for acquiring the biometric information and the biometric information previously. When the biometric information acquisition condition, which is at least one of the same conditions as the case of acquiring the above, is satisfied, the process of receiving the information representing the favorite food transmitted from the favorite food supply device is executed.

The seventeenth aspect of the present disclosure is a biometric information acquisition program, in which information representing a virtual favorite food supplied to a virtual life form is transmitted to a computer to an electronic device representing the virtual life form according to a user's instruction. When recognizing the user, acquiring the user's biometric information, and acquiring the biometric information of the favorite food supply device to be transmitted to the user, the conditions related to the user are the predetermined conditions for acquiring the biometric information and the biological body in the previous time. A process is executed that guides the user to a state that satisfies the biometric information acquisition condition, which is at least one of the same conditions as when the information is acquired.

According to the above aspect, the biometric information acquisition system, the electronic device, the biometric information acquisition method, and the biometric information acquisition program of the present disclosure can appropriately and continuously acquire the biometric information of the user.

It is a block diagram which shows an example of the structure of the biological information acquisition system of an exemplary embodiment. It is a block diagram which shows an example of the hardware composition of the favorite food supply device of an exemplary embodiment. It is a block diagram which shows an example of the hardware composition of the pet robot of an exemplary embodiment. It is a block diagram which shows an example of the hardware configuration of the server of an exemplary embodiment. It is a block diagram which shows an example of the functional structure of the biological information acquisition system of an exemplary embodiment. It is a flowchart which shows an example of the favorite food supply processing executed by the favorite food supply apparatus of an exemplary embodiment. It is a flowchart which shows an example of the biological information acquisition processing executed by the pet robot of an exemplary embodiment. It is a flowchart which shows an example of the analysis result providing processing executed in the server of an exemplary embodiment.

Hereinafter, examples of embodiments for carrying out the technique of the present disclosure will be described in detail with reference to the drawings.

First, the configuration of the biological information acquisition system 1 of this exemplary embodiment will be described with reference to FIG. As shown in FIG. 1, the biological information acquisition system 1 of this exemplary embodiment includes a favorite food supply device 10, a pet robot 12, and a server 14. The favorite food supply device 10, the pet robot 12, and the server 14 are connected to the network N so as to be able to communicate with each other. Further, the favorite food supply device 10 and the pet robot 12 are connected so as to be able to communicate with each other without going through the network N. The communication between the favorite food supply device 10 and the pet robot 12 is preferably wireless communication, but may be priority communication.

The favorite food supply device 10 is a device used to supply a virtual favorite food to the pet robot 12 by a user who possesses the favorite food supply device 10 and the pet robot 12. In this exemplary embodiment, as an example, the favorite food supply device 10 is a so-called smart device such as a smartphone or a tablet terminal, but the specific form of the favorite food supply device 10 is not particularly limited, for example, for the supply of favorite food. It may be a device dedicated to the above, a device such as a remote controller, or a combination of these devices.

Further, in the present exemplary embodiment, the “favorite food” is the food of the pet robot 12 as an example in the present exemplary embodiment, but is not limited to food and corresponds to other money items such as money and money. It may be a point, a decorative item, or the like, or may be a combination of these. Further, in the present exemplary embodiment, the grade, item, cooking name, taste, and the like are provided for the food that is the “favorite food”.

Further, what is handled in the biological information acquisition system 1 of the present exemplary embodiment is not the actual "favorite" itself, but the "virtual favorite", and specifically, the electronic data representing the favorite. Hereinafter, in the biological information acquisition system 1 of the present exemplary embodiment, the term "favorite" may refer to "virtual favorite".

The pet robot 12 is an example of the electronic device of the present disclosure, and is also an example of the "virtual life form" of the present exemplary embodiment, and receives the favorite food supplied from the favorite food supply device 10. In this exemplary embodiment, since the favorite food is food as described above, the pet robot 12 indicates that the favorite food has been received by pretending to have eaten the favorite food. The pet robot 12 may have a form in which the appearance of the robot itself represents a pet, or may have a form in which a pet is represented by an image or the like displayed on a display unit 43 described later, and is not particularly limited. .. Further, the "living body" in the present exemplary embodiment is not limited to the living body that actually exists, and may be a fictitious living body. Further, in this exemplary embodiment, the "virtual life form" shows a form in which the "virtual life form" is a "robot" and a "pet", but the present invention is not limited to these forms, and is an electronic device other than the "robot". Needless to say, it may be present or it may be a life form other than a "pet".

Further, when the pet robot 12 of the present exemplary embodiment receives the favorite food supplied from the favorite food supply device 10, if the biometric information of the user satisfies the biometric information acquisition condition described in detail later, the biometric information of the user is obtained. If it is acquired and it is not satisfied, the user is guided to the state where it is satisfied.

The server 14 is an example of the analysis device of the present disclosure, analyzes the biometric information of the user acquired by the pet robot 12, and provides the analysis result to a predetermined destination.

Next, with reference to FIG. 2, the hardware configuration of the favorite food supply device 10 of this exemplary embodiment will be described. As shown in FIG. 2, the favorite food supply device 10 includes a CPU (Central Processing Unit) 20, a memory 21 as a temporary storage area, and a non-volatile storage unit 22. Further, the favorite food supply device 10 includes a display unit 23 such as a liquid crystal display, an input unit 24 such as a keyboard, an output unit 25 such as a speaker that outputs voice, a network I / F (InterFace) 26 connected to a network N, and a network I / F (InterFace) 26. Includes a communication I / F 27 for communicating with the pet robot 12. The display unit 23 and the input unit 24 may be an integrated touch panel display. The CPU 20, the memory 21, the storage unit 22, the display unit 23, the input unit 24, the output unit 25, the network I / F26, and the communication I / F27 are connected to the bus 28.

The storage unit 22 is realized by an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like. The favorite food supply program 30 is stored in the storage unit 22 as a storage medium. The CPU 20 reads each of the favorite food supply programs 30 from the storage unit 22, expands the favorite food supply program 30 into the memory 21, and executes the expanded favorite food supply program 30. Further, the storage unit 22 stores favorite food management information 32 used for managing favorite foods that can be supplied to the pet robot 12.

Further, with reference to FIG. 3, the hardware configuration of the pet robot 12 of this exemplary embodiment will be described. As shown in FIG. 3, the pet robot 12 includes a CPU 40, a memory 41 as a temporary storage area, and a non-volatile storage unit 42. Further, the pet robot 12 communicates with a display unit 43 such as a liquid crystal display, an output unit 45 such as a speaker that outputs sound, a drive unit 44, a network I / F 46 connected to the network N, and a favorite food supply device 10. Communication I / F 47 is included. Further, the pet robot 12 includes a biometric information acquisition sensor 49 used for acquiring the biometric information of the user. The CPU 40, the memory 41, the storage unit 42, the display unit 43, the drive unit 44, the output unit 45, the network I / F46, the communication I / F47, and the biometric information acquisition sensor 49 are connected to the bus 48.

The storage unit 42 is realized by an HDD, an SSD, a flash memory, or the like. The biological information acquisition program 50 is stored in the storage unit 42 as a storage medium. The CPU 40 reads out the biometric information acquisition program 50 from the storage unit 42, expands the biometric information acquisition program 50 into the memory 41, and executes the expanded biometric information acquisition program 50. Further, the storage unit 42 stores the biometric information data 52 representing the acquired biometric information of the user.

The drive unit 44 has a function of moving the limbs (not shown) of the pet robot 12.

The biometric information acquisition sensor 49 is a sensor for acquiring information (data for deriving biometric information) necessary for deriving the biometric information of the user. The biological information acquisition sensor 49 may be any as long as it corresponds to the type of biological information to be acquired, and is not particularly limited. Examples of the type of biological information include, but are not limited to, complexion, pulse, heart rate, blood flow, blood pressure, voice quality, vital capacity, and the like. The biological information acquisition sensor 49 includes, for example, an RGB (Red Green Blue) camera capable of acquiring a moving image or a still image of a user's face, a far-infrared camera capable of acquiring a user's body temperature, a user's face, and the like. Depth camera that can acquire the shape (depth) of, a sound sensor that can acquire the user's voice, and a Doppler sensor that uses microwaves and millimeter waves that can acquire the movement of the user's body surface, etc. Or, a form in which these are combined can be mentioned. Further, for example, the biological information acquisition sensor 49 may be in the form of using an optical measurement system for measuring blood flow described in JP-A-2009-200433. The optical measurement system described in JP-A-2009-200433 is provided with a means for measuring blood flow by receiving and analyzing a laser beam irradiating a living tissue.

Further, with reference to FIG. 4, the hardware configuration of the server 14 of this exemplary embodiment will be described. As shown in FIG. 4, the server 14 includes a CPU 60, a memory 61 as a temporary storage area, and a non-volatile storage unit 62. Further, the server 14 includes a display unit 63 such as a liquid crystal display, an input unit 64 such as a keyboard and a mouse, and a network I / F 66 connected to the network N. The display unit 63 and the input unit 64 may be an integrated touch panel display. The CPU 60, the memory 61, the storage unit 62, the display unit 63, the input unit 64, and the network I / F 66 are connected to the bus 68.

The storage unit 62 is realized by an HDD, an SSD, a flash memory, or the like. The analysis result providing program 70 is stored in the storage unit 62 as a storage medium. The CPU 60 reads the analysis result providing program 70 from the storage unit 62, expands the analysis result providing program 70 into the memory 61, and executes the expanded analysis result providing program 70. Further, the storage unit 62 stores user management information 72 for managing users of the favorite food supply device 10 and the pet robot 12.

Next, with reference to FIG. 5, the functional configuration of the biological information acquisition system 1 of this exemplary embodiment will be described. As shown in FIG. 5, the favorite food supply device 10 has a purchase unit 90 and a favorite food supply unit 92. By executing the favorite food supply program 30, the CPU 20 functions as the purchase unit 90 and the favorite food supply unit 92.

The purchasing unit 90 has a function for the user to purchase electronic data representing a virtual favorite food supplied to the pet robot 12. The favorite food supply unit 92 transmits electronic data representing a virtual favorite food to the pet robot 12 according to a user's instruction.

On the other hand, as shown in FIG. 5, the pet robot 12 has a request unit 80, a recognition unit 82, a biometric information acquisition unit 84, and a receiving unit 86.

The request unit 80 requests the user to supply a favorite food when it is time to acquire the biometric information of the user. The recognition unit 82 recognizes the user. The biometric information acquisition unit 84 acquires the biometric information of the user. Further, the biometric information acquisition unit 84 transmits the acquired data representing the biometric information of the user to the server 14 via the network N.

The receiving unit 86 includes a guiding unit 87. In the receiving unit 86, the condition regarding the user when the biometric information acquisition unit 84 acquires the biometric information is at least one of a predetermined condition for acquiring the biometric information and the same condition as when the biometric information was acquired last time. When the condition for acquiring biological information is satisfied, electronic data representing the favorite food supplied from the favorite food supply device 10 is received. If the guidance unit 87 does not satisfy the biometric information acquisition condition, the guidance unit 87 guides the user to a state in which the biometric information acquisition condition is satisfied.

On the other hand, as shown in FIG. 5, the server 14 includes an analysis unit 96 and a provision unit 98. The analysis unit 96 analyzes the biological information acquired by the pet robot 12 and derives the information as an analysis result for the health management of the user. The providing unit 98 provides the analysis result of the biological information by the analysis unit 96 to a predetermined providing destination such as a user.

Next, the operation of the biological information acquisition system 1 of this exemplary embodiment will be described. First, the supply of favorite food to the pet robot 12 by the favorite food supply device 10 will be described with reference to FIG. When the CPU 20 executes the favorite food supply program 30, the favorite food supply process shown in FIG. 6 is executed. The favorite food supply process shown in FIG. 6 is executed, for example, at the timing when a predetermined instruction regarding the execution of the favorite food supply by the user of the favorite food supply device 10 is input by the input unit 24 or the like.

In step S100 of FIG. 6, the favorite food supply unit 92 determines whether or not to execute the supply of the favorite food. In the favorite food supply device 10 of the present exemplary embodiment, the user supplies the favorite food to the pet robot 12 and purchases the favorite food to be supplied. In this step, it is determined whether or not the user has instructed to execute the supply of the favorite food among the supply of the favorite food and the purchase of the favorite food. If the execution of the supply of the favorite food is not instructed, in other words, if the execution of the purchase of the favorite food is instructed, the determination in step S100 becomes a negative determination, and the process proceeds to step S102. In step S102, the purchasing unit 90 causes the display unit 23 to display the purchased favorite food designation information for the user to specify the favorite food to be purchased. In this exemplary embodiment, when purchasing a favorite food, it is possible to specify the number (amount) and type of the favorite food to be purchased, and the purchase price differs depending on the number and type of the favorite food. Therefore, the purchasing unit 90 designates the number and type of favorite foods to be purchased by the user, and causes the display unit 23 to display the information for the user to pay the amount corresponding to the number and types of the designated favorite foods as the purchase favorite food designation information. The method of payment by the user at the time of purchase is not particularly limited, such as cash, virtual currency, some points, and a combination thereof.

In the next step S104, the purchasing unit 90 determines whether or not the user has specified the favorite food to be purchased by the input unit 24. The determination in step S104 becomes a negative determination until the favorite food to be purchased is specified, and when the favorite food to be purchased is specified, the determination in step S104 becomes an affirmative determination, and the process proceeds to step S106. In the biometric information acquisition system 1 of the present exemplary embodiment, regarding the management of the purchase of the favorite food, the information regarding the purchase of the favorite food is managed externally such as the favorite food supply device 10 and the server 14 via the network I / F26. It is transmitted to and received from the device and managed by an external management device.

In step S106, the purchasing unit 90 updates the favorite food management information 32 stored in the storage unit 22, and then proceeds to step S118. The favorite food management information 32 includes information indicating the number and types of favorite foods that can be supplied to the pet robot 12. Specifically, the purchasing unit 90 updates the number of favorite foods that can be provided in the favorite food management information 32 according to the number of purchases, or increases the types that can be provided according to the purchased types. ..

On the other hand, when the execution of the supply of the favorite food is instructed, the determination in step S100 becomes an affirmative determination, and the process proceeds to step S108. In step S108, the favorite food supply unit 92 causes the display unit 23 to display the supply favorite food designation information for the user to specify the favorite food to be supplied. In the present exemplary embodiment, when the pet robot 12 is supplied with the favorite food, it is possible to specify the number (amount) and the type of the favorite food to be supplied. Therefore, the favorite food supply unit 92 causes the display unit 23 to display the information for the user to specify the number and type of the favorite food to be supplied as the supply favorite food designation information.

In the next step S110, the favorite food supply unit 92 determines whether or not the user has specified the favorite food to be supplied by the input unit 24. The determination in step S110 becomes a negative determination until the favorite food to be supplied is specified, and when the favorite food to be supplied is specified, the determination in step S110 becomes an affirmative determination, and the process proceeds to step S112.

In step S112, the favorite food supply unit 92 supplies the favorite food according to the designated number and type, and transmits the data representing the favorite food as the favorite food data to the pet robot 12 via the communication I / F 27. In the present exemplary embodiment, when the favorite food is supplied, the favorite food supply unit 92 transmits the favorite food data to the pet robot 12, and also provides the user with information indicating that the favorite food is supplied to the pet robot 12. Present. By presenting the user with information indicating that the favorite food is supplied, the user can be given a feeling that the pet robot 12 is being supplied with the favorite food. The method of supplying the favorite food and the method of presenting the information indicating that the favorite food is supplied to the user are not particularly limited. For example, the image showing the favorite food displayed on the display unit 23 may be changed as if the pet robot 12 is eating the favorite food. Further, for example, the sound or state as if the favorite food is going out from the favorite food supply device 10 may be visually or audibly displayed by the display unit 23 and the output unit 25, and the sound or state may be displayed. May be in the form of outputting in conjunction with the user moving the favorite food supply device 10. Further, for example, when the favorite food supply device 10 has a function of realizing augmented reality (AR), the augmented reality function may be used to display the favorite food to be supplied to the virtual space. Further, for example, the favorite food supply device 10 may be arranged at a predetermined position such as in front of the face of the pet robot 12 to start the supply of the favorite food.

As will be described later, when the pet robot 12 receives the favorite food, the pet robot 12 transmits the receipt data indicating the receipt to the favorite food supply device 10 via the communication I / F 27. Therefore, in the next step S114, the favorite food supply unit 92 determines whether or not the received data has been received via the communication I / F 27. The determination in step S114 becomes a negative determination until the received data is received, and when the received data is received, the determination in step S114 becomes an affirmative determination, and the process proceeds to step S116.

In step S116, the favorite food supply unit 92 updates the favorite food management information 32 stored in the storage unit 22, and then proceeds to step S118. Specifically, the favorite food supply unit 92 updates the number of favorite foods that can be supplied in the favorite food management information 32 according to the number of payments, or reduces the types that can be supplied according to the types that have been provided. conduct.

In step S118, the favorite food supply unit 92 determines whether or not to end the favorite food supply process. For example, if an instruction to continuously supply the favorite food is input after the purchase of the favorite food is executed, the determination in step S118 becomes a negative determination, the process returns to step S100, and the processes of steps S102 to S116 are repeated. On the other hand, when the user inputs an instruction to end by the input unit 24, the determination in step S118 becomes an affirmative determination, and the favorite food supply process ends.

Next, the acquisition of the user's biometric information by the pet robot 12 will be described with reference to FIG. 7. When the CPU 40 executes the biometric information acquisition program 50, the biometric information acquisition process shown in FIG. 7 is executed. The biometric information acquisition process shown in FIG. 7 is executed, for example, at the timing when the power is turned on for the first time in the pet robot 12, the timing at which the reset is performed, and the like.

In step S200 of FIG. 7, the requesting unit 80 determines whether or not it is time to acquire the biometric information of the user. In the biometric information acquisition system 1 of the present exemplary embodiment, the timing of acquiring biometric information is set in advance, for example, at a predetermined time, at predetermined intervals, etc., according to the type of biological information to be acquired. It has been decided. The request unit 80 determines whether or not it is time to acquire the biometric information for each type of biometric information to be acquired. The method for determining whether or not it is the timing to acquire biometric information is not particularly limited, and for example, a timer may be referred to (not shown) to determine whether or not the time has reached a predetermined time. However, it may be determined based on the elapsed time since the last time the favorite food was received, which corresponds to the virtual degree of hunger of the pet robot 12. Further, for example, the determination may be made based on the position where the pet robot 12 is placed, or the determination may be made based on historical information such as the battery consumption of the pet robot 12 and the operating time. May be combined. As described above, in the pet robot 12 of the present exemplary embodiment, the timing of acquiring the biometric information of the user is determined based on the information representing the state of the pet robot 12.

The determination in step S200 becomes a negative determination until the timing of acquiring the biological information, and the determination in step S200 becomes an affirmative determination until the timing of acquiring the biological information, and the process proceeds to step S202.

In step S202, the request unit 80 executes a request for a favorite food. The method by which the request unit 80 executes the request for the favorite food is not particularly limited. For example, a specific voice indicating that a favorite food is requested may be output by the output unit 45, the facial expression of the pet robot 12 may be changed, or the limbs of the pet robot 12 may be output by the drive unit 44. Etc. may be moved, or for example, a specific message or the like requesting a favorite food may be displayed on the display unit 43, or a combination of these forms may be used.

In this exemplary embodiment, in response to the pet robot 12 making a request for a favorite food, the user uses the favorite food supply device 10 to supply the favorite food to the pet robot 12 as described above. Therefore, in the next step S204, the recognition unit 82 determines whether or not the favorite food data has been received from the favorite food supply device 10 via the communication I / F 47. The determination in step S204 becomes a negative determination until the favorite food data is received, and when the favorite food data is received, the determination in step S204 becomes an affirmative determination, and the process proceeds to step S206. If the favorite data is not received even after the predetermined time has elapsed, in other words, if the negative determination continues for the predetermined time, it is preferable to return to step S200.

In step S206, the recognition unit 82 acquires user information for identifying the user. In this exemplary embodiment, user information is acquired using the biological information acquisition sensor 49. In the next step S208, the recognition unit 82 executes a user inquiry to determine whether or not the user is the target user for acquiring biometric information (hereinafter referred to as “target user”) based on the acquired user information. do. In the biological information acquisition system 1 of the present exemplary embodiment, it is also possible for a person other than the target user to supply the favorite food to the pet robot 12 by using the favorite food supply device 10. Further, when the pet robot 12 acquires biometric information for a plurality of users, for example, the biometric information to be acquired may differ for each target user, and the target user of the biometric information determined to be acquired this time. A target user different from the above may try to supply a favorite food to the pet robot 12. Therefore, in this exemplary embodiment, it is inquired whether or not the user is the target user of this time in this step. The user inquiry method is not particularly limited. For example, when the biometric information acquisition sensor 49 is an RGB camera, a still image of the user's face is acquired, image analysis is performed on the still image, and a pre-registered target user is registered. It may be a form that matches the facial features of the image or performs so-called face recognition. When the biological information acquisition sensor 49 is an RGB camera, for example, a learning model that has been machine-learned using user information such as a face image of a target user registered in advance as teacher data is used, and a still image of the user is used as a learning model. It may be in the form of inputting and outputting whether or not the user is the target user.

If the user is not the target user, the determination in step S210 is a negative determination, and the process proceeds to step S212. In step S212, the receiving unit 86 returns to step S200 after making a response for the non-target user. In this exemplary embodiment, as an example, the receiving unit 86 uses a display unit 43, a driving unit 44, an output unit 45, and the like to perform predetermined actions for stopping the supply of favorite food as a response for a non-target user. Do it. As a specific example, the output unit 45 outputs, such as "I'm not hungry after all". The response for non-target users is not limited to this form, and may be, for example, a form in which a favorite food is received (eaten) but biometric information is not acquired. In addition, it may be in the form of presenting to the user that the user is not a target user.

On the other hand, in the case of the target user, the determination in step S210 becomes an affirmative determination, and the process proceeds to step S214. In step S214, the biometric information acquisition unit 84 acquires biometric information derivation data by the biometric information acquisition sensor 49. For example, when the biometric information to be acquired is the pulse of the user, a moving image or a still image of the user's face is acquired from the biometric information acquisition sensor 49 which is an RGB camera.

In the next step S216, the receiving unit 86 determines whether or not the biometric information derivation data acquired in step S214 satisfies the biometric information acquisition condition. The biometric information acquisition condition is a condition for appropriately deriving the biometric information of the user with high accuracy, and is a predetermined condition for acquiring biometric information and the same condition as when the biometric information was acquired last time. At least one of the conditions. The predetermined conditions for acquiring biometric information are, specifically, appropriate positions for acquiring biometric information. As an example of the condition for acquiring biometric information, in this exemplary embodiment, in this step, it is determined whether or not the user is located at an appropriate position based on the biometric information derivation data acquired from the biometric information acquisition sensor 49. do. For example, when the biometric information acquisition sensor 49 is an RGB camera, whether or not the target user is photographed in a front-facing posture in the acquired image of the target user's face, in other words, the target user's face orientation is front. Judge whether or not it faces. Further, for example, when the biometric information acquisition sensor 49 is an optical measurement system, it is determined whether or not the biometric information acquisition sensor 49 is in contact with the skin of the target user. If the biometric information acquisition condition is not satisfied, the determination in step S216 becomes a negative determination, and the process proceeds to step S218.

In step S218, the receiving unit 86 responds to reject the favorite food, and in the next step S220, the guiding unit 87 guides the user's position to a position satisfying the biometric information acquisition condition, and then returns to step S214 to return to the above step. The processing of S216 to S220 is repeated. The response to reject the favorite food made by the receiving unit 86 in step S218 is not particularly limited, and for example, the display unit 43, the driving unit 44, the output unit 45, etc. are used to reject or receive the favorite food ( (Eat) is made to perform an action indicating that the favorite food is not placed in an appropriate position.

Further, the method of guiding the user's position executed by the guidance unit 87 in step S220 is not particularly limited, and the position satisfying the biometric information acquisition condition and the current position of the user derived from the biometric information derivation data match. Any method can be used as long as it can guide the user's position to a state that can be regarded as being present. For example, the user's position and the pet robot that fit the user's face image in the specified size within the specified range and the angle between the user's face and the pet robot 12 (biological information acquisition sensor 49) within a certain range. The position of the user's face, etc. (front and back) in order to keep the distance from 12 (biological information acquisition sensor 49) within a certain range, and to perform shooting according to shooting conditions such as predetermined resolution, light intensity, and focus. , Left and right) may be guided by a voice output from the output unit 45 or the like. Further, for example, the drive unit 44 may guide the pet robot 12 by moving the limbs or the like, or the display unit 43 may display information indicating the position of the guidance destination. Further, for example, the position must satisfy the biometric information acquisition condition, such as the pet robot 12 performing a happy operation when the user's position meets the biometric information acquisition condition without inducing a specific position. It may be in the form of guiding the position of the user by expressing. Further, for example, when the biological information acquisition sensor 49 is an optical measurement system, the biological information acquisition sensor 49 is a portion corresponding to the mouth of the pet robot 12. Then, in order to guide the skin of the target user to a position where it comes into contact with the biometric information acquisition sensor 49, the portion of the biometric information acquisition sensor 49 corresponding to the mouth of the robot 12 may be shaken left, right, up and down, or the robot 12 may be shaken. The part of the biometric information acquisition sensor 49 corresponding to the mouth of the robot may be opened and closed. Further, the present invention is not limited to this exemplary embodiment, and information for guiding the position of the user is transmitted to the favorite food supply device 10, and guidance is performed using the display unit 23, the output unit 25, and the like of the favorite food supply device 10. It may be a form or a form in which these forms are combined.

On the other hand, when the biological information acquisition condition is satisfied, the determination in step S216 becomes an affirmative determination, and the process proceeds to step S222. In step S222, the receiving unit 86 makes a response to receive the favorite food. The response to receive the favorite food made by the receiving unit 86 is not particularly limited, and in the present exemplary embodiment, it may be a response indicating that the pet robot 12 is eating the favorite food which is food. For example, the drive unit 44 may be used to perform an operation of eating a favorite food, the output unit 45 may be used to output a voice of eating a favorite food, or the display unit 43, the drive unit 44, or the like may be used to output a voice. , The expression of the pet robot 12 may be changed, or a combination of these forms may be used.

When the pet robot 12 indicates that the pet robot 12 is eating a favorite food, as described above, in the present exemplary embodiment, the amount and type of the favorite food to be supplied are specified. It is preferable to make a response. As the response in this case, for example, the eating speed may be different depending on the amount and type, or the movement itself may be different.

In the next step S224, the receiving unit 86 transmits the received data indicating that the favorite food has been received to the favorite food supply device 10 via the communication I / F 47.

In the next step S226, the biometric information acquisition unit 84 derives biometric information from the biometric information derivation data acquired in step S214. The pet robot 12 may be in a form of performing a predetermined operation (response) according to the derived biological information. For example, when the body temperature is derived as biological information, generally or personally, when the body temperature is higher than the so-called normal temperature, the user may perform an operation indicating that he / she is ill.

In the next step S228, the biometric information acquisition unit 84 determines whether or not it is time to transmit the derived data representing the biometric information (hereinafter referred to as “biological information data”) to the server 14. The timing of transmitting the biometric information data to the server 14 is, for example, each time the biometric information data is derived, a predetermined number of the derived biometric information data is accumulated, or a predetermined period has elapsed. Cases may be mentioned, but the present invention is not particularly limited.

If it is not the timing to transmit the biometric information data to the server 14, the determination in step S228 becomes a negative determination, and the process proceeds to step S230. In step S230, the biometric information acquisition unit 84 stores the derived biometric information data as biometric information data 52 in the storage unit 42, then returns to step S200 and repeats the processes of steps S202 to S228.

On the other hand, in the case of the timing of transmitting the biometric information data to the server 14, the determination in step S228 becomes an affirmative determination, and the process proceeds to step S232. In step S232, the biometric information acquisition unit 84 transmits biometric information data to the server 14 via the network I / F46, then returns to step S200, and repeats the processes of steps S202 to S230. When the biometric information data is transmitted to the server 14, if the biometric information data 52 is stored in the storage unit 42, the biometric information data 52 is transmitted to the server 14 together with the stored biometric information data 52. In this exemplary embodiment, the biometric information data is associated with data representing the date and time when the corresponding biometric information was acquired, and is transmitted to the server 14 in a state of being associated with the data representing the date and time. To.

Next, the provision of the analysis result of the biological information by the server 14 will be described with reference to FIG. When the CPU 60 executes the analysis result providing program 70, the analysis result providing process shown in FIG. 8 is executed. The analysis result providing process shown in FIG. 8 is executed, for example, at the timing when the biometric information data is received from the pet robot 12 via the network I / F66.

In step S300 of FIG. 8, the analysis unit 96 analyzes the biometric information data of the user. The method by which the analysis unit 96 analyzes the biological information data is not particularly limited, and any analysis method may be used as long as it can obtain at least one of information indicating the health condition of the user and information useful for the health management of the user. For example, it may be in the form of analyzing the time-series change of the biological information and analyzing whether the user's physical condition is not sick or there is a date and time when the user is liable to be sick. It should be noted that the method of analyzing the biological information data by the server 14 may be different or the content to be analyzed may be different depending on the amount and type of the favorite food supplied to the pet robot 12 by the user. In other words, what is provided as an analysis result may be different depending on the amount paid (purchased) by the user.

In the next step S302, the providing unit 98 provides the analysis result to a predetermined providing destination, and then ends the analysis result providing process. The predetermined provider is not limited to the user himself / herself, and is not particularly limited. For example, the predetermined destination may be the user's children, parents, or the like. Further, the method of providing the analysis result is not particularly limited, and the analysis result may be sent to a designated destination by mail, courier, or the like, or the data representing the analysis result may be transmitted to the designated destination such as the favorite food supply device 10. It may be in the form of being electronically transmitted by e-mail or the like first, or it may be in the form of being provided by the pet robot 12. Further, a predetermined provision destination may be a doctor or the like, and once the analysis result is provided to the doctor or the like, the analysis result may be verbally provided to the user via the doctor or the like.

As described above, the biometric information acquisition system 1 of the present exemplary embodiment transfers information representing a virtual favorite food supplied to a virtual life form to a pet robot 12 representing a virtual life form according to a user's instruction. The favorite food supply device 10 having the favorite food supply unit 92 to transmit to the user, the recognition unit 82 for recognizing the user, the biological information acquisition unit 84 for acquiring the user's biological information, and the biological information acquisition unit 84 acquired the biological information. When the conditions relating to the user in this case satisfy the predetermined conditions for acquiring biometric information and at least one of the same conditions as when the biometric information was acquired last time, the biometric information acquisition condition is satisfied. A receiving unit 86 for receiving information representing a favorite food transmitted from the vehicle, and a pet robot 12 having the receiving unit 86.

According to the biometric information acquisition system 1 of the present exemplary embodiment, the pet robot 12 receives a favorite food and eats the favorite food when the biometric information acquisition condition, which is an appropriate condition for acquiring the biometric information of the user, is satisfied. As a result, according to the biometric information acquisition system 1 of the present exemplary embodiment, the user who wants the pet robot 12 to eat his / her favorite food naturally becomes in a state of satisfying the biometric information acquisition condition. The biometric information of the user can be acquired. Further, according to the biometric information acquisition system 1 of the present exemplary embodiment, the user will continuously supply the favorite food from the enjoyment of supplying (eating) the favorite food to the pet robot 12, so that the biometric information can be obtained. Continuous acquisition is possible.

Further, the biological information acquisition system 1 of the present exemplary embodiment from another viewpoint transfers information representing a virtual favorite food supplied to the virtual life form to the pet robot 12 representing the virtual life form according to a user's instruction. The favorite food supply device 10 having the favorite food supply unit 92 to transmit to the user, the recognition unit 82 for recognizing the user, the biological information acquisition unit 84 for acquiring the user's biological information, and the biological information acquisition unit 84 acquire the biological information. In this case, the user is guided to a state in which the condition relating to the user satisfies the biometric information acquisition condition, which is at least one of the predetermined biometric information acquisition condition and the same condition as when the biometric information was acquired last time. It includes a guide unit 87 and a pet robot 12 having the guide unit 87.

According to the biometric information acquisition system 1 of this exemplary embodiment, in order to guide a user who supplies (feeds) a pet robot 12 with a favorite food to a state in which the biometric information acquisition condition is satisfied, a state in which the biometric information acquisition condition is satisfied. With, the biometric information of the user can be acquired. Further, according to the biometric information acquisition system 1 of the present exemplary embodiment, the user will continuously supply the favorite food from the enjoyment of supplying (eating) the favorite food to the pet robot 12, so that the biometric information can be obtained. Continuous acquisition is possible.

Therefore, according to the biometric information acquisition system 1 of the present exemplary embodiment, the biometric information of the user can be appropriately and continuously acquired. Further, according to the pet robot 12 of the present exemplary embodiment, the biometric information of the user can be acquired without contact, and the load on the user due to the acquisition of the biometric information can be reduced. It should be noted that the acquisition of biometric information by non-contact is not limited, but it goes without saying that it is preferable to use a form that reduces the load on the user.

Not limited to this exemplary embodiment, the pet robot 12 changes the timing and frequency of acquiring biometric information according to the derived biometric information and the analysis result obtained by the server 14 analyzing the biometric information data. For example, when the user's health condition is not good, the form may be such that the frequency of acquiring biometric information is increased. Further, for example, when the requesting unit 80 of the pet robot 12 requests a favorite food but the state in which the favorite food is not supplied by the target user continues, the timing and frequency of acquiring the biometric information are obtained according to the duration. It may be a form of changing, for example, a form of increasing the timing of acquiring biometric information as the duration becomes longer.

Further, in this exemplary embodiment, the biometric information derivation data acquired by the biometric information acquisition sensor 49 is used for both user recognition (inquiry) and biometric information income, but is used for user recognition. It may be in the form of separately providing an image pickup unit and a sensor for acquiring the data for the purpose.

Further, in the present exemplary embodiment, the pet robot 12 has described the form of directly acquiring the data used for the recognition of the user, but may be the form of indirectly acquiring the data. As a form of indirectly acquiring, for example, the identification information of the user registered in the favorite food supply device 10 may be acquired from the favorite food supply device 10 and the user may be recognized based on the acquired identification information. .. Further, for example, the user may be recognized based on the user data acquired through another device (another pet robot 12) or the like that recognizes the user in the vicinity of the pet robot 12.

Further, in the present exemplary embodiment, the server 14 analyzes the biological information data and provides the analysis result, which is an example of the analysis device of the present disclosure. However, the pet robot 12 and the favorite food supply device are used. 10 may be in the form of having the function of the analysis device.

Further, various processors other than the CPU may execute various processes executed by the CPU executing software (program) in the above exemplary embodiment. As a processor in this case, in order to execute specific processing such as PLD (Programmable Logic Device) whose circuit configuration can be changed after manufacturing FPGA (Field-Programmable Gate Array) and ASIC (Application Specific Integrated Circuit). An example is a dedicated electric circuit or the like, which is a processor having a circuit configuration designed exclusively for the purpose. Further, the above-mentioned various processes may be executed by one of these various processors, or a combination of two or more processors of the same type or different types (for example, a plurality of FPGAs and a combination of a CPU and an FPGA). Etc.). Further, the hardware-like structure of these various processors is, more specifically, an electric circuit in which circuit elements such as semiconductor elements are combined.

Further, in the above exemplary embodiment, the favorite food supply program 30 is stored (installed) in advance in the storage unit 22, the biological information acquisition program 50 is stored in advance in the storage unit 42, and the analysis result providing program 70 is stored in advance. Explained the embodiment stored in the storage unit 62 in advance, but the present invention is not limited thereto. Each of the favorite food supply program 30, the biometric information acquisition program 50, and the analysis result providing program 70 is a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), and a USB (Universal Serial Bus). ) It may be provided in a form recorded on a recording medium such as a memory. Further, each of the favorite food supply program 30, the biological information acquisition program 50, and the analysis result providing program 70 may be downloaded from an external device via a network.

All documents, patent applications and technical standards described herein are to the same extent as if it were specifically and individually stated that the individual documents, patent applications and technical standards are incorporated by reference. Incorporated by reference in the book.

The disclosure of Japanese application Japanese Patent Application No. 2018-0946227 is incorporated herein by reference in its entirety.

Claims (17)

A favorite food supply device having a favorite food supply unit that transmits information representing a virtual favorite food to be supplied to the virtual life form to an electronic device representing the virtual life form according to a user's instruction.
The recognition unit for recognizing the user, the biometric information acquisition unit for acquiring biometric information which is information for analyzing the health state of the user, and the user when the biometric information acquisition unit acquires the biometric information. The condition is transmitted from the favorite food supply device when the predetermined condition for acquiring biometric information and the condition for acquiring biometric information, which is at least one of the same conditions as when the biometric information was acquired last time, are satisfied. The electronic device having a receiving unit for receiving information representing the favorite food, and the electronic device.
A biometric information acquisition system equipped with. The biometric information acquisition system according to claim 1, wherein the receiving unit includes a guiding unit that guides the user to a state in which the biometric information acquisition condition is not satisfied. The biometric information acquisition according to claim 1 or 2, wherein the electronic device further includes a requesting unit for requesting the user to supply the favorite food when it is time to acquire the biometric information of the user. system. The third aspect of the present invention, wherein the requesting unit determines the timing based on at least one piece of information, that is, information that represents a change in the state of the electronic device, information that represents time, and information that represents the current position of the own device. Biometric information acquisition system. The biometric information acquisition system according to any one of claims 1 to 4, wherein the receiving unit responds to the user when the favorite food is received. The biometric information acquisition system according to any one of claims 1 to 5, further comprising an analysis device for analyzing the biometric information acquired by the biometric information acquisition unit. The biometric information acquisition system according to claim 6, wherein the analysis device is possessed by at least one of the favorite food supply device and the electronic device. The favorite food supply device includes a purchasing unit in which the user purchases information representing the favorite food.
The analysis device has a providing unit that provides an analysis result of analyzing the biological information to the user according to a purchase price corresponding to the information representing the favorite food received by the receiving unit.
The biometric information acquisition system according to claim 6 or 7. The biometric information acquisition system according to any one of claims 1 to 8, wherein the favorite food is virtual food. The biometric information acquisition system according to any one of claims 1 to 8, wherein the favorite food is a virtual gold item. A favorite food supply device having a favorite food supply unit that transmits information representing a virtual favorite food to be supplied to the virtual life form to an electronic device representing the virtual life form according to a user's instruction.
The recognition unit that recognizes the user, the biometric information acquisition unit that acquires biometric information that is information for analyzing the health state of the user, and the biometric information acquisition unit that acquires the biometric information, the user. The guidance unit that guides the user to a state in which the conditions relating to the above are a predetermined condition for acquiring biometric information and a state in which the biometric information acquisition condition, which is at least one of the same conditions as when the biometric information was acquired last time, is satisfied. And the electronic device having
A biometric information acquisition system equipped with. A recognition unit that recognizes the user of the favorite food supply device that transmits information representing a virtual favorite to be supplied to the virtual life form to an electronic device representing the virtual life form according to a user's instruction.
A biometric information acquisition unit that acquires biometric information, which is information for analyzing the user's health condition, and
The condition regarding the user when the biometric information acquisition unit acquires the biometric information is at least one of a predetermined condition for acquiring the biometric information and the same condition as when the biometric information was acquired last time. A receiving unit that receives information representing the favorite food transmitted from the favorite food supply device when a certain biological information acquisition condition is satisfied.
Have an electronic device. A recognition unit that recognizes the user of the favorite food supply device that transmits information representing a virtual favorite to be supplied to the virtual life form to an electronic device representing the virtual life form according to a user's instruction.
A biometric information acquisition unit that acquires biometric information, which is information for analyzing the user's health condition, and
When the biometric information acquisition unit acquires the biometric information, the conditions relating to the user are at least one of a predetermined condition for acquiring the biometric information and the same condition as when the biometric information was acquired last time. A guidance unit that guides the user to a state that satisfies the biological information acquisition condition,
Have an electronic device. On the computer
Recognizing the user of the favorite food supply device that transmits information representing a virtual favorite to be supplied to the virtual life form to an electronic device representing the virtual life form in response to a user's instruction.
Obtaining biometric information, which is information for analyzing the health condition of the user,
When the condition regarding the user when the biometric information is acquired satisfies at least one of the condition for acquiring the biometric information and the same condition as when the biometric information was acquired last time, the favorite food supply device transmits the information. Receive information representing the said favorite food
A biometric information acquisition method for executing processing. On the computer
Recognizing the user of the favorite food supply device that transmits information representing a virtual favorite to be supplied to the virtual life form to an electronic device representing the virtual life form in response to a user's instruction.
Obtaining biometric information, which is information for analyzing the health condition of the user,
When acquiring the biometric information, the conditions relating to the user are a predetermined biometric information acquisition condition and a biometric information acquisition condition which is at least one of the same conditions as when the biometric information was acquired last time. Guide the user to a satisfying state,
A biometric information acquisition method for executing processing. On the computer
Recognizing the user of the favorite food supply device that transmits information representing a virtual favorite to be supplied to the virtual life form to an electronic device representing the virtual life form in response to a user's instruction.
Obtaining biometric information, which is information for analyzing the health condition of the user,
The condition regarding the user when the biometric information is acquired is a predetermined biometric information acquisition condition and a biometric information acquisition condition which is at least one of the same conditions as when the biometric information was acquired last time. When satisfied, the information representing the favorite food transmitted from the favorite food supply device is received.
A biometric information acquisition program for executing processing. On the computer
Recognizing the user of the favorite food supply device that transmits information representing a virtual favorite to be supplied to the virtual life form to an electronic device representing the virtual life form in response to a user's instruction.
Obtaining biometric information, which is information for analyzing the health condition of the user,
When acquiring the biometric information, the conditions relating to the user are at least one of a predetermined condition for acquiring the biometric information and the same condition as when the biometric information was acquired last time. Guide the user to a state that satisfies
A biometric information acquisition program for executing processing.

Images