JP7844072B2 - Information processing systems, information processing methods, and computer programs - Google Patents

Description

This invention relates to an information processing system, an information processing method, and a computer program.

Traditionally, when a user wants to know their weight, they typically measure it by stepping onto a scale.

However, when sharing a weighing scale with other users, hygienic management is necessary.

Furthermore, stepping onto a scale is not only physically burdensome for the user, but some people also experience psychological resistance to such an action.

Patent Document 1 discloses a technique for estimating the weight of animals that are difficult to measure with a weighing scale using a non-contact method, but there are still issues with the accuracy of the measurement.

Japanese Patent Publication No. 2016-059300

The purpose of this disclosure is to provide technical improvements that solve or mitigate at least some of the problems of the prior art described above. One of the more specific purposes of this disclosure is to provide an information processing method, a computer program, and an information processing device that can measure the weight of an object to be measured with high accuracy and without contact.

The information processing system in this disclosure is an information processing system comprising one or more computer processors, wherein the information processing system comprises a measuring device including an imaging device, an infrared sensor unit and an ultrasonic sensor unit, and an information processing device connected to the measuring device, wherein one or more computer processors have a receiving unit that receives data acquired by the measuring device and a processing unit that calculates the weight of the object to be measured by processing the data received by the receiving unit, wherein the processing unit calculates the volume of each part of the object to be measured based on the data received by the receiving unit, and calculates the weight of the object to be measured based on the volume of each part, information regarding the configuration of each part and the specific gravity of the elements related to said configuration.

The above processing unit can estimate the composition of the object being measured based on the reflection data from the object acquired by the ultrasonic sensor unit, which is received by the receiving unit.

The above processing unit can generate 3D data of the object to be measured based on the reflection data and/or radiation data from the object, including the object to be measured, which are received by the receiving unit and acquired by the infrared sensor unit.

The above processing unit can generate 3D data of the object to be measured based on image data including the object to be measured, which is received by the receiving unit and acquired by the imaging device.

The above processing unit divides a three-dimensional object having the external shape corresponding to the object to be measured into multiple parts of a predetermined size based on the 3D data of the object to be measured. Based on information regarding the composition of each part and the specific gravity of the elements related to that composition, it calculates the weight of each part and obtains the weight of the object to be measured by summing the weights of all parts.

The above processing unit can further identify the measurement target by analyzing the image data, including the measurement target, that has been received by the receiving unit and acquired by the imaging device.

The above processing unit can further perform background removal from image data by analyzing the image data, including the object to be measured, that has been received by the receiving unit and acquired by the imaging device.

The above infrared sensor unit may include an infrared camera and an infrared sensor composed of an infrared light emitter, an infrared light receiver, and a reflector.

The above ultrasonic sensor unit may comprise a main unit consisting of an ultrasonic light emitter and an ultrasonic light receiver, and a sub-unit consisting of an ultrasonic light receiver and a light reflector.

The ultrasonic sensor unit described above comprises a main unit and two sub-units, and can be arranged such that the horizontal angle of the straight line connecting the main unit and each of the sub-units, and the vertical angle of the straight line connecting the main unit and each of the sub-units, are within predetermined values.

The above measuring device can be used to be positioned either directly in front of the object to be measured or above the object to be measured.

The above-mentioned one or more computer processors further have a storage unit that stores user information of the user to be measured, and the processing unit determines whether the image data of the user's face, which is the user to be measured and acquired by the imaging device and received by the receiving unit, is included in the user information stored in the storage unit. If the determination is made and it is determined that the image data of the user's face is included in the user information, the user can be identified as the user to be measured.

The memory unit also stores information regarding the user's actual weight. The processing unit compares the calculated weight of the measured object (the user's weight) with the user's actual weight stored in the memory unit, and based on the comparison, can determine whether there is a difference of more than a predetermined amount between the user's weight and the user's actual weight.

If the processing unit determines, as a result of the determination, that there is a difference of a predetermined amount or more between the user's weight and the user's actual weight, it can request the measuring device to acquire data again.

The information processing method in this disclosure is an information processing method in an information processing system comprising one or more computer processors, wherein the information processing system comprises a measuring device including an imaging device, an infrared sensor unit and an ultrasonic sensor unit, and an information processing device connected to the measuring device, and is characterized in that it causes one or more computer processors to perform the steps of receiving data acquired by the measuring device, calculating the volume of each part of the object to be measured based on the data, and calculating the weight of the object to be measured based on the volume of each part, information regarding the configuration of each part and the specific gravity of the elements related to the configuration.

The computer program in this disclosure is a computer program executed in an information processing system comprising one or more computer processors, wherein the information processing system comprises a measuring device including an imaging device, an infrared sensor unit and an ultrasonic sensor unit, and an information processing device connected to the measuring device, and one or more computer processors implement a receiving function for receiving data acquired by the measuring device and a processing function for calculating the weight of a target to be measured by processing the data received by the receiving function, wherein the processing function calculates the volume of each part of the target to be measured based on the data received by the receiving function, and calculates the weight of the target to be measured based on the volume of each part, information on the configuration of each part and the specific gravity of the elements related to the configuration.

This disclosure provides technical improvements that solve or mitigate at least some of the problems of the prior art described above. Specifically, it provides an information processing method, a computer program, and an information processing device that can measure the weight of an object to be measured with high accuracy and without contact.

This is a system configuration diagram showing an example of the system configuration of the information processing system described in this disclosure. This diagram shows an example of the hardware configuration of the information processing device described in this disclosure. This diagram shows an example of the functional configuration of the information processing device described in this disclosure. This is a conceptual diagram illustrating an example of the arrangement of the information processing system in this disclosure. This is a conceptual diagram illustrating the measurement algorithm for the weight of the object being measured in this disclosure. This is a conceptual diagram illustrating another example of the information processing system configuration described in this disclosure. This is a conceptual diagram illustrating another example of the information processing system configuration described in this disclosure. This is a conceptual diagram illustrating another example of the information processing system configuration described in this disclosure. This diagram shows another example of the functional configuration of the information processing device described herein. This is a system configuration diagram showing another example of the system configuration of the information processing system in this disclosure. This flowchart shows an example of the user registration flow in this disclosure. This flowchart shows an example of the measurement flow in this disclosure. This is a flowchart illustrating an example of the information processing method described in this disclosure. This is a circuit diagram showing an example of a circuit configuration for realizing the functions of the computer program described in this disclosure. This is a system configuration diagram showing an example of the system configuration of an information processing system in another embodiment of the present disclosure. This is a conceptual diagram illustrating the image of the first information processing device in this disclosure. This diagram shows an example of the functional configuration of the first information processing device in this disclosure. This is a conceptual diagram showing an image of the screen displayed on the display of the first information processing device in this disclosure. This is a system configuration diagram showing an example of the system configuration of an information processing system in another embodiment of the present disclosure. This diagram shows an example of the functional configuration of the third information processing device in this disclosure. This diagram shows another example of the functional configuration of the first information processing device in this disclosure. This flowchart shows an example of the flow of an information processing method in another embodiment of the present disclosure. This is a circuit diagram showing an example of a circuit configuration for realizing the functionality of a computer program in other embodiments of this disclosure. This is a system configuration diagram showing an example of the system configuration of an information processing system in another embodiment of the present disclosure.

Embodiments of the information processing system described herein will be explained with reference to the drawings.

Figure 1 shows an example of the system configuration of the information processing system 1000 in this disclosure.

The information processing system 1000 in this disclosure comprises an information processing device 100 and a measuring device 200, as shown in Figure 1. These information processing device 100 and measuring device 200 can be directly connected by wire or wireless means.

Here, the hardware configuration of the information processing device 100 will be described using Figure 2. The information processing device 100 may include a processor 101, a memory 102, a storage 103, an input/output interface (input/output I/F) 104, and a communication interface (communication I/F) 105. Each component is interconnected via bus B.

The information processing device 100 can realize the functions and methods described in this embodiment through the cooperation of the processor 101, memory 102, storage 103, input/output interface 104, and communication interface 105.

The processor 101 executes functions and/or methods realized by code or instructions contained in a program stored in the storage 103. The processor 101 may include, for example, a central processing unit (CPU), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), a microprocessor, a processor core, a multiprocessor, an ASIC (Application-Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), etc., and may realize each process disclosed in each embodiment by logic circuits (hardware) or dedicated circuits formed on an integrated circuit (IC (Integrated Circuit) chip, LSI (Large Scale Integration)), etc. Furthermore, these circuits may be realized by one or more integrated circuits, and the multiple processes shown in each embodiment may be realized by a single integrated circuit. In addition, LSIs may be referred to as VLSI, Super LSI, Ultra LSI, etc., depending on the degree of integration.

Memory 102 temporarily stores programs loaded from storage 103 and provides a workspace for the processor 101. Various data generated while the processor 101 is executing the program are also temporarily stored in memory 102. Memory 102 includes, for example, RAM (Random Access Memory) and ROM (Read Only Memory).

The storage 103 stores programs. The storage 103 includes, for example, an HDD (Hard Disk Drive), an SSD (Solid State Drive), flash memory, etc.

The communication interface 105 is implemented as hardware such as a network adapter, communication software, or a combination thereof, and transmits and receives various types of data over the network. This communication may be performed via wired or wireless connection, and any communication protocol may be used as long as communication between the two devices is possible. The communication interface 105 communicates with other information processing devices over the network. The communication interface 105 transmits various types of data to other information processing devices according to instructions from the processor 101. Furthermore, the communication interface 105 receives various types of data transmitted from other information processing devices and transmits them to the processor 101.

The input/output interface 104 includes an input device for inputting various operations to the information processing device 100, and an output device for outputting processing results processed by the information processing device 100. The input/output interface 104 may have the input device and output device integrated, or they may be separated into an input device and an output device.

The input device is implemented by any or a combination of any type of device capable of receiving input from the user and transmitting the information related to said input to the processor 101. The input device includes, for example, hardware keys such as touch panels, touch displays, and keyboards, pointing devices such as mice, cameras (image-based operation input), and microphones (voice-based operation input).

The output device outputs the processing results processed by the processor 101. The output device includes, for example, a touch panel, a speaker, etc.

Returning to Figure 1, the measuring device 200 includes an imaging device 210, an infrared sensor unit 220, and an ultrasonic sensor unit 230.

In this disclosure, the one or more computer processors provided in the information processing system 1000 are described as being provided in the information processing device 100, but are not limited to this, and may be provided in cooperation with other devices connected to the information processing device 100.

Furthermore, one or more computer processors in this disclosure include a receiving unit 110 and a processing unit 120, as shown in Figure 3.

The receiving unit 110 receives the data acquired by the measuring device 200.

Furthermore, data acquisition by the measuring device 200 may be triggered when the user enters a predetermined measurement area. For example, the user entering the predetermined measurement area can be determined by image analysis performed by the imaging device 210, which is one of the measuring devices 200. In this case, the measurement by the infrared sensor unit 220 and the ultrasonic sensor unit 230 may be initiated according to the results of the image analysis.

The predetermined measurement area can, for example, be the range that the imaging device 210 can capture.

Alternatively, data acquisition by the measuring device 200 may be performed continuously, while data acquisition by the receiving unit 110 may be triggered when the user enters a predetermined measurement area.

The processing unit 120 calculates the weight of the object to be measured by processing the data received by the receiving unit 110.

The object of measurement is not particularly limited, but in the following examples, the object of measurement is assumed to be a human being, and the weight of the object of measurement is assumed to be the human's body weight. It is preferable that the weight referred to here does not include the weight of the clothing the person is wearing, as will be explained later.

The processing unit 120 calculates the weight of each part of the object to be measured based on the data received by the receiving unit 110.

As an example, the processing unit 120 divides a three-dimensional object having an outline corresponding to the object to be measured into multiple parts (faults) of predetermined sizes based on the 3D (three-dimensional) data of the object to be measured. For each divided part, the weight of each part is obtained by integrating the area of the cross-section. Note that the predetermined size does not have to be irregular.

The processing unit 120 then calculates the weight of the object to be measured based on the volume of each part, information regarding the composition of each part, and the specific gravity of the elements related to that composition.

Information regarding the composition of each body part refers, for example, to the proportion of elements that make up each body part. These elements are what is commonly known as the body's component composition. The human body is said to be mainly composed of skeletal muscle, adipose tissue, bone, and blood, while organs are mainly composed of water, fat, and protein.

Information regarding the composition of the above-mentioned parts may be obtained by using pre-prepared reference data regarding the proportion of elements, or by using data obtained by analyzing data from the measuring device 200.

Furthermore, the weighting of the elements involved in the composition shall be determined using pre-prepared standard data regarding the weighting of elements.

The weight of the object to be measured, calculated by the processing unit 120, may be displayed on a display provided by or connected to the information processing system 1000. It is preferable that the display referred to here be a user terminal 400 (such as a mobile phone or smartphone) held by the user.

The above configuration provides a technical improvement that solves or mitigates at least some of the problems of the conventional technology described above. Specifically, it becomes possible to estimate the weight of the object to be measured with high accuracy without contact.

In particular, the COVID-19 pandemic has heightened people's vigilance regarding contact.

However, conventional weighing scales and similar devices use springs or pressure sensors, requiring users to directly step onto the device for measurement. Therefore, there was a need for a "non-contact" technology to measure weight.

According to the invention disclosed herein, by measuring various data of the object to be measured in a non-contact manner, hygienic management becomes unnecessary.

Furthermore, according to the invention disclosed herein, since there is no need to step onto the measuring device, the physical burden on the user can be reduced.

In addition, by eliminating the need to step onto the measuring device, measurements can be taken discreetly without interfering with daily life.

According to the present invention, by adopting a novel configuration that calculates weight using data acquired by an imaging device, an infrared sensor unit, and an ultrasonic sensor unit, it becomes possible to estimate the weight of the object to be measured with higher accuracy than in conventional methods.

Furthermore, the processing unit 120 can estimate the composition of the object to be measured based on the transmission and/or reflection data from the object to be measured, which is received by the receiving unit 110 and acquired by the ultrasonic sensor unit 230.

The composition estimated by this method may be used as information regarding the composition of the above-mentioned part. For estimating the composition of the object to be measured by the ultrasonic sensor unit 230, known estimation techniques can be used.

This configuration makes it possible to calculate the weight of the object being measured with higher accuracy than when using reference data.

Furthermore, the processing unit 120 can generate 3D data of the object to be measured based on the reflection data and/or radiation data from the object, including the object to be measured, which are received by the receiving unit 110 and acquired by the infrared sensor unit 220.

Here, the infrared sensor unit 220 can be configured to include an infrared camera 221 and an infrared sensor 222, as shown in Figure 4.

The infrared camera 211 is an infrared thermography camera that can detect heat radiated from the object U being measured. The processing unit 120 uses this heat as radiation data.

The infrared sensor 222 consists of an infrared light emitter 223, an infrared light receiver 224, and a reflector 225. Specifically, the infrared sensor 222 emits infrared light from the infrared light emitter 223 toward the object to be measured U, which passes through the object U. The transmitted light, reflected by the reflector 225, is then received by the infrared light receiver 224. The processing unit 120 uses this transmitted light as reflection data.

In this context, the measurement target U refers to a person without clothes (a naked person), while the subject refers to a person wearing clothes. That is, with this configuration, it becomes possible to generate 3D data of only the body, excluding the clothes, even for a person wearing clothes.

As described above, the processing unit 120 divides a three-dimensional object having the shape corresponding to the object to be measured into multiple parts of a predetermined size based on the 3D data of the object to be measured. Based on information regarding the composition of each part and the specific gravity of the elements related to that composition, it calculates the weight of each part and obtains the weight of the object to be measured by summing the weights of all parts.

As an example, as described above, the processing unit 120 divides a three-dimensional object having an external shape corresponding to the object to be measured into multiple parts of a predetermined size based on the 3D data of the object to be measured. Then, for each divided part, as shown in Figure 5, the area of the cross-section of the divided part is calculated, and the volume of each part is obtained by integrating these areas for each part.

Alternatively, the processing unit 120 can generate 3D data of the object to be measured based on the image data including the object to be measured acquired by the imaging device 210, which is received by the receiving unit 110.

In other words, the processing unit 120 can generate 3D data from 2D image data. This configuration may also be realized through an external service, such as automatic generation by AI, which is compatible with the information processing system of the present invention.

Furthermore, the processing unit 120 can identify the measurement target by analyzing the image data, including the measurement target, that has been received by the receiving unit 110 and acquired by the imaging device 210.

The imaging device 210 can, for example, be a visible light camera.

Identifying the measurement target U involves, for example, identifying attribute information such as the gender and age of the user who is the measurement target U. Such attribute information is obtained by analyzing the image data of the user's face and/or body captured by the imaging device 210.

Alternatively, the identification of the measurement target is the identification of a registered user. Such identification can be performed by determining whether the measurement target is a registered user based on the image data of the user's face captured by the imaging device 210. In the case of a registered user, the attribute information is pre-registered based on user input.

The processing unit 120 can further perform background removal from the image data by analyzing the image data, including the object to be measured, that has been received by the receiving unit 110 and acquired by the imaging device 210.

For separating humans from the background in image data, known techniques can be used.

The ultrasonic sensor unit 230 may comprise a main unit 231 and two sub-units 232, as shown in Figure 6.

The main unit 231 consists of an ultrasonic light emitting unit 233 and an ultrasonic light receiving unit 234.

The sub-unit 232 consists of an ultrasonic light receiving unit 235 and a reflecting unit 236.

The main unit 231 and the two slave units 232 can be arranged such that the horizontal angle of the straight line connecting the main unit 231 and each of the slave units 232, and the vertical angle of the straight line connecting the main unit 231 and each of the slave units 232, are within predetermined values.

For example, it is preferable to set the predetermined value to 80°.

Furthermore, the measuring device 200 can be positioned either directly in front of the object to be measured U (Figure 6) or above the object to be measured (Figure 7).

Although Figures 6 and 7 only show the infrared camera 221 and the main unit 231 of the ultrasonic sensor unit 230 as examples of the measuring device 200, it may also include the other components mentioned above.

One or more computer processors in this disclosure may further have a storage unit 130, as shown in Figure 9.

The memory unit 130 stores the user's user information.

At this time, the processing unit 120 determines whether the image data of the user's face, which is the target of measurement and was acquired by the imaging device 210 and received by the receiving unit 110, is included in the user information stored in the storage unit 130.

Then, if the determination results in a finding that the user's facial image data is included in the user information, the processing unit 120 identifies the user as the measurement target U.

The measuring device 200 may be configured to perform measurements only on users who have been certified as the target of measurement U.

Furthermore, for users who are not certified as measurement target U, the measurement device 200 (in this case, the infrared sensor unit 220 and the ultrasonic sensor unit 230) may perform measurements only with the user's permission. For example, a confirmation screen may be displayed on a display connected to the information processing system 1000 in this disclosure, asking whether or not to perform the measurement. Note that the display referred to here may be provided by the information processing system 1000.

Furthermore, the above confirmation screen may be displayed on the user's terminal 400 (such as a mobile phone or smartphone; details will be described later). In this case, information may be transmitted from the information processing device 100 to the user terminal 400 via push notification or the like.

This configuration allows for appropriate handling of situations where an unregistered user enters the measurement area.

The memory unit 130 may also store information regarding the user's actual weight.

At this time, the processing unit 120 compares the user's weight, which is the calculated weight of the object to be measured U, with the user's actual weight stored in the storage unit 130.

Then, based on the comparison, it is determined whether there is a difference of more than a predetermined amount between the user's weight and the user's actual weight.

Then, if the determination shows that there is a difference of a predetermined amount or more between the user's weight and the user's actual weight, the processing unit 120 requests the measuring device 200 to acquire the data again.

Alternatively, the processing unit 120 corrects the user's weight based on the actual weight.

Furthermore, as shown in Figure 10, the information processing device 100 may be connected to the server device 300 via the Internet. In this case, the storage unit 130 may be provided by the server device 300. Also, the calculated user weight can be stored in association with the user information stored in the storage unit 130.

Furthermore, the information processing device 100 may be connected to a user terminal 400. The connection can be made via the Internet, or via Bluetooth®, wireless LAN, or the like.

The information processing device 100 can transmit the calculated weight data to the user terminal 400, and the user terminal 400 can store that data.

Here, we will explain the user registration flow for the information processing system described in this disclosure using Figure 12.

First, the processing unit 120 acquires an image of the user who wishes to register (S11). Such user images may be acquired and registered using both a visible light camera and an infrared camera.

Next, the processing unit 120 registers an image of the identified user's face (S12). The user's face image registered here can be automatically displayed on the aforementioned display during or after the measurement.

Then, the processing unit 120 acquires and registers information regarding the user's name, gender, age, weight, blood type, and height based on the user's operation (S13). The weight registered here will be managed as the actual weight, as described later.

Finally, the processing unit 120 completes the user registration after the user confirms the registration details (S14).

Next, we will explain the weight measurement flow in the information processing system of this disclosure using Figure 12.

First, the processing unit 120 acquires an image of the user (S15). Based on this image, it is determined whether the user is a registered user. Furthermore, this image is used with the user's body and background separated, and the background removed.

Next, the processing unit 120 acquires data from the ultrasonic sensor unit 230 and the infrared sensor unit 220 (S16, S17). The order of these steps is not particularly limited.

Then, the processing unit 120 performs image analysis and processing of the above data (S18). Here, the image captured by the visible light camera and the image projected by the infrared camera are analyzed, and noise reduction processing can be performed.

Next, the processing unit 120 displays the data in a distribution chart (S19).

Then, the processing unit 120 calculates the volume (S21).

If necessary, the processing unit 120 corrects the weight error (S22).

Finally, the calculated weight information is displayed on the display connected to the information processing device 100 (S23).

Furthermore, the calculated weight information may be stored in the server device 300 described above (S24).

Next, embodiments of the information processing method described herein will be explained with reference to the drawings.

The information processing method in this disclosure is an information processing method in an information processing system 1000 comprising one or more computer processors.

The above-described information processing system 1000 comprises a measuring device 200 including an imaging device 210, an infrared sensor unit 220, and an ultrasonic sensor unit 230, and an information processing device 100 connected to the measuring device 200. Details of these devices are as described above.

Furthermore, the information processing method in this disclosure causes one or more computer processors to execute steps S110 to S130 shown in Figure 13.

In step S110, the data acquired by the measuring device 200 is received. This step S110 can be performed by the receiving unit 110 described above. Details of the receiving unit 110 are as described above.

In step S120, the volume of each part to be measured is calculated based on the received data. This step S120 can be performed by the processing unit 120 described above. Details of the processing unit 120 are as described above.

In step S130, the weight of the object to be measured is calculated based on the volume of each part, information regarding the composition of each part, and the specific gravity of the elements related to that composition. This step S130 can be performed by the processing unit 120 described above. Details of the processing unit 120 are as described above.

The above configuration provides a technical improvement that solves or mitigates at least some of the problems of the conventional technology described above. Specifically, it becomes possible to estimate the weight of the object to be measured with high accuracy without contact.

The information processing system described in this disclosure can improve measurement accuracy compared to conventional methods by analyzing and applying data obtained from ultrasonic waves emitted from an ultrasonic sensor, reflected back by a reflector, data from three-dimensional body measurements using an infrared sensor, and gender and age data obtained using a visible light camera.

The system consists of a main sensor and sensors installed at three, two, or one location on the reflective surface. The sensors 3D scan the human body and calculate its area.

It's possible to measure only the body by penetrating clothing, calculate a distribution map, and then make estimations.

• Scanning method: 1) Measure distance using ultrasound. 2) Scan 3D with an infrared sensor. 3) Measure only the body, penetrating clothing. Calculate volume in 3D form. Create a volume distribution map of the body's contours in centimeters to calculate volume with greater accuracy.

• Weight Calculation Method: Since the body is composed of skeletal muscle, adipose tissue, bone, blood, and other organs made up of water, fat, and protein, the volume is calculated, and each component is assumed to be calculated using the specific gravity below.

Since the human body is composed of water, bone, muscle, fat, and protein, its volume is calculated, and the specific gravity of each component is estimated and calculated using the following formulas. The standard range for blood specific gravity in Japanese people is 1.052 to 1.060 for men and 1.049 to 1.056 for women. The calculations can be performed using the following values: bone = approximately 2.0, muscle = 1.06, brain = 1.04, fat = 0.94.

Ultrasonic and infrared sensors can measure body composition by analyzing the difference in transmittance through the human body. This allows for the quantitative determination of bone mass, muscle mass, and fat mass.

• Technical point 1. Basic information input section (age, gender, weight, blood type, height)
2. Algorithm for estimating gender and age using a visible light camera 3. Algorithm for estimating height 4. Algorithm for estimating body structure using an ultrasonic sensor 5. Algorithm for estimating area using 3D scanning 6. Algorithm for calculating weight from area 7. Algorithm for correcting errors 8. Method for displaying weight 9. Wi-Fi® and Bluetooth® communication method 10. Method for providing service using a dedicated app

• Measurement algorithm 1. Outline detection: The 3D measured body is divided into irregular sizes, and a horizontal and vertical image distribution map is created as shown in Figure 5. The curved surface is then integrated and calculated.
2. Estimating each body part: Separate the water, bone, muscle, and fat components to estimate body weight.
3. Noise reduction 4. Weight estimation

3D scanning for measurement: 1. Measures only the body, passing through clothing. 2. Separates body parts from background parts. Represents body volume as a distribution map with irregular sizes, and represents the 3D-measured body as a point distribution map with irregular sizes. Allows for more precise calculation of curved surfaces. 3. Recognizes gender. 4. Performs person recognition and can be automatically acquired.

Next, embodiments of the computer program described herein will be explained with reference to the drawings.

The computer program in this disclosure is a computer program that is executed in an information processing system 1000 comprising one or more computer processors.

The above-described information processing system 1000 comprises a measuring device 200 including an imaging device 210, an infrared sensor unit 220, and an ultrasonic sensor unit 230, and an information processing device 100 connected to the measuring device 200. Details of these devices are as described above.

Then, the receiving and processing functions are implemented in one or more of the above-mentioned computer processors.

The receiving function receives data acquired by the measuring device.

The processing function calculates the weight of the object being measured by processing the received data.

Specifically, the processing function calculates the volume of each part of the object to be measured based on the data received by the receiving function, and then calculates the weight of the object based on the volume of each part, information about the composition of each part, and the specific gravity of the elements related to that composition.

The above-mentioned receiving and processing functions can be realized by the receiving circuit 111 and processing circuit 121 shown in Figure 14. The receiving circuit 111 and processing circuit 121 are realized by the receiving unit 110 and processing unit 120 described above, respectively. Details of each unit are as described above.

The above configuration provides a technical improvement that solves or mitigates at least some of the problems of the conventional technology described above. Specifically, it becomes possible to estimate the weight of the object to be measured with high accuracy without contact.

Other embodiments of the information processing system in this disclosure will be described below. In this embodiment, one or more processors provided by the information processing device 100 may be provided by the first information processing device 1100 described below.

The inventions described below, according to the embodiments, relate to an information processing system and an information processing device equipped with an analysis unit as an AI platform.

Biological information such as blood pressure and body temperature is crucial for detecting abnormalities in health. Traditionally, the main method for obtaining this biological information has been to attach measuring devices to the body and directly acquire the values.

In recent years, the widespread use of non-contact measuring devices and wearable devices has made it easier to acquire biometric information than before.

In the conventional technology described above, biological information acquired by a measuring instrument was processed by an information processing device connected via the Internet.

However, the above configuration has the problem that it cannot be used with devices that cannot connect to the internet or in locations where internet access is unavailable. Furthermore, due to security issues, there is a risk that measurement data of biometric information, which constitutes personal information, and the results of its analysis, may be leaked.

Therefore, the purpose of the disclosure in this embodiment is to provide a technical improvement that solves or mitigates at least some of the problems of the prior art described above. One of the more specific purposes of this disclosure is to provide an information processing system, information processing method, computer program, and information processing device that can analyze a user's health status even in an environment that is not connected to the Internet.

The information processing system of the present invention in this embodiment is characterized by comprising a first information processing device having a storage unit for storing the user's genome information, a biometric information acquisition unit for acquiring the user's biological information, an image acquisition unit for acquiring at least an image of the user's face, an environmental information acquisition unit for acquiring environmental information, a display unit for displaying at least a portion of the biometric information acquired by the biometric information acquisition unit and at least a portion of the environmental information acquired by the environmental information acquisition unit, a first analysis unit for analyzing the user's health status based on the biometric information acquired by the biometric information acquisition unit and the genome information stored in the storage unit, a determination unit for determining whether or not there is an abnormality in the health status analyzed by the first analysis unit as an AI base, and an output unit for outputting the result of the determination by the determination unit.

The above information processing system further includes a biometric information acquisition device connected to the first information processing device, and the biometric information acquisition unit can acquire the user's biometric information acquired by the biometric information acquisition device.

The first information processing device described above is connected to multiple biometric information acquisition devices, each of which is installed in a room used by different users in a residential or shared facility. The biometric information acquisition unit can acquire the user's biometric information acquired by the biometric information acquisition devices, along with the user's identification number.

The above-mentioned biometric information acquisition device can be installed embedded in the walls and/or ceilings of residential or shared facilities.

The above-mentioned biological information acquisition unit and/or biological information acquisition device can acquire biological information at predetermined times or at predetermined time intervals.

The above-mentioned biometric information acquisition unit and/or biometric information acquisition device can acquire the user's respiration, heart rate, and blood pressure in a non-contact manner.

The above-mentioned biometric information acquisition unit and/or biometric information acquisition device may acquire the user's brainwaves by contact or non-contact.

The above-mentioned biological information acquisition unit and/or biological information acquisition device can acquire the user's body surface temperature in a non-contact manner.

The above-mentioned biometric information acquisition unit and/or biometric information acquisition device may acquire the user's blood glucose level by contact or non-contact.

The above-mentioned biological information acquisition unit and/or biological information acquisition device may be capable of acquiring information via short-range communication with a vital sign measurement sensor embedded in a part of the user's body.

The above-mentioned environmental information acquisition unit may acquire at least one of the following: temperature, humidity, atmospheric pressure, and oxygen concentration.

The first analysis unit described above can further analyze the user's facial image acquired by the image information acquisition unit to obtain skin tone information and/or facial expression information, and then analyze the user's health status based on the skin tone information and/or facial expression information, the biological information acquired by the biological information acquisition unit, and the genome information stored in the memory unit.

The first information processing device described above may further include a user identification unit that identifies the user based on an image of the user's face acquired by the image acquisition unit.

The first information processing device described above may further include a communication unit that can communicate with the outside world only under specific conditions.

The above information processing system further comprises a second information processing device that can be connected to the first information processing device by short-range wireless communication, and a third information processing device that can be connected to the second information processing device by an internet line. The third information processing device may have a second analysis unit that analyzes the results of the determination obtained via the second information processing device and determines the appropriate action, and an execution unit that executes the action determined by the second analysis unit.

The above information processing system further includes a third information processing device and a fourth information processing device that can be connected via an internet line, and the action may be the notification of the result output by the output unit to the fourth information processing device.

The above information processing system further includes a third information processing device and a fifth information processing device that can be connected via an internet line, and the action may be defined as the transmission of an operation command to the fifth information processing device.

The third information processing device described above can acquire health checkup data for which access has been permitted in advance, and its action can be to transmit information on lifestyle improvements corresponding to the health checkup data to the second information processing device.

The above information processing system further comprises a second information processing device that can be connected to the first information processing device by short-range wireless communication, and a sixth information processing device that can be connected to the second information processing device by short-range wireless communication. The sixth information processing device is installed on a predetermined means of transport. The sixth information processing device acquires the user's biometric information during transport and transmits the acquired biometric information during transport to the second information processing device. The second information processing device transmits the biometric information during transport to the first information processing device when it is within short-range wireless communication distance of the first information processing device. The first information processing device can then pass the acquired biometric information during transport to the first analysis unit.

The above information processing system further comprises a second information processing device that can be connected to the first information processing device by short-range wireless communication, and a seventh information processing device that can be connected to the second information processing device by short-range wireless communication. The seventh information processing device is equipped with a predetermined means of movement. The seventh information processing device acquires the user's biometric information, transmits the acquired biometric information during movement to the second information processing device, and when the second information processing device is within a distance where short-range wireless communication is possible with the first information processing device, transmits the biometric information during movement to the first information processing device. The first information processing device can then pass the acquired biometric information to the first analysis unit.

The above-mentioned first information processing device can utilize a rechargeable battery, a single-use battery, or new energy sources as its power source.

The information processing method in this embodiment is characterized by causing one or more computer processors to execute: a biometric information acquisition step for acquiring the user's biometric information; an image acquisition step for acquiring at least an image of the user's face; an environmental information acquisition step for acquiring environmental information; a display step for displaying at least a portion of the biometric information acquired in the biometric information acquisition step and at least a portion of the environmental information acquired in the environmental information acquisition step; a first analysis step for analyzing the user's health status based on the biometric information acquired in the biometric information acquisition step and the user's genome information stored in a predetermined storage unit; a determination step for determining whether or not there is an abnormality in the health status analyzed in the first analysis step; and an output step for outputting the result of the determination in the determination step.

The computer program in this embodiment is characterized by implementing on one or more computer processors: a biometric information acquisition function for acquiring the user's biometric information; an image acquisition function for acquiring at least an image of the user's face; an environmental information acquisition function for acquiring environmental information; a display function for displaying at least a portion of the biometric information acquired by the biometric information acquisition function and at least a portion of the environmental information acquired by the environmental information acquisition function; a first analysis function for analyzing the user's health status based on the biometric information acquired by the biometric information acquisition function and the user's genome information stored in a predetermined memory unit; a determination function for determining whether or not there is an abnormality in the health status analyzed by the first analysis function; and an output function for outputting the result of the determination by the determination function.

The information processing device in this embodiment is characterized by comprising: a storage unit for storing the user's genome information; a biometric information acquisition unit for acquiring the user's biological information; an image acquisition unit for acquiring at least an image of the user's face; an environmental information acquisition unit for acquiring environmental information; a display unit for displaying at least a portion of the biometric information acquired by the biometric information acquisition unit and at least a portion of the environmental information acquired by the environmental information acquisition unit; a first analysis unit as an AI platform for analyzing the user's health status based on the biometric information acquired by the biometric information acquisition unit and the genome information stored in the storage unit; a determination unit for determining whether or not there is an abnormality in the health status analyzed by the first analysis unit; and an output unit for outputting the result of the determination by the determination unit.

The invention in this embodiment provides a technical improvement that solves or mitigates at least some of the problems of the prior art described above. Specifically, it provides an information processing system, information processing method, computer program, and information processing device that can analyze a user's health status based on acquired biometric information and output the analysis results, even without being connected to the internet.

An embodiment of the information processing system in this embodiment will be described with reference to the drawings.

Figure 15 shows an example of the system configuration of the information processing system 2000 in this embodiment.

In this embodiment, the information processing system 2000 includes a first information processing device 2100, as shown in Figure 15.

Furthermore, the information processing system 2000 may include a biological information acquisition device 10 that can be connected to the first information processing device 2100, or the functions of the biological information acquisition device 10 may be provided by the first information processing device 2100. Details of the biological information acquisition device 10 will be described later.

The hardware configuration of the first information processing device 2100 can be the same as that of the information processing device 100 described above.

Furthermore, the second information processing device 2200, the third information processing device 2300, the fourth information processing device 2400, the fifth information processing device 2500, the sixth information processing device, and the seventh information processing device, which will be described later, can also have the same hardware configuration as the first information processing device 2100.

Figure 16 shows an image of the external appearance of the first information processing device 2100.

As shown in Figure 16 as an example, the first information processing device 2100 consists of a housing 106 and a display 107 provided on the front of the housing 106. A camera 108 and a speaker 109 may also be provided on the front of the housing 106. Furthermore, the first information processing device 2100 may include various sensors, a rechargeable battery, a power cable connection, a SIM card insertion slot, an SD card memory insertion slot, a USB insertion slot, etc. (not shown).

The first information processing device 2100, as shown as an example in Figure 17, includes a storage unit 2110, a biological information acquisition unit 2120, an image acquisition unit 2130, an environmental information acquisition unit 2140, a display unit 2150, a first analysis unit 2160, a determination unit 2170, and an output unit 2180.

The memory unit 2110 stores the user's genome information.

The memory unit 2110 may be the storage 103 of the first information processing device 2100, or it may be a recording medium (USB memory, SD card, etc.) that can be removed from the first information processing device 2100.

Genomic information includes, for example, data showing the genetic predisposition to a user's diseases and physical characteristics, obtained by analyzing saliva or blood samples taken from the user.

Furthermore, the memory unit 2110 may include basic information such as the user's address, name, and age; medical history information including a history of illnesses the user has suffered in the past; performance information including the user's daily respiratory rate and heart rate; abnormality history information regarding abnormalities in the user's health condition; and contact information including a list of caregivers who will notify the user of their condition.

Initially, the performance information registers daily respiratory rate and heart rate values included in the user's application. However, after the first information processing device 2100 is put into use, the measured normal data is saved chronologically so that changes over time can be retrieved.

The biometric information acquisition unit 2120 acquires the user's biometric information.

The user's biometric information includes, for example, at least one of the following: blood pressure, pulse, respiration, consciousness, body temperature, and blood oxygen saturation. Of these, blood pressure, pulse, and respiration are important parameters for analyzing the user's health status.

Furthermore, the biometric information acquisition unit 2120 can be configured to acquire the above-mentioned biometric information from the user in a non-contact manner.

As an example, the biometric information acquisition unit 2120 has a transmitting unit that emits microwaves and a receiving unit that receives microwaves reflected by the user. The user's movement can be detected by the phase difference created by the Doppler effect between the emitted microwaves and the received microwaves.

This technology allows for the detection of unconscious biological activities such as breathing and heartbeat, based on subtle movements on the body surface associated with respiration and heartbeat. Furthermore, it can also estimate blood pressure fluctuations.

The biological information acquisition unit 2120 may further include a processing unit that detects the time change in the phase difference associated with the transmission and reception of microwaves and extracts frequency components from the time change to determine respiratory rate and heart rate.

Furthermore, the microwaves are emitted from the transmitter at an irradiation angle of approximately 180°, and biological information can be detected within a distance range of approximately 10m from the transmitter.

The image acquisition unit 2130 acquires at least an image of the user's face.

The image acquisition unit 2130 acquires an image of the location where the first information processing device 2100 is installed. The image acquisition unit 2130 acquires the image using the camera 108 described above. The image may be a still image or a video. The image acquisition unit 2130 can be the receiving unit 110 described above.

To avoid privacy issues, the image acquisition unit 2130 is locked in the control program so that it does not operate under normal circumstances. It can also be controlled so that the lock is released and image acquisition becomes possible when an abnormality above a predetermined level is detected.

Furthermore, the system could be configured to activate camera 108 when a user shouts.

The environmental information acquisition unit 2140 acquires environmental information.

The environmental information acquisition unit 2140 acquires environmental information of the space in which the first information processing device 2100 is installed. Here, environmental information refers to information related to the living space, such as room temperature and humidity.

In one embodiment, the environmental information acquisition unit 2140 includes a temperature sensor and a humidity sensor. In other embodiments, it may include a smoke sensor or a gas leak detection sensor. The temperature sensor may use a thermistor, a resistance thermometer, or any other type. The humidity sensor may use polymer resistance, polymer capacitance, or any other type, but an electrical sensor that can output an electrical signal is used.

While temperature and humidity sensors can continuously measure room temperature and humidity, these environmental indicators generally do not change rapidly in a short period of time. Therefore, a configuration that intermittently acquires environmental information at predetermined time intervals is also acceptable.

Furthermore, the system may be equipped with a radio wave receiving sensor that receives standard radio waves carrying time and calendar information, and a barometric pressure sensor. These allow for the acquisition of environmental information such as time and weather.

The display unit 2150 displays at least a portion of the biological information acquired by the biological information acquisition unit 2120, and at least a portion of the environmental information acquired by the environmental information acquisition unit 2140. The display unit 2150 can be the display described above.

Figure 18 shows an example of a display screen 151 that the display unit 2150 displays on the display 107, and the screen is provided with a biometric information display area 152 and an environmental information display area 153.

The biometric information display area 152 displays numerical values and graphs of respiration, heart rate, and blood pressure, as shown in Figure 18, but is not limited to these.

The environmental information display area 153 displays the time and weather, as shown in Figure 18, but is not limited to these.

The first analysis unit 2160 analyzes the user's health status based on the biological information acquired by the biological information acquisition unit 2120 and the genomic information stored in the storage unit 2110. In other words, the first analysis unit 2160, acting as an AI platform, uses AI to analyze the user's health status.

The first analysis unit 2160 has learning data of factors highly correlated with the onset of specific diseases, and analyzes whether pre-onset tendencies for diseases that the user is genetically likely to develop can be seen in the user's biological information.

The determination unit 2170 determines whether or not there is an abnormality in the health condition analyzed by the first analysis unit 2160.

Specifically, the determination unit 2170 first determines whether or not there is a first abnormality in the health condition. A first abnormality refers to a case where the numerical value of the biological information exceeds a predetermined threshold, regardless of the genomic information. Specifically, a first abnormality refers to a level where the numerical value of the biological information requires immediate medical attention.

Next, the determination unit 2170 determines whether or not there is a second abnormality in the health condition. A second abnormality refers to a case where, although the numerical values of the biological information are below a predetermined threshold, the genomic information shows a pre-symptomatic tendency for a disease that the user is genetically likely to develop. Specifically, a second abnormality refers to a level where, although the numerical values of the biological information do not require immediate medical attention, the genomic information shows a pre-symptomatic tendency for a disease that the user is genetically likely to develop.

The criteria used for these determinations are pre-stored in the memory unit 2110.

If no abnormality is detected, the acquired biological information is determined to be the normal data described above and stored in the storage unit 2110. Because the storage unit 2110 has limited capacity, the normal data may be stored by converting spot data at regular time intervals into numerical values to show the passage of time, or it may be stored as numerical data obtained by averaging interval data at regular time intervals. Furthermore, data that has been in storage for a certain period of time may be overwritten with the latest data, so that only the most recent data for a certain period is always stored, thereby suppressing an increase in storage capacity.

The determination unit 2170 may rank the abnormality based on the results of the above determination. For example, in one embodiment, the abnormality is ranked into three levels: normal level, level that does not require immediate attention but requires confirmation (second abnormality), and emergency level that requires immediate action (first abnormality).

The output unit 2180 outputs the result of the determination made by the determination unit 2170.

Specifically, if the determination unit 2170 determines that there is a first type of abnormality in the health condition, the output unit 2180 can output a predetermined warning sound and/or warning display from the first information processing device 2100.

The predetermined warning sound will be output from the speaker 109 of the first information processing device 2100, and the predetermined warning display will be displayed on the display 107 of the first information processing device 2100.

Furthermore, if the determination unit 2170 determines that there is a first abnormality in the health condition, the output unit 2180 may output a warning sound and/or a warning display from the first information processing device 2100 to other devices, and may also be configured to enable emergency calls. Details will be described later.

Other devices may include information processing devices owned by the user's family, information processing devices owned by caregivers, and information processing devices owned by hospitals, fire departments, police, security companies, etc. Further details will be provided later.

Furthermore, if the determination unit 2170 determines that there is a second abnormality in the health condition, the output unit 2180 can output a predetermined notification sound or notification display from the first information processing device 2100.

The predetermined notification sound will be output from the speaker 109 of the first information processing device 2100, and the predetermined notification display will be displayed on the display 107 of the first information processing device 2100.

Furthermore, the output unit 2180 may display an icon on the display 107 corresponding to the rank determined by the determination unit 2170. It is preferable to change the shape and color of the icon so that the urgency can be judged at a glance. For example, a normal level could be displayed with a green icon, a level that does not require immediate attention but needs confirmation with a yellow icon, and an emergency level requiring immediate action with a red icon, allowing the user to intuitively grasp the situation.

Furthermore, the ranking by the judgment unit 2170 may be performed on both biological information and environmental information, and the rankings may be displayed on the display 107 using icons. This allows users to easily determine what kind of abnormality is occurring.

The above configuration provides a technical improvement that solves or mitigates at least some of the problems of the conventional technology described above. Specifically, since the first information processing device 2100 itself holds the user's genome information and has the function of AI-analyzing the information, it is possible to analyze the user's health status and output the analysis results even in an environment that is not connected to the internet (even if it operates standalone without a network).

Next, other embodiments of the information processing system 2000 in this disclosure will be described.

As shown in Figure 19, the information processing system 2000 in this disclosure may further include a second information processing device 2200 and a third information processing device 2300.

The second information processing device 2200 is capable of connecting to the first information processing device 2100 via short-range wireless communication.

The second information processing device 2200 can be, for example, a smartphone or tablet PC, and can be a device capable of communicating with the outside world using various communication standards. The hardware configuration of the second information processing device 2200 is as described above.

Furthermore, the first information processing device 2100 and the second information processing device 2200 can be connected using short-range wireless communication such as BLE (registered trademark).

The third information processing device 2300 is designed to be connectable to the second information processing device 2200 via an internet connection.

The third information processing device 2300 can be, for example, a server or other device capable of communicating with the outside world. The hardware configuration of the third information processing device 2300 is as described above.

Furthermore, the second information processing device 2200 and the third information processing device 2300 can be connected via an internet connection.

Furthermore, the third information processing device 2300 has a second analysis unit 2310 and an execution unit 2320, as shown in Figure 20.

The second analysis unit 2310 analyzes the judgment result obtained from the first information processing device 2100 via the second information processing device 2200 and determines the appropriate action to take.

Depending on whether the judgment includes information indicating a primary health abnormality, information indicating a secondary health abnormality, or information indicating no abnormalities at all, the second analysis unit 2310 may determine different results for the actions it should take.

The execution unit 2320 performs actions based on the analysis results from the second analysis unit 2310.

With the above configuration, the first analysis unit 2160 analyzes information in the Close space for InHouse use, while the second analysis unit 2310 can perform actions necessary to maintain or improve the user's health by coordinating with other devices connected via the Internet.

Next, we will explain specific examples of actions.

As shown in Figure 19, the information processing system 2000 in this disclosure may further include a fourth information processing device 2400.

The fourth information processing device 2400 is a device that can be connected to the third information processing device 2300 via an internet connection.

The fourth information processing device 2400 refers to information processing devices owned by the user's family, information processing devices owned by the user's caregiver, and information processing devices owned by the user's regular hospital, nearby fire department, police, security company, etc.

In this case, the above action is to notify the fourth information processing device 2400 of the result output by the output unit 2180.

Specifically, the second analysis unit 2310 determines an action to output a warning sound and/or a warning display to the fourth information processing device 2400 if the information contains information indicating a first type of abnormality in the health condition.

Furthermore, as shown in Figure 19, the information processing system 1000 in this disclosure may further include a fifth information processing device 2500.

The fifth information processing device 2500 is capable of connecting to the third information processing device 2300 via an internet connection.

Specifically, the fifth information processing device 2500 can be an IoT device located around the user. Examples include internet-connected air conditioners, automatic windows, electronic locks, humidifiers, dehumidifiers, electric devices, aroma diffusers, speakers, and refrigerators.

At this time, the above action is the transmission of an operation command to the fifth information processing device 2500.

Examples of operation commands include turning the air conditioner on/off and adjusting the temperature.

Furthermore, the third information processing device 2300 may control the fifth information processing device 2500 in accordance with the biological information, environmental information, and/or image information obtained from the first information processing device 2100 by the second information processing device 2200.

Specifically, the AI analysis of the second analysis unit 2310 can determine skin tone and facial expression to provide an optimal space, coordinate with lighting color and relaxing scents, and provide music in conjunction with speakers. Furthermore, it can maintain comfort by operating the air conditioner in conjunction with the AI based on temperature and humidity, check indoor oxygen concentration, and provide notifications and automatically open/close windows with ventilation motors in conjunction with the AI. It may also have functions to notify pre-registered email addresses when the temperature exceeds a certain level, to notify the disaster prevention center or management office, and to automatically unlock doors in conjunction with door locks. It may also be possible to provide guidance on dietary restrictions and recipes in conjunction with an IoT refrigerator.

Furthermore, if the necessary equipment is not IoT-enabled, the system may send advice to the second information processing device 2200 suggesting that it would be better to operate a nearby device.

Furthermore, the above action can be used to transmit information on improving lifestyle habits to the second information processing device 2200.

At this time, the third information processing device 2300 can acquire pre-approved health checkup data. Lifestyle improvement information is then generated according to the health checkup data.

Lifestyle improvement information specifically includes advice on diet, and users can send recommended recipes, etc.

Furthermore, as shown in Figures 15 and 19, the information processing system 2000 may also include a biological information acquisition device 10 connected to the first information processing device 2100.

The biological information acquisition device 10 is a separate device that controls the functions of the biological information acquisition unit 2120.

At this time, the biometric information acquisition unit 2120 acquires the user's biometric information acquired by the biometric information acquisition device 10.

By separating the biometric information acquisition device 10 from the first information processing device 2100, the biometric information acquisition device 10 can be used in a variety of ways, such as embedding the sensor in the wall of a building, decorating the wall, or attaching it to the back of wallpaper to automatically acquire vital information.

This configuration can be adopted in facilities with multiple users, such as nursing homes.

With this configuration, body temperature, blood pressure, pulse, and respiration can be automatically monitored in real time, eliminating the need for frequent measurements by nurses or administrators.

When a user resides in a nursing home, their primary living space is often a single private room, and the first information processing device 2100 can be installed in one location for monitoring. However, when a user lives in an individual residence such as an apartment or detached house, their living space is often divided into multiple rooms such as a living room and bedroom, requiring the acquisition of biometric information in each room.

Therefore, in another embodiment of this disclosure, the information processing system 2000 may include one master unit (first information processing device 2100) and multiple slave units (biometric information acquisition devices 10).

The configuration of the master unit is the same as that of the first information processing device 2100 described above. However, the biological information acquisition unit 2120 of the first information processing device 2100 manages not only the biological information acquired by the first information processing device 2100's own biological information acquisition unit 2120 and the environmental information acquired by the environmental information acquisition unit 2140, but also the biological information and environmental information transmitted from the biological information acquisition device 10, and determines whether or not there is an abnormality according to the pre-set abnormality judgment criteria.

If there are multiple biometric information acquisition devices 10, there is a risk that it will be impossible to identify which device the transmitted biometric and environmental information originates from. Therefore, each device is assigned a unique ID number, and when biometric and environmental information is transmitted, it is transmitted in association with the unique ID number.

The biometric information acquisition device 10 comprises at least a biometric information acquisition unit and a communication unit. Since information is transmitted from the slave unit to the master unit using short-range wireless communication, the slave unit can be placed in any location within the wireless range. If wired terminals are installed in each room of the house, a wired connection may also be used.

Furthermore, the sub-unit does not include elements equivalent to an analysis unit. This is because the analysis is performed by the main unit, which allows for miniaturization of the sub-unit. In addition, for sub-units installed in places where privacy is particularly important, such as toilets and bathrooms, the image acquisition unit may be omitted. Thus, sub-units with different configurations may be mixed depending on the installation location. The mounting location and shape may also be changed to suit the installation location. For example, a sub-unit installed in the bedroom of a user who spends a lot of time lying in bed may be installed under the bed to acquire biometric information with high accuracy. Sub-units can also be installed by embedding them in walls or ceilings. With these configurations, installation can be carried out without making the user unnecessarily aware that biometric information is being acquired, and without compromising the aesthetics of the installation location.

The biometric information acquisition unit 2120 and/or biometric information acquisition device 10 can acquire the user's respiration, heart rate, and blood pressure in a non-contact manner.

These can be obtained non-contactually by transmitting and receiving microwaves as described above.

Furthermore, the biometric information acquisition unit 2120 and/or biometric information acquisition device 10 can acquire the user's brainwaves by contact or non-contact.

Brainwaves can be obtained using publicly known brainwave sensors. Furthermore, non-contact brainwave measurement techniques can be realized using publicly known or future technologies.

Furthermore, the biological information acquisition unit 2120 and/or the biological information acquisition device 10 can acquire the user's body surface temperature in a non-contact manner.

Body surface temperature can be obtained using a known thermosensor. For example, the infrared camera mentioned above can be used.

Furthermore, the biometric information acquisition unit 2120 and/or biometric information acquisition device 10 can acquire the user's blood glucose level by contact or non-contact.

Blood glucose levels can be obtained using publicly known blood glucose sensors. Furthermore, non-contact blood glucose measurement techniques can be realized using publicly known or future technologies.

The biological information acquisition unit 2120 and/or the biological information acquisition device 10 can be configured to acquire information via short-range communication with a vital sign measurement sensor embedded in a part of the user's body.

Furthermore, the environmental information acquisition unit 2140 can acquire at least one of the temperature, humidity, atmospheric pressure, and oxygen concentration of the location where the first information processing device 2100 is located.

These can be obtained by the temperature sensor, humidity sensor, pressure sensor, and oxygen concentration sensor provided in the first information processing device 2100.

Furthermore, the values obtained from the barometric pressure sensor can be used to display weather forecasts.

Furthermore, the environmental information acquisition unit 2140 may also acquire the time. In this case, the time can be acquired by the radio wave receiving sensor provided in the first information processing device 2100. The time set in the first information processing device 2100 may also be used.

These may all be displayed on display 107, or only those that have been configured may be displayed. This configuration may be made possible by the user.

With the above configuration, it is possible to create a comfortable space that helps maintain or improve the health of users.

Furthermore, the environmental information acquisition unit 2140 may acquire values from fire sensors and sound sensors. These sensors may be provided by the first information processing device 2100, or they may be obtained from other connectable devices.

The first analysis unit 2160 can further analyze the user's facial image to acquire skin tone information and/or facial expression information, and analyze the user's health status based on the skin tone information and/or facial expression information, the biological information acquired by the biological information acquisition unit, and the genome information stored in the memory unit.

Facial color and facial expression information are important diagnostic tools, alongside biological information, and when combined with genome analysis data, they can enable the early detection of certain diseases.

Furthermore, since facial color and expression information can be used as indicators to measure the level of comfort in the environment, the fifth information processing device 500 can be operated based on this information.

For example, by coordinating lighting color, relaxing scents, and providing music in conjunction with speakers, an optimal space (environment) can be created.

As shown in Figure 21, the first information processing device 2100 may further include a user identification unit 2190.

The user identification unit 2190 identifies the user based on the image acquired by the image acquisition unit 2130.

As explained earlier, the images acquired by the image acquisition unit 2130 are used to analyze the user's facial expressions and complexion. Here, however, they can be used to implement a facial recognition function for identifying the user.

Regarding facial recognition technology, publicly available technologies can be used.

With the above configuration, it becomes possible to enable use by multiple users.

Furthermore, the first information processing device 2100 in this disclosure may further include a communication unit 195, as shown in Figure 21.

The communication unit 2195 enables the first information processing device 2100 to communicate with an external device only under specific conditions.

A specific condition, for example, refers to the case in which the determination unit 2170 determines that there is a first abnormality in the health condition.

To enable the above-mentioned communication by the communication unit 2195, the first information processing device 2100 may be equipped with a wired LAN connection terminal and/or a wireless LAN card. Furthermore, to enable communication even when an internet connection environment is not available, it may also be equipped with a SIM card insertion terminal. By inserting a SIM card, it becomes possible to communicate with external devices via the mobile phone's wireless communication network.

Specifically, the first information processing device 2100 will be able to communicate directly with the fourth information processing device 2400 without going through the second information processing device 2200 and/or the third information processing device 2300.

With the above configuration, it becomes possible to respond quickly in emergencies.

Next, embodiments of the information processing method described herein will be explained with reference to the drawings.

As shown in Figure 22 as an example, the information processing method in this disclosure is characterized by causing one or more computer processors to execute a biological information acquisition step S2120, an image acquisition step S2130, an environmental information acquisition step S2140, a display step S2150, a first analysis step S2160, a determination step S2170, and an output step S2180.

In the biometric information acquisition step S2120, the user's biometric information is acquired. This biometric information acquisition step S2120 can be performed by the biometric information acquisition unit 2120 described above. Details of the biometric information acquisition unit 2120 are as described above.

In the image acquisition step S2130, an image of at least the user's face is acquired. This image acquisition step S2130 can be performed by the image acquisition unit 2130 described above. Details of the image acquisition unit 2130 are as described above.

In the environmental information acquisition step S2140, environmental information is acquired. This environmental information acquisition step S2140 can be performed by the environmental information acquisition unit 2140 described above. Details of the environmental information acquisition unit 2140 are as described above.

In the display step S2150, at least a portion of the biological information acquired in the biological information acquisition step S2120 and at least a portion of the environmental information acquired in the environmental information acquisition step S2140 are displayed. This display step S2150 can be performed by the display unit 2150 described above. Details of the display unit 2150 are as described above.

In the first analysis step S2160, the user's health status is analyzed based on the biological information acquired in the biological information acquisition step S2120 and the user's genome information stored in a predetermined storage unit. This first analysis step S2160 can be performed by the first analysis unit 2160 described above. Details of the first analysis unit 2160 are as described above.

In the determination step S2170, it is determined whether or not there is an abnormality in the health condition analyzed in the first analysis step S2160. This determination step S2170 can be performed by the determination unit 2170 described above. Details of the determination unit 2170 are as described above.

In the output step S2180, the result of the determination in the determination step S2170 is output. This output step S2180 can be performed by the output unit 2180 described above. Details of the output unit 2180 are as described above.

The above configuration provides a technical improvement that solves or mitigates at least some of the problems of the conventional technology described above. Specifically, since the first information processing device itself holds the user's genome information and has the function of AI-analyzing the information, it becomes possible to analyze the user's health status and output the analysis results even in an environment that is not connected to the internet.

Next, embodiments of the computer program described herein will be explained with reference to the drawings.

The computer program in this disclosure is characterized by enabling one or more computer processors to implement a biological information acquisition function, an image acquisition function, an environmental information acquisition function, a display function, a first analysis function, a judgment function, and an output function.

The biometric information acquisition function acquires the user's biometric information.

The image acquisition function acquires at least an image of the user's face.

The environmental information acquisition function acquires environmental information.

The display function displays at least a portion of the biometric information acquired by the biometric information acquisition function, and at least a portion of the environmental information acquired by the environmental information acquisition function.

The first analysis function analyzes the user's health status based on biometric information acquired by the biometric information acquisition function and the user's genome information stored in a designated memory unit.

The judgment function determines whether or not there is an abnormality in the health condition analyzed by the first analysis function.

The output function outputs the result of the judgment made by the judgment function.

The above-mentioned biological information acquisition function, image acquisition function, environmental information acquisition function, display function, first analysis function, judgment function, and output function can be realized by the biological information acquisition circuit 2121, image acquisition circuit 2131, environmental information acquisition circuit 2141, display circuit 2151, first analysis circuit 2161, judgment circuit 2171, and output circuit 2181 shown in Figure 23. The biological information acquisition circuit 2121, image acquisition circuit 2131, environmental information acquisition circuit 2141, display circuit 2151, first analysis circuit 2161, judgment circuit 2171, and output circuit 2181 are realized by the biological information acquisition unit 2120, image acquisition unit 2130, environmental information acquisition unit 2140, display unit 2150, first analysis unit 2160, judgment unit 2170, and output unit 2180, respectively. Details of each unit are as described above.

The above configuration provides a technical improvement that solves or mitigates at least some of the problems of the conventional technology described above. Specifically, since the first information processing device itself has the function of storing the user's genome information and performing AI analysis on the acquired information, it becomes possible to analyze the user's health status and output the analysis results even in an environment without an internet connection.

Finally, we will explain the circumstances that led the inventors to create this invention.

As the aging rate of society rapidly increases, medical benefit expenditures due to the expansion of social security spending are expected to reach approximately 54 trillion yen in fiscal year 2025, up from the current approximately 36 trillion yen. Per capita medical expenses increase with age, except for infancy, but increase rapidly after age 65, and after age 80, the proportion of expenses related to hospitalization (hospitalization + meals and living expenses) becomes high. Currently, more than one-third of medical treatment expenses (fiscal year 2013) are related to lifestyle-related diseases, and diseases associated with aging and mental and neurological disorders account for a large proportion.

Amidst the economic and employment uncertainty caused by the spread of the novel coronavirus, which has led to restrictions on contact with others and self-isolation due to health concerns, working styles are changing. In this context, awareness of health is higher than ever before, particularly regarding health management through remote work and caregiving due to an aging population.

This invention was created with the aim of providing a service that contributes to improved lifestyles and a comfortable living environment by utilizing personal genome data as a contactless healthcare service, enabling prediction of bodily abnormalities and health management services, through the use of such a standalone device that does not rely on a network.

Currently, home-use electronic blood pressure monitors are broadly divided into two main types: "upper arm type," which measures blood pressure on the upper arm, and "wrist type," which measures blood pressure on the wrist. Furthermore, "upper arm type" monitors can be divided into two types: those where the user wraps a cuff (armband) around their upper arm themselves, and those where the user inserts their arm through a cylindrical cuff integrated with the blood pressure monitor body.

Healthcare devices include wristwatches, finger-worn devices, and devices that connect to smartphones, etc. People with pre-existing conditions related to blood pressure, such as hypertension and diabetes, need to measure their blood pressure and have blood tests done daily or regularly.

With contact-type sensors, data is often not collected due to the stress of wearing them, forgetting to wear them, and other natural human habits. By using a non-contact design, vital data can be acquired simply by being present, without wearing anything. This non-contact vital sensor can contribute to human health without interfering with daily life.

Furthermore, by inputting genomic information, we aim to provide effective personalized services tailored to each individual. Additionally, it can be operated as a standalone device anywhere, without needing an internet connection. If realized, it possesses the elements to be recognized as a business that contributes to society.

Furthermore, using the individual's genomic data, vital data, complexion and facial expressions, and brainwave information, a standalone AI and a dedicated app can work in conjunction with AI services to provide an optimal living environment, enabling early detection and notification of symptoms, monitoring of lifestyle habits, and guidance for improvement.

Examples of non-contact vital signs sensors include the following:
• Respiration, heart rate, blood pressure (estimated)
• Face recognition sensor: Identifies individuals through face recognition; estimates state based on skin tone and facial expression; thermosensor (body surface temperature)
• Electroencephalogram (EEG) measurement (connected or non-contact)
• Diabetes test sensor

In one embodiment of this disclosure, a server device, data processing system, data processing method, and program are provided that acquire a person's health status and inform a dedicated display device of ways to improve lifestyle and environment, using a device programmed with AI that analyzes the person's genome analysis data acquired in advance, facial expressions and behavioral patterns (movements), a device that acquires non-contact vital information (heart rate, respiration, blood pressure, body temperature, etc.) using microwaves, a device that can measure brain waves, a device that measures temperature using infrared rays, a device that measures oxygen concentration, and a device that displays the weather forecast and time.

The invention disclosed herein detects early signs of illness in users. However, network connectivity for disease prediction presents security challenges such as data leakage, making it unusable in locations without network connectivity. Furthermore, it is not useful for lifestyle improvement, as it does not predict illness.

For example, AI can optimize health conditions by performing automatic ventilation control, automatic lighting control, fragrance control, and door control based on a comprehensive assessment, thereby enabling improvements in lifestyle habits.

The invention described herein involves loading genome analysis data, which has been previously confirmed by the user, into a standalone device via a dedicated application.

If someone collapses at home, vital signs such as heart rate and respiration can be measured to understand changes in their body. However, due to the accuracy of the sensors, there is a possibility of malfunctions. Therefore, if the AI's behavioral patterns (movements) are not natural, the AI equipped with vital data will make a comprehensive judgment and send an alert.

According to this invention, the AI can analyze accumulated data and pre-control a comfortable environment. For example, by using the AI's judgment to perform automatic ventilation control, automatic lighting control, fragrance control, door control, etc., health conditions can be optimized.

Furthermore, the information processing system disclosed herein can be controlled in conjunction with a smart home in residential or shared facilities.

Furthermore, in another embodiment, the information processing system of the present disclosure may further include a second information processing device that can be connected to the first information processing device by short-range wireless communication, and a sixth information processing device that can be connected to the second information processing device by short-range wireless communication.

The sixth information processing device shall be installed on a designated means of transportation. Specifically, the designated means of transportation may be a vehicle such as a bus or an airplane.

In this configuration, the sixth information processing device acquires the user's biometric information during movement, transmits the acquired biometric information during movement to the second information processing device, the second information processing device transmits the biometric information during movement to the first information processing device when it is within range of short-range wireless communication with the first information processing device, and the first information processing device passes the acquired biometric information during movement to the first analysis unit.

With this configuration, passengers or other crew members in limited spaces on modes of transport such as buses and airplanes can perform health checks by scanning a dedicated identification number on their smartphone with a dedicated app.

Furthermore, in another embodiment, the information processing system may further include a second information processing device that can be connected to the first information processing device by short-range wireless communication, and a seventh information processing device that can be connected to the second information processing device by short-range wireless communication.

The seventh information processing device shall be equipped with a predetermined means of transportation. Specifically, the seventh information processing device may be a mobile robot.

In this configuration, the seventh information processing device acquires the user's biometric information, transmits the acquired biometric information during movement to the second information processing device, the second information processing device transmits the biometric information during movement to the first information processing device when it is within range of short-range wireless communication with the first information processing device, and the first information processing device passes the acquired biometric information to the first analysis unit.

This configuration allows the robot to monitor the user's health status while moving around a specific location.

The notification method may include a standalone device for notification, a function to notify a third party via a dedicated app on the user's smartphone that connects to an external AI, and a function to view the history of acquired data.

Furthermore, the display screen can be made more convenient by showing weather information and the time, which are among the first things people want to know when they wake up each day.

Furthermore, by linking with sensors that measure oxygen and PM (particulate matter) concentrations, the surrounding environment can be made more comfortable.

The information processing system 1000 in this disclosure may be equipped with a rechargeable battery, a single-use battery, or a new energy source (solar power, wind power, etc.) and capable of taking measurements anywhere.

The information processing system 1000 in this disclosure may be configured to acquire vital data in residential facilities or shared facilities in conjunction with a slave unit.

The information processing system 1000 in this disclosure may be embedded in the wall or ceiling of a residential facility or other facility, linked to each person's ID that has been registered in advance, and may be used to obtain the data of the person in question in advance, and to check and notify them of their condition.

The information processing system 1000 in this disclosure may be equipped with a function that allows a physician to view data remotely, and may also be used to shorten the time when a physician performs remote medical consultation using a camera.

In the information processing system 1000 of this disclosure, in order to save power, various sensors may be activated when a person is detected by a motion sensor.

Furthermore, the biological information acquisition unit and/or biological information acquisition device can acquire biological information at predetermined times or at predetermined time intervals.

Next, another embodiment of the information processing system in this disclosure will be described. In this embodiment, the information processing device 100 may include an information processing unit, a control unit, a communication unit, a recording unit, a display unit, and an input unit, as shown in Figure 24.

The input section accepts data for registering and correcting user information. Users can register their age, gender, actual weight, blood type, height, etc., through this input section.

The control unit controls the entire system.

The information processing unit performs noise reduction, surface area calculation, and volume calculation on the data acquired from the sensor.

Sensors that can be connected include visible light cameras, infrared sensors, and ultrasonic sensors.

Visible light cameras are used to measure the entire body and acquire data to determine gender and age categories.

Infrared sensors are used to measure the entire body from body heat, even while wearing clothes, and to acquire data for 3D modeling.

Ultrasonic sensors are used to acquire data for defining the structural divisions of the human body (bones, muscles, etc.).

Furthermore, the reflective portion reflects specific wavelengths of infrared and ultrasonic waves.

The recording unit is responsible for recording all data.

The display unit shows user-selectable UI elements.

The communications unit is responsible for connecting to the network. Connection is possible using methods such as Wi-Fi (registered trademark) and Bluetooth (registered trademark).

In the cloud, data is managed.

The mobile device is used to manage weight data using a dedicated app.

Furthermore, a computer or mobile phone or other information processing device can be suitably used to function as a server or terminal device according to the above-described embodiment. Such an information processing device can be realized by storing a program describing the processing content that realizes each function of the server or terminal device according to the embodiment in the storage unit of the information processing device, and having the CPU of the information processing device read and execute the program.

While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be implemented in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents.

Furthermore, the methods described in the embodiments can be distributed as programs that can be executed by a computer, stored on recording media such as magnetic disks (floppy disks, hard disks, etc.), optical disks (CD-ROMs, DVDs, MOs, etc.), and semiconductor memories (ROMs, RAMs, flash memories, etc.), and transmitted via communication media. The programs stored on the media also include configuration programs that configure the computer with software means (including not only executable programs but also tables and data structures) to be executed by the computer. The computer implementing this device reads the program recorded on the recording media, and, if necessary, constructs the software means using the configuration program. The above-described processing is executed by controlling the operation of this software means. Note that the recording media referred to in this specification are not limited to those for distribution, but also include storage media such as magnetic disks and semiconductor memories provided within the computer or in devices connected via a network. The storage unit may function as, for example, main memory, auxiliary memory, or cache memory.

1000 Information processing system 100 Information processing device 110 Receiving unit 120 Processing unit 200 Measuring device 210 Imaging device 220 Infrared sensor unit 230 Ultrasonic sensor unit

Claims (18)

An information processing system comprising one or more computer processors,
The information processing system comprises a measuring device including an imaging device, an infrared sensor unit, and an ultrasonic sensor unit, and an information processing device connected to the measuring device.
The one or more computer processors mentioned above are:
A determination unit that analyzes the image captured by the aforementioned imaging device to determine whether the object to be measured has entered a predetermined measurement area,
When the determination unit determines that the object to be measured has entered a predetermined measurement area, the facial recognition unit determines whether or not the object to be measured is a registered user.
If the facial recognition unit determines that the subject to be measured is not a registered user, a confirmation unit confirms whether or not to proceed with the measurement for that subject.
A receiving unit that receives the data acquired by the measuring device,
The receiving unit has a processing unit that processes the data received to calculate the weight of the object to be measured,
The processing unit is an information processing system that calculates the volume of each part of the object to be measured based on the data received by the receiving unit, and calculates the weight of the object to be measured based on the volume of each part, information regarding the configuration of each part, and the specific gravity of the elements related to the configuration. The information processing system according to claim 1, characterized in that the acquisition of data by the measuring device is initiated when the verification unit confirms that the measurement can be performed. The information processing system according to claim 1, characterized in that the measurement by the infrared sensor unit and the ultrasonic sensor unit is initiated when the confirmation unit confirms that the measurement can be performed. The information processing system according to claim 1, characterized in that, when the verification unit determines that the measurement target is not a registered user, it displays a verification screen on the display of the information processing system or the display of the user's information processing terminal. The aforementioned processing unit,
The information processing system according to claim 1, characterized in that the receiving unit estimates the composition of the object to be measured based on the reflection data from the object to be measured acquired by the ultrasonic sensor unit, which is received by the receiving unit. The information processing system according to claim 1, characterized in that the processing unit generates 3D data of the object to be measured based on the reflection data and/or radiation data from the object, including the object to be measured, which are received by the receiving unit and acquired by the infrared sensor unit. The information processing system according to claim 1, characterized in that the processing unit generates 3D data of the measurement target based on image data including the measurement target acquired by the imaging device, which is received by the receiving unit. The aforementioned processing unit,
The information processing system according to claim 6 or 7, characterized in that, based on the 3D data of the object to be measured, a three-dimensional object having an external shape corresponding to the object to be measured is divided into a plurality of parts of a predetermined size, the weight of each part is calculated based on the information regarding the configuration of each part and the specific gravity of the elements related to said configuration, and the weight of the object to be measured is obtained by summing the weights of all parts. The information processing system according to claim 1, further characterized in that the processing unit performs background removal from the image data, which includes the measurement target and is received by the receiving unit and acquired by the imaging device. The information processing system according to claim 1, characterized in that the infrared sensor unit comprises an infrared camera and an infrared sensor composed of an infrared light emitter, an infrared light receiver, and a reflector. The information processing system according to claim 1, characterized in that the ultrasonic sensor unit comprises a main unit consisting of an ultrasonic light emitting unit and an ultrasonic light receiving unit, and a sub-unit consisting of an ultrasonic light receiving unit and a light reflecting unit. The information processing system according to claim 11, characterized in that the ultrasonic sensor unit comprises a main unit and two sub-units, and is arranged such that the horizontal angle of the angle formed by the straight line connecting the main unit and each of the sub-units, and the vertical angle of the straight line connecting the main unit and each of the sub-units, are within a predetermined value. The information processing system according to claim 1, characterized in that the measuring device is used to be positioned in front of or above the object to be measured. The information processing system according to claim 1, wherein the one or more computer processors further have a storage unit for storing user information of the user to be measured, and the processing unit determines whether the image data of the user's face, which has been received by the receiving unit and acquired by the imaging device, is included in the user information stored in the storage unit, and if, as a result of the determination, it is determined that the image data of the user's face is included in the user information, the processing unit designates the user as the target of measurement. The memory unit further stores information regarding the user's actual weight.
The information processing system according to claim 14, characterized in that the processing unit compares the user's weight, which is the calculated weight of the object to be measured, with the user's actual weight stored in the storage unit, and determines whether there is a difference of a predetermined amount or more between the user's weight and the user's actual weight as a result of the comparison. The information processing system according to claim 14, characterized in that, if the processing unit determines, as a result of the determination, there is a difference of a predetermined amount or more between the user's weight and the user's actual weight, it requests the measuring device to acquire data again. An information processing method in an information processing system comprising one or more computer processors,
The information processing system comprises a measuring device including an imaging device, an infrared sensor unit, and an ultrasonic sensor unit, and an information processing device connected to the measuring device.
The one or more computer processors:
A determination step in which the object to be measured enters a predetermined measurement area by analyzing the image captured by the aforementioned imaging device,
If, in the aforementioned determination step, it is determined that the object to be measured has entered a predetermined measurement area, a facial recognition step is performed to determine whether or not the object to be measured is a registered user.
In the facial recognition step, if it is determined that the subject to be measured is not a registered user, a confirmation step is taken to confirm whether or not to perform the measurement on the subject.
The steps include receiving the data acquired by the measuring device,
A step of calculating the volume of each part of the object to be measured based on the aforementioned data,
An information processing method that performs the step of calculating the weight of the object to be measured based on the volume of each of the aforementioned parts, information regarding the composition of each of the aforementioned parts, and the specific gravity of the elements related to said composition. A computer program executed in an information processing system comprising one or more computer processors,
The information processing system comprises a measuring device including an imaging device, an infrared sensor unit, and an ultrasonic sensor unit, and an information processing device connected to the measuring device.
The one or more computer processors:
The imaging device analyzes the images it captures to determine whether the object to be measured has entered a predetermined measurement area.
When the aforementioned determination function determines that the subject to be measured has entered a predetermined measurement area, a facial recognition function determines whether or not the subject to be measured is a registered user.
The facial recognition function determines that the subject to be measured is not a registered user, and a confirmation function is provided to confirm whether or not to proceed with the measurement for that subject.
The device implements a receiving function for receiving data acquired by the measuring device, and a processing function for calculating the weight of the object to be measured by processing the data received by the receiving function.
The aforementioned processing function is
Based on the data received by the receiving function, the volume of each part of the object to be measured is calculated.
A computer program that calculates the weight of the object to be measured based on the volume of each of the aforementioned parts, information regarding the composition of each of the aforementioned parts, and the specific gravity of the elements related to said composition.