JP7749458B2 - terminal device - Google Patents

Description

The present invention relates to a terminal device that measures biometric information of a subject without contact.

Technology for superimposing and displaying an index image on an image of a person being photographed is known. For example, Patent Document 1 discloses a video processing system that combines a video of a user's photograph with the outline (index image) of the model performer in a model video to create a video for display, and then displays the video for display. Furthermore, Patent Document 2 discloses an image display control device that generates a face display frame (index image) that surrounds the subject's facial area and a human body display frame (index image) that surrounds the human body area, and displays these display frames on a screen along with an image obtained by photographing the subject.

Furthermore, the above-mentioned technology can be particularly applied to terminal devices that measure the biometric information of a person being measured (photographed person) based on a captured image of the person being measured. In such terminal devices that measure biometric information, it is important to continue capturing images of the person being measured at a predetermined measurement position on the display screen. For this reason, the terminal device displays an indicator image (face position guide, human-shaped outline guide, etc.) indicating the measurement position on the display screen, superimposed on an image including the person being measured.

Japanese Patent Application Laid-Open No. 2010-258613 JP 2012-165174 A

However, with the above-mentioned technology, if information about the measurement situation is displayed while the subject is being measured in line with the index image, the subject may look away from the index image, which could result in a significant shift in face position and a failed measurement.

One aspect of the present invention was conceived in consideration of the above-mentioned problems, and its purpose is to provide a terminal device that allows users to check information about the measurement situation displayed on the terminal device while gazing at the indicator image.

In order to solve the above problems, a terminal device according to one aspect of the present invention comprises an imaging unit, a display unit, an information acquisition unit that acquires an image of the person being measured captured by the imaging unit as information for measuring the biometric information of the person being measured, a situation identification unit that identifies a situation related to the measurement, and a display control unit that displays a first indicator image superimposed on an image including the person being measured displayed on the display unit, and if the situation identified by the situation identification unit is before the measurement, displays a circular frame-shaped guide that fits the face as the first indicator image, and if the situation identified by the situation identification unit is during the measurement, changes the display form of the first indicator image to a human-shaped outline guide that includes the face and shoulders . In order to solve the above-mentioned problems, another aspect of the present invention provides a terminal device comprising: an imaging unit; a display unit; an information acquisition unit that acquires an image of the subject captured by the imaging unit as information for measuring the subject's biometric information; a situation identification unit that identifies a situation related to the measurement; and a display control unit that displays a first index image superimposed on an image including the subject displayed on the display unit and changes the display form of the first index image in accordance with the situation identified by the situation identification unit, wherein the situation identification unit includes a first identification unit that identifies a deviation of the subject's face position from a predetermined detection area during imaging based on a facial image of the subject included in the image being captured by the imaging unit, and the display control unit changes the display form of the first index image based on the identification by the first identification unit so that the person measuring can grasp the magnitude of the deviation, and the display control unit changes the thickness of the first index image in accordance with the magnitude of the deviation. In order to solve the above-mentioned problems, a terminal device according to another aspect of the present invention comprises an imaging unit, a display unit, an information acquisition unit that acquires an image of the subject captured by the imaging unit as information for measuring the subject's biometric information, a situation identification unit that identifies a situation related to the measurement, and a display control unit that displays a first index image superimposed on an image including the subject displayed on the display unit and changes the display form of the first index image in accordance with the situation identified by the situation identification unit, wherein the situation identification unit includes a first identification unit that identifies a deviation of the subject's face position from a predetermined detection area during image capture based on a facial image of the subject included in the image being captured by the imaging unit, and the display control unit changes the display form of the first index image based on the identification by the first identification unit so that the person measuring can grasp the magnitude of the deviation, and the display control unit displays, in addition to the first index image located in the detection area, an image similar to the first index image that moves together with the facial image of the subject, like an afterimage. In order to solve the above-mentioned problems, another aspect of the present invention provides a terminal device comprising: an imaging unit; a display unit; an information acquisition unit that acquires an image of the subject captured by the imaging unit as information for measuring the subject's biometric information; a situation identification unit that identifies a situation related to the measurement; and a display control unit that displays a first index image superimposed on an image including the subject displayed on the display unit and changes the display form of the first index image in accordance with the situation identified by the situation identification unit, wherein the situation identification unit includes a first identification unit that identifies a deviation of the subject's face position from a predetermined detection area during image capture based on a facial image of the subject included in the image being captured by the imaging unit, and the display control unit changes the display form of the first index image based on the identification by the first identification unit so that the person measuring can grasp the magnitude of the deviation, and when the deviation of the face position is within a predetermined range, the display control unit displays the first index image in a manner that follows the change in the face position, and when the deviation of the face position exceeds the predetermined range, changes the first index image to a position that would be displayed if there was no deviation, more quickly than the change in the face position, and displays the first index image. In order to solve the above problem, another aspect of the present invention provides a terminal device comprising: an imaging unit; a display unit; an information acquisition unit that acquires an image of the subject captured by the imaging unit as information for measuring the subject's biometric information; a situation identification unit that identifies a situation related to the measurement; and a display control unit that displays a first indicator image superimposed on an image including the subject displayed on the display unit and changes the display form of the first indicator image in accordance with the situation identified by the situation identification unit, wherein the situation identification unit includes a second identification unit that identifies the progress of measurement of the subject's biometric information, and the display control unit changes the display form of the first indicator image based on the identification by the second identification unit so that the person measuring can grasp the progress, and the display control unit gradually changes the color of the first indicator image from one end to the other end in accordance with the progress. In order to solve the above problem, another aspect of the present invention provides a terminal device comprising: an imaging unit; a display unit; an information acquisition unit that acquires an image of the subject captured by the imaging unit as information for measuring the subject's biometric information; a situation identification unit that identifies a situation related to the measurement; and a display control unit that displays a first indicator image superimposed on an image including the subject displayed on the display unit and changes the display form of the first indicator image according to the situation identified by the situation identification unit, wherein the situation identification unit includes a third identification unit that identifies that the subject's biometric information is being measured, and the display control unit changes the display form of the first indicator image based on the identification by the third identification unit so that the person being measured can understand that measurement is being performed, and the display control unit regularly changes the thickness or size of the first indicator image when measurement is being performed.

One aspect of the present invention provides a terminal device that allows users to check information about the measurement situation displayed on the terminal device while gazing at an index image.

1 is a block diagram showing a schematic configuration of a terminal device according to an embodiment of the present invention; 10A and 10B are diagrams showing examples of images displayed by the terminal device when measuring a subject in a seated or standing position. FIG. 10 is a diagram showing an example of an image displayed by the terminal device when measuring a subject lying down. FIG. 10 is a diagram showing an example of an image displayed by the terminal device when measuring a subject whose face is turned to the side. 10 is a diagram showing an example of an image displayed by the terminal device when the position of the subject's face on the screen of the display unit is shifted within a predetermined range. FIG. 10A and 10B are diagrams showing other examples of images displayed by the terminal device when the position of the subject's face on the screen of the display unit is shifted within a predetermined range. 10 is a diagram showing an image displayed by the terminal device when the size of the subject's face on the screen of the display unit becomes smaller than a predetermined threshold value. FIG. 10 is a diagram showing an example of an image displayed by the terminal device based on the amount of deviation of the subject's face position from a predetermined detection area on the screen of the display unit. FIG. 10 is a diagram showing another example of an image displayed by the terminal device based on the amount of deviation of the subject's face position from the predetermined detection area on the screen of the display unit. FIG. FIG. 10 is a diagram showing yet another example of an image displayed by the terminal device based on the amount of deviation of the subject's face position from a predetermined detection area on the screen of the display unit. FIG. 10 is a diagram showing yet another example of an image displayed by the terminal device based on the amount of deviation of the subject's face position from a predetermined detection area on the screen of the display unit. 10A and 10B are diagrams showing examples of images displayed by a terminal device based on the progress of measurement of biological information of a subject. FIG. 10 is a diagram showing an example of an image displayed by a terminal device based on the fact that biological information of a person being measured is currently being measured. FIG. 10 is a diagram showing another example of an image displayed by the terminal device based on the fact that biological information of the subject is being measured. FIG. 10 is a diagram showing an example of an image displayed by the terminal device upon completion of measurement of the subject's biological information. FIG. 10 is a diagram showing a gradual change from a second index image to a first index image.

[Embodiment 1]
(1. Schematic configuration of terminal device 100)
FIG. 1 is a block diagram showing the schematic configuration of a terminal device according to this embodiment. As shown in FIG. 1, the terminal device 100 includes a control unit 1, an image capturing unit 2, an input unit 3, a display unit 4, a communication unit 5, and a storage unit 6. The terminal device 100 is a device used to measure the biometric information of a subject based on a captured image of the subject (i.e., non-contact). Examples of biometric information include, but are not limited to, the subject's body temperature, blood pressure, pulse rate, respiratory rate, etc. The terminal device 100 may be any device having image acquisition and image display functions, such as a smartphone or tablet device.

The person taking the measurement uses the terminal device 100 to measure the biometric information of the person being measured by continuing to photograph the person being measured while checking an image including the person being measured displayed on the screen of the display unit 4. Such a terminal device 100 is used, for example, in a care setting when a caregiver (measurer) measures the biometric information of a person being cared for (person being measured).

Note that the functions of the terminal device 100 described below can also be realized by installing a program on a general-purpose computer. The program can also be called application software. In the following, an example will be described in which the terminal device 100 is a smartphone on which the program is installed.

The control unit 1 controls all the components of the terminal device 100. The image capture unit 2 captures images. The input unit 3 accepts input operations for the terminal device 100. The display unit 4 has a screen and displays images captured by the image capture unit 2 on the screen. The communication unit 5 transmits and receives various data between an external communication device and the control unit 1. The memory unit 6 stores various data handled by the terminal device 100. The input unit 3 may be a touch panel, in which case the input unit 3 is configured as an integrated unit with the display unit 4.

The control unit 1 includes an information acquisition unit 11, a measurement unit 12, a tilt detection unit 13, an orientation detection unit 14, a size detection unit 15, a situation identification unit 16, and a display control unit 17.

The information acquisition unit 11 acquires an image of the subject captured by the imaging unit 2 (hereinafter referred to as the captured image) as information for measuring the subject's biometric information. The captured image may be a video or a still image of the subject.

The measurement unit 12 measures the subject's biometric information based on the captured image. Note that an external server may measure the subject's biometric information instead of the measurement unit 12. In this case, the captured image acquired by the information acquisition unit 11 is transmitted to the external server via the communication unit 5.

The tilt detection unit 13 detects the tilt of the subject's face on the screen of the display unit 4 based on the facial image of the subject (hereinafter simply referred to as the facial image) included in the captured image acquired by the information acquisition unit 11. The tilt of the face is calculated from the center line of the face. The center line is, for example, a line connecting the center of the nose and the center of the mouth, or a line connecting the center of the right eye and the center of the left eye. The orientation detection unit 14 detects whether the subject's face is facing sideways on the screen of the display unit 4 based on the facial image. The size detection unit 15 detects the size of the subject's face on the screen of the display unit 4 based on the facial image.

Note that the subject's "face tilt" on the screen of the display unit 4 refers to the angle between the center line of the facial image and a specific reference direction on the screen, such as the up-down direction parallel to the vertical side of the display screen or the left-right direction parallel to the horizontal side.

The situation identification unit 16 identifies the situation related to the measurement. The situation identification unit 16 identifies whether the measurement of the biological information has failed, whether the measurement of the biological information has been completed, etc. The situation identification unit 16 also includes a first identification unit 161, a second identification unit 162, and a third identification unit 163.

The first identification unit 161 identifies the deviation of the subject's face position from a predetermined detection area during imaging, based on the face image acquired by the information acquisition unit 11. The predetermined detection area may be, for example, the position (predetermined position) of the second indicator image 52 (see Figures 2 and 3) described below that is displayed by the display control unit 17 before measurement begins, or the position of the face image on the screen of the display unit 4 at the start of measurement.

The second identification unit 162 identifies the progress of measurement of the subject's biological information by the measurement unit 12. The third identification unit 163 identifies that the measurement unit 12 is currently measuring the subject's biological information.

The display control unit 17 displays the captured image on the screen of the display unit 4. Hereinafter, the image including the person being measured that is displayed on the screen will be referred to as the display image. The display control unit 17 superimposes a first indicator image 51, which is used to encourage the person being measured to continue taking pictures without changing the position of the person's face, on the image including the person being measured that is displayed on the display unit 4 (displayed on the screen), and changes the display form of the first indicator image 51 depending on the situation identified by the situation identification unit 16.

The display control unit 17 may also superimpose a first indicator image 51, which is aligned with the inclination of the face detected by the inclination detection unit 13, on the display image (see Figures 2 to 14).

The first index image 51 may be a human-shaped contour guide including the face and shoulders. Here, the first index image 51 may be generated by rotating a contour guide selected from multiple human-shaped contour guides pre-stored in the memory unit 6 based on the face tilt detected by the tilt detection unit 13. Alternatively, the first index image 51 may be generated by extracting the contours of the subject's face and shoulders included in the captured image.

Furthermore, before measurement by the measurement unit 12 begins, the display control unit 17 may superimpose a second index image 52 on the display image to help the person being measured align the position of the person's face with a predetermined position on the screen of the display unit 4 (see Figures 2 and 3). In this case, after measurement begins, the display control unit 17 superimposes a first index image 51, which is a human-shaped outline guide including the face and shoulders, on the display image.

The second index image 52 may be a frame-shaped guide that allows the subject's face displayed on the screen to fit inside. The size of the frame-shaped guide is such that, by having the subject photograph the subject's face at approximately the same size as the frame guide, the distance between the subject and the terminal device 100 is an appropriate distance (e.g., 50 to 60 cm) that corresponds to the performance of the imaging unit 2. The subject can measure the subject's biometric information by maintaining an appropriate distance between the subject and the terminal device 100. The second index image 52 may also be a shape (e.g., a cross) that indicates the center of the subject's face when the subject's face is aligned with a specified position on the screen of the display unit 4, or a shape that indicates the positions of the eyes, nose, mouth, ears, etc.

The frame-shaped guide may have an isotropic shape. Here, isotropic shapes include, but are not limited to, a circle, a regular polygon, or a sphere.

The display control unit 17 may also superimpose on the display image a notification image 61 showing notification information related to the measurement to the subject based on the measurement-related situation identified by the situation identification unit 16 (see Figures 2 and 3). The display control unit 17 may also superimpose on the display image a measurement result image 62 showing the biometric information items measured by the measurement unit 12 and the measurement results (see Figures 2 and 3).

Instead of the display control unit 17 displaying the notification image 61, a speaker provided in the terminal device 100 may output notification information related to the measurement to the subject by voice. Similarly, instead of the display control unit 17 displaying the measurement result image 62, a speaker provided in the terminal device 100 may output the items of biometric information to be measured and the measurement results by voice.

(2. Display Method of First Index Image 51 and Second Index Image 52)
2 to 7, a detailed description will be given below of a method for displaying the first index image 51 and the second index image 52 by the display control unit 17. In the example shown in Fig. 2 to 7, the second index image 52 is a circular frame guide that is an isotropic shape, and the first index image 51 is a human-shaped outline guide.

In the example shown in Figures 2 to 7, while the display image is being displayed, the display control unit 17 displays a notification image 61 at the top of the screen of the display unit 4 and a measurement result image 62 at the bottom of the screen of the display unit 4. However, the positions and timing at which the display control unit 17 displays the notification image 61 and measurement result image 62 are not limited to this. For example, the notification image 61 and measurement result image 62 may be displayed on the left or right side of the screen of the display unit 4. The measurement result image 62 may be displayed after the measurement is completed. For convenience, the measurement result image 62 is not shown in Figures 4 to 7.

Figure 2 shows an example of an image displayed by the terminal device 100 when measuring a subject who is in a seated or standing position. Figure 2 shows an example of display images P201 to P204 displayed by the display control unit 17 to remind the subject to take an appropriate photograph of the subject who is in a seated position.

Display image P201 shows the image displayed by the display control unit 17 when imaging begins. Here, the display control unit 17 displays the second index image 52 at a predetermined position on the screen of the display unit 4. The predetermined position is, for example, approximately the center of the area on the screen of the display unit 4 excluding the notification image 61 and the measurement result image 62. In addition, the display control unit 17 displays notification information in the notification image 61 to indicate that the subject's face should be placed within the frame of the second index image 52 (the sentence "Please place your face within the frame").

The display control unit 17 also displays a list of the biological information items to be measured ("body temperature," "blood pressure," "pulse rate," and "respiration") in the measurement result image 62. The result display field in the measurement result image 62 remains blank until the measurement is complete. The person taking the measurement checks this display image P201 and moves the terminal device 100 to adjust the capture area so that the subject's face is within the frame of the second index image 52.

Display image P202 shows the state in which the subject's face has been adjusted by the measurer to fit within the frame of second index image 52. Here, the tilt detection unit 13 detects the tilt of the subject's face (which has fit within the frame of second index image 52) in display image P202. The measurement unit 12 also begins measuring the subject's biometric information.

Display image P203 shows the image displayed by the display control unit 17 after measurement of biometric information begins. Here, the display control unit 17 displays the first index image 51 that matches the inclination of the face detected by the inclination detection unit 13. In other words, the display control unit 17 switches the second index image 52 to the above-mentioned first index image 51. When the subject is seated as shown in Figure 2, the inclination of the subject's face is aligned with the vertical direction on the screen of the display unit 4. Therefore, the first index image 51 appears as a symmetrical outline guide of a human figure facing forward, with the shoulders located directly below the face.

The display control unit 17 also displays notification information (the text "Measuring") in the notification image 61 to indicate that the biometric information is being measured. The display control unit 17 also displays the measurement results in the result display column in the measurement result image 62, one by one, starting with the biometric information item for which measurement has been completed. The display control unit 17 displays the display image P203 until the measurement of the biometric information is complete. The person measuring the subject checks this display image P203 and continues to take pictures without changing the position of the subject's face until the measurement of the biometric information is complete.

Display image P204 shows the image displayed by the display control unit 17 when measurement of all items of biological information to be measured is complete. Here, the display control unit 17 ends the display of the first indicator image 51. The display control unit 17 also displays notification information in the notification image 61 indicating that measurement of all items of biological information has been completed (the text "Measurement completed"). The display control unit 17 also displays the measurement results of the biological information measured in the result display field in the measurement result image 62. The person taking the measurement confirms this display image P204 and recognizes that measurement of the biological information has been completed.

As described above, the display control unit 17 can first start capturing the subject's face so that it is within the frame of the second index image 52, and then remind the subject to continue capturing the image so that the face position does not shift in line with the first index image 51. This allows the subject to capture the images necessary to measure biometric information relatively easily by using the terminal device 100, even if they are unfamiliar with devices such as smartphones.

In addition, the display control unit 17 sequentially displays the measurement results for completed biological information on the measurement result image 62, allowing the subject to check their progress. This makes the measurement time seem shorter to the subject, compared to when the measurement results are displayed once all biological information has been measured, reducing the stress the subject may feel as they wait for the measurement to be completed.

The display control unit 17 may also display, in the measurement result image 62, only the biological information that the measurement unit 12 can measure from the captured image, out of the specified biological information (biological information of the measurement subject). For example, to measure the respiratory rate, the subject's shoulders must be visible in the captured image. If the subject's shoulders are not visible in the captured image, the measurement unit 12 will not measure the respiratory rate, even if the specified biological information includes the respiratory rate.

In such a case, the situation identification unit 16 identifies the respiratory rate as a non-measurable item of the specified biological information. The display control unit 17 displays a list of biological information in the measurement result image 62, excluding the non-measurable biological information. This prevents the person taking the measure from becoming confused by the presence of biological information (biological information items) for which the measurement results are not displayed even after the measurement is complete. Furthermore, reducing the number of items of biological information displayed in the list is expected to have the effect of making the person taking the measure feel that the measurement time is shorter.

Figure 3 shows an example of an image displayed by the terminal device 100 when measuring a subject who is lying down. Figure 3 shows an example of display images P301 to P304 that the display control unit 17 displays to remind the subject to take an appropriate photograph of the subject who is lying down.

Similar to display images P201, P202, and P204 in Figure 2, the display control unit 17 displays display images P301, P302, and P304, respectively.

Furthermore, in the display image P303, the display control unit 17 displays a first indicator image 51 corresponding to the person being measured who is lying down. That is, as shown in FIG. 3, when a person being measured who is lying down is photographed from diagonally above while positioned to the right of the person being measured, the inclination of the person's face will be to the left relative to the up-and-down direction on the screen of the display unit 4. The inclination detection unit 13 detects this inclination of the person's face, and therefore the first indicator image 51 becomes a diagonally tilted human-shaped outline guide with the shoulder located in the lower right corner of the face facing diagonally upward to the right, and the left shoulder located higher than the right shoulder.

In this way, the display control unit 17 displays the first indicator image 51, which matches the inclination of the photographed face of the person being measured, so that the person taking the photograph can continue taking the photograph without changing the position of the person's face. In other words, if the face of the person being measured who is lying down is photographed at an angle to the screen, the inclination of the face is detected and the first indicator image 51 with the face tilted at an angle is displayed. This allows the person taking the photograph to intuitively understand that there is no need to rotate the terminal device 100 to match the inclination of the face of the person being measured who is lying down, that there is no need to point the terminal device 100 directly in front of the person's face when taking the photograph, and that there is no problem with continuing to take the photograph in this state.

Furthermore, by using the first indicator image 51 as a human-shaped contour guide including the face and shoulders, the person being measured will be conscious of aligning the lines of the face and shoulders in the image being photographed with the lines of the human-shaped contour guide displayed nearby, making it clear that the person being measured should not move their face out of position and that the terminal device should not be moved. This makes it easy to photograph without moving (shifting) the face out of position.

In addition, by displaying the second index image 52 before measurement begins, the person taking the photograph can begin taking the photograph without any confusion about the position of the person being measured's face within the displayed image. After measurement begins, a human-shaped outline guide including the shoulders is displayed as the first index image 51, reminding the person taking the photograph not to move the person being measured's face from the correct position and not to move the terminal device, as described above. This makes it easy to take photographs without moving (shifting) the face from the correct position.

Depending on the performance of the imaging unit 2, restrictions may be placed on the distance between the person being measured and the terminal device 100. Even in such cases, before starting measurement, a frame-shaped guide such as that shown in Figures 2 and 3 is displayed as the second indicator image 52, and the person being measured is asked to place their face within the frame-shaped guide, making it easy to adjust the distance between the person being measured and the terminal device 100 to fit within the restrictions. Note that the measurement unit 12 may start measurement after a certain period of time has passed during which the difference between the size of the frame-shaped guide and the size of the face is smaller than a threshold.

Furthermore, if a directional frame guide such as an oval or rectangle were displayed as the frame guide, the person being measured would be conscious of the need to align their face to the direction of the frame guide, which could cause them to feel burdened or start the measurement in an awkward position. In contrast, by using an isotropic frame guide, the person being measured can be made aware that all they need to do is place their face within the frame guide.

Display image P304 shows the image displayed by the display control unit 17 when measurement of all items of biological information to be measured is complete. Here, the display control unit 17 ends the display of the first indicator image 51. The display control unit 17 also displays notification information in the notification image 61 indicating that measurement of all items of biological information has been completed (the text "Measurement completed"). The display control unit 17 also displays the measurement results of the biological information measured in the result display field in the measurement result image 62. The person taking the measurement recognizes that measurement of the biological information has been completed by checking this display image P304.

Figure 4 shows an image displayed by the terminal device 100 when measuring a subject whose face is turned to the side. Figure 4 shows an example of a display image P401 that the display control unit 17 displays when the orientation detection unit 14 determines, based on the facial image, that the subject's face is turned to the side on the screen of the display unit 4.

In the display image P401, the display control unit 17 displays a first index image 51 to prompt the person being measured to continue taking a photograph without changing the facial position of the person being measured, whose face is turned sideways. Here, the human-shaped contour guide that is the first index image 51 includes characteristic features facing sideways (for example, a nose turned sideways or the shape of shoulders turned sideways).

This allows the person being measured to be aware that there is no problem with capturing a profile image. This prevents the person from moving the terminal device 100 in an attempt to capture a frontal image of the face, resulting in a failed measurement.

Figure 5 shows an example of an image displayed by the terminal device 100 when the face position of the person being measured on the screen of the display unit 4 is shifted within a predetermined range. Figure 5 shows examples of display images P501 to P503, in which the first indicator image 51 is displayed in the position where it would be displayed if there was no face position shift, without tracking the shift in the face position of the person being measured on the screen of the display unit 4. Note that if the face position is shifted, the position of the shoulders will naturally also shift, but hereinafter this will be referred to as a "shift in face position."

Display image P501 shows the image displayed by the display control unit 17 when measurement of biometric information begins. Here, the display control unit 17 displays a first index image 51 that is aligned with the facial inclination detected by the inclination detection unit 13 and is not misaligned with the facial position of the subject.

Display image P502 shows a state in which the subject's face position has shifted from the face position of the subject at the start of biometric information measurement (shown in display image P501), due to, for example, hand shaking by the subject. Here, the display control unit 17 superimposes and displays the first index image 51 in the position where it would be displayed if there was no face position shift, so that it does not follow the shift in face position. Therefore, the first index image 51 is maintained in the position it was in at the start of measurement, and in display image P502, the first index image 51 is shifted from the face position of the subject.

Display image P503 shows a state in which the subject's face position is further shifted from the face position of the subject at the start of biometric information measurement than in display image P502. In display image P503, the first index image 51 is further shifted from the face position of the subject than in display image P502.

In a configuration in which the first index image 51 follows any deviation in face position, there is a concern that some people taking the photograph may become unaware of the need to keep their face position constant, i.e., to take a photograph without moving the terminal device 100. On the other hand, as shown in Figure 5, by displaying the first index image 51 in the position where it would be displayed if there was no deviation in face position, it is possible to make the person taking the photograph more aware of any deviation in face position.

Figure 6 shows another example of an image displayed by the terminal device 100 when the subject's face position is shifted on the screen of the display unit 4. Figure 6 shows examples of display images P601 to P603, in which the first index image 51 follows changes due to shifts in the subject's face position on the screen of the display unit 4. Note that the display in which the first index image 51 follows changes in face position is performed only when the shift in face position is within a predetermined range. This predetermined range is, for example, a range in which predetermined biometric information of the subject can be measured.

Display image P601 shows the image displayed by the display control unit 17 when measurement of biological information begins. Here, the display control unit 17 displays a first index image 51 that is aligned with the face position of the subject and is aligned with the face tilt detected by the tilt detection unit 13.

Display image P602 shows a state in which the face position of the person being measured has shifted from the face position of the person being measured (shown in display image P601) at the start of biometric information measurement, for example, due to hand shake by the person being measured. The shift in the face position of the person being measured in display image P602 is within a predetermined range. Here, if the shift in face position is within the predetermined range, the display control unit 17 displays the first index image 51 superimposed on the display image, following the change in face position (change in the position of the face image). Therefore, in display image P602, the first index image 51 is not shifted from the face position of the person being measured.

Display image P603 shows a state in which the subject's face position is further shifted than in display image P602 relative to the face position of the subject at the start of biometric information measurement. The shift in the subject's face position in display image P603 is within a specified range. Because the first index image 51 is displayed in accordance with changes in the face image, the first index image 51 does not shift relative to the subject in display image P603 either.

In a configuration in which the first index image 51 is displayed in the position where it would be if there was no misalignment of the face position, some people may become concerned about the misalignment of their face position and move the terminal device significantly, which could prevent them from acquiring the information necessary for measuring their biometric information. For example, continuous changes are required to measure a pulse, but if the face image changes significantly, continuous changes cannot be acquired. In such cases, by displaying the image in accordance with changes in face position as described above, it is possible to reduce measurement failures caused by moving the terminal device 100. Furthermore, by displaying the image in accordance with changes in face position, the person being measured can be made aware that there are no problems with the image capture and that the measurement is in progress, providing peace of mind.

Figure 7 shows images displayed by the terminal device 100 when the size of the subject's face on the screen of the display unit 4 falls below a predetermined threshold. Figure 7 shows examples of display images P701 to P703 in which the size of the first indicator image 51 is set to a predetermined minimum size when the size of the subject's face on the screen of the display unit 4 falls below a predetermined threshold.

Display image P701 shows the image displayed by the display control unit 17 when measurement of biological information begins. Here, the display control unit 17 displays a first index image 51 that matches the size of the subject's face detected by the size detection unit 15.

Display image P702 shows a state in which the size of the subject's face has become smaller compared to the size of the subject's face at the start of biometric information measurement (shown in display image P701). The size of the subject's face in display image P702 is equal to or greater than a predetermined threshold. Here, when the size of the subject's face is equal to or greater than the predetermined threshold, the display control unit 17 displays the first indicator image 51 (human-shaped outline guide) in a size that matches the size of the subject's face in the display image. Therefore, from display image P701 to display image P702, the first indicator image 51 follows the size of the subject's face.

Display image P703 shows a state in which the size of the subject's face is even smaller than in display image P702, relative to the size of the subject's face at the start of biometric information measurement. The size of the subject's face in display image P703 is smaller than a predetermined threshold. Here, when the size of the subject's face is smaller than the predetermined threshold, the display control unit 17 displays the first indicator image 51 (human-shaped outline guide) at a predetermined minimum size. In display image P703, the first indicator image 51 does not follow the size of the subject's face and maintains the predetermined minimum size.

If the distance between the terminal device 100 and the person being measured is far and the size of the person being measured's face in the captured image is small, there is a possibility that measurement of biometric information will fail. For this reason, it is necessary to prevent the size of the person being measured's face in the captured image from becoming too small. Therefore, if the size of the person being measured's face is smaller than a predetermined threshold, the display control unit 17 fixes the size of the first index image 51 to a predetermined minimum size and displays the first index image 51 so that it does not become smaller than the predetermined minimum size. This makes it possible to make the person being measured aware that the size of the person being measured's face on the screen of the display unit 4 must not be smaller than the predetermined threshold (i.e., to maintain an appropriate distance between the terminal device 100 and the person being measured).

(3. Configuration for changing the display form of the first index image 51)
Below, we will explain the configuration in which the display control unit 17 superimposes a first index image 51 on the display image to encourage the person being measured to continue taking pictures without changing the position of the person's face, and changes the display form of the first index image 51 depending on the situation identified by the situation identification unit 16.

The following describes how the display control unit 17 changes the display form of the first index image 51, with reference to Figures 8 to 14. In the example shown in Figures 8 to 14, the first index image 51 is a human-shaped outline guide. Furthermore, the first index image 51 shown is an example of a first index image 51 that matches the inclination of the subject's face, as described above, but it may also be configured to change the display form of a conventional type of index image that is fixed on the screen.

In the example shown in Figures 8 to 14, while the display image is being displayed, the display control unit 17 displays a notification image 61 at the top of the screen of the display unit 4 and a measurement result image 62 at the bottom of the screen of the display unit 4. However, the positions and timing at which the display control unit 17 displays the notification image 61 and measurement result image 62 are not limited to this. For example, the notification image 61 and measurement result image 62 may be displayed on the left or right side of the screen of the display unit 4. The measurement result image 62 may be displayed after the measurement is completed. For convenience, the measurement result image 62 is not shown in Figures 8 to 14.

Figures 8 to 11 are diagrams showing examples of images displayed by the terminal device 100 based on the amount of deviation of the subject's face position from the predetermined detection area on the screen of the display unit 4. The first identification unit 161 identifies the deviation of the subject's face position from the predetermined detection area during capture, based on the face image of the subject included in the captured image. The display control unit 17 changes the display form of the first indicator image 51 based on the identification by the first identification unit 161 so that the subject can grasp the amount of deviation. Figures 8 to 11 show such changes in the display form of the first indicator image 51.

Figure 8 shows examples of display images P801 to P803 in which the thickness of the first index image 51 changes depending on the magnitude of the deviation.

Display image P801 shows the image displayed by the display control unit 17 when measurement of biometric information begins. Here, the display control unit 17 displays a first indicator image 51 (a human-shaped outline guide) that is not misaligned with the position of the subject's face.

Display images P802 and P803 show a state in which the subject's face position has shifted from the face position of the subject at the start of biometric information measurement (shown in display image P1101). Here, the display control unit 17 changes the thickness of the first indicator image 51 depending on the amount of deviation of the subject's face position from the specified detection area during imaging.

In the example shown in FIG. 8, the display control unit 17 makes the thickness of the first index image 51 thinner as the deviation increases. When the deviation is small, the first index image 51 is displayed thicker, and as the deviation increases, the first index image 51 becomes thinner, allowing the person taking the measure to intuitively sense that there is a deviation. Conversely, as the deviation increases, the first index image 51 can also be displayed thicker, allowing the person taking the measure to intuitively sense that there is a deviation.

Figure 9 shows examples of display images P901 to P903 in which the color of the first index image 51 changes depending on the magnitude of the deviation. Display image P901 shows the same state as display image P801.

Display images P902 and P903 show a state in which the subject's face position has shifted from the face position of the subject at the start of biometric information measurement (shown in display image P901). Here, the display control unit 17 changes the color of the first indicator image 51 according to the magnitude of deviation of the subject's face position from the specified detection area during image capture. For example, the display control unit 17 changes the color of the first indicator image 51 from white to closer to red as the deviation increases. Multiple thresholds may be set for the magnitude of deviation, and the color may be changed for each threshold. For example, if the deviation is smaller than a first threshold, the color is green; if the deviation is greater than the first threshold but less than a second threshold, the color is yellow; and if the deviation is greater than the second threshold, the color is red. Using the same colors as traffic lights makes it easier to understand the meaning of the colors.

Figure 10 shows examples of display images P1001 to P1003, in which an image similar to the first index image is displayed like an afterimage. Display image P1001 shows the same state as display image P801.

Display images P1002 and P1003 show a state in which the subject's face position has shifted relative to the face position of the subject at the start of biometric information measurement (shown in display image P1001). Here, in addition to the first index image 51 located in the detection area, the display control unit 17 displays, as afterimages, images similar to the first index image 51 that move along with the subject's face image. In the example shown in FIG. 10, the display control unit 17 displays, as afterimages 51a to 51c, images similar to the first index image 51 that move along with the subject's face image from the start of biometric information measurement to the present. Here, the first index image 51 at the face position at the start of measurement is highlighted by being bold, but the first index image 51 at the current face position may also be highlighted by being bold. Alternatively, all of the first index images may be the same bold. Any number of similar images may be displayed as afterimages.

Figure 11 shows examples of display images P1101 to P1104, in which the first index image, which follows changes in the facial image, is displayed as if it is quickly returning to its original position at the start of measurement when the facial image shifts beyond a predetermined range. Display image P1101 shows the same state as display image P801.

Display image P1102 shows a state in which the subject's face position has shifted relative to the face position of the subject at the start of biometric information measurement (shown in display image P1101). Note that the shift in the subject's face position in display image P1102 is within a predetermined range. When the shift in face position is within the predetermined range, the display control unit 17 displays the first index image 51 superimposed on the display image, following changes in face position. Therefore, in display image P1102, the first index image 51 is not shifted relative to the subject's face position.

Display image P1103 shows a state in which the subject's face position is further displaced from the face position of the subject at the start of biometric information measurement than in display image P1102. Note that the displacement of the subject's face position in display image P1103 is within a predetermined range. In display image P1103, first index image 51 is not displaced from the face position of the subject.

Display image P1104 shows a state in which the subject's face position has shifted beyond a predetermined range relative to the face position of the subject at the start of biometric information measurement. When the face position shift exceeds the predetermined range, the display control unit 17 displays the first index image 51 at a position that would be displayed if there was no shift (toward the direction of the first index image 51 displayed at the start of biometric information measurement) at a speed faster than the change in face position. In the example shown in Figure 11, the face position has shifted upward, so the display control unit 17 represents the movement of the first index image as the first index image moving quickly downward.

Figure 12 shows an example of an image displayed by the terminal device 100 based on the progress of measurement of the subject's biological information. The second identification unit 162 identifies the progress of measurement of the subject's biological information in the measurement unit 12 (hereinafter referred to as the measurement progress). The display control unit 17 changes the display form of the first indicator image 51 based on the identification by the second identification unit 162 so that the subject can understand the measurement progress.

Figure 12 shows an example of display images P1201 to P1204 in which the color of the first indicator image gradually changes from one end to the other depending on the progress of the measurement. Display image P1201 shows the same state as display image P801. Note that the display control unit 17 displays the first indicator image 51 in the first color.

Display image P1202 shows a state where the measurement progress has progressed from the state shown in display image P1201. Here, the display control unit 17 gradually changes the color of the first indicator image 51 from one end to the other end according to the measurement progress. In the example shown in FIG. 12, the display control unit 17 changes the color of the first indicator image 51 from a first color to a second color from one end (left shoulder) to the other end (right shoulder) of the first indicator image 51.

Display image P1203 shows a state where the measurement progress has progressed further from the state shown in display image P1202. Display image P1204 shows a state where the measurement progress has progressed further from the state shown in display image P1203, and the measurement has been completed. At this point, the display control unit 17 displays the first indicator image 51 in the second color from one end to the other end.

Figure 13 shows an example of an image displayed by the terminal device 100 when the subject's biological information is being measured. The third identification unit 163 identifies that the subject's biological information is being measured by the measurement unit 12. Based on the identification by the third identification unit 163, the display control unit 17 changes the display form of the first indicator image 51 so that the subject can understand that measurement is in progress.

Figure 13 shows examples of display images P1301 to P1304 in which the thickness of the first index image is changed regularly. Display image P1301 shows the same state as display image P801.

When the measurement unit 12 is measuring the subject's biometric information, the display control unit 17 regularly changes the thickness of the first index image 51. In the example shown in FIG. 13 , the display control unit 17 displays the first index image 51 so that the thickness alternates between the thickness shown in display images P1301 and P1303 and the thickness shown in display images P1302 and P1304.

Figure 14 shows another example of an image displayed by the terminal device 100 when the subject's biological information is currently being measured. The third identification unit 163 identifies that the subject's biological information is currently being measured by the measurement unit 12. Based on the identification by the third identification unit 163, the display control unit 17 changes the display format of the first indicator image 51 so that the subject can understand that measurement is currently being performed.

Figure 14 shows examples of display images P1401 to P1404 in which the size of the first index image is changed regularly. Display image P1401 shows the same state as display image P801.

When the measurement unit 12 is measuring the subject's biometric information, the display control unit 17 regularly changes the size of the first index image 51. In the example shown in FIG. 14, the display control unit 17 displays the first index image 51 in a size that alternates between a size that matches the size of the subject's face, as shown in display images P1401 and P1403, and a size that is slightly larger than the subject's face, as shown in display images P1402 and P1404.

Alternatively, the display control unit 17 may display the first indicator image 51 so that the size alternates between a size that matches the size of the subject's face, as shown in display images P1401 and P1403, and a size that is slightly smaller than the size of the subject's face.

(4. Example of display when measurement is completed)
15 is a diagram showing an image displayed by the terminal device 100 when measurement of the subject's biological information has ended. The situation identification unit 16 identifies that measurement of the subject's biological information has ended in the measurement unit 12. Based on the identification by the situation identification unit 16, the display control unit 17 changes the display format of the screen of the display unit 4 so that the subject can understand that measurement has ended.

Figure 15 shows examples of display images P1501 and P1502 that are displayed facing forward on the screen of the display unit 4 when measurement of the subject's biological information is completed. Display image P1501 shows the same state as display image P801.

Display image P1502 shows an image displayed by the display control unit 17 after measurement of the subject's biometric information has been completed. Here, the display control unit 17 displays the screen of the display unit 4 facing forward, based on the identification by the situation identification unit 16, so that the subject can understand that the measurement has been completed. In other words, the display control unit 17 rotates and displays the display image so that the tilt of the face is aligned with the vertical direction on the screen of the display unit 4. The display control unit 17 may also display the process of this rotation. This allows the terminal device 100 to allow the subject to intuitively understand that it is time to end imaging of the subject.

The display control unit 17 may terminate the display of the first indicator image 51 so that the subject can understand that the measurement has finished. Furthermore, regardless of whether the subject is facing the screen of the display unit 4 directly, or when other display examples are used, the display control unit 17 may display the biometric information for which measurement has been completed in a larger size.

Furthermore, regardless of whether the screen of the display unit 4 is faced directly, including the cases shown in other display examples, if a video is being displayed during measurement, the display control unit 17 may switch the display format of the screen of the display unit 4 from a video to a still image after the measurement is completed.

Figure 16 is a diagram showing the gradual change from the second index image 52 to the first index image 51. As shown in Figure 16, when switching from the second index image 52 to the first index image 51, the display control unit 17 may gradually change from the second index image 52 (figure m1), which is a circular frame-shaped guide, to the first index image 51 (figure m8), which is a human-shaped outline guide. Then, the screen of the display unit 4 may display a portion of the human-shaped outline guide that is sized to correspond to the captured image.

In this way, by smoothly changing from the second index image 52 to the first index image 51, which matches the angle of the subject's face, the subject can be made aware that the current condition can be used appropriately for photographing.

(5. Effects)
As described above, the display control unit 17 superimposes the first index image on the image including the person being measured to encourage the person being measured to continue taking pictures without changing the face position. Therefore, the terminal device 100 can make the person being measured conscious of not changing the face position, and can easily take pictures without changing (shifting) the face position.

In addition, the display control unit 17 changes the display format of the first indicator image according to the measurement-related situation identified by the situation identification unit 16. This makes it possible to communicate the identified situation to the person gazing at the area where the first indicator image is displayed, without having to avert their eyes. This makes it possible to provide a terminal device that allows the user to check information about the measurement-related situation displayed on the terminal device while gazing at the indicator image.

Furthermore, by using a human-shaped outline guide as the first indicator image 51, the person being measured can be made aware of not moving the face of the person being measured and not moving the terminal device. This makes it easy to take photographs without moving the face (shifting it) out of position.

Furthermore, as shown in Figures 8 to 11, the display control unit 17 can change the display format of the first index image 51 based on the amount of deviation in face position. Therefore, the terminal device 100 can allow the subject to intuitively grasp the amount of deviation in face position using the first index image 51 without having to avert their gaze.

Furthermore, as shown in FIG. 10, the display control unit 17 can display afterimages 51a to 51c based on the amount of deviation in face position. Therefore, the distance between the displayed similar image and the original first index image narrows or widens depending on the amount of deviation in face position, so the terminal device 100 allows the person being measured to intuitively understand that the face position has shifted and the amount of deviation.

Furthermore, as shown in FIG. 11 , when the amount of deviation in face position exceeds a predetermined range, the display control unit 17 displays the first index image 51 with a movement that quickly returns to the position that would be displayed if there was no deviation. In other words, the terminal device 100 does not simply make the first index image 51 follow the face, but rather changes it faster than the change in face position, causing it to move in a bouncing motion, thereby making the person being measured more aware that the face position has shifted.

Furthermore, as shown in FIG. 12, the display control unit 17 changes the display form of the first indicator image 51 depending on the measurement progress. Therefore, the terminal device 100 can allow the subject to intuitively grasp the measurement progress using the first indicator image 51 without having to avert their eyes. In particular, the display control unit 17 can display the measurement progress like an indicator depending on the measurement progress, allowing the subject to intuitively grasp the measurement progress.

Furthermore, as shown in Figures 13 and 14, the display control unit 17 changes the display format of the first index image 51 when the subject's biological information is being measured. For example, the thickness or size of the first index image is changed regularly. Therefore, the terminal device 100 can use the first index image 51 to let the subject know that measurement is underway without having to look away.

A speaker provided on the terminal device 100 may be used to enable the person being measured to understand the magnitude of the deviation. That is, the control unit 1, which controls the speaker output, changes the speaker output mode depending on the magnitude of deviation of the subject's face position from a predetermined detection area during imaging. This makes it possible to communicate the specified situation through sound output from the speaker without requiring the person being measured, who is gazing at the area where the first index image is displayed, to avert their gaze. For example, sound may be output at intervals according to the magnitude of the deviation, or only when the deviation becomes larger than a threshold, or only when the deviation becomes smaller than a threshold. This makes it possible to communicate the status of the deviation to the person being measured.

As described above, the terminal device 100 according to this embodiment can contribute to the achievement of Goal 3 of the Sustainable Development Goals (SDGs), "Good health and well-being for all." This can contribute to the achievement of the Sustainable Development Goals (SDGs).

[Software implementation example]
The functions of the terminal device 100 (hereinafter referred to as the "device") are realized by a program that causes a computer to function as the device, and by a program that causes a computer to function as each control block of the device (particularly each part included in the control unit 1).

In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The functions described in each of the above embodiments are realized by executing the program using this control device and storage device.

The above program may be stored non-transitory on one or more computer-readable storage media. These storage media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

Furthermore, some or all of the functions of each of the above control blocks can be realized by logic circuits. For example, integrated circuits incorporating logic circuits that function as each of the above control blocks are also included in the scope of the present invention. In addition, the functions of each of the above control blocks can also be realized by, for example, a quantum computer.

Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI may run on the control device, or on another device (such as an edge computer or cloud server).

〔summary〕
A terminal device according to aspect 1 of the present invention comprises an imaging unit, a display unit, an information acquisition unit that acquires an image of the subject captured by the imaging unit as information for measuring the subject's biometric information, a situation identification unit that identifies a situation related to the measurement, and a display control unit that displays a first indicator image superimposed on an image including the subject displayed on the display unit and changes the display form of the first indicator image according to the situation identified by the situation identification unit.

In the terminal device according to aspect 2 of the present invention, in the above-mentioned aspect 1, the first indicator image is a human-shaped outline guide including a face and shoulders.

A terminal device according to Aspect 3 of the present invention is the same as Aspects 1 or 2 above, in which the situation identification unit includes a first identification unit that identifies a deviation of the face position of the person being measured during image capture from a predetermined detection area based on a facial image of the person being measured included in the image being captured by the image capture unit, and the display control unit changes the display form of the first indicator image based on the identification by the first identification unit so that the person being measured can grasp the magnitude of the deviation.

A terminal device according to aspect 4 of the present invention is similar to aspect 3 above, in that the display control unit changes the thickness of the first indicator image depending on the magnitude of the deviation.

A terminal device according to aspect 5 of the present invention is similar to aspect 3 above, in that the display control unit changes the color of the first indicator image depending on the magnitude of the deviation.

In the terminal device according to Aspect 6 of the present invention, in addition to Aspect 3 above, the display control unit displays, in addition to the first index image located in the detection area, an image similar to the first index image that moves together with the facial image of the subject, like an afterimage.

A terminal device according to aspect 7 of the present invention is similar to aspect 3 above, in that, when the deviation in face position is within a predetermined range, the display control unit displays the first indicator image so that it follows the change in face position, and when the deviation in face position exceeds the predetermined range, the display control unit changes the first indicator image to a position that would be displayed if there was no deviation, at a faster rate than the change in face position.

A terminal device according to Aspect 8 of the present invention is any of Aspects 1 to 7 above, wherein the situation identification unit includes a second identification unit that identifies the progress of measurement of the subject's biological information, and the display control unit changes the display form of the first indicator image based on the identification by the second identification unit so that the subject can grasp the progress.

A terminal device according to aspect 9 of the present invention is similar to aspect 8 above, in that the display control unit gradually changes the color of the first indicator image from one end to the other end in accordance with the progress status.

A terminal device according to Aspect 10 of the present invention is any of Aspects 1 to 9 above, wherein the situation identification unit includes a third identification unit that identifies that the subject's biological information is being measured, and the display control unit changes the display form of the first indicator image based on the identification by the third identification unit so that the subject can understand that measurement is being performed.

In the terminal device according to aspect 11 of the present invention, in the above-mentioned aspect 10, the display control unit regularly changes the thickness or size of the first indicator image while measurement is in progress.

The terminal device according to each aspect of the present invention may be realized by a computer. In this case, the control program for the terminal device, which causes the computer to operate as each unit (software element) of the terminal device, thereby realizing the terminal device on the computer, and the computer-readable recording medium on which the program is recorded, also fall within the scope of the present invention.

The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention. Furthermore, new technical features can be created by combining the technical means disclosed in each embodiment.

REFERENCE SIGNS LIST 1 Control unit 2 Photography unit 4 Display unit 11 Information acquisition unit 13 Tilt detection unit 14 Orientation detection unit 15 Size detection unit 16 Situation identification unit 17 Display control unit 51 First index image 52 Second index image 100 Terminal device 161 First identification unit 162 Second identification unit 163 Third identification unit

Claims (12)

The photography department and
A display unit;
an information acquisition unit that acquires an image of the subject captured by the imaging unit as information for measuring biological information of the subject;
a situation identification unit that identifies a situation related to the measurement;
a display control unit that displays a first indicator image superimposed on an image including the subject displayed on the display unit, and that displays a circular frame-shaped guide that fits into the face as the first indicator image when the situation identified by the situation identification unit is before the measurement, and changes the display form of the first indicator image to a human-shaped outline guide that includes the face and shoulders when the situation identified by the situation identification unit is during the measurement . a tilt detection unit that detects a tilt of the subject's face on the screen of the display unit based on the image acquired by the information acquisition unit,
The terminal device according to claim 1 , wherein the display control unit rotates the outline guide based on the inclination of the face detected by the inclination detection unit. The photography department and
A display unit;
an information acquisition unit that acquires an image of the subject taken by the imaging unit as information for measuring biological information of the subject;
a situation identification unit that identifies a situation related to the measurement;
a display control unit that displays a first indicator image superimposed on an image including the subject displayed on the display unit, and changes a display form of the first indicator image according to the situation identified by the situation identifying unit,
the situation specifying unit includes a first specifying unit that specifies a deviation of a face position of the subject during photographing from a predetermined detection area based on a face image of the subject included in the image being photographed by the photographing unit,
the display control unit changes a display form of the first index image based on the identification by the first identification unit so that the measurer can grasp the magnitude of the deviation ;
The display control unit changes the thickness of the first indicator image according to the magnitude of the deviation . The photography department and
A display unit;
an information acquisition unit that acquires an image of the subject taken by the imaging unit as information for measuring biological information of the subject;
a situation identification unit that identifies a situation related to the measurement;
a display control unit that displays a first indicator image superimposed on an image including the subject displayed on the display unit, and changes a display form of the first indicator image according to the situation identified by the situation identifying unit,
the situation specifying unit includes a first specifying unit that specifies a deviation of a face position of the subject during photographing from a predetermined detection area based on a face image of the subject included in the image being photographed by the photographing unit,
the display control unit changes a display form of the first index image based on the identification by the first identification unit so that the measurer can grasp the magnitude of the deviation;
The display control unit is a terminal device that displays, in addition to the first index image located in the detection area, an image similar to the first index image that moves together with the facial image of the subject, like an afterimage. The photography department and
A display unit;
an information acquisition unit that acquires an image of the subject taken by the imaging unit as information for measuring biological information of the subject;
a situation identification unit that identifies a situation related to the measurement;
a display control unit that displays a first indicator image superimposed on an image including the subject displayed on the display unit, and changes a display form of the first indicator image according to the situation identified by the situation identifying unit,
the situation specifying unit includes a first specifying unit that specifies a deviation of a face position of the subject during photographing from a predetermined detection area based on a face image of the subject included in the image being photographed by the photographing unit,
the display control unit changes a display form of the first index image based on the identification by the first identification unit so that the measurer can grasp the magnitude of the deviation;
The display control unit displays the first index image in accordance with changes in the face position when the face position deviation is within a predetermined range, and when the face position deviation exceeds the predetermined range, the display control unit changes the first index image to a position that would be displayed if there was no deviation, at a faster rate than the change in the face position. the situation specifying unit includes a first specifying unit that specifies a deviation of a face position of the subject during photographing from a predetermined detection area based on a face image of the subject included in the image being photographed by the photographing unit,
The terminal device according to claim 1 , wherein the display control unit changes a display form of the first index image based on the identification by the first identification unit so that the measurer can grasp the magnitude of the deviation. The terminal device according to claim 3 , wherein the display control unit changes a color of the first indicator image in accordance with the magnitude of the deviation. The photography department and
A display unit;
an information acquisition unit that acquires an image of the subject taken by the imaging unit as information for measuring biological information of the subject;
a situation identification unit that identifies a situation related to the measurement;
a display control unit that displays a first indicator image superimposed on an image including the subject displayed on the display unit, and changes a display form of the first indicator image according to the situation identified by the situation identifying unit,
the status specifying unit includes a second specifying unit that specifies a progress status of measurement of the biological information of the subject,
the display control unit changes a display form of the first indicator image based on the identification by the second identification unit so that the measurer can grasp the progress status; and
The display control unit is a terminal device that gradually changes the color of the first indicator image from one end to the other end according to the progress status . The photography department and
A display unit;
an information acquisition unit that acquires an image of the subject taken by the imaging unit as information for measuring biological information of the subject;
a situation identification unit that identifies a situation related to the measurement;
a display control unit that displays a first indicator image superimposed on an image including the subject displayed on the display unit, and changes a display form of the first indicator image according to the situation identified by the situation identifying unit,
the situation specifying unit includes a third specifying unit that specifies that biological information of the subject is being measured,
the display control unit changes a display form of the first indicator image based on the identification by the third identification unit so that the measurer can understand that measurement is in progress; and
The display control unit is a terminal device that regularly changes the thickness or size of the first indicator image during measurement. The terminal device according to claim 3 , wherein the first index image is a human-shaped outline guide including a face and shoulders. the situation specifying unit includes a third specifying unit that specifies that biological information of the subject is being measured,
The terminal device according to any one of claims 3 to 8, wherein the display control unit changes the display form of the first indicator image based on the identification by the third identification unit so that the person taking the measurement can understand that measurement is in progress. 12. A program for causing a computer to function as the terminal device according to claim 1, the program causing the computer to function as at least the information acquisition unit, the situation identification unit, and the display control unit.