JP7752018B2 - Information processing device, information processing method, information processing system, and program - Google Patents

Description

The present invention relates to an information processing device, an information processing method, an information processing system, a terminal device, and a program.

Technology for supporting rehabilitation, a type of treatment for injured or disabled individuals, is known. Patent Document 1 discloses technology that automatically determines a rehabilitation menu based on the movements of the individual.

JP 2019-24580 A

For injured or disabled individuals, treatment, including rehabilitation, is painful, making it difficult to maintain motivation. The technology in Patent Document 1 leaves room for improvement in terms of maintaining the individual's motivation.

One aspect of the present invention aims to provide technology that can maintain the motivation of subjects undergoing treatment to improve their physical function.

In order to solve the above problem, an information processing device according to one aspect of the present invention includes an information acquisition unit that acquires information related to the subject's physical condition, a selection unit that references the information related to the subject's physical condition and selects a video of the other subject after treatment, the video including as a subject another subject whose physical condition is similar to that of the subject, and an output unit that outputs the video selected by the selection unit.

One aspect of the present invention makes it possible to maintain the motivation of subjects undergoing treatment to improve their physical function.

1 is a block diagram showing an example of the configuration of a terminal device and an information processing device included in an information processing system according to a first embodiment of the present invention. 4 is a table illustrating an example of data stored in a storage unit by a storage unit according to the first embodiment of the present invention. FIG. 2 is a sequence diagram showing a processing flow in the information processing system according to the first embodiment of the present invention. 5A and 5B are diagrams showing an example of a moving image displayed on a display panel by a display unit according to the first embodiment of the present invention. FIG. 10 is a block diagram showing an example of the configuration of a terminal device, an input device, and an information processing device included in an information processing system according to a second embodiment of the present invention. FIG. 10 is a schematic diagram illustrating an overview of an information processing system 100 according to a second embodiment of the present invention. FIG. 10 is a sequence diagram showing a processing flow in an information processing system according to a second embodiment of the present invention. 10 is a table showing an example of data stored in a storage unit by a storage unit according to the first modified example of the present invention. 10A and 10B are diagrams showing an example of a moving image displayed on a display panel by a display unit according to a first modified example of the present invention. 10A and 10B are diagrams showing another example of a moving image displayed on a display panel by a display unit according to the first modified example of the present invention. 10 is a table showing an example of data stored in a storage unit by a storage unit according to a second modification of the present invention. FIG. 1 is a block diagram illustrating the physical configuration of a terminal device, an input device, and a computer used as an information processing device according to each embodiment of the present invention.

[Embodiment 1]
An information processing system 100 according to an embodiment of the present invention will be described below.

(Configuration of information processing system 100)
FIG. 1 is a block diagram showing an example of the configuration of a terminal device 1 and an information processing device 3 included in an information processing system 100 according to this embodiment.

As shown in FIG. 1, a terminal device 1 and an information processing device 3 are connected to each other so that they can communicate with each other via a network N. Examples of the terminal device 1 include a smartphone, a PC (Personal Computer), and a tablet. An example of the information processing device 3 is a server.

The specific configuration of network N does not limit this embodiment, but examples include a wireless LAN (Local Area Network), a wired LAN, a WAN (Wide Area Network), a public line network, a mobile data communication network, or a combination of these networks.

In the information processing system 100, the information processing device 3 acquires information about the subject's physical condition from the terminal device 1, references the information, and selects a video that includes as a subject another subject whose physical condition is similar to that of the subject, and shows the other subject after the other subject has completed treatment. The information processing device 3 then outputs the selected video to the terminal device 1. The terminal device 1 displays the video output from the information processing device 3.

In the following, the above subject will also be referred to as "subject A," and the other subject will also be referred to as "subject B." Furthermore, "subject B" may be a subject different from "subject A," and any subject among multiple subjects different from "subject A" will be referred to as "subject B." In other words, in the following, multiple "subjects B" may be the same person or different people. In the following, when referring to both "subject A" and "subject B," they will simply be referred to as "subjects."

Here, examples of subject A include patients who are about to start treatment for an injury or disability, patients currently being treated for an injury or disability, and trainees who exercise. Examples of subject B include patients currently being treated for an injury or disability or patients who have fully recovered, and trainees who exercise. Furthermore, examples of users of terminal device 1 include therapists who care for patients currently being treated for an injury or disability, and trainers who instruct trainees who exercise. However, these do not limit this embodiment.

Examples of information regarding the subject's physical condition include, but are not limited to, the following:
Information indicating symptoms in a part of the body where the subject feels that the function is declining; Video images of the subject's movements; Information indicating treatment details being given to the subject to cure the part of the body where the function is declining; A doctor's diagnosis of the subject; Information indicating the exercises being performed by the subject. Examples of information indicating symptoms in a part of the body where the subject feels that the function is declining include knee pain and inability to lift shoulders. Examples of video images of the subject's movements include video images of the subject performing actions such as walking, raising arms, and standing up. Examples of treatment details being given to the subject include treatments (such as surgery) performed on the subject, medications prescribed for the subject, and rehabilitation training programs being performed by the subject. Examples of a doctor's diagnosis of the subject include the name of the disease the subject is suffering from, the location and name of the injury the subject has sustained, and the time until complete recovery. Examples of exercises being performed by the subject include squats and bench presses. These examples do not limit the present embodiment.

(Configuration of terminal device 1)
As shown in FIG. 1 , the terminal device 1 includes a communication unit 10 , a display panel 11 , an imaging unit 12 , and a control unit 15 .

The communication unit 10 is a communication module for communicating via the network N. The communication unit 10 supplies data acquired from the information processing device 3 via the network N to the control unit 15, and outputs data acquired from the control unit 15 to the information processing device 3 via the network N.

The display panel 11 is a display that displays data supplied from the control unit 15, which will be described later.

The imaging unit 12 is a camera capable of capturing moving images. As an example, the imaging unit 12 is directed toward the subject A by the user of the terminal device 1 so that the angle of view of the imaging unit 12 includes the subject A. The imaging unit 12 then captures moving images including the subject A performing a predetermined action (e.g., walking, raising an arm, standing up, etc.) and generates imaging data representing the moving images. The imaging unit 12 supplies the imaging data obtained by capturing images to the control unit 15.

(Control unit 15)
The control unit 15 controls each component of the terminal device 1. For example, the control unit 15 acquires imaging data indicating moving images captured by the imaging unit 12 and supplies data to be displayed on the display panel 11.

In addition, as shown in FIG. 1, the control unit 15 also functions as an information acquisition unit 16 (terminal device acquisition unit), a display unit 17, and an output unit 18 (terminal device output unit).

The information acquisition unit 16 acquires data output from the information processing device 3 and imaging data supplied from the imaging unit 12. As an example, the information acquisition unit 16 acquires from the imaging unit 12 video images output from the information processing device 3 and imaging data indicating video images including subject A as a subject.

The display unit 17 supplies data to the display panel 11 and displays images on the display panel 11. Examples of images that the display unit 17 displays on the display panel 11 include moving images output from the information processing device 3 and moving images showing imaging data supplied from the imaging unit 12. The display unit 17 may also display moving images including subject A and moving images output from the information processing device 3 on the display panel 11 so that they can be compared. Examples of images in which the display unit 17 displays moving images including subject A and moving images output from the information processing device 3 on the display panel 11 so that they can be compared will be described later with reference to different drawings.

The output unit 18 outputs data to the information processing device 3 via the communication unit 10. As an example, the output unit 18 outputs a moving image captured by the imaging unit 12, which is information regarding the physical condition of subject A.

(Configuration of information processing device 3)
As shown in FIG. 1, the information processing device 3 includes a communication unit 30, a storage unit 34, and a control unit 35.

The communication unit 30 is a communication module for communicating via the network N. The communication unit 30 supplies data acquired from the terminal device 1 via the network N to the control unit 35, and outputs data acquired from the control unit 35 to the terminal device 1 via the network N.

The memory unit 34 stores various types of data referenced by the control unit 35, which will be described later. More specifically, the memory unit 34 stores information relating to the physical condition of subject B and imaging data showing moving images acquired from the terminal device 1, in association with each other. Examples of data stored in the memory unit 34 will be described later with reference to different drawings.

(Control unit 35)
The control unit 35 controls each component of the information processing device 3. As an example, the control unit 35 acquires data from the terminal device 1 via the communication unit 30 and outputs data to the terminal device 1 via the communication unit 30.

As shown in FIG. 1, the control unit 35 also functions as an information acquisition unit 36 (information processing device acquisition unit), an output unit 38 (information processing device output unit), a selection unit 39, an extraction unit 40, and a storage unit 41.

The information acquisition unit 36 acquires data from the terminal device 1 via the communication unit 30. An example of data acquired by the information acquisition unit 36 is a video image that includes subject A as a subject.

The output unit 38 outputs data to the terminal device 1 via the communication unit 30. As an example, the output unit 38 outputs a moving image selected by the selection unit 39 (described later) to the terminal device 1.

The selection unit 39 references the video images acquired by the information acquisition unit 36 that include subject A as a subject, and selects a video image that includes subject B, whose physical condition is similar to that of subject A, after subject B has completed treatment. The selection unit 39 also acquires imaging data representing the selected video image from the storage unit 34. Details of the processing performed by the selection unit 39 will be described later.

The following are examples of methods by which the selection unit 39 distinguishes between the moving image after the subject B has finished treatment and other moving images, but these do not limit this embodiment.
- Tag information indicating the treatment stage is attached to the video, and by referring to the tag information, video whose tag information indicates "after treatment" is determined to be "video after treatment is completed." - Tag information indicating the subject and the shooting date and time is attached to the video, and by referring to the tag information, video whose tag information indicates the subject and which was acquired a predetermined period of time (e.g., two months) after the first acquisition of a video of the subject indicated by the tag information is determined to be "video after treatment is completed." - Analyze the audio contained in the video from the start to a predetermined time (e.g., 10 seconds), and determine that video whose analyzed audio includes words indicating that treatment has been completed (e.g., "after treatment,""completerecovery," etc.) is "video after treatment is completed." - Perform image analysis of objects contained in the video, and determine that video whose analyzed objects include an object indicating that treatment has been completed (e.g., a piece of paper with "after treatment,""completerecovery," etc.) is "video after treatment is completed." Here, the "treatment stage" refers to a stage in which treatment is divided until a diagnosis of complete recovery is made, and may be a stage set according to the content of the treatment, the duration of the treatment, or the physical condition. In the following example, the treatment stages are divided into five stages: pre-treatment, treatment stages 1 to 3, and post-treatment, but are not limited to this.

As an example of a case where the "treatment stage" is set according to the content of the treatment, in a treatment where a complete cure is diagnosed after n injections, the stage before injections is set as "pre-treatment," the stage after n/4 injections is set as "treatment stage 1," the stage after n/2 injections is set as "treatment stage 2," the stage after 3n/4 injections is set as "treatment stage 3," and the stage after n injections is set as "post-treatment."

As an example of a case where the "treatment stage" is set according to the duration of treatment, for an injury that takes m months to heal, the time before treatment would be set as "pre-treatment," the time after m/4 months would be set as "treatment stage 1," the time after m/2 months would be set as "treatment stage 2," the time after 3m/4 months would be set as "treatment stage 3," and the time after 4 months would be set as "post-treatment."

An example of a case where the "treatment stage" is set according to the physical condition is a treatment in which a complete recovery is diagnosed when the range of motion of a joint reaches k degrees, with the stage before treatment being set as "pre-treatment," the stage at which the range of motion reaches k/4 degrees being set as "treatment stage 1," the stage at which the range of motion reaches k/2 degrees being set as "treatment stage 2," the stage at which the range of motion reaches 3k/4 degrees being set as "treatment stage 3," and the stage at which the range of motion reaches k degrees being set as "post-treatment."

The extraction unit 40 applies a skeleton extraction process to the moving image indicated by the imaging data acquired by the information acquisition unit 36, and extracts the skeleton of subject A contained in the moving image. The extraction unit 40 outputs an extraction result indicating the result of skeleton extraction to the selection unit 39.

The accumulation unit 41 accumulates data in the memory unit 34. More specifically, the accumulation unit 41 associates information about the physical condition of subject B with imaging data showing video images of subject B's movements after treatment has been completed, and accumulates the associated information in the memory unit 34. Details of the data accumulated in the memory unit 34 by the accumulation unit 41 will be described with reference to Figure 2. Figure 2 is a table T1 showing an example of data accumulated in the memory unit 34 by the accumulation unit 41 according to this embodiment.

As shown in Table T1, the accumulation unit 41 associates previously acquired information about the physical condition of subject B with imaging data showing video images of subject B's movements after treatment has been completed, and stores the associated information in the storage unit 34. In Table T1, the information about subject B's physical condition, "Knee pain," is associated with imaging data "Imaging Data A," showing video images of subject B's movements after treatment has been completed. In other words, "Imaging Data A" is imaging data showing video images of subject B, a patient with the symptom "knee pain," performing movements after treatment has been completed. Similarly, in Table T1, the information about the physical condition of each of multiple subjects B, "slow walking speed," "knee joint replaced with an artificial joint," "prescribed drug X," and "uneven arm-raising movement," is associated with imaging data "Imaging Data B," "Imaging Data C," "Imaging Data D," and "Imaging Data E," showing video images of each subject B's movements after treatment has been completed.

Here, it is preferable that the movements of subject B included in the moving images represented by the imaging data stored in the memory unit 34 are movements related to information about the physical condition of subject B associated with the imaging data. More specifically, it is preferable that the movements of subject B included in the moving images are movements using the body parts indicated by the information about the physical condition of subject B.

As an example, if the information regarding subject B's physical condition is "my knee hurts," it is preferable that the movement of subject B included in the video image shown by the associated imaging data is a movement using the "knee" body part indicated by the information regarding subject B's physical condition (e.g., walking, standing up, etc.).

As another example, if the information regarding subject B's physical condition is "prescribed drug X," then it is preferable that the movements of subject B included in the video images shown by the associated imaging data are movements using a part of the body whose function is improved by "drug X." For example, if "drug X" is a drug that improves the function of the "shoulder," it is preferable that the movements of subject B included in the video images shown by the imaging data are movements using the "shoulder" (e.g., raising the arm).

(Processing Example 1 Executed by Selector 39)
The process executed by the selection unit 39 will be described.

The selection unit 39 refers to the indices derived from the video images indicated by the imaging data acquired by the information acquisition unit 36, and selects a video image that includes subject B, whose physical condition is similar to that of subject A, as a subject, after subject B has completed treatment.

As an example, the selection unit 39 derives the walking speed of subject A from the video as an index, and, by referring to the walking speed, selects a video that includes subject B, whose physical condition is similar to that of subject A, as a subject, and that shows subject B after the subject has completed treatment. For example, if the walking speed of subject A derived from the video is slower than a predetermined speed, the selection unit 39 selects, from the imaging data stored in the memory unit 34, imaging data in which information regarding the physical condition is associated with "slow walking speed."

Using table T1 shown in FIG. 2 as an example, the selection unit 39 selects "imaging data B," imaging data whose physical condition information is associated with "slow walking speed." In other words, the selection unit 39 selects "imaging data B," which includes, as a subject, subject B, whose physical condition is similar to subject A's physical condition of "slow walking speed." The selection unit 39 supplies the moving image indicated by the selected imaging data to the output unit 38, and the output unit 38 outputs the acquired moving image to the terminal device 1 via the communication unit 30.

Here, examples of indicators related to the subject's behavior are as follows:
- Speed of movement (an indicator of the speed of movement)
- Rhythm of movement (an indicator showing whether the movement is performed at the same rhythm each time)
- Body unsteadiness when performing movements (an index showing the fluctuation of the center of gravity in the left-right direction when performing movements)
- Laterality of movement (an index showing the symmetry of movement)
- Range of motion (an indicator of the range of movement of each part of the body during movement)
These include, but are not limited to:

The selection unit 39 may also be configured to refer to information other than the indices derived from the moving images. In other words, the selection unit 39 may be configured to refer to the moving images and information other than the moving images, which is information related to the physical condition of the subject A.
For example, when the selection unit 39 derives the walking speed of the subject A from the moving image as an index and the information acquisition unit 36 acquires information indicating the symptom of the subject A, "knee pain," the selection unit 39 selects imaging data in which the associated information on the physical condition is "knee pain" and "slow walking speed" from among the imaging data stored in the storage unit 33. The configuration when the information acquisition unit 36 acquires information other than moving images will be described in detail in an embodiment described later.

(Processing Example 2 Executed by Selector 39)
As another example, the extraction unit 40 may extract the skeleton of subject A contained in the video, and the selection unit 39 may refer to indices derived from the skeleton extracted by the extraction unit 40 and select a video containing subject B, whose physical condition is similar to that of subject A, as a subject.

As an example, if subject A included in a video acquired by the information acquisition unit 36 is raising his/her arm, the extraction unit 40 extracts subject A's arm. Next, the selection unit 39 references the arms extracted by the extraction unit 40 and derives an index based on the time difference until the left and right arms are raised to their highest position. Then, the selection unit 39 references the derived index and selects a video that includes subject B, whose physical condition is similar to that of subject A, as a subject.

For example, if the time difference between the left and right arms until they reach the top is greater than a predetermined value, the selection unit 39 selects, from the image data stored in the memory unit 34, image data associated with information about the body condition that indicates "there is a difference between the left and right arms in the arm-raising movement."

Using table T1 shown in FIG. 2 as an example, the selection unit 39 selects "imaging data E," imaging data associated with information on the physical condition that "there is a difference between the left and right sides in the arm-raising movement." In other words, the selection unit 39 selects "imaging data E," which includes, as a subject, subject B, whose physical condition is similar to that of subject A, "there is a difference between the left and right sides in the arm-raising movement." The selection unit 39 supplies the moving image represented by the selected imaging data to the output unit 38.

(Processing in Information Processing System 100)
The processing in the information processing system 100 will be described with reference to Fig. 3. Fig. 3 is a sequence diagram showing the flow of processing in the information processing system 100 according to this embodiment.

(Step S12)
In step S12, the information acquisition unit 16 of the terminal device 1 acquires, via the imaging unit 12, a moving image including the subject A as a subject, as information relating to the subject's physical condition.

(Step S13)
In step S<b>13 , the output unit 18 outputs the moving image acquired by the information acquisition unit 16 in step S<b>12 to the information processing device 3 via the communication unit 10 .

(Step S14)
In step S14, the information acquisition unit 36 of the information processing device 3 acquires, via the communication unit 30, the moving image output from the terminal device 1 in step S13.

(Step S15)
In step S15, the extraction unit 40 extracts the skeleton of the subject A included in the moving image acquired by the information acquisition unit 36 in step S14. Note that if there is no need to extract the skeleton of the subject A included in the moving image, the process of step S15 does not need to be executed, and in that case, step S16 may be executed after step S14 is completed.

(Step S16)
In step S16, the selection unit 39 refers to the moving image that is information about the physical condition of subject A, and selects a moving image that includes, as a subject, subject B whose physical condition is similar to that of subject A. If the extraction unit 40 has extracted the skeleton of subject A included in the moving image in step S15, the selection unit 39 refers to the extraction result that indicates the skeleton of subject A extracted by the extraction unit 40, and selects a moving image indicated by the imaging data that includes, as a subject, subject B whose physical condition is similar to that of subject A. The detailed processing by the selection unit 39 has been described above, and therefore will not be described here.

(Step S17)
In step S<b>17 , the output unit 38 outputs the moving image indicated by the imaging data selected by the selection unit 39 in step S<b>16 to the terminal device 1 via the communication unit 30 .

(Step S18)
In step S18, the information acquisition unit 16 of the terminal device 1 acquires, via the communication unit 10, the moving image output from the information processing device 3 in step S17.

(Step S19)
In step S19, the display unit 17 displays on the display panel 11 the moving image acquired by the information acquisition unit 16 in step S18.

(Example of moving image displayed on display unit 17)
An example of a moving image displayed on the display panel 11 by the display unit 17 will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of a moving image displayed on the display panel 11 by the display unit 17 according to the present embodiment.

As shown in FIG. 4, the display unit 17 displays a moving image MI2 including, as a subject, subject TP2, who is subject B and whose physical condition is similar to that of subject A. As shown in FIG. 4, the display unit 17 may display, in a comparable manner, moving image MI1 including, as a subject, subject TP1, who is subject A, and moving image MI2 including, as a subject, subject TP2, who is subject B, both acquired by the information acquisition unit 16. In addition, the display unit 17 may perform processing such as pixelating or blurring the face of subject TP2, who is subject B, so that it is not possible to identify him or her.

In this way, in the information processing system 100, the information processing device 3 includes an information acquisition unit 36 that acquires moving images containing subject A as a subject, which are information related to the physical condition of subject A; a selection unit 39 that references the moving images and selects a moving image containing subject B as a subject whose physical condition is similar to that of subject A, after subject B has completed treatment; and an output unit 38 that outputs the moving image selected by the selection unit 39.

Therefore, the information processing device 3 can present to subject A a moving image of subject B, whose physical condition is similar to that of subject A, after subject B has completed treatment. As a result, when subject A undergoes treatment to improve physical function, such as rehabilitation, the information processing device 3 can present the extent to which subject B, who has a similar physical condition, has improved in physical function after completing rehabilitation, thereby maintaining subject A's motivation.

[Embodiment 2]
An information processing system 100A according to an embodiment of the present invention will be described below.

(Overview of information processing system 100A)
First, an overview of the information processing system 100A will be described with reference to Fig. 6. Fig. 6 is a schematic diagram showing an overview of the information processing system 100A according to this embodiment. As shown in Fig. 2, the information processing system 100A includes a terminal device 1, an input device 2, and an information processing device 3A.

As shown in FIG. 6, the terminal device 1, input device 2, and information processing device 3A are connected to each other via a network N so that they can communicate with each other. Examples of the terminal device 1 and input device 2 include a smartphone, a PC, and a tablet. An example of the information processing device 3A is a server.

In the information processing system 100A, the information processing device 3A acquires moving images as an example of information related to the physical condition of subject A from the terminal device 1, and acquires information related to the physical condition of subject A other than the moving images from the input device 2.

In addition, in the information processing system 100A, the information processing device 3A refers to at least one of the acquired video images and information other than the video images relating to the physical condition, and selects a video image that includes subject B, whose physical condition is similar to that of subject A, as a subject, after subject B has completed treatment.

The information processing device 3A then outputs the selected video to the terminal device 1. The terminal device 1 displays the acquired video. The configuration by which the information processing device 3A acquires the video from the terminal device 1 has been explained in the above embodiment, so explanation will be omitted in this embodiment as appropriate.

Here, examples of users of the input device 2 include a doctor examining a patient who is about to start treatment for an injury or disability or a patient currently being treated for an injury or disability, and a trainer who instructs a trainee who is exercising. As in embodiment 1, examples of subject A include a patient who is about to start treatment for an injury or disability, a patient currently being treated for an injury or disability, and a trainee who is exercising, and examples of subject B include a patient currently being treated for an injury or disability or a patient who has fully recovered, and a trainee who is exercising. Furthermore, examples of users of the terminal device 1 include a therapist who cares for a patient currently being treated for an injury or disability, and a trainer who instructs a trainee who is exercising. However, these do not limit this embodiment.

(Terminal device 1)
Next, a configuration example of the terminal device 1 according to this embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing a configuration example of the terminal device 1, the input device 2, and the information processing device 3A included in the information processing system 100A according to this embodiment.

As shown in FIG. 5, the terminal device 1 has the same main components as the terminal device 1 in the first embodiment described above. That is, in this embodiment as well, the information acquisition unit 16 of the terminal device 1 acquires moving images including subject A as a subject and moving images output from the information processing device 3A. The output unit 18 outputs the moving images including subject A as a subject acquired by the information acquisition unit 16 to the information processing device 3A. The display unit 17 displays the moving images including subject A as a subject and moving images acquired from the information processing device 3A on the display panel 11. The specific processing by the terminal device 1 is the same as in the first embodiment, so a description thereof will be omitted here.

(Input device 2)
As shown in FIG. 5, the input device 2 includes a communication unit 20 , a display panel 21 , an operation reception unit 23 , and a control unit 25 .

The communication unit 20 is a communication module for communicating via the network N. The communication unit 20 supplies data acquired from the information processing device 3A via the network N to the control unit 25, and outputs data acquired from the control unit 25 to the information processing device 3A via the network N.

The display panel 21 is a display that displays data supplied from the control unit 25, which will be described later.

The operation reception unit 23 is a user interface that receives input from the user. As an example, the operation reception unit 23 receives input of information regarding the physical condition of subject A, such as the results of a doctor's diagnosis of the subject, information indicating subject A's symptoms, and the details of treatment to be performed on subject A. The operation reception unit 23 supplies the input information to the control unit 25.

(Control unit 25)
The control unit 25 controls each component of the input device 2. For example, the control unit 25 acquires information regarding the physical condition of the subject A accepted by the operation acceptance unit 23, and supplies data to be displayed on the display panel 21.

In addition, as shown in FIG. 5, the control unit 25 also functions as an information acquisition unit 26 (input device acquisition unit), a display unit 27, and an output unit 28 (input device output unit).

The information acquisition unit 26 acquires data acquired from the information processing device 3A via the communication unit 20 and information regarding the physical condition of subject A supplied from the operation acceptance unit 23.

The display unit 27 supplies data to the display panel 21 and displays an image on the display panel 21. An example of an image that the display unit 27 displays on the display panel 21 is an image corresponding to an input received by the operation reception unit 23.

Furthermore, when the above-mentioned information acquisition unit 26 acquires a moving image from the information processing device 3A, the display unit 27 displays the moving image acquired by the information acquisition unit 26 on the display panel 21. Further, when the information acquisition unit 26 acquires a moving image including the subject as a subject and a moving image output from the information processing device 3A, the display unit 27 may, similar to the above-mentioned display unit 17, display the moving image including the subject as a subject and the moving image output from the information processing device 3A on the display panel 21 so that they can be compared.

The output unit 28 outputs data to the information processing device 3A via the communication unit 20. As an example, the output unit 28 outputs information regarding the physical condition of subject A acquired by the information acquisition unit 26 to the information processing device 3A via the communication unit 20.

(Information processing device 3A)
5, the information processing device 3A includes a communication unit 30, a storage unit 34, and a control unit 35A. The communication unit 30 and the storage unit 34 are as described above.

(Control unit 35A)
The control unit 35A controls each component of the information processing device 3A. As shown in Fig. 5 , the control unit 35A also functions as an information acquisition unit 36A, an output unit 38, a selection unit 39A, an extraction unit 40, and a storage unit 41. The output unit 38, the extraction unit 40, and the storage unit 41 are as described above.

In addition to the functions of the information acquisition unit 36 described above, the information acquisition unit 36A acquires information regarding the physical condition of subject A output from the input device 2 via the communication unit 30.

In addition to the functions of the selection unit 39 described above, the selection unit 39A references information regarding the physical condition of subject A acquired by the information acquisition unit 36A, and selects video images that include subject B, whose physical condition is similar to that of subject A, as a subject, and that are taken after subject B has completed treatment.

(Processing Example 1 Executed by Selector 39A)
The process executed by the selection unit 39A will be described.

As an example, if the information regarding the physical condition of subject A acquired by the information acquisition unit 36A indicates "knee pain," which is information indicating symptoms in a part of the body where subject A feels that function is declining, the selection unit 39A selects, from the imaging data stored in the memory unit 34, imaging data in which the information regarding the physical condition is associated with "knee pain."

Using table T1 shown in FIG. 2 as an example, the selection unit 39A selects "imaging data A," imaging data whose information on the physical condition is associated with "knee pain." In other words, the selection unit 39A selects "imaging data A," which includes subject B, whose physical condition is similar to subject A's physical condition of "knee pain," as a subject, and which is taken after subject B has completed treatment. The selection unit 39A outputs the moving image represented by the selected imaging data to the output unit 38.

(Processing Example 2 Executed by Selector 39A)
As another example, if the information regarding the physical condition of subject A acquired by information acquisition unit 36A is information indicating that "the subject's knee joint has been replaced with an artificial joint," which indicates the treatment to be performed on subject A to cure a part of the subject A's body that has weakened function, selection unit 39A selects, from the imaging data stored in memory unit 34, imaging data whose information regarding the physical condition is associated with "the subject's knee joint has been replaced with an artificial joint."

Using table T1 shown in FIG. 2 as an example, the selection unit 39A selects "imaging data C," imaging data associated with information on the physical condition that "the subject's knee joint has been replaced with an artificial joint." In other words, the selection unit 39A selects "imaging data C," which includes subject B, whose physical condition is similar to that of subject A, "the knee joint has been replaced with an artificial joint." The selection unit 39A outputs the moving image represented by the selected imaging data to the output unit 38.

(Processing Example 3 Executed by Selector 39A)
As yet another example, if the information regarding the physical condition of subject A acquired by information acquisition unit 36A is information indicating that "subject A has been prescribed medicine X," which indicates the treatment to be performed on subject A to cure a part of the body where function has deteriorated, selection unit 39A selects, from the imaging data stored in memory unit 34, imaging data in which the information regarding the physical condition is associated with "medicine X has been prescribed."

Using table T1 shown in FIG. 2 as an example, the selection unit 39A selects "imaging data D," imaging data associated with information on the physical condition "prescribed drug X." In other words, the selection unit 39A selects "imaging data D," which includes subject B, whose physical condition is similar to that of subject A, "prescribed drug X," as a subject, and which is taken after subject B has completed treatment. The selection unit 39A outputs a moving image represented by the selected imaging data to the output unit 38.

(Processing in Information Processing System 100A)
The processing in the information processing system 100A will be described with reference to Fig. 7. Fig. 7 is a sequence diagram showing the flow of processing in the information processing system 100A according to this embodiment.

(Step S31)
In step S<b>31 , the information acquisition unit 26 of the input device 2 acquires information about the physical condition of the subject A via the operation acceptance unit 23 .

(Step S32)
In step S32, the output unit 28 outputs the information on the physical condition of the subject A acquired by the information acquisition unit 26 in step S31 to the information processing device 3A via the communication unit 20.

(Step S33)
In step S33, the information acquisition unit 36A of the information processing device 3A acquires, via the communication unit 30, the information on the physical condition of the subject A output from the input device 2 in step S32.

(Step S34)
In step S34, the selection unit 39A refers to the information regarding the physical condition of the subject A acquired by the information acquisition unit 36A in step S33, selects imaging data that includes, as a subject, subject B whose physical condition is similar to that of subject A, and that is obtained after subject B has completed treatment, and acquires the imaging data from the storage unit 34. Detailed processing by the selection unit 39A has been described above, and therefore will not be described here.

(Steps S17 to S19)
Steps S17 to S19, in which the output unit 38 outputs the moving image selected by the selection unit 39A to the terminal device 1 and the display unit 17 of the terminal device 1 displays the moving image on the display panel 11, are the same as the processes described above, and therefore will not be described here.

Here, in step S17, the output unit 38 may be configured to output the moving image selected by the selection unit 39A to the input device 2 instead of or together with the terminal device 1. In this case, the information acquisition unit 26 of the input device 2 acquires the moving image output from the information processing device 3A. Then, the display unit 27 displays the moving image acquired by the information acquisition unit 26 on the display panel 21.

In this way, in the information processing system 100A, the information processing device 3A is equipped with an information acquisition unit 36A that acquires information other than moving images, such as information related to the physical condition of subject A, from the input device 2; a selection unit 39A that references the information related to the physical condition of subject A and selects a moving image of subject B, whose physical condition is similar to that of subject A, after subject B has completed treatment, as a subject; and an output unit 38 that outputs the moving image selected by the selection unit 39A.

Therefore, similar to the embodiment described above, the information processing device 3A can present to subject A a moving image of subject B, whose physical condition is similar to that of subject A, after subject B has completed treatment. Therefore, when subject A undergoes treatment to improve physical function, such as rehabilitation, the information processing device 3A can present the extent to which subject B, who has a similar physical condition, has improved in physical function after completing rehabilitation, thereby maintaining subject A's motivation.

[Modification]
Modifications of the present invention will be described below. In the following modifications, the information processing device 3, the information acquisition unit 36, and the selection unit 39 can be read as an information processing device 3A, an information acquisition unit 36A, and a selection unit 39A, respectively.

(Variation 1)
The information processing device 3 may be configured to acquire, in advance, as imaging data to be stored in the storage unit 34, pre-treatment imaging data showing moving images including the subject B as a subject before treatment, in addition to post-treatment imaging data showing moving images after the subject B has finished treatment. In this case, the storage unit 41 associates the pre-treatment imaging data and the post-treatment imaging data with information on the physical condition of the subject B and stores them in the storage unit 34. Details of the data stored in the storage unit 34 in this configuration will be described with reference to FIG. 8. FIG. 8 is a table T2 showing an example of data stored in the storage unit 34 by the storage unit 41 according to this modification.

In Table T2, information about subject B's physical condition, "Knee pain," is associated with "Imaging data A1," which is imaging data before treatment, and "Imaging data A2," which is imaging data after treatment. In Table T2, information about subject B's physical condition other than "Knee pain" is also associated with each of subject B's respective information about the physical condition, and the imaging data before treatment and imaging data after treatment.

One example of a method by which the information processing device 3 identifies pre-treatment imaging data and post-treatment imaging data is to attach tag information indicating the treatment stage to the imaging data. In this method, the accumulation unit 41 associates information related to the physical condition, imaging data attached with tag information indicating the treatment stage, and the tag information, and stores the associated information in the memory unit 34. With this configuration, the information processing device 3 can identify pre-treatment imaging data and post-treatment imaging data by referencing the associated tag information.

In this modified example, the selection unit 39 selects pre-treatment imaging data and post-treatment imaging data as imaging data showing moving images including, as a subject, subject B, whose physical condition is similar to that of subject A. For example, if the information regarding subject A's physical condition acquired by the information acquisition unit 36 indicates "knee pain," the selection unit 39 selects pre-treatment imaging data "imaging data A1" and post-treatment imaging data "imaging data A2," which are associated in table T2 with the information regarding the physical condition as "knee pain." The moving images shown by the imaging data selected by the selection unit 39 are transmitted to the terminal device 1, as described above, and displayed on the display panel 11 by the display unit 17 of the terminal device 1.

In other words, the selection unit 39 selects the imaging data of subject B, whose physical condition is similar to that of subject A, "pain in the knee," as the subject, "imaging data A1," before treatment, and the imaging data of subject B, "imaging data A2," after treatment.

(Example 1 of moving image displayed by display unit 17 in this modification)
An example of a moving image displayed on the display panel 11 by the display unit 17 will be described with reference to Fig. 9. Fig. 9 is a diagram showing an example of a moving image displayed on the display panel 11 by the display unit 17 according to this modification.

As shown in FIG. 9, the display unit 17 displays a moving image MI3 shown by imaging data after treatment, including as a subject a subject TP3 who is subject B and whose physical condition is similar to that of subject A. As shown in FIG. 9, the display unit 17 may display a moving image MI1 shown by imaging data after treatment, including as a subject a subject TP1 who is subject A, and a moving image MI3 shown by imaging data after treatment, including as a subject a subject TP3 who is subject B and whose physical condition is similar to that of subject A, so that they can be compared.

(Example 2 of moving images displayed by the display unit 17 in this modification)
Another example of a moving image displayed on the display panel 11 by the display unit 17 will be described with reference to Fig. 10. Fig. 10 is a diagram showing another example of a moving image displayed on the display panel 11 by the display unit 17 according to this modification.

As shown in FIG. 10, the display unit 17 displays a moving image MI4 shown by imaging data before treatment, including as a subject a subject TP4 who is subject B and whose physical condition is similar to that of subject A. As shown in FIG. 10, the display unit 17 may display a moving image MI1 shown by imaging data before treatment, including as a subject a subject TP1 who is subject A, and a moving image MI3 shown by imaging data before treatment, including as a subject a subject TP4 who is subject B and whose physical condition is similar to that of subject A, so that they can be compared.

In this way, the information processing device 3 according to this modified example includes subject B, whose physical condition is similar to that of subject A, as a subject, and selects a video MI3 represented by the post-treatment imaging data and a video MI4 represented by the pre-treatment imaging data. Therefore, by selecting video MI3 represented by the post-treatment imaging data and then video MI4 represented by the pre-treatment imaging data, the information processing device 3 can show the subject how much the physical condition of another subject has improved as a result of treatment, thereby maintaining subject A's motivation.

Furthermore, the information acquisition unit 36 of the information processing device 3 may acquire video images of subject A's movements before treatment as information regarding subject A's physical condition, and may further acquire video images of subject A's movements after treatment. In other words, the information acquisition unit 36 may acquire video images including subject A as a subject before and after treatment administered to subject A. With this configuration, the video images of subject A before and after treatment acquired by the information acquisition unit 36 are associated with information regarding the physical condition by the accumulation unit 41 and stored in the memory unit 34 as video images of subject B before and after treatment. Therefore, the information processing device 3 can increase the amount of imaging data stored in the memory unit 34.

(Variation 2)
The information acquisition unit 36 may be configured to acquire imaging data before and after each of a plurality of treatments in advance as imaging data to be stored in the storage unit 34. In this case, the storage unit 41 associates the imaging data at each treatment stage with information on the physical condition of the subject B and stores it in the storage unit 34. Details of the data stored in the storage unit 34 in this configuration will be described with reference to Fig. 11. Fig. 11 is a table T3 showing an example of data stored in the storage unit 34 by the storage unit 41 according to this modification.

In Table T3, information about subject B's physical condition, "Knee pain," is associated with "Imaging data A1," which is imaging data before treatment, "Imaging data A1-1," which is imaging data at treatment stage 1, "Imaging data A1-2," which is imaging data at treatment stage 2, "Imaging data A1-3," which is imaging data at treatment stage 3, and "Imaging data B2," which is imaging data after treatment. In Table T3, information about subject B's physical condition other than "Knee pain" is also associated with imaging data at each treatment stage.

One example of a method by which the information processing device 3 can identify which treatment stage the imaging data belongs to is to attach tag information indicating the treatment stage to the imaging data. In this method, the accumulation unit 41 associates information related to the physical condition, imaging data attached with tag information indicating the treatment stage, and the tag information and stores the associated information in the memory unit 34. With this configuration, the information processing device 3 can identify which treatment stage the imaging data belongs to by referencing the associated tag information.

Here, "treatment stages" refer to the stages of treatment until a diagnosis of complete recovery is made. For example, the stages may be set according to the content of the treatment, the duration of the treatment, or the physical condition of the patient. In this modified example, the treatment stages are divided into five stages: pre-treatment, treatment stages 1 to 3, and post-treatment, but are not limited to this.

As an example of a case where the "treatment stage" is set according to the content of the treatment, in a treatment where a complete cure is diagnosed after n injections, the stage before injections is set as "pre-treatment," the stage after n/4 injections is set as "treatment stage 1," the stage after n/2 injections is set as "treatment stage 2," the stage after 3n/4 injections is set as "treatment stage 3," and the stage after n injections is set as "post-treatment."

As an example of a case where the "treatment stage" is set according to the duration of treatment, for an injury that takes m months to heal, the time before treatment would be set as "pre-treatment," the time after m/4 months would be set as "treatment stage 1," the time after m/2 months would be set as "treatment stage 2," the time after 3m/4 months would be set as "treatment stage 3," and the time after 4 months would be set as "post-treatment."

An example of a case where the "treatment stage" is set according to the physical condition is a treatment in which a complete recovery is diagnosed when the range of motion of a joint reaches k degrees, with the stage before treatment being set as "pre-treatment," the stage at which the range of motion reaches k/4 degrees being set as "treatment stage 1," the stage at which the range of motion reaches k/2 degrees being set as "treatment stage 2," the stage at which the range of motion reaches 3k/4 degrees being set as "treatment stage 3," and the stage at which the range of motion reaches k degrees being set as "post-treatment."

In this modified example, the selection unit 39 may select all videos associated with information about the physical condition of subject B, or may select videos at a pre-specified stage of treatment, as videos containing subject B, whose physical condition is similar to that of subject A, as subjects.

For example, if the information regarding the physical condition of subject A acquired by the information acquisition unit 36 indicates "my knee hurts," the selection unit 39 selects the imaging data "imaging data A1," "imaging data A1-1," "imaging data A1-2," "imaging data A1-3," and "imaging data A2" associated with the information regarding the physical condition "my knee hurts" in table T3. Then, as described above, the video represented by the imaging data selected by the selection unit 39 is transmitted to the terminal device 1 and displayed on the display panel 11 by the display unit 17 of the terminal device 1.

Here, the display unit 17 may sequentially display the multiple acquired moving images. Furthermore, the terminal device 1 may receive instructions, via an operation reception unit (not shown), indicating which treatment stage moving images to display. In this case, the display unit 17 may display the moving image of the corresponding treatment stage from among the multiple acquired moving images, in accordance with the received instruction.

As another example, if the information regarding the physical condition of subject A acquired by the information acquisition unit 36 indicates "slow walking speed" and the information acquisition unit 36 acquires information indicating that the subject's treatment stage is "treatment stage 2," the selection unit 39 selects "imaging data B1-2," which corresponds to "treatment stage 2," from among the imaging data associated in table T3 with the information regarding the physical condition as "slow walking speed." Then, as described above, the video representing "imaging data B1-2" selected by the selection unit 39 is transmitted to the terminal device 1 and displayed on the display panel 11 by the display unit 17 of the terminal device 1.

In this way, the information processing device 3 according to this modified example includes subject B, whose physical condition is similar to that of subject A, as a subject, and selects videos to present from videos taken before and after each of a number of treatments. Therefore, the information processing device 3 can present to subject A how much treatment will improve his or her physical condition, thereby maintaining subject A's motivation.

Furthermore, the information acquisition unit 36 of the information processing device 3 may acquire, as information regarding the physical condition of subject A, video images of subject A's movements before treatment at a certain treatment stage, and may further acquire video images of subject A's movements after treatment at a certain treatment stage. In other words, the information acquisition unit 36 may acquire video images including subject A as a subject before and after each of one or more treatments administered to subject A. With this configuration, the video images of subject A before and after treatment at a certain treatment stage acquired by the information acquisition unit 36 are associated with information regarding the physical condition and stored in the memory unit 34 as video images of subject B before and after treatment at a certain treatment stage by the storage unit 41. Therefore, the information processing device 3 can increase the amount of imaging data stored in the memory unit 34.

(Variation 3)
The selection unit 39 may be configured to select imaging data according to the body part indicated by the acquired information on the subject A's physical condition.

As an example, if the information regarding the physical condition of subject A acquired by the information acquisition unit 36 indicates that "my knee hurts," the selection unit 39 first identifies the body part "knee" indicated by the information regarding subject A's physical condition.

Next, the selection unit 39 selects information about the subject's physical condition related to the "knee" from the information about the physical condition stored in the memory unit 34. Taking table T1 shown in Figure 3 as an example, the selection unit 39 selects "My knee hurts" and "My knee joint was replaced with an artificial joint" related to the "knee."

Then, the selection unit 39 selects imaging data associated with the selected information about the physical condition. Taking table T1 shown in FIG. 3 as an example, the selection unit 39 selects imaging data "imaging data A" and "imaging data C" associated with "knee pain" and "knee joint replaced with artificial joint," respectively.

Furthermore, for example, if drug X can improve knee function, the selection unit 39 may select "prescribed drug X" as information related to the physical condition of the "knee" in the above example. In this case, the selection unit 39 also selects the imaging data "imaging data D" associated with "prescribed drug X." Then, as in the above embodiment, the display unit 17 of the terminal device 1 displays the imaging data selected by the selection unit 39 on the display panel 11.

In this way, the information processing device 3 selects moving images according to the body part indicated by the acquired information on the physical condition of subject A. With this configuration, for example, the information processing device 3 can present to subject A, who has knee pain, moving images including subject B, who has had his knee joint replaced with an artificial joint, as a subject, and moving images including subject B, who has been prescribed drug X, as a subject. Therefore, the information processing device 3 can allow subject A to compare the results of having his knee replaced with an artificial joint with the results of being prescribed drug X, thereby allowing subject A to select a treatment method.

[Software implementation example]
The functions of the terminal device 1, the input device 2, and the information processing device 3, 3A can be realized by a program for causing a computer to function as the device, and a program for causing a computer to function as each control block of the device (particularly each part included in the control unit 15, 25, 35, 35A).

In this case, the device includes a computer having at least one control device (e.g., a processor) and at least one storage device (e.g., a memory) as hardware for executing the program. The functions described in each of the above embodiments are realized by executing the program using this control device and storage device.

The above program may be stored non-transitory on one or more computer-readable storage media. These storage media may or may not be included in the device. In the latter case, the program may be supplied to the device via any wired or wireless transmission medium.

Furthermore, some or all of the functions of each of the above control blocks can be realized by logic circuits. For example, integrated circuits incorporating logic circuits that function as each of the above control blocks are also included in the scope of the present invention. In addition, the functions of each of the above control blocks can also be realized by, for example, a quantum computer.

Furthermore, each process described in each of the above embodiments may be executed by AI (Artificial Intelligence). In this case, the AI may run on the control device, or on another device (for example, an edge computer or a cloud server).

(Physical configuration of terminal device 1)
12 is a block diagram illustrating the physical configuration of a computer used as the terminal device 1, the input device 2, and the information processing device 3. As shown in Fig. 12, the terminal device 1 can be configured by a computer including a bus 110, a processor 101, a main memory 102, an auxiliary memory 103, a communication interface 104, a display panel 105, and a camera 106. The processor 101, the main memory 102, the auxiliary memory 103, the communication interface 104, the display panel 105, and the camera 106 are connected to one another via the bus 110.

The processor 101 may be, for example, a CPU (Central Processing Unit), a microprocessor, a digital signal processor, a microcontroller, or a combination of these.

The main memory 102 may be, for example, a semiconductor RAM (random access memory).

The auxiliary memory 103 may be, for example, a flash memory, a hard disk drive (HDD), a solid state drive (SSD), or a combination of these. The auxiliary memory 103 stores a program that causes the processor 101 to execute the operations of the terminal device 1 described above. The processor 101 loads the program stored in the auxiliary memory 103 onto the main memory 102 and executes each command included in the loaded program.

The communication interface 104 is an interface that connects to the network N.

Display panel 105 is an example of a hardware element that realizes display panel 11.

The camera 106 is an example of a hardware element that realizes the imaging unit 12.

In this example, the processor 101 is an example of a hardware element that realizes the control unit 15. The main memory 102 and auxiliary memory 103 are also examples of hardware elements that realize a storage unit (not shown). The communication interface 104 is also an example of a hardware element that realizes the communication unit 10.

(Physical configuration of input device 2)
12, the input device 2 can be configured by a computer including a bus 210, a processor 201, a main memory 202, an auxiliary memory 203, a communication interface 204, a display panel 205, and a keyboard 207. The processor 201, the main memory 202, the auxiliary memory 203, the communication interface 204, the display panel 205, and the keyboard 207 are connected to one another via the bus 210.

The keyboard 207 is an example of a hardware element that realizes the operation reception unit 23.

In this example, the processor 201 is an example of a hardware element that realizes the control unit 25. The main memory 202 and auxiliary memory 203 are also examples of hardware elements that realize a storage unit (not shown). The communication interface 204 is also an example of a hardware element that realizes the communication unit 20. The display panel 205 is also an example of a hardware element that realizes the display panel 21.

(Physical configuration of information processing device 3)
12, the information processing device 3 can be configured by a computer including a bus 310, a processor 301, a main memory 302, an auxiliary memory 303, and a communication interface 304. The processor 301, the main memory 302, the auxiliary memory 303, and the communication interface 304 are connected to one another via the bus 310.

In this example, the processor 301 is an example of a hardware element that realizes the control unit 35. The main memory 302 and auxiliary memory 303 are examples of hardware elements that realize the storage unit 34. The communication interface 304 is an example of a hardware element that realizes the communication unit 30.

[summary]
An information processing device according to one aspect of each embodiment includes an information acquisition unit that acquires information relating to the subject's physical condition, a selection unit that refers to the information relating to the subject's physical condition and selects a video of the other subject having a physical condition similar to that of the subject as a subject, after the other subject has completed treatment, and an output unit that outputs the video selected by the selection unit.

With the above configuration, the subject can be presented with video images of other subjects with similar physical conditions as the subject, showing those other subjects after they have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve their physical function.

In an information processing device according to one aspect of each embodiment, it is preferable that the information acquisition unit acquires video images including the subject as a subject, and the selection unit refers to an index derived from the video images acquired by the information acquisition unit and selects video images including another subject as a subject whose physical condition is similar to that of the subject, after the other subject has completed treatment.

With the above configuration, the subject can be presented with video images of other subjects with similar physical conditions as the subject, showing those other subjects after they have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve their physical function.

It is preferable that the information processing device according to one aspect of each embodiment further includes an extraction unit that extracts the subject's skeleton included in the video acquired by the information acquisition unit, and the selection unit references the indices derived from the skeleton extracted by the extraction unit and selects a video that includes as a subject another subject whose physical condition is similar to that of the subject, and that shows the other subject after the other subject has completed treatment.

With the above configuration, the subject can be presented with video images of other subjects with similar physical conditions as the subject, showing those other subjects after they have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve their physical function.

In an information processing device according to one aspect of each embodiment, it is preferable that the information acquisition unit acquires moving images including the subject as a subject before and after each of one or more treatments administered to the subject.

With the above configuration, the number of moving images presented to the subject increases, which helps maintain the subject's motivation to undergo treatment to improve physical function.

In an information processing device according to one aspect of each embodiment, the information acquisition unit acquires information indicating the treatment to be administered to the subject, and the selection unit references the information indicating the treatment acquired by the information acquisition unit, and preferably selects a video of the subject after the treatment has been completed, the video including as a subject another subject whose physical condition is similar to that of the subject.

With the above configuration, the subject can be presented with video images of other subjects with similar physical conditions as the subject, showing those other subjects after they have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve their physical function.

An information processing method according to one aspect of each embodiment includes an information acquisition step of acquiring information related to the subject's physical condition; a selection step of referring to the information related to the subject's physical condition and selecting a video of the subject after the other subject has completed treatment, the video including as a subject another subject whose physical condition is similar to that of the subject; and an output step of outputting the video selected in the selection step.

With the above configuration, the subject can be presented with video images of other subjects with similar physical conditions as the subject, showing those other subjects after they have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve their physical function.

An information processing system according to one aspect of each embodiment is an information processing system including a terminal device, an input device, and an information processing device, wherein the terminal device includes a terminal device acquisition unit that acquires from the information processing device moving images including a subject as a subject, and moving images of other subjects whose physical conditions are similar to those of the subject as subjects and after the other subjects have completed treatment; a terminal device output unit that outputs the moving images including the subject as a subject acquired by the terminal device acquisition unit to the information processing device; and a display unit that displays the moving images including the other subjects as subjects and after the other subjects have completed treatment, acquired by the terminal device acquisition unit; an input device acquisition unit that acquires information about the subject's physical condition, and an input device output unit that outputs the information about the subject's physical condition acquired by the input device acquisition unit, and the information processing device comprises an information processing device acquisition unit that acquires at least one of moving images output from the terminal device and information output from the input device, a selection unit that references at least one of the moving images and information acquired by the information processing device acquisition unit and selects a moving image of the other subject after treatment has been completed, the moving image including as a subject another subject whose physical condition is similar to that of the subject, and an information processing device output unit that outputs the moving image selected by the selection unit to the terminal device.

With the above configuration, the subject can be presented with video images of other subjects with similar physical conditions as the subject, showing those other subjects after they have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve their physical function.

A terminal device according to one aspect of each embodiment includes, as a subject, another subject whose physical condition is similar to that of the subject, and includes an acquisition unit that acquires video images that include the subject as a subject and video images of the other subject after treatment, the video images being referenced for selecting video images of the other subject after treatment has been completed; an output unit that outputs the video images acquired by the acquisition unit; and a display unit that displays the video images acquired by the acquisition unit of the other subject after treatment has been completed.

With the above configuration, the subject can be presented with video images of other subjects with similar physical conditions as the subject, showing those other subjects after they have completed treatment, thereby maintaining the motivation of the subject undergoing treatment to improve their physical function.

It is preferable that the display unit in the terminal device according to one aspect of each embodiment displays a video image including the subject as a subject and a video image of the other subject after treatment has been completed, in a manner that allows comparison.

The above configuration allows the subject to compare video images that include the subject as a subject with video images that include another subject as a subject whose physical condition is similar to that of the subject, and that show the other subject after the other subject has completed treatment, thereby maintaining the subject's motivation to undergo treatment to improve physical function.

The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention.

REFERENCE SIGNS LIST 1 Terminal device 2 Input device 3, 3A Information processing device 10, 20, 30 Communication unit 11, 21, 31 Display panel 12 Imaging unit 15, 25, 35, 35A Control unit 16, 26, 36, 36A Information acquisition unit 17, 27 Display unit 18, 28, 38 Output unit 23 Operation acceptance unit 34 Storage unit 39, 39A Selection unit 40 Extraction unit 41 Accumulation unit 100, 100A Information processing system

Claims (8)

an information acquisition unit that acquires information about the subject's physical condition;
a storage unit that stores information about the physical condition of the other subject and a moving image of the other subject after the other subject has finished treatment in association with each other in the storage unit;
a selection unit that identifies information about the physical condition of the other subject that indicates a physical condition similar to a physical condition indicated by the information about the physical condition of the subject, and selects, in the storage unit, a video associated with the identified information about the physical condition of the other subject;
an output unit that outputs the moving image selected by the selection unit;
An information processing device comprising: the information acquisition unit acquires a moving image including the target person as a subject;
The information processing device according to claim 1, wherein the selection unit refers to an index derived from the moving image acquired by the information acquisition unit, and selects a moving image that includes as a subject another subject whose physical condition is similar to that of the subject, after the other subject has completed treatment. further comprising an extraction unit that extracts a skeleton of the subject included in the moving image acquired by the information acquisition unit;
The information processing device according to claim 2, wherein the selection unit refers to the indices derived from the skeleton extracted by the extraction unit, and selects a video image of another subject whose physical condition is similar to that of the subject, after the other subject has completed treatment, the video image including the other subject whose physical condition is similar to that of the subject. The information processing device according to claim 2 or 3, wherein the information acquisition unit acquires moving images including the subject as a subject before and after each of one or more treatments performed on the subject. The information acquisition unit acquires information indicating a treatment content to be performed on the subject,
The information processing device described in any one of claims 1 to 4, wherein the selection unit refers to information indicating the treatment content acquired by the information acquisition unit, and selects a video image of another subject whose physical condition is similar to that of the subject as a subject, after the other subject has completed treatment. The information processing device
an information acquisition step of acquiring information about the subject's physical condition;
a storage step of associating information about the physical condition of the other subject with a moving image including the other subject as a subject and obtained after the other subject has completed treatment, and storing the information in a storage unit;
a selection step of identifying information about the physical condition of the other subject that indicates a physical condition similar to a physical condition indicated by the information about the physical condition of the subject, and selecting, in the storage unit, a video associated with the identified information about the physical condition of the other subject ;
an output step of outputting the moving image selected in the selection step;
An information processing method that performs the above. An information processing system including a terminal device, an input device, and an information processing device,
The terminal device
a terminal device acquisition unit that acquires, from the information processing device, a moving image including the subject as a subject, and a moving image of another subject having a physical condition similar to that of the subject as a subject, the other subject having completed treatment;
a terminal device output unit that outputs a moving image including the subject as a subject, which is acquired by the terminal device acquisition unit, to the information processing device;
a display unit that displays a moving image of the other subject after the other subject has finished treatment, the moving image including the other subject acquired by the terminal device acquisition unit as a subject,
The input device is
an input device acquisition unit that acquires information about the subject's physical condition;
an input device output unit that outputs information regarding the physical condition of the subject acquired by the input device acquisition unit,
The information processing device includes:
an information processing device acquisition unit that acquires at least one of a moving image output from the terminal device and information output from the input device;
a storage unit that stores information about the physical condition of the other subject and a moving image of the other subject after the other subject has finished treatment in association with each other in the storage unit;
a selection unit that identifies information about the physical condition of the other subject that indicates a physical condition similar to a physical condition indicated by at least one of the moving image and the information acquired by the information processing device acquisition unit, and selects, in the storage unit, the moving image associated with the identified information about the physical condition of the other subject;
an information processing device output unit that outputs the video selected by the selection unit to the terminal device. 2. A program for causing a computer to function as the information processing device according to claim 1, the program causing the computer to function as the information acquisition unit, the storage unit, the selection unit, and the output unit.