JP6863572B2 - Display control device and display control program - Google Patents

Description

The present invention relates to a display control device and a display control program.

Conventionally, there has been a technique for supporting the rehabilitation of a subject by virtually displaying the amputated limb of the subject (hereinafter referred to as "cut limb") in which at least one of the limbs has been amputated on a display device. Are known. Similarly, a paralyzed limb (hereinafter referred to as "paralyzed limb") of a subject who is paralyzed in at least one of the limbs caused by a stroke or the like is virtually displayed on a display device. , The technology to support the rehabilitation of the subject is also known. In the following, the limbs that are virtually displayed on the display device are referred to as "virtual limbs".

For example, Patent Document 1 proposes a rehabilitation support device that detects the movement of the body of a subject and displays a virtual limb in a head-mounted display according to the detected movement.

Further, Non-Patent Document 1 proposes a rehabilitation system for reducing phantom limb pain using VR (Virtual Reality) technology.

Further, Non-Patent Document 2 describes a technique for estimating the movement of an amputated limb by using a myoelectric potential signal output from a myoelectric potential sensor attached to the remaining portion of the amputated limb for the treatment of phantom limb pain. Proposed.

JP-A-2015-0471993

Inamura, Ouchida, Ide, Asama, Ota, "Concept of Phantom Limb Pain Rehabilitation System Using Immersive VR System Based on Physical Infrastructure", Robotics Society of Japan Academic Lecture Material, 2013 Max Ortiz-Catalan, Nichlas Sander, Morten B. Kristoffersen, Bo Hakansson and Rickard Branemark, “Treatment of phantom limb pain (PLP) based on augmented reality and gaming controlled by myoelectric pattern recognition: a case study of a chronic PLP patient”, Frontiers in Neuroscience, 2014

In the technique described in Patent Document 1, the virtual limb displayed on the display device moves up, down, left and right, and does not rotate the virtual limb in response to a twisting motion of the limb or the like. There was a problem that there was a limit to enhancing the sense of ownership. The sense of body retention here means the feeling that a part of one's body belongs to oneself.

Even in the techniques described in Non-Patent Document 1 and Non-Patent Document 2, the above-mentioned problems are not taken into consideration.

An object of the present invention is to provide a display control device and a display control program capable of enhancing the body holding feeling of a subject.

The display control device of the present invention estimates the posture of the portion of the impaired limb to which the motion sensor is attached, based on the detection result of the motion sensor attached to the impaired limb including disconnection or paralysis. When controlling the display of a virtual limb that virtually represents a healthy limb corresponding to the impaired limb by using the unit and the posture estimation result by the estimation unit, the limb approaches the tip of the virtual limb. It is provided with a control unit that controls the display of the virtual limb on the display device by making it larger than the rotation amount determined from the estimation result.

The display control program of the present invention estimates the posture of the portion of the impaired limb to which the motion sensor is attached, based on the detection result of the motion sensor attached to the impaired limb including disconnection or paralysis. When controlling to display a virtual limb that virtually represents a healthy limb corresponding to the disabled limb on a display device using the posture estimation result, the amount of rotation determined from the estimation result as the tip of the virtual limb is approached. The computer is made to execute a process including controlling the display of the virtual limb on the display device.

According to the present invention, it is possible to enhance the body retention feeling of the subject.

It is a block diagram (partial plan view) which shows an example of the structure of the support system which concerns on embodiment. It is a perspective view which shows an example of the structure of the motion sensor which concerns on embodiment. It is a figure which shows an example of the screen displayed on the display device which concerns on embodiment. It is a block diagram which shows an example of the main part structure of the electric system of the display control device which concerns on embodiment. It is a block diagram which shows an example of the functional structure of the display control device which concerns on embodiment. It is a figure which provides the explanation of the roll angle at the time of displaying the virtual limb which concerns on embodiment. It is a flowchart which shows an example of the flow of the display control processing which concerns on embodiment. It is a figure which provides the explanation of the motion angle at the time of displaying the virtual limb in the 2nd motion mode which concerns on embodiment.

Hereinafter, examples of embodiments for carrying out the present invention will be described in detail with reference to the drawings.

First, the configuration of the support system 10 according to the present embodiment will be described with reference to FIGS. 1 to 3. The support system 10 is a system that supports the rehabilitation of the subject H, such as a patient having an amputated limb and a patient having a paralyzed limb. In the following, when a limb in which a disorder such as an amputated limb or a paralyzed limb has occurred is generically referred to as a "disordered limb".

As shown in FIG. 1, the support system 10 includes a motion sensor 12, a display control device 14, and a display device 16. Each of the motion sensor 12 and the display device 16 and the display control device 14 transmit and receive various information by wireless communication. In addition, each of the motion sensor 12 and the display device 16 and the display control device 14 may transmit and receive various information by wire communication.

As shown in FIG. 2 as an example, the motion sensor 12 according to the present embodiment is a band-type wearable sensor, and is attached to a handicapped limb to be rehabilitated by the subject H. Note that FIG. 1 shows an example in which the subject H loses a part of the forearm of the right arm due to amputation, and the motion sensor 12 is attached to the remaining part of the forearm of the right arm of the subject H. The motion sensor 12 may be attached to the upper arm of the subject H, for example. If the foot of the subject H is amputated or the foot is paralyzed, the motion sensor 12 is attached to the thigh or lower leg. Further, for example, when both arms of the subject H are disabled limbs, the motion sensor 12 may be attached to both arms of the subject H.

The motion sensor 12 has a built-in 3-axis acceleration sensor and an angular velocity sensor. Then, the motion sensor 12 transmits each of the acceleration and the angular velocity in the three-axis direction detected by each of the three-axis acceleration sensor and the angular velocity sensor to the display control device 14 at predetermined time intervals.

Further, as shown in FIG. 2, a plurality of myoelectric potential sensors 18 (8 in the example of FIG. 2) are provided on the inner contact surface of the motion sensor 12 at substantially equal distance intervals along the circumferential direction. Has been done. Then, the motion sensor 12 transmits the myoelectric potential signal detected by each myoelectric potential sensor 18 to the display control device 14 at predetermined time intervals.

The display control device 14 according to the present embodiment receives each of the acceleration and the angular velocity in the three axial directions transmitted from the motion sensor 12. Further, the display control device 14 receives the myoelectric potential signal transmitted from the motion sensor 12. Then, the display control device 14 corresponds to the disabled limb based on the received triaxial acceleration, angular velocity, and myoelectric potential signal according to the frame rate when displaying the image on the display device 16 described later. Control is performed to display the virtual limb that virtually represents the limb on the display device 16 in real time.

Further, in the display control device 14 according to the present embodiment, as an operation mode, either a first operation mode corresponding to the amputated limb or a second operation mode corresponding to the paralyzed limb can be specified.

In the present embodiment, a case where a portable information processing device such as a laptop computer is applied as the display control device 14 will be described, but the present invention is not limited to this. As the display control device 14, a stationary information processing device such as a desktop computer or a server computer may be applied.

The display device 16 according to the present embodiment is an immersive display device, and is a head mount configured by integrating a mounting component for mounting on the head of the subject H and a display unit such as a liquid crystal display. It is a display. That is, the display device 16 is used by being attached to the head of the subject H.

The display device 16 displays the virtual limb corresponding to the disabled limb on the display unit under the control of the display control device 14. FIG. 3 shows an example of a display screen when the virtual limb K corresponding to the disabled limb is displayed on the display unit of the display device 16. Note that FIG. 3 shows an example of a display screen when the right arm of the subject H is a handicapped limb.

Further, the display device 16 has a built-in 3-axis acceleration sensor and an angular velocity sensor, and the image displayed on the display unit of the display device 16 according to the movement of the head of the subject H is also the subject H. Switches so that the situation is visually observed. That is, the support system 10 according to the present embodiment is a system using VR technology.

As described above, in the support system 10 according to the present embodiment, the wearable sensor is applied as the motion sensor 12, the portable information processing device is applied as the display control device 14, and the head-mounted display is applied as the display device 16. doing. Therefore, the subject H can perform rehabilitation not only at a specialized facility such as a hospital but also at the subject H's home or the like.

Next, with reference to FIG. 4, a configuration of a main part of the electrical system of the display control device 14 according to the present embodiment will be described. As shown in FIG. 4, the display control device 14 includes a CPU (Central Processing Unit) 30, a memory 32 as a temporary storage area, and a non-volatile storage unit 34. Further, the display control device 14 includes an input device 36 such as a keyboard and a mouse, and a network I / F (InterFace) 38 connected to the network. The CPU 30, the memory 32, the storage unit 34, the input device 36, and the network I / F 38 are connected to each other via the bus 40.

The storage unit 34 is realized by an HDD (Hard Disk Drive), an SSD (Solid State Drive), a flash memory, or the like. The display control program 50 is stored in the storage unit 34 as a storage medium.

Next, the functional configuration of the display control device 14 according to the present embodiment will be described with reference to FIG. As shown in FIG. 5, the display control device 14 includes a reception unit 60, an estimation unit 62, and a control unit 64. Further, the feature amount information 70 and the subject information 72 are stored in the predetermined storage area of the storage unit 34.

The feature amount information 70 includes information for estimating the movement of the assumed portion assumed as the neck and fingers of the disabled limb for each limb to which the motion sensor 12 is attached. Examples of the movement of the assumed part as the neck of the disabled limb include flexion and extension of the wrist and ankle, and examples of the movement of the assumed part of the finger of the disabled limb include the fingers and feet of the hand. Examples include finger opening and closing movements.

In the present embodiment, for example, a motion sensor 12 is attached to the limbs of a person having a healthy limb, and various movements are performed on the neck and fingers of the limbs. On the other hand, the display control device 14 full-wave rectifies the myoelectric potential signal output from each myoelectric potential sensor 18 of the motion sensor 12 in response to each operation, and applies a low-pass filter to the signal that has undergone full-wave rectification. The obtained amplitude is obtained as a feature quantity. Then, the display control device 14 associates the obtained feature amount with the movements of the neck and fingers of the limbs corresponding to the feature amount, and stores the feature amount information 70 in the storage unit 34.

The subject information 72 includes information indicating the impaired limb of the subject H such as the right arm, the left arm, the right foot, and the left foot, and the length, thickness, and the like, in association with the identification information that identifies the subject H. Information indicating the size of the virtual limb corresponding to the disabled limb and information indicating the color of the virtual limb corresponding to the disabled limb are included.

The reception unit 60 receives the identification information of the subject H input via the input device 36 by the operator of the display control device 14 (hereinafter, simply referred to as “operator”). Further, the reception unit 60 receives each of the acceleration and the angular velocity in the three-axis directions transmitted from the motion sensor 12 via the network I / F38. Further, the reception unit 60 receives the myoelectric potential signal transmitted from the motion sensor 12 via the network I / F38.

The estimation unit 62 estimates the posture of the portion to which the motion sensor 12 of the handicapped limb is attached by using the acceleration and the angular velocity in the three axial directions received by the reception unit 60. In the present embodiment, the estimation unit 62 estimates the pitch angle and yaw angle of the portion where the motion sensor 12 of the handicapped limb is attached as the above posture by using the acceleration and the angular velocity in the three axial directions. In addition, the estimation unit 62 also estimates the roll angle with respect to the axis along the longitudinal direction of the disabled limb as the amount of rotation with respect to the axis along the longitudinal direction of the disabled limb using the acceleration and the angular velocity in the triaxial direction.

Further, the estimation unit 62 estimates the movement of the assumed portion assumed as the neck and fingers of the disabled limb by using the myoelectric potential signal received by the reception unit 60. In the present embodiment, the estimation unit 62 full-wave rectifies the myoelectric potential signal received by the reception unit 60, and obtains the amplitude obtained by applying a low-pass filter to the signal that has undergone full-wave rectification as a feature quantity. .. Then, the estimation unit 62 refers to the feature amount information 70 and acquires the movements of the neck and fingers of the limbs associated with the feature amount closest to the obtained feature amount, thereby performing the movement of the assumed portion. presume. The estimation unit 62 may estimate the movement of the assumed portion as either the neck or the finger of the handicapped limb.

As a technique for estimating the movements of the neck and fingers of the limbs using the myoelectric potential signal, for example, the techniques disclosed in References 1 and 2 below can be applied.
[Reference 1] Kevin Englehart, Bernard Hudgins, "A Robust, Real-Time Control Scheme for Multifunction Myoelectric Control", IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, VOL.50, NO.7, JULY 2003
[Reference 2] T. Scott Saponas, Desney S. Tan, Dan Morris, Ravin Balakrishnan, Jim Turner, James A. Landay, "Enabling Always-Available Input with Muscle-Computer Interfaces", In Proceedings of 22nd Annual ACM Symposium on User Interface Software and Technology, pp.167-176, 2009

The control unit 64 displays the virtual limb corresponding to the disabled limb on the display device 16 based on the posture of the disabled limb estimated by the estimation unit 62 and the movement of the assumed portion assumed as the neck and fingers of the disabled limb. (See FIG. 3). At the time of this control, the control unit 64 refers to the subject information 72 and virtualizes it according to the size and color of the virtual limb associated with the identification information of the subject H received by the reception unit 60. Control is performed to display the limbs on the display device 16.

Further, when the control unit 64 controls to display the virtual limb on the display device 16, as shown in FIG. 6, for example, a portion closer to the tip of the virtual limb such as a wrist is estimated by the estimation unit 62. The roll angle is increased to control the display of the virtual limb on the display device 16.

Next, the operation of the support system 10 according to the present embodiment will be described with reference to FIG. 7. When the CPU 30 executes the display control program 50, the display control process shown in FIG. 7 is executed. The display control process shown in FIG. 7 is executed, for example, when the identification information of the subject H is input by the operator via the input device 36 and the operation mode is specified. When the CPU 30 executes the display control program 50, it functions as the reception unit 60, the estimation unit 62, and the control unit 64 shown in FIG. Further, here, it is assumed that the operator inputs the identification information and the operation mode after the display device 16 is attached to the head of the subject H and the motion sensor 12 is attached to the disabled limb.

In step S10 of FIG. 7, the reception unit 60 receives the identification information of the subject H input by the operator via the input device 36. In the next step S12, the control unit 64 refers to the subject information 72, and information indicating the disabled limb corresponding to the identification information of the subject H received in step S10, and information indicating the size of the virtual limb. , And the information indicating the color of the virtual limb is acquired. Then, the control unit 64 displays the virtual limb corresponding to the acquired information indicating the disabled limb according to the size corresponding to the acquired size information and the color corresponding to the acquired color information. Controls the display on. At the time of this control, the control unit 64 controls to display the virtual limb at a predetermined initial position. In the present embodiment, the control unit 64 controls, for example, to display the virtual limbs on the display device 16 with the position where the virtual limbs are horizontally extended toward the front of the body as the initial position.

In the present embodiment, when the first operation mode is specified, the operator can change the length, thickness, and color of the virtual limb via the input device 36. The operator confirms with the subject H whether the subject H feels uncomfortable with respect to the length, thickness, and color of the virtual limb displayed on the display device 16. Then, when the subject H feels uncomfortable, the operator changes the length, thickness, and color of the virtual limb via the input device 36 according to the confirmation result for the subject H.

Therefore, in step S14, the reception unit 60 determines whether or not the operation mode designated by the operator via the input device 36 is the first operation mode. If this determination is affirmative, the process proceeds to step S16, and if the determination is negative, the process proceeds to step S20.

Then, in step S16, the reception unit 60 determines whether or not the change in the length, thickness, and color of the virtual limb has been accepted via the input device 36. If this determination is affirmative, the process proceeds to step S18, and if the determination is negative, the process proceeds to step S20.

In step S18, the control unit 64 changes the length, thickness, and color of the virtual limb according to the length, thickness, and color of the virtual limb received in step S16, and displays the display on the display device 16. I do.

On the other hand, the operator instructs the subject H to move the handicapped limb to a position corresponding to the virtual limb displayed on the display device 16. When the operator confirms that the subject H has moved the disabled limb to a position that matches the virtual limb displayed on the display device 16, the input device 36 gives a confirmation instruction indicating that the position of the disabled limb has been determined. Enter via.

Therefore, in step S20, the reception unit 60 determines whether or not the confirmation instruction has been received via the input device 36. If this determination is a negative determination, the process returns to step S14, and if the determination is affirmative, the process proceeds to step S22. That is, the positions of the disabled limb and the virtual limb at the time when the determination in step S20 becomes an affirmative determination become the home position.

In step S22, the reception unit 60 receives each of the acceleration and the angular velocity in the three axial directions transmitted from the motion sensor 12 and the myoelectric potential signal via the network I / F 38. In the next step S24, as described above, the estimation unit 62 estimates the posture of the portion where the motion sensor 12 of the handicapped limb is attached by using the acceleration and the angular velocity in the three axial directions received in the step S22.

In the next step S26, the reception unit 60 determines whether or not the operation mode designated by the operator via the input device 36 is the first operation mode. If this determination is affirmative, the process proceeds to step S28, and if the determination is negative, the process proceeds to step S32.

In step S28, as described above, the estimation unit 62 refers to the feature amount information 70 and uses the myoelectric potential signal received in step S22 to move the assumed portion as the neck and finger of the disabled limb. To estimate. In the next step S30, the control unit 64 controls to display the virtual limb corresponding to the disabled limb on the display device 16 according to the posture estimated in step S24 and the motion estimated in step S28.

On the other hand, in step S32, as described above, the estimation unit 62 refers to the feature amount information 70 and uses the myoelectric potential signal received in step S22 to assume the neck and fingers of the disabled limb. Estimate the behavior of. At the time of this estimation, the estimation unit 62 estimates the operation of the assumed portion by making the signal level of the myoelectric potential signal received in step S22 larger than the detected value. As the degree of increasing the signal level in this case, for example, the value obtained as the degree to which the rehabilitation of the subject H having a paralyzed limb can be effectively performed by an experiment using an actual support system 10 or the like is used. Can be applied. Further, the degree of increasing the signal level in this case may be input by the operator.

In the next step S34, the control unit 64 controls to display the virtual limb corresponding to the disabled limb on the display device 16 according to the posture estimated in step S24 and the motion estimated in step S32. At the time of this control, as shown in FIG. 8 as an example, the control unit 64 controls to display the virtual limb on the display device 16 by making the operation angle larger than the change in the posture estimation result in step S24. .. As the degree of increasing the operating angle in this case, for example, the value obtained as the degree to which the rehabilitation of the subject H having a paralyzed limb can be effectively performed by an experiment using an actual support system 10 or the like is used. Can be applied. Further, the degree of increasing the operating angle in this case may be input by the operator.

In step S36, the reception unit 60 determines whether or not the end timing has arrived. If this determination is a negative determination, the process returns to step S22, and if the determination is affirmative, the display control process ends. That is, the processes from step S22 to step S36 are repeatedly executed at time intervals according to a predetermined frame rate, so that the virtual limb displayed on the display device 16 is displayed in real time according to the movement of the disabled limb. Will be updated. The end timing includes, for example, the timing at which the operator inputs an instruction to end the display control process via the input device 36.

By the way, the applicant has obtained the following findings as a result of interviewing a plurality of patients having amputated limbs (hereinafter referred to as "amputed limb patients"). As a result, the applicant performs an action in a posture that is not normally performed in rehabilitation such as a posture in which the arm is twisted and a posture in which the arm is folded, and the virtual limb is displayed on the display device in response to this movement. It was found that the feeling of retention is enhanced and phantom limb pain is reduced. That is, the applicant has obtained the finding that in this case, phantom limb pain is reduced as compared with the case where the amputated limb patient performs rehabilitation by moving the amputated limb only up, down, left and right.

On the other hand, in the present embodiment, as described above, the closer to the tip of the virtual limb, the more the rotation with respect to the axis along the longitudinal direction of the impaired limb than the estimation result of the posture of the portion to which the motion sensor 12 is attached. The momentum is increased to control the display of virtual limbs on the display device. Therefore, according to the present embodiment, it is possible to enhance the body retention feeling of the subject. Further, according to the present embodiment, the sense of agency of the subject can be enhanced. The sense of movement subject here means the feeling that oneself is the subject of movement.

Further, Reference 3 below discloses an experimental result that the feeling of body retention and the feeling of exercise subjectivity are improved by using an immersive display device. On the other hand, in the present embodiment, an immersive display device is applied as the display device 16. Therefore, according to the present embodiment, it is possible to enhance the feeling of body retention and the feeling of exercise subjectivity.
[Reference 3] Kondo, Nagamine, Omura, Yano, "Examples of using immersive head-mounted displays in cognitive psychology experiments", Journal of the Japanese Society of Neural Networks, vol.23, no.3, pp.87-97, 2016

Further, in the present embodiment, the virtual limb is displayed on the display device 16 according to the estimation result of the movement of the assumed portion assumed as the neck and the finger of the disabled limb based on the myoelectric potential signal. Therefore, according to the present embodiment, it is possible to further enhance the feeling of body retention and the feeling of exercise subjectivity.

Further, in the present embodiment, the length of the virtual limb can be changed in the first operation mode. Thereby, the length of the virtual limb can be changed to a length that does not make the subject H having the amputated limb feel uncomfortable. Therefore, according to the present embodiment, the feeling of holding the body can be enhanced. Similarly, in the present embodiment, in the first operation mode, the thickness and color of the virtual limbs can be changed, so that the feeling of holding the body can be enhanced.

Further, in the second operation mode, in the second operation mode, the signal level of the myoelectric potential signal is made larger than the detected value, and the operation of the assumed portion assumed as the neck and fingers of the disabled limb is estimated. That is, as a result of making it easier for the subject H having a paralyzed limb to feel that the paralyzed limb is moving voluntarily, the motivation of the subject H for rehabilitation is increased. As a result, it is possible to suppress a phenomenon in which the paralysis does not improve due to a decrease in the frequency of use of the paralyzed limb, so-called learned non-use. Similarly, in the present embodiment, in the second motion mode, the motion angle is made larger than the change in the estimation result of the posture of the portion where the motion sensor 12 is attached, and the virtual limb is displayed on the display device, which is not possible. Learning to use can be suppressed.

In the above embodiment, the case where the integrated head-mounted display is applied as the display device 16 has been described, but the present invention is not limited to this. For example, as the display device 16, an assembled head-mounted display in which a mobile terminal having a display unit such as a smartphone is attached to a mounting component to be mounted on the head of the subject H may be applied.

Further, in the above embodiment, the case where the immersive display device is applied as the display device 16 has been described, but the present invention is not limited to this. For example, as the display device 16, a display device other than the immersive type such as a stationary display device may be applied.

Further, in the above embodiment, the case where the length, thickness, and color of the virtual limb of the subject H are stored in the storage unit 34 in advance has been described, but the present invention is not limited to this. For example, the subject H may be photographed by a photographing device such as a camera or a smartphone, and the length, thickness, and color of the virtual limb may be derived from the photographed result.

Further, in the above embodiment, the case where the operator inputs the operation mode has been described, but the present invention is not limited to this. For example, the subject H is photographed by an imaging device, and it is determined from the imaging result whether the subject H has an amputated limb or a paralyzed limb. Then, according to the determination result, it may be in the form of determining whether to operate in the first operation mode or the second operation mode.

Further, in the above embodiment, the mode in which the display control program 50 is stored (installed) in the storage unit 34 in advance has been described, but the present invention is not limited to this. The display control program 50 is provided in a form recorded on a recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), and a USB (Universal Serial Bus) memory. May be good. Further, the display control program 50 may be downloaded from an external device via a network.

10 Support system 12 Motion sensor 14 Display control device 16 Display device 18 Myoelectric potential sensor 30 CPU
32 Memory 34 Storage unit 36 Input device 50 Display control program 60 Reception unit 62 Estimating unit 64 Control unit 70 Feature information 72 Subject information H Subject K Virtual limb

Claims (9)

An estimation unit that estimates the posture of the portion of the impaired limb to which the motion sensor is attached, based on the detection result of the motion sensor attached to the impaired limb including amputation or paralysis.
When controlling to display a virtual limb that virtually represents a healthy limb corresponding to the disabled limb on a display device using the posture estimation result by the estimation unit, the estimation result is used as the distance from the tip of the virtual limb approaches. A control unit that controls the display of the virtual limb on the display device by making it larger than the fixed amount of rotation.
Display control device equipped with. Based on the myoelectric potential signal detected by the myoelectric potential sensor attached to the impaired limb, the estimation unit further estimates the movement of the assumed portion assumed as at least one of the neck and the finger of the impaired limb.
The display according to claim 1, wherein the control unit controls a portion of the virtual limb displayed on the display device, which corresponds to the assumed portion, to perform an operation corresponding to an estimation result of the operation by the estimation unit. Control device. Either the first motion mode corresponding to the amputated limb or the second motion mode corresponding to the paralyzed limb can be specified.
The display control according to claim 1 or 2, wherein the control unit controls the display state of the virtual limb to be changed and displayed on the display device in the first operation mode and the second operation mode. apparatus. The display control device according to claim 3, wherein when the first operation mode is specified, the length of the virtual limb can be changed from the reference length. The display control device according to claim 3 or 4, wherein at least one of the thickness and color of the virtual limb can be changed from the reference thickness and color when the first operation mode is specified. The claim that the control unit controls to display the virtual limb on the display device by making the operation angle larger than the change in the estimation result of the posture by the estimation unit when the second operation mode is specified. The display control device according to 3. Either the first motion mode corresponding to the amputated limb or the second motion mode corresponding to the paralyzed limb can be specified.
The display control device according to claim 2, wherein when the second operation mode is specified, the estimation unit makes the signal level of the myoelectric potential signal larger than the detected value to estimate the operation of the assumed portion. The display control device according to any one of claims 1 to 7, wherein the display device is an immersive display device. Based on the detection result by the motion sensor attached to the impaired limb in which the disorder including amputation or paralysis has occurred, the posture of the portion of the impaired limb to which the motion sensor is attached is estimated.
When controlling to display a virtual limb that virtually represents a healthy limb corresponding to the impaired limb on a display device using the estimation result of the posture, the amount of rotation determined from the estimation result as the tip of the virtual limb is approached. To control the display of the virtual limb on the display device.
A display control program that causes a computer to perform processing including that.

Images