JP6744559B2 - Information processing device, information processing method, and program - Google Patents

Description

The present invention relates to an information processing apparatus, an information processing method, and a program, and more particularly to a mechanism capable of specifying a walking speed of a target person even when the passing of the target person cannot be specified at a predetermined timing.

In recent years, the effect measurement in nursing care and rehabilitation has been performed using a motion capture technology that digitally records the movement of a person or an object.

As one of the methods of motion capture technology, there is a method of attaching a marker to a subject (also referred to as a subject) and photographing the subject from a plurality of directions with a camera to detect the marker, convert the subject's movement into digital data, and record it. is there. There is also a method of measuring the distance from the sensor to the subject using an infrared sensor without using a marker and recording the subject's movement based on the measured value.

Patent Document 1 discloses a mechanism using motion capture technology in the field of rehabilitation.

JP, 2005-61577, A

By the way, among the items of the effect measurement, the item for which the walking speed is specified from the time required when the subject walks from the first predetermined position to the second predetermined position and the effect is measured (hereinafter referred to as “normal walking”). There is).

However, in the case of the method of measuring the distance from the sensor to the subject using the infrared sensor described in Patent Document 1 and recording the movement of the subject based on the measured value, the subject uses the infrared sensor. On the other hand, in order to identify the subject's movement assuming that the subject is facing the front, the subject's movement is measured for the event where the subject faces sideways with respect to the infrared sensor, such as normal walking. There was a possibility that it was difficult to identify the movement.

Therefore, when the test subject passes through the first predetermined position, the movement of the test subject may not always be identified. Further, in the conventional mechanism, the first predetermined position is fixed, so that the walking speed of the test subject is reduced. Could not be identified and the effect could not be measured correctly.

It is an object of the present invention to provide a mechanism capable of specifying the walking speed of a target person even when the passing of the target person cannot be specified at a predetermined timing.

The information processing apparatus of the present invention uses the superimposing moving image data generated by the generating unit that generates the superimposing moving image data on which the position information of the subject who is walking is superimposed, and the superimposing moving image data. Passing specifying means for specifying a first timing at which the subject passes the first upper position, and second timing for passing the second position on the superimposed moving image data by the subject, and the passage identifying means. From the first timing and the second timing specified in step 1, the first time required for the subject to walk the predetermined distance between the first position and the second position is specified. An information processing apparatus comprising: a time specifying unit; and a walking speed specifying unit that specifies a walking speed of the target person based on the predetermined distance and a first required time specified by the time specifying unit. Even if the passage specifying unit cannot specify the first timing, the passing of the target person at the position between the first position and the second position is performed using the superimposed moving image data. When it is possible to specify the time, the time specifying means determines the second from the passage timing and the second timing of the position between the first position and the second position where the passage of the target person is specified. Is determined based on the second required time and the distance between the second position and the position between the first position and the second position. Then, the walking speed is specified.

Further, the information processing method of the present invention is a method for controlling an information processing apparatus including a generation unit that generates superimposed moving image data in which position information of a subject who is walking is superimposed. The passage identifying unit uses the superimposed moving image data generated by the generating unit, and a first timing at which the subject passes the first position on the superimposed moving image data and a second position on the superimposed moving image data. From the first timing and the second timing identified by the passage identifying step, the passage identifying step of identifying the second timing at which the target person passes And a second step, the time specifying step of specifying a first required time taken for the subject to walk a predetermined distance between the position and the second position; A walking speed specifying step of specifying a walking speed of the target person based on a distance and a first required time specified in the time specifying step, and specifying the first timing in the passage specifying step. Even if it is not possible, if the passing of the target person can be specified at the position between the first position and the second position by using the superimposed moving image data, the time specifying step is performed. , A second required time is specified from the passage timing and the second timing of the position between the first position and the second position where the passage of the target person is specified, and the walking speed identification step Specifies the walking speed based on the second required time and the distance between the second position and the position between the first position and the second position.

Further, the program of the present invention is a program that is read and executed by an information processing device including a generation unit that generates superimposed moving image data in which position information of a subject who is performing a walking motion is superimposed, and Using the superimposed moving image data generated by the generation means, the first timing at which the target person passes the first position on the superimposed moving image data, and the second position on the superimposed moving image data, the target person. A predetermined distance between the first position and the second position from the passage specifying means that specifies the second timing at which the vehicle passes and the first timing and the second timing that are specified by the passage specifying means. Walking of the subject based on a time specifying unit that specifies a first required time taken by the subject to walk, and the predetermined distance and the first required time specified by the time specifying unit Even when the passage specifying unit fails to specify the first timing, it functions as a walking speed specifying unit that specifies a speed, and the first position and the second position are calculated using the superimposed moving image data. When the passage of the target person can be specified at the position between the position and the time, the time specifying means determines the position of the position between the first position and the second position where the passage of the target person is specified. A second required time is specified from the passage timing and the second timing, and the walking speed specifying means determines the second required time and a position between the first position and the second position. The walking speed is specified based on the distance from the second position.

According to the present invention, the walking speed of the target person can be specified even when the passage of the target person cannot be specified at a predetermined timing.

Diagram showing the functional configuration of the information processing apparatus 101 Diagram showing the hardware configuration of the information processing apparatus 101 Flowchart showing a process of performing measurement while photographing a subject Flowchart showing the measurement process for each eye when pre-recorded motion information is used Flowchart showing the report creation process Diagram showing an example of the subject list The figure which shows an example of the coordinate information of each joint The figure which shows the state of the test subject acquired by the motion information acquisition part 151. The figure which shows an example of the skeletal information of the test subject formed from the coordinate information of each joint. In the present invention, it is a diagram showing an example of a screen which is displayed on the display 212 of the information processing apparatus 101 and which accepts the selection of the subject from the user. In the present invention, it is a diagram showing an example of processing executed by the CPU 201 of the information processing apparatus 101 when the selection of the item of “normal walking” is accepted from the user in step S301. In the present invention, it is a diagram showing an example of a screen displayed on the display 212 of the information processing apparatus 101 when the selection of the item of “normal walking” is accepted from the user in step S301. In the present invention, it is a figure which shows an example of the process which CPU201 of the information processing apparatus 101 performs, when selection of the item of "one eye standing with eyes open" is received from the user in step S301. In the present invention, it is a diagram showing an example of a screen displayed on a display 212 of the information processing apparatus 101 when the information processing apparatus 101 starts photographing a subject in step S302. In the present invention, it is a diagram showing an example of a process in which the CPU 201 of the information processing apparatus 101 extracts a measurement result in step S502. FIG. 9 is a diagram showing an example of processing in which the CPU 201 of the information processing apparatus 101 creates a report in step S503 in the present invention. In the present invention, it is a diagram showing an example of a screen displayed on a display 212 of the information processing apparatus 101 when extracting a measurement result. In the present invention, it is a diagram showing an example of a screen displayed on the display 212 of the information processing apparatus 101 after extracting the measurement result. In the present invention, it is a diagram showing an example of a measurement result management table that stores the measurement results in the storage device 204 of the information processing apparatus 101. In the present invention, it is a diagram showing an example of a report created by the CPU 201 of the information processing apparatus 101 and output to a printing apparatus or the like. An example of a screen in which the skeleton information and the video captured and acquired by the motion information acquisition unit 151 are combined An example of a screen in which the area of the area where the skeleton information is displayed has been adjusted An example of a screen that displays the evaluation target video and the comparison target video vertically side by side An example of a screen that displays the evaluation target video and the comparison target video side by side A diagram showing an example of a table in which layouts are registered for each item The figure which shows the case where the left and right of the upper moving image on the screen of FIG. 23 are reversed. An example of a screen that displays videos for comparison An example of a screen that displays only the skeleton information without displaying the background etc. Flowchart showing the process of evaluating the subject's movements and displaying a message to the subject and caregiver Figure showing an example of evaluation conditions Figure showing an example of the message table

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

FIG. 1 is a diagram showing a functional configuration of the information processing apparatus 101.

The motion information acquisition unit 151 detects the motion of a person (in the present invention, a subject (a person who receives care and rehabilitation)) in a space where nursing and rehabilitation are performed, and acquires motion information of the subject.

Specifically, the motion information acquisition unit 151 is a sensor group known as Kinect (registered trademark), which has an RGB camera, a depth sensor, a voice sensor, and the like built therein, and a subject (in the present invention, a subject (caregiver or rehabilitation)). Recipient)) position, movement, voice, face, etc. can be recognized.

The depth sensor uses a method of measuring the distance to the subject using infrared rays. According to this method, it is possible to measure the distance from the sensor to the subject without attaching a marker or the like to the subject.

Each piece of data acquired by the motion information acquisition unit 151 is moving image data (also referred to as superimposed moving image data or superimposed image data. The moving image data including the specified skeleton information is stored in the storage unit.

The motion information acquired by each sensor of the motion information acquisition unit 151 is transmitted to the motion information analysis unit 152 and data analysis is performed.

The motion information analysis unit 152 analyzes each data acquired by the motion information acquisition unit 151 and converts the motion of the subject into coordinate information.

FIG. 8 shows a state of the subject acquired by the motion information acquisition unit 151. The motion information acquisition unit 151 obtains the coordinates of the human body surface of the subject by detecting the movement of the subject and matching the human body pattern stored in advance. Then, the coordinates of each joint forming the skeleton of the subject are calculated, and the skeleton of the subject is formed based on the calculated coordinate information.

FIG. 7 shows an example of coordinate information of each joint. Further, FIG. 9 shows an example of the skeleton information of the subject formed from the coordinate information of each joint.

In this way, by calculating the coordinate information of each joint and detecting the change in the coordinate of each joint, it becomes possible for the subject to recognize the motion of raising the foot or bending the knee.

The measurement unit 153 performs the measurement in the relevant item based on the motion information analyzed by the motion information analysis unit 152 and the setting according to each item.

FIG. 2 is a block diagram showing an example of the hardware configuration of the information processing apparatus 101 according to the embodiment of the present invention.

As shown in FIG. 2, in the information processing apparatus 101, a CPU (Central Processing Unit) 201, a ROM (Read Only) are provided via a system bus 200.
A memory 202, a RAM (Random Access Memory) 203, a storage device 204, an input controller 205, a voice input controller 206, a video controller 207, a memory controller 208, and a communication I/F controller 209 are connected.

The CPU 201 centrally controls each device and controller connected to the system bus 200.

The ROM 202 or the storage device 204 is a control program executed by the CPU 201, such as a BIOS (Basic Input/Output System), an OS (Operating System), a computer-readable executable program for implementing the information processing method, and various necessary programs. Holds data (including data table).

The RAM 203 functions as a main memory, a work area, etc. of the CPU 201. The CPU 201 loads various programs necessary for executing the processing from the ROM 202 or the storage device 204 into the RAM 203, and executes the loaded programs to realize various operations.

The input controller 205 controls input from an input device such as the keyboard/touch panel 210. The input device is not limited to this, and may be a touch panel such as a mouse or a multi-touch screen capable of detecting a position touched by a plurality of fingers.

The user can give various instructions by pressing down (touching with a finger or the like) in accordance with the icon, cursor, or button displayed on the touch panel.

The input device is used to input a destination for a communication destination that can be used in various communication devices.

The voice input controller 206 controls the input from the microphone 211. The voice input from the microphone 211 can be recognized.

The video controller 207 controls display on an external output device such as the display 212. The display shall include the display of a laptop computer integrated with the main body. The external output device is not limited to the display, and may be a projector, for example. Further, with respect to a device which can be accepted by the touch operation described above, it is possible to accept an input from the keyboard/touch panel 210.

Note that the video controller 207 can control a video memory (VRAM) for performing display control, can use part of the RAM 203 as a video memory area, or can be provided with a dedicated video memory separately. It is possible.

According to the present invention, a first video memory area used for a display when a user normally uses an information processing apparatus and a display superimposed on the display content of the first video memory area when a predetermined screen is displayed. Has a second video memory area used for. The number of video memory areas is not limited to two, and a plurality of video memory areas can be provided as long as the resources of the information processing device allow.

The memory controller 208 controls access to the external memory 213. The external memory is connected to an external storage device (hard disk), a flexible disk (FD), or a PCMCIA card slot that stores a boot program, various applications, font data, user files, edit files, and various data via an adapter. A compact flash (registered trademark) memory or the like can be used.

It connects and communicates with an external device via the communication I/F controller 209 and the network 214, and executes communication control processing in the network. For example, communication using TCP/IP, telephone lines such as ISDN, and communication using 3G lines of mobile phones are possible.

The storage device 204 is a medium for permanently storing information, and its form is not limited to a storage device such as a hard disk. For example, a medium such as SSD (Solid State Drive) may be used.

It can also be used as a temporary memory area during various processes performed by the communication terminal in this embodiment.

Next, a process of performing measurement while photographing a subject will be described using the flowchart shown in FIG. The process shown in the flowchart of FIG. 3 is a process in which the CPU 201 of the information processing apparatus 101 reads and executes a predetermined program.

In step S301, the selection of the subject and the selection of the item are accepted from the user.

The subject information is assumed to be registered in the subject list shown in FIG. In addition, as the event, "Open one leg standing" that measures the time when you open your eyes and stand on one leg, "Chair standing sitting" that measures how many times you could sit and sit within the time limit, maximum stride "Maximum step" to measure, "normal walking" to measure the time required to walk at a distance of 5 m, "TUG (TimedUp & Go)" to measure the time to sit back and forth from a chair up and down 3 m is there.

By accepting the selection of the item, the setting files and programs necessary for the measurement of the item are read.

The subject information may be newly registered in addition to being selected from the already registered information.

In step S302, a shooting instruction is received from the user. Upon receiving the shooting instruction, the motion information acquisition unit 151 of the information processing apparatus 101 starts shooting the subject. Also, motion information, which is information obtained by each sensor (coordinate information of each joint, etc.), is acquired. Step S302 is an example of a generation unit that generates superimposed moving image data in which position information of a subject who is performing a walking motion is superimposed according to the present invention.

In step S303, when there are a plurality of persons in the captured video, selection of which person is the subject is accepted.

Hereinafter, the details of the processing in step S303 will be described with reference to FIG.

FIG. 10 is a screen in which the information processing apparatus 101 receives a selection of which person is the subject from the user in step S303, and the screen in FIG. 10 is displayed on the display 212 of the information processing apparatus 101.

In 1003 of FIG. 10, the moving image acquired by the motion information acquisition unit 151 of the information processing apparatus 101 is displayed.

In 1001 of FIG. 10, the state of the person (subject or caregiver) acquired by the motion information acquisition unit 151 is displayed together with the skeleton information specified by the coordinate information of each joint.

First, when the person switching button 1005 is pressed by the user operating the mouse pointer 1004, the skeleton information of the subject is displayed on the subject 1001 based on the information acquired by the motion information acquisition unit 151.

Then, the user operates the mouse pointer 1004 to specify the subject among the persons displayed in 1001 of FIG.

Then, the user selected by the mouse pointer 1004 is selected from the drop-down list 1002 by the mouse pointer 1004 by the user.

The drop-down list 1002 displays the names of subjects included in the subject list (FIG. 6) managed by the information processing apparatus 101 in advance.

In step S304, coordinate information of each joint of the subject is acquired from the motion information acquired in step S302. When the reproduced moving image is used, the coordinate information of each joint of the subject is acquired by using the motion information included in the reproduced moving image data.
FIG. 7 shows an example of coordinate information of each joint.

In step S305, the image acquired in step S303 and the skeleton information acquired based on the coordinate information of each joint acquired in step S304 are combined and displayed on the display 212.

FIG. 21 shows an example of a screen obtained by synthesizing the skeleton information with the video image captured and acquired by the motion information acquisition unit 151.

In 2101 of FIG. 21, the image and the skeleton information are displayed in a combined state. Further, 2102 displays skeletal information when the subject is viewed from above, and 2103 displays skeletal information when the subject is viewed from the side.

The skeleton information displayed in the areas 2102 and 2103 is calculated and generated based on the coordinate information of each joint acquired by the motion information acquisition unit 151.

The area of the display area 2102 or 2103 is adjusted to an area in which the skeleton information can be displayed. For example, the screen shown in FIG. 21 is a screen when no adjustment is made. In this case, although the skeleton information displayed in 2103 hardly moves, there is a large margin around the skeleton information.

FIG. 22 is an example of a screen when the size is adjusted. The skeletal information has been adjusted to fit, and the margins have been reduced.

By controlling so as not to display useless margins in this way, it becomes possible to collect the three pieces of skeleton information in the vicinity, which makes it easier to observe.

As a method of determining the display range, for example, a method of specifying a rectangle in which the skeleton information fits and displaying a predetermined width from the rectangle as a blank space is considered.

In step S306, the skeletal information analyzed in step S304 is used to perform measurement according to the item selected in step S301.

The specific content of the process will be described with reference to FIGS. 11, 13, and 29.

Next, with reference to FIG. 11, in the present invention, a process executed by the CPU 201 of the information processing apparatus 101 when the selection of the item of “normal walking” is received from the user in step S301 will be described.

In the process of FIG. 11, the screen displayed on the display 212 of the information processing device 101 is, for example, FIG.
Here, FIG. 12 will be described.

The measurement start (end) coordinates 1201 in FIG. 12 indicate (x, y, z) coordinates at which the measurement of the normal walking set in advance is started or ended, and the x coordinate of the toe of the subject and the measurement start (end) coordinates. The counting of the number of seconds is started at the timing when the x-coordinate of 1201 overlaps the first time, and the counting of the number of seconds is ended at the timing when the x-coordinate of the measurement start (end) coordinate 1201 overlaps the second time.

For example, when the subject walks from the left side of the screen in FIG. 12, the number of seconds is counted when the x coordinate of the measurement start (end) coordinate 1201 on the left side of the screen in FIG. 12 and the x coordinate of the toe of the subject overlap. The counting of the number of seconds is started when the x coordinate of the measurement start (end) coordinate 1201 on the right side of the screen in FIG. 12 and the x coordinate of the toe of the subject overlap.

Due to the characteristics of the motion information acquisition unit 151, the specified distance from the left and right ends of the shooting range is low in the accuracy of specifying the coordinates of the joints, so the measurement start (end) coordinates 1201 are a little more than the left and right ends of the screen of FIG. It is set to the open position (coordinates).

Reference numeral 1202 in FIG. 12 indicates a timeline, and the timeline 1202 is displayed when evaluating the recorded shooting data.

Reference numeral 1203 in FIG. 12 is an evaluation time designating unit, and when evaluating recorded video data, when evaluating the motion of the subject in a section different from between the measurement start (end) coordinates 1201, the evaluation time is set. It can be designated by moving the evaluation time designation unit 1203 by operating the mouse or the like by the user.
Returning to the description of FIG.

In step S1101, the information processing apparatus 101 identifies the coordinates of the toe of the subject from the image of the frame currently being processed.

In step S1102, the information processing apparatus 101 determines whether the coordinates of the toe of the subject have been specified from the image of the frame currently processed in step S1101, and if specified, the process proceeds to step S1103. If it cannot be specified, this process ends.

The reason why the process of step S1102 is executed will be described. The motion information acquisition unit 151 specifies the position coordinates of each joint of the subject on the assumption that the subject is facing the front with respect to the motion information acquisition unit 151. Therefore, when the subject is facing the lateral direction with respect to the motion information acquisition unit 151 like normal walking, it is difficult to obtain the coordinate information of each joint of the subject by steps S304 and S305 in FIG. Is. Unless the coordinate information of each joint can be acquired, the process of step S1103 and subsequent steps cannot be executed. Therefore, the process of step S1102 determines whether or not the process of step S1103 and subsequent steps can be executed.

In step S1103, the information processing apparatus 101 determines whether the coordinates of the toe of the subject identified in step S1101 are outside coordinates, not between two preset measurement start (end) coordinates 1201.

When the coordinates of the toe of the subject identified in step S1101 are coordinates outside the two preset measurement start (end) coordinates 1201, the information processing apparatus 101 ends this processing and identifies in step S1101. When the coordinates of the toe of the subject are coordinates other than the two measurement start (end) coordinates 1201 set in advance, the information processing apparatus 101 shifts the processing to step S1104.

In step S1104, the information processing apparatus 101 determines whether the coordinates of the toe of the subject identified in step S1101 are on one of two preset measurement start (end) coordinates 1201.

When the coordinates of the toe of the subject identified in step S1101 are on any of the two preset measurement start (end) coordinates 1201, the information processing apparatus 101 shifts the processing to step S1105, When the coordinates of the toe of the subject identified in step S1101 are not on one of the two preset measurement start (end) coordinates 1201, the information processing apparatus 101 determines the toe of the subject identified in step S1101. It is determined that the coordinates are between two preset measurement start (end) coordinates 1201, and the process proceeds to step S1109.

In step S1105, the information processing apparatus 101 determines whether it is the first time that it is determined to be on any of the two measurement start (end) coordinates 1201 set in advance in step S1104.

When it is determined that it is the first time that it is determined to be on one of the two preset measurement start (end) coordinates 1201 in step S1104, the information processing apparatus 101 proceeds to step S1106. When it is determined that it is not the first time (that is, the second time) that it is determined that the coordinate is one of the two preset measurement start (end) coordinates 1201 in step S1104, the information processing apparatus 101 Shifts the processing to step S1107.

In step S1106, the information processing apparatus 101 counts the number of seconds, and ends this processing.

In step S1107, the information processing apparatus 101 ends the counting of the number of seconds executed in step S1106. Then, in step S1108, the motion of the subject is evaluated and stored in the measurement result management table (FIG. 19).

To describe the process of step S1108 more specifically, the information processing apparatus 101 first determines the walking distance in the X direction between the measurement start point (X1, Y1, Z1) and the measurement end point (X2, Y2, Z2). It is determined by the absolute value of X1-X2, which is the distance (unit is meter).

The measurement start point referred to here is a measurement start (end) coordinate 1201 on the left side of the screen in FIG. 12 when the subject walks from the left side of the screen in FIG. 12 (measurement on the right side when walking from the right side). Start (end) coordinates 1201) or coordinates of the toe of the subject included in the image of the frame when No is determined in step S1109.

In addition, the measurement end point referred to here is, when the subject walks from the left side of the screen in FIG. 12, measurement start (end) coordinates 1201 on the right side of the screen in FIG. 12 (on the left side when walking from the right side). Measurement start (end) coordinates 1201). In the present embodiment, the coordinates of the toes of the subject are used, but as another embodiment, the coordinates of the subject's head and the coordinates of the hands may be used, or the average value of the coordinates of each part may be used. Is also good. However, it is preferable that the parts used at the measurement start point and the measurement end point match.

In addition, in the present embodiment, it is possible that the test subject does not walk straight and shifts diagonally (front side or back side of the screen in FIG. 12). I'm calculating.

However, as another example, when considering a case where the position is slanted (front side or rear side of the screen in FIG. 12), a measurement start point (X1, Y1, Z1) and a measurement end point (X2, Y2) are considered. , Z2), the walking distance may be calculated.

Next, the information processing apparatus 101 obtains the walking speed of the subject by dividing the previously obtained walking distance by the time taken to finish counting in step S1107.

Then, finally, the information processing apparatus 101 calculates the time required for walking 5 m at the previously obtained walking speed, and correct normal walking can be performed depending on whether the time is longer or shorter than the preset time. Determine if done. The number 5m is the distance required to determine the subject's normal walking movements.

By performing the above-described calculation, for example, even in a small room where the subject cannot walk 5 m, it is possible to determine whether or not the normal walking motion is correctly performed.

In step S1109, the information processing apparatus 101 determines that the coordinates of the toe of the subject identified in step S1101 are on one of the two preset measurement start (end) coordinates 1201. It is determined whether or not it has started counting the number.

That is, if YES is determined in step S1109, the information processing apparatus 101 uses the superimposed moving image data to determine the first position even if the passage specifying unit cannot specify the first timing. And the second position, the passage of the target person can be specified at a position between the first position and the second position where the passage of the target person is specified. The second required time is specified from the passage timing of the position between the second position and the second timing, and the walking speed identification means is configured to determine the second required time, the first position, and the second position. The walking speed is specified based on the distance between the position and and the second position.

If it is determined that the counting of the number of seconds is started, the information processing apparatus 101 ends the present process, and if it is determined that the counting of the number of seconds is not started, the process proceeds to step S1106. To migrate.

The case where No is determined in step S1109 means, for example, when the image of the frame preceding the image of the frame currently being processed is being processed, the toes of the subject identified in step S1101 Where the coordinate overlaps with one of the two preset measurement start (end) coordinates 1201 and should originally start counting the number of seconds, step S304 and step S305 in FIG. Accordingly, when the coordinate information of each joint of the subject cannot be specified, it is determined No in step S1109.

In that case, in step S1106, by starting counting the number of seconds from the point where the coordinates of the toe of the subject can be recognized between the measurement start (end) coordinates 1201, the movement of the subject can be performed without re-imaging. It becomes possible to evaluate.

In step S1104 to step S1108 of FIG. 11, the generation means for generating the superimposed moving image data in which the position information of the subject who is performing the walking motion is superimposed in the present invention, and the superimposed moving image data generated by the generating means are used. A passage identifying means for identifying a first timing at which the subject passes the first position on the superimposed moving image data and a second timing at which the subject passes the second position on the superimposed moving image data, A first time required for the subject to walk a predetermined distance between the first position and the second position from the first timing and the second timing identified by the passage identifying means. Is an example of a walking speed specifying unit that specifies a walking speed of the subject based on a time specifying unit that specifies a predetermined distance and a first required time specified by the time specifying unit.
This is the end of the description of FIG. 11.

Next, with reference to FIG. 13, in the present invention, a process executed by the CPU 201 of the information processing apparatus 101 when the selection of the item of “one eye standing with one eye open” is received from the user in step S301 will be described.

In step S1301, the information processing apparatus 101 determines whether or not the subject's foot is raised.

More specifically, first, before executing the process of step S1301, the information processing apparatus 101 specifies the y-coordinate value of the heels of both feet of the subject, and determines the difference in the coordinate values of the heels of the respective feet. By determining that is within a predetermined range, it is determined that both feet are on the ground.

Next, in step S1301, the y-coordinate value of one of the feet changes by a predetermined amount or more than the y-coordinate value of the heels of both feet of the subject identified by the information processing apparatus 101 before executing the process of step S1301. The information processing apparatus 101 identifies from the image of the frame currently being processed that the information processing apparatus 101 has changed, and if there is a change of a predetermined amount or more, the information processing apparatus 101 determines that the foot is up.

If it is determined in step S1301 that the subject's foot is raised, the information processing apparatus 101 proceeds to the process of step S1302, and if it is determined that the subject's foot is not raised, the information processing apparatus 101. Shifts to the processing of step S1304.

In step S1302, the information processing apparatus 101 determines whether the foot of the subject who has been determined to be raised in step S1301 is raised to a predetermined height.

If it is determined in step S1301 that the subject's foot, which has been determined to be raised, is raised to a predetermined height, the information processing apparatus 101 starts counting the number of seconds in step S1303, and is determined to be raised in step S1301. When it is determined that the subject's feet have not risen to the predetermined height, the information processing apparatus 101 ends this processing.

More specifically, in step S1302, the value of the y-coordinate of each foot indicates whether the subject has raised his/her foot to the height (FIG. 30) to be raised by “one-leg standing with eyes open”, by performing the processing in step S1301. Before execution, the information processing apparatus 101 identifies from the image of the frame currently processed by the information processing apparatus 101 whether the y-coordinate value of the heels of both feet of the subject identified by the information processing apparatus 101 has changed by a predetermined amount or more, When there is a change, the information processing apparatus 101 determines that the foot has risen to a predetermined height.

The “predetermined” value in step S1302 is larger than the “predetermined” value in step S1301.

In step S1304, the information processing apparatus 101 determines whether or not it is determined that the subject's foot is raised (YES in step S1301) in the frame preceding the image of the frame currently being processed. ..

If it is determined that the subject's foot is raised (YES in step S1301) in the image of the frame before the image of the frame currently being processed, the information processing apparatus 101 proceeds to step S1305. When it is determined that the subject's foot is not raised (YES in step S1301) in the image of the frame before the image of the frame currently measured, the information processing apparatus 101 determines that the subject is Determines that he has not raised his leg yet, and ends this processing.

In step S1305, the information processing apparatus 101 determines whether or not the subject's feet have descended.

More specifically, in step S1305, the y-coordinate value of each foot changes by a predetermined amount or more than the y-coordinate value of the heels of both feet of the subject identified by the information processing apparatus 101 before executing the process of step S1301. The information processing apparatus 101 identifies from the image of the frame currently being processed whether or not the information is processed, and if there is no change for a predetermined amount or more, the information processing apparatus 101 determines that the foot is down.

When it is determined in step S1305 that the subject's foot is descending, the information processing apparatus 101 transitions to the process of step S1306, ends the counting of the number of seconds executed in step S1303, and the subject's foot descends. If it is determined that the subject is not present, the information processing apparatus 101 determines that the subject is still raising his/her foot, and ends this processing.

In step S1307, the information processing apparatus 101 determines whether the number of seconds counted from the start of counting the number of seconds in step S1303 to the end of the counting in step S1306 is less than a predetermined number of seconds (for example, 24 seconds). , The subject's athletic ability is evaluated according to whether or not it exceeds. The evaluation result is stored in the measurement result management table (FIG. 19).
This is the end of the description of FIG.

Note that in FIG. 13, the information processing apparatus 101 automatically determines whether the subject's feet are raised or lowered, but as shown in FIG. 14, the user (e.g., evaluator) may manually specify the subject's feet raised or lowered. It is possible.

Therefore, a mechanism in which a user (e.g., an evaluator) manually specifies the raising and lowering of the subject's foot will be described below with reference to FIG.

FIG. 14 is a screen displayed on the display 212 of the information processing device 101 when the information processing device 101 starts photographing the subject in step S302.

On 1401, a moving image acquired by the motion information acquisition unit 151 of the information processing device 101 is displayed.

Reference numeral 1402 denotes an up/down button. When the up/down button 1402 is pressed for the first time by the user operating the mouse or the like, the information processing apparatus 101 stops the processing in FIG. 13 and the up/down button 1402 is pressed for the first time. At that timing, the information processing apparatus 101 determines that the subject has lifted his/her foot, and starts counting the number of seconds.

Then, when the raising/lowering button 1402 is pressed for the second time by the user operating the mouse or the like, the information processing apparatus 101 determines that the subject has lowered his/her foot, and finishes counting the number of seconds. Then, the exercise capacity of the subject is evaluated according to the counted number of seconds.

Note that in this embodiment, when the up/down button 1402 is pressed for the first time by the user operating the mouse or the like, the information processing apparatus 101 stops the processing of FIG. 13, but as another embodiment, FIG. When the up/down button 1402 is pressed by the user operating the mouse or the like after the processing of step S1303, the information processing apparatus 101 ends the counting of the number of seconds without executing the processing of steps S1304 and S1305. If the up/down button 1402 is pressed by the user operating the mouse or the like before the processing of step S1302, the information processing apparatus 101 starts counting the number of seconds without executing the processing of steps S1301 and S1302. After that, the processes of step S1304 and thereafter may be executed.

As shown in FIG. 14, when the user (e.g., evaluator) manually specifies the raising/lowering of the subject's foot, the information processing apparatus 101 automatically determines the raising/lowering of the subject's foot as shown in FIG. 13. , If the information processing device determines that the subject does not raise the leg even though the subject has raised the leg, or if the subject has determined that the subject has not lowered the leg Even if it happens, the judgment result can be corrected.
This is the end of the description of FIG.

Next, with reference to FIG. 29, a process of evaluating a subject's motion and displaying a message to the subject and a caregiver will be described. The process shown in the flowchart of FIG. 29 is a process in which the CPU 201 of the information processing device 101 reads and executes a predetermined control program.

In step S2901, it is determined whether the specified skeleton information satisfies a predetermined evaluation condition.

If the evaluation conditions are satisfied (step S2901: YES), the process moves to step S2902.

If the evaluation conditions are not satisfied (step S2901: NO), the process proceeds to step S2903.

An example of evaluation conditions is shown in FIG. As shown in FIG. 30, the evaluation condition and the evaluation content are associated with each item.

For example, with respect to “item: standing up in a chair”, when the knee angle is 175 degrees or more, it is evaluated as a standing motion, and when it is 95 degrees or less, it is evaluated as a sitting motion. Then, when the standing motion and the sitting motion are performed, it is evaluated that the standing and sitting motion is performed once.

In standing on one foot with the eyes open, it is evaluated that one foot is raised when the difference in height between the left and right feet is 5 cm or more.

In step S2902, evaluation values are added. For example, if the person is standing on a chair, one time is added. In the one-leg standing with the eyes open, the measurement of the one-leg standing time is started when the start condition for the one-leg standing is satisfied. When the end condition is satisfied, the measurement of the one-leg standing time is ended.

In step S2903, the message is specified based on the specified skeleton coordinates.

The message content is specified based on the message table shown in FIG. For example, in the category: standing and sitting on a chair, the message “please sit down” is specified when the knee angle is 175 degrees or more. Further, when the operation shifts to a sitting motion in the state where the knee angle is less than 175 degrees (when the knee angle becomes small), the message “Stand up firmly” is specified.

When standing on one leg with the eyes open, the message “Please raise your foot” is displayed if you are not raising your legs, and the message “Please raise your legs more” is displayed if the height of the raised legs is low. , The message "Measuring" is specified when the user's legs are firmly lifted.

By displaying the message in this manner, the subject and the caregiver can recognize whether the motion is being evaluated firmly and what kind of motion should be evaluated.

In step S2904, the message specified in step 2903 is displayed. 2201 of FIG. 22 is shown as an example.
Returning to the description of FIG.

The processing of steps S304 to S306 is processing performed each time the motion information acquisition unit 151 acquires a moving image frame. By recognizing the skeleton information each time a frame is acquired, it is possible to detect a change in the coordinate information of each joint and recognize the motion.

In step S307, the CPU 201 of the information processing apparatus 101 stores the result measured in step S306 (FIG. 19).

Next, with reference to FIG. 4, description will be given of measurement processing of each eye when using prerecorded motion information.

It is to be noted that whether to perform the real-time measurement shown in FIG. 3 (the process of performing the measurement while acquiring the motion information) or the measurement using the pre-recorded motion information shown in FIG. 4 is selected by the user. Determined by

In step S401, the user receives a selection of a moving image to be played (a moving image of a motion of a subject to be measured), and receives a playback instruction of the moving image.

The moving image data includes data acquired by each sensor of the motion information acquisition unit 151.

In step S402, the selection of a moving image to be compared with the moving image selected in step S401 is received.

In step S403, various settings are accepted for the moving image to be reproduced and the moving image to be compared.

In step S404, the settings accepted in step S402 are saved. When the save button 2801 in FIG. 28 is pressed, the save process is executed.

In step S405, the moving image instructed to be reproduced and the moving image set as the comparison target are reproduced.

At this time, when the simultaneous playback button is pressed, both moving images are played simultaneously, and when the individual playback buttons are pressed, the pressed moving images are played individually.

Then, the processing after step S304 in FIG. 3 is executed.

As shown in FIGS. 3 and 4, by making it possible to switch between a case where a motion is evaluated in real time while photographing a subject and a case where a moving image of the subject is saved and the motion is evaluated later, for example, If you want to give feedback to the subject on the spot, the user sets the motion to be evaluated in real time, if you want to record multiple subjects first and evaluate later, or if the user (evaluator) repeats detailed movements. ) Wants to check while watching, or if you want to evaluate the captured video as another event, if you want to check the angle of the subject's skeleton with the annotation function, or if the subject and the evaluator are together, It is possible for the user to save the captured moving image and set the motion to be evaluated later.

In addition, when a moving image of a subject is saved and the operation is evaluated later, there is an advantage that the user can manually change the evaluation result without re-taking the image if there is an erroneous detection.
23 and 24 show examples of comparison screens.

FIG. 23 is an example of a screen in which a moving image to be evaluated and a moving image to be compared are vertically arranged and displayed.

FIG. 24 is an example of a screen in which a moving image to be evaluated and a moving image to be compared are displayed side by side.

Regarding the layout of the comparison screen (vertical arrangement or horizontal arrangement), for example, there is a method of registering whether to arrange vertically or horizontally for each item and display according to the registered contents. FIG. 25 shows a table in which layouts are registered for each item.

As shown in FIG. 25, standing and sitting in chairs are arranged horizontally, and normal walking is arranged vertically. In this way, by registering in advance, events in which the subject moves in the vertical direction (such as "chair standing") are arranged side by side, and events in which the subject moves in the horizontal direction (such as "normal walking") It is possible to arrange them vertically. In this way, by deciding the arranging method according to the moving direction, it is possible to display in a layout that is easy to compare.

The method of registering in advance in this way is effective when the item is specified in advance.

There is also a method of determining the layout based on the trajectory of the subject. For example, the layout is determined based on the movement of the subject, such as arranging vertically when the subject's trajectory is in the left-right direction and arranging horizontally when the subject's trajectory is in the up-down direction.

According to the method of making a determination based on the trajectory of the subject in this way, it is possible to display the layout in a layout that is easy to compare even if the event is not specified in advance.

Also, on the comparison screen, it is possible to reverse the left and right of the moving image.

FIG. 26 is a diagram showing a case where the left and right sides of the upper moving image on the screen of FIG. 23 are reversed. As shown in FIG. 26, the person shown in the above moving image is facing right in FIG. 23, but is facing left in FIG.

The instruction to invert is accepted by checking the check box indicated by 2601 in FIG. If the "invert upper screen" in 2601 is checked, the upper screen is reversed. When "Reverse lower screen" is checked, the lower screen is reversed. If both are checked, the upper and lower screens will be reversed.

By reversing in this way, for example, one month ago, we measured from left to right in the image, but this time we also measured from right to left. Therefore, it becomes easier to compare and it becomes possible to grasp the difference between the two in detail.

Further, on the comparison screen, not only the images to be compared can be displayed side by side but also can be displayed in an overlapping manner.

FIG. 27 shows an example of overlapping display. 2701 and 2702 in FIG. 27 are images to be compared. 2703 is an image in which the images of 2701 and 2702 are superimposed.

On the comparison screen, it is possible to adjust the size and position of the image to be compared.

Regarding the size, by checking the “size” of the automatic adjustment menu 2704 of FIG. 27, for example, the lengths between the head and the waist are used so that the lengths match between the skeleton information to be compared. Adjusted.

Further, it is possible to perform not only the automatic adjustment but also the user's operation. In this case, the size can be adjusted by pressing the size adjustment buttons 2705 and 2706 in FIG.

By adjusting the size in this way, it becomes easier to compare even when comparing people with different heights, or when the magnification is different from those photographed in the past, and it is possible to grasp the difference between the two in detail. It will be possible.

Regarding the position, by checking the “position” of the automatic adjustment menu 2704 of FIG. 27, for example, the position of the head is adjusted so as to match the skeleton information of the comparison target. Further, the position is adjusted so that the person appears in the center of the composite image.

The position can also be adjusted by the user performing a drag operation.

In this way, by making the position adjustable, it is possible to arrange the skeleton information to be compared at a desired position for comparison, or to overlap and compare, which makes it easier to compare, and the difference between the two It is possible to understand in detail.

Also, if a check is put in “both” in the automatic adjustment menu 2704, both size and position are adjusted.

Further, in the comparison screen, it is possible to display only the skeleton information without displaying the background or the like.
FIG. 28 shows an example of a screen displaying only skeleton information.

For example, when the moving images to be compared are shot in different rooms, the difference in background interferes and it becomes difficult to compare the movements of the skeletons. In particular, in a composite image, different backgrounds are displayed in a superimposed manner, which makes it very difficult to see and makes comparison difficult. Therefore, by deleting the background, the comparison target can be clearly displayed, and the difference between the two can be grasped in detail.

The contents (combination of comparison moving images, screen layout, position, size, etc.) set on the various screens described above can be saved and reused as a comparison scenario.

The information of the comparison scenario includes information of the moving image file, a reproduction start position, a reproduction end position, a zoom state, an adjusted position of the composite video, and a horizontal inversion setting.

In this way, by saving the set contents as a comparison scenario, it is possible to save the trouble of setting again when the user wants to review again later.

Next, the report creating process will be described with reference to FIG.

In step S501, the selection of the subject is received from the user, and the instruction to output the measurement result (report) of the subject is received.

In step S502, the measurement result of the subject who received the output instruction is extracted.

Details of the measurement result extraction process will be described with reference to FIG.

In step S1501, the information processing apparatus 101 receives the extraction condition setting from the user. FIG. 17 shows an image of the extraction condition setting screen. In the screen of FIG. 17, a start date 1701 and an end date 1702 are set as extraction conditions.

In step S1502, the information processing apparatus 101 receives selection of an item from the user. In the screen of FIG. 17, as the item 1703, one of standing with one eye on one leg, standing with a chair, sitting on a chair, maximum step, normal walking, and TUG is selected.

In step S1503, the information processing apparatus 101 extracts the current measurement result and the previous measurement result from the measurement result management table shown in FIG. 19 according to the extraction condition and the item accepted in steps S1501 and S1502. Specifically, this process is executed by pressing the extraction button 1704 in FIG. 17, and the measurement result management table for the selected item 1703 within the range of the start date 1701 and the end date 1702 which are the extraction conditions. And the latest measurement result and the second newest measurement result are extracted as the present result and the previous result.

By extracting the latest measurement result included in the specified period range and the second most recent result as the current measurement result and the previous measurement result for the specified event (usually there are multiple specifications), It is possible to extract measurement results for report output without performing a series of operations such as setting search conditions for each item, searching for measurement results, and selecting current measurement results and previous measurement results. ..

Here, the measurement result management table will be described with reference to FIG. The measurement result management table includes measurement result ID 1901, subject 1902, measurement date and time 1903, item 1904, measurement value 1905, evaluation point 1906, and moving image file 1907 as items. The measurement result ID 1901 is a character string for uniquely identifying the measurement result. Subject 1902 is the subject who received the measurement. The measurement date and time 1903 is the date and time when the measurement was started. The event 1904 is the measured event and is any one of the following: one-leg standing with eyes open, standing on a chair, maximum step, normal walking, and TUG. The measurement value 1905 is a numerical value indicating the measurement result. The evaluation score 1906 is a score evaluated based on the measured value 1905. The moving image file 1907 is a file name of moving image data corresponding to the measurement result or a link to the moving image data.

In step S1504, the information processing apparatus 101 displays the measurement result extracted in step S1503 on the display 212 or the like. FIG. 18 shows an image of the extraction result display screen. On the screen of FIG. 18, a thumbnail image 1801 of moving image data corresponding to the extracted measurement result is displayed.
Returning to the explanation of FIG.

In step S503, a report is created based on the result extracted in step S502.

Here, details of the report creation process will be described with reference to FIG.

The processes of steps S1601 to S1605 are repeatedly executed for each item for which the selection is accepted in step S1502.

In step S1601, the information processing apparatus 101 acquires the current and previous measurement results extracted in step S1503.

In step S1602, the information processing apparatus 101 determines whether the measurement result acquired in step S1601 has been evaluated. Specifically, it is determined whether a value is set for the evaluation point 1906 of the measurement result management table. If it has been evaluated, the process proceeds to step S1604, and if it has not been evaluated, the process proceeds to step S1603.

In step S1603, the information processing apparatus 101 evaluates the unevaluated measurement result and registers it in the measurement value 1905 and the evaluation point 1906 of the measurement result management table.

In step S1604, the information processing apparatus 101 searches each frame image of the moving image from the moving image corresponding to the measurement result, and extracts a frame image having a characteristic timing with respect to the item. The conditions that determine the characteristic timing are determined for each discipline.For example, with one eye standing with the eyes open, the timing when the foot is attached to the ground, that is, the state transitions from the state where the foot is raised to the state where the foot is attached The timing is the timing of opening the legs the most if it is the largest step, that is, the timing when the legs are lifted from the state of raising the legs when it is judged as the highest record. The specific condition is set based on the value of the coordinate data for each joint, the change status, the correlation of the coordinate data of a plurality of joints, and the like. The frame image having a characteristic timing may be extracted by this process, or may be extracted and saved at the time of evaluation and called by this process. Further, in the present embodiment, one characteristic frame image is extracted for each item, but a plurality of frame images may be extracted depending on conditions.

In step S1605, the information processing apparatus 101 outputs the thumbnail images of the characteristic frame images extracted in step S1604 and the evaluation results for various eyes as report elements. When a plurality of characteristic frame images are extracted in step S1604, a plurality of corresponding thumbnail images may be arranged and output, or may be narrowed down to one and output.

In this way, by outputting the evaluation results for various eyes and the thumbnail image of the characteristic frame image to the report element, not only the situation can be grasped by the numerical data, but also the quality of the measurement result can be grasped visually and intuitively. be able to.

In step S1606, the report elements output for various items are aggregated, and a report is created by adding information related to measurement such as the report creation date, subject information, and measurement location information.
Returning to the explanation of FIG.

In step S504, the CPU 201 of the information processing apparatus 101 outputs the report created in step S503.

FIG. 20 shows an output example of the report created in this process and output in step S504. In the output example of FIG. 20, the date of creation, the implementer (subject), the place of implementation, and the person in charge are displayed in the report information column 2001, a comment from the evaluator in the general comment column 2002, and each item in the radar chart column 2003. The radar chart of the evaluation points of is displayed. In the pickup item column 2004, thumbnails and skeleton images are displayed for the items selected by the user from the characteristic images extracted in step S1605. In the item-specific result column 2005, the current and previous implementation dates for each item, results (measured values), the degree of improvement determined from the current and previous evaluation points, comments from the evaluator to the item, and extraction in step S1605. A thumbnail image of the selected characteristic frame image is displayed.

As described above, according to the present invention, it is possible to provide a mechanism capable of specifying the walking speed of the target person even when the passage of the target person cannot be specified at a predetermined timing.

Further, the program according to the present invention is a program that causes a computer to execute the processes of FIGS. 3 to 5, 11, 11, 13, 15, 16 and 29. The program according to the present invention may be a program for each process of FIGS. 3 to 5, FIG. 11, FIG. 13, FIG. 15, FIG. 16, and FIG.

As described above, the recording medium recording the program that realizes the functions of the above-described embodiments is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the program stored in the recording medium. It goes without saying that the object of the present invention can also be achieved by reading and executing.

In this case, the program itself read from the recording medium realizes the novel function of the present invention, and the recording medium recording the program constitutes the present invention.

A recording medium for supplying the program includes, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a DVD-ROM, a magnetic tape, a non-volatile memory card, a ROM, an EEPROM, and a silicon. A disk or the like can be used.

Further, not only the functions of the above-described embodiments are realized by executing the program read by the computer, but also the OS (operating system) operating on the computer is actually executed based on the instructions of the program. It goes without saying that a case where some or all of the processing is performed and the functions of the above-described embodiments are realized by the processing is also included.

Furthermore, after the program read from the recording medium is written in the memory provided in the function expansion board inserted in the computer or the function expansion unit connected to the computer, the function expansion board is instructed based on the instruction of the program code. Needless to say, this also includes the case where the CPU or the like included in the function expansion unit performs some or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

Further, the present invention may be applied to a system including a plurality of devices or an apparatus including a single device. Further, it goes without saying that the present invention can be applied to the case where it is achieved by supplying a program to a system or an apparatus. In this case, by reading the recording medium storing the program for achieving the present invention into the system or device, the system or device can enjoy the effects of the present invention.

Further, by downloading and reading a program for achieving the present invention from a server, a database or the like on a network using a communication program, the system or apparatus can enjoy the effects of the present invention. It should be noted that the present invention also includes all configurations that combine the above-described embodiments and modifications thereof.

101 Information processing device

Claims (5)

The time required for the target person performing the walking motion to move the distance from the first position, which is a preset position on the moving image of the target person, to the second position, and the distance. Based on the moving speed specifying means for specifying the moving speed of the target person,
Detection means for detecting the subject between the first position and the second position;
Equipped with
Of the two positions set in advance on the moving image, the position that overlaps the position of the subject person first is the first position, and the position that overlaps the position of the subject person is the second position. Characterized by
When the moving speed identification means cannot detect the target person at the first position, the time required for moving the distance from the position where the target person is detected by the detection means to the second position, and An information processing device, characterized in that the moving speed of the subject is specified based on the distance. The information processing apparatus according to claim 1, further comprising a calculation unit that calculates an evaluation value regarding a walking motion of the subject based on the moving speed specified by the moving speed specifying unit. Further comprising display control means for controlling display of the moving image,
Wherein the display control unit, an information processing apparatus according to claim 1 or 2, the first position and the second position the user and displaying controlling the moving picture so as to be identified. The moving speed identification means of the information processing device causes the target person who is performing the walking motion to move a distance from the first position, which is a preset position on the moving image of the target person, to the second position. Based on the time required for and the distance, a moving speed specifying step of specifying the moving speed of the target person,
A detection step of detecting the target person between the first position and the second position by the detection means of the information processing device;
Equipped with
Of the two positions set in advance on the moving image, the position that overlaps the position of the subject person first is the first position, and the position that overlaps the position of the subject person is the second position. Characterized by
In the moving speed specifying step, when the target person cannot be detected at the first position, the time required to move the distance from the position where the target person is detected by the detecting step to the second position, and An information processing method, characterized in that the moving speed of the target person is specified based on the distance. Information processing equipment,
The time required for the target person performing the walking motion to move the distance from the first position, which is a preset position on the moving image of the target person, to the second position, and the distance. Based on the moving speed specifying means for specifying the moving speed of the target person,
Between the first position and the second position, functioning as detection means for detecting the target person,
Of the two positions set in advance on the moving image, the position overlapping first with the position of the target person is the first position, and the position overlapping with the position of the target person is the second position. Characterized by
When the moving speed specifying means cannot detect the target person at the first position, the time required to move the distance from the position where the target person is detected by the detecting means to the second position, and , A program for functioning as a means for identifying the moving speed of the target person based on the distance.

Images