JP7101424B2 - Measurement and display method of muscle deformation in the motor process of aquatic animals - Google Patents

Description

The present invention belongs to the technical field of animal kinematics, and specifically relates to a method for measuring and displaying muscle deformation in the movement process of aquatic animals.

Muscle activity drives the activity of animal-related organs and completes various motor functions of the animal. Muscle morphological changes are features that reflect muscle activity and are important indicators of animal kinematics research, the practice of motor system disorders, and related data are related to animal and human movements. It can be used to enhance the feat effect of video advertising.

It is possible to observe and measure the structure of animal muscles by dissection, and it is possible to obtain static perspective views of muscles for living animals using technologies such as CT, nuclear magnetic resonance, biomuscular fluorescence, and polarization. It can be done (Wu Jia, 2014; Zhu Yu, etc., 2019; Olszewski, etc., 2009; Camp, etc., 2018). Complete muscles with clear bond boundaries in large animals may be distinguishable, but muscles in small animals and muscles with unclear bond boundaries in large animals are indistinguishable in these figures. Under conditions that constrain the animal in a particular device, changes in the contour of the biological muscle group of an animal can be detected using ultrasonic techniques, biomuscular fluorescence, etc. (Wakeling et al., 1999; Camp et al., Etc., 2018). However, there are no reports yet of measuring continuous changes in the clear boundaries of certain complete muscles during the animal's motor process. There is currently no way to measure continuous changes in muscle without restraining the animal, especially in animal motion videos taken outdoors. Some video advertisements add cartoons of muscle movement to animal movement videos, but they are not realistic.

Therefore, in the measurement of muscle changes in animal exercise, problems that are not currently solved are 1) it is difficult to measure complete muscle morphological changes with unclear connection boundaries, and 2) field photography. It includes the difficulty of measuring the morphological changes of the animal's muscles in the moving images, and 3) when the aquatic animals exercise in water, it becomes more difficult to solve these problems.

A main object of the present invention is to overcome the shortcomings and deficiencies of the prior art, and to accurately measure the data in which the three-dimensional morphological structure of a certain muscle changes according to the movement process of the animal. It is to provide a method of measuring and displaying muscle deformation in the process.

The present invention discloses a method for measuring and displaying muscle deformation during the motor process of an aquatic animal, obtains a behavioral video of the aquatic animal, and uses the photographed animal for use in determining the posture of the animal during CT tomographic scanning. A step of decomposing the behavioral video into multiple photographs, a step of acquiring a CT tomographic image, a step of dissecting an animal that has undergone video recording and CT tomographic scanning, and a step of analyzing the morphological structure of the muscle. The muscle data by the step of determining the muscle boundary in the CT tomographic data based on the anatomical structure and performing the same processing for all the CT tomographic data in different postures and the muscle boundary of the labeled CT tomographic data. To construct a group of muscle feature point equations that can not only describe the spatial morphological structure of a muscle in a specific posture of an animal, but also describe the spatial morphological structure change process of a muscle in the movement process of an animal. Analyze the quantitative relationship between the step and the size of the individual and the size of the muscle, and calculate the spatial morphological structure of the muscle of a specific size animal using the equation group of the relationship between the size of the individual and the size of the muscle. The steps to be taken and the process of muscle morphological change in the movement process of the animal in the video taken in the field or in the field are analyzed, and the video taken in the field or in the field is decomposed into multiple pictures to determine the size of the animal in the picture. It includes a step of calculating the spatial morphological structure of one or more muscles using a group of muscle feature point equations based on posture.

Preferably, as a method of acquiring an animal behavior video, a plurality of cameras are used to shoot one animal behavior video from different angles, and spatial dynamic data of each point of the body during the animal movement process is acquired. ..

Preferably, the CT tomographic scan includes a limit scan in which the CT tomographic scan is performed in the maximum activity-restricted posture of each active joint of the animal, and a moving motion scan in which the CT tomographic scan is performed in different postures of the animal in the animal behavior video. including.

Preferably, when determining a muscle boundary, if the boundary of a muscle studied on a CT photograph is blurred and no boundary is visible, then it is adjacent to the size of the anatomical structure of that muscle. Boundaries are divided based on the muscle boundary data labeled on the tomographic.

Preferably, as a specific method for constructing a group of muscle feature point equations, all three-dimensional data points within the muscle boundary in the CT tomographic data are separated, and then the data is simplified to make the muscle three-dimensional. It leaves the main feature point data that can draw the detailed structure of, scans the spatial morphology of the muscle at the spatial distance and / or the spatial angle of these major feature point data, and is all the same for the CT tomographic scan data in different postures. Processing is performed to establish a relational expression between the spatial distance / or spatial angle of different muscle feature points and the animal posture parameter, and form a group of muscle feature point equations.

Preferably, to analyze the quantitative relationship between the size of the individual and the size of the muscle, specifically, individuals of different sizes of the same species are taken, CT tomography is performed in the same posture, and further, these are further performed. Each animal is dissected to obtain the spatial size of the muscle to be studied, and all 3D data points within the muscle boundary of the CT tomographic scan data are separated, the feature points are simplified, and the feature points of the muscle are different. Establish a relational expression between the spatial distance and / or the spatial angle of the animal and the size of the animal, and form a group of equations to analyze the relationship between the size of the individual and the size of the muscle.

Preferably, the acquisition of a fluoroscopic effect video is further included, specifically, a perspective view of a muscle having a specific spatial morphological structure is superimposed on a photograph, and these photographs are connected to the moving image to obtain a video of muscle activity. An animal movement video with a fluoroscopic effect can be obtained.

The present invention is a three-dimensional morphological structure of a specific muscle by anatomy of a real animal and tomographic CT fluoroscopy based on the motion posture of the animal, as compared with the conventional measurement and display technique of muscle morphology change in the movement of aquatic animals. It is possible to accurately measure the data that changes depending on the movement process of the animal. Information such as continuous deformation of these muscle morphologies has extremely great reference value for biological and medical research. In addition, a three-dimensional structural model of muscles can be calculated from videos and photographs of animals, and by superimposing these digitized muscles on actual captured videos and photographs, the perspective is realistic.

It is a flowchart of the measurement and display method of the muscle deformation in the motor process of the aquatic animal of this Example. (A)-(c) are partial CT tomographic scan images of this Example. It is an anatomical view of the large side muscle of tilapia of this example. It is a tilapia large side muscle fine 3D model including 60,000 feature data points of this embodiment. It is a tilapia large side muscle fine 3D model including 400 feature data points of this embodiment. In (a) and (b), the tilapia large side muscle 3D model is superimposed on the general map and the fluoroscopic view of the skeleton, respectively.

In order for those skilled in the art to better understand aspects of the present application, the technical solutions of the embodiments of the present application will be clearly and completely described below in connection with the drawings of the embodiments of the present application. It is clear that the examples described are only partial examples of the present application and not all embodiments. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative labor are all within the scope of protection of the present application.

(Example)
As shown in FIG. 1, this embodiment is a method for measuring and displaying muscle deformation in an aquatic animal's motor process, and specifically presents a state of morphological change of one or a plurality of muscles in the animal's motor process. Data such as continuous deformation of muscle morphology are of great reference value for biological and medical research. In addition, a three-dimensional model of this digitized muscle can be calculated from a moving image or a photograph taken in the field, and further, a fluoroscopic effect having analysis data is obtained by superimposing it on the actually taken moving image or a photograph. This measurement and display method includes the following steps.

(1) Acquire a motion video of an animal. In order to acquire spatial dynamic data of each point of the body in the movement process of an animal, first, a plurality of cameras are used to shoot a motion video of one animal from different angles. Since the moving image is continuously displayed as continuous photographs, the behavioral moving images of the captured animals are decomposed into a plurality of photographs in order to be used when determining the posture of the animal during CT tomographic scanning.

More specifically, in this embodiment, the motion video of the photographed experimental animal is divided into simple motion video segments using software such as edius, and then the motion video is generated using software such as Photoshop. Divide into one frame posture image.

(2) Acquire a CT tomographic scan image with abundant information. Both parts of the CT tomographic scan are the limit scan, in which the CT tomographic scan is performed in the maximum activity-restricted posture of each active joint of the animal, and the moving image posture scan, in which the CT tomographic scan is performed in different postures of the animal in the animal behavior video. It is divided into.

More specifically, in this embodiment, the posture of the experimental animal is determined based on the posture image of one frame and the range of motion of the joint, and CT tomographic scanning is performed.

(3) The morphological structure of the muscle is analyzed by dissecting the animal that has undergone video recording and CT tomographic scanning. When an animal's muscles are studied, the muscles are dissected and separated, the boundaries of the muscles are measured, and the features are analyzed. Anatomical studies of multiple animal muscles, as well as each muscle, are possible.

(4) Determine the muscle boundary in the CT tomographic scan data based on the anatomical structure of the muscle. There are 1000-2000 CT scans of one posture, and sometimes more, which mark the boundaries of the muscles in the CT scans containing the muscle under study. If the boundary of a muscle to be studied is blurred in the CT photograph and the boundary is not shown at all, then the size of the anatomical structure of that muscle and the muscle boundary data labeled on the adjacent tomographic photograph are displayed. Divide the boundaries based on. The same processing is performed for all CT tomographic scan data in different postures.

(5) The muscle data is separated by the muscle boundary of the labeled CT tomographic scan data, and a group of muscle feature point equations is constructed. First, all the 3D data points within the muscle boundary of the CT tomographic data are separated, and then the data is simplified to leave the main feature point data that can draw the 3D fine structure of the muscle. The spatial morphology of the muscle is scanned by the spatial distance (and optionally the spatial angle may be added) of the key feature point data. The same processing is performed for all CT tomographic scan data in different postures. Establish a relational expression between the spatial distance of different muscle feature points (spatial angle may be added in some cases) and animal posture parameters (joint motion angle, bending angle of the main axis of the spine, etc.), and the muscle feature point equation. Form a group. Using the muscle feature point equations, it is possible not only to describe the spatial morphological structure of a muscle in a specific posture of an animal, but also to describe the spatial morphological structural change process of a muscle in the movement process of an animal.

More specifically, in the specific embodiment of this embodiment, 3D imaging is realized by using Mimics software → 3D imaging data is introduced into CAD software → fine data points based on muscle anatomy boundary data. Determine a 3D digital model using → Reduce data points to form a 3D digital model with fewer feature data points → Analyze the relationship between feature point parameters and animal posture parameters to form muscle feature point equations do.

(6) Analyze the quantitative relationship between individual size and muscle size. Individuals of different sizes of the same species to be studied are taken, CT tomographic scans are performed in the same posture, and each of these animals is dissected to obtain the spatial size of the muscle to be studied, and then CT is performed according to the above steps. All three-dimensional data points within the muscle boundary of the tomographic scan data are separated, the feature points are simplified, the spatial distance of different feature points of the muscle (possibly a spatial angle may be added) and the size of the animal. Establish the relational expression of and form a group of equations to analyze the relationship between the size of the individual and the size of the muscle. Using the equations of the relationship between the size of this individual and the size of the muscle, the spatial morphological structure of a muscle of an animal of a specific size is calculated.

(7) Analyze the morphological change process of the muscles of the animal's motor process in the video taken in the field or in the field. A video taken in the field or in the field is decomposed into multiple photographs, and based on the size and posture of the animal in the photographs, the spatial morphological structure of a certain muscle (one or more) is constructed using a group of muscle feature point equations. calculate. If you want to get a fluoroscopic effect video of muscles, you can superimpose a perspective view of a muscle with a specific spatial morphological structure on a photo and connect these photos to the video to get an animal exercise video with a perspective effect of muscle activity. Be done.

More specifically, using the muscle feature point equation group, we analyze the motion videos of animals in the field or in the field, acquire the data of the 3D structural change process of the muscle in the movement process of the animal, and at the same time, 3D of the muscle. Structural changes are superimposed on the video to form an animal locomotion video with a muscle activity fluoroscopic effect.

Hereinafter, the technical solution means of this embodiment will be further described by taking tilapia as an example.

Research purpose: Understand the morphological change process of the large side muscles in the swimming process of tilapia, and use it as a reference for aquaculture, video feat creation, and fish kinematics research.

process:
First, multiple cameras are used to shoot Tyrapia's behavior videos from different angles → Tyrapia's posture is taken based on the video posture and joint range of motion, and CT tomographic scanning is performed → CT scan images are acquired (Fig. 2 (a)-). (Shown in FIG. 2 (c)) → 3D imaging CT scan image data using Mimics software → Introducing 3D imaging data into CAD software → Of the data for each posture, muscle anatomy data (shown in FIG. 3) and Select a Tyrapia large side muscle fine 3D digital model containing 60,000 feature data points based on the skeletal reference system (shown in FIG. 4) → 3D digital of Tyrapia large side muscle coarse contour containing 400 feature data points Select a model (shown in FIG. 5) → Establish a group of muscle feature point equations that can analyze changes in the large side muscle morphology of a specific posture of a specific size Thirapia.

Healthy tilapia and muscle damage The process by which tilapia bends and activates was analyzed using the tilapia large side muscle feature point equations. As a result, it was clear that the healthy tilapia had a large change in muscle morphology (distance between each feature point, etc.) during the activation process, but the fish with muscle damage had a small change in muscle morphology. In addition, the Thirapia large side muscle 3D model can be superimposed on a general photograph, and as shown in FIGS. 6 (a) and 6 (b), the exercise video frame image in which the muscle 3D model is superimposed can be displayed as a muscle. The three-dimensional structure of can be linked to a Tyrapia motion video with a dynamically changing fluoroscopic effect.

The above-described embodiment is a preferred embodiment of the present invention, but the embodiment of the present invention is not limited to the above-mentioned embodiment, and is performed without departing from the spirit and principle of the present invention. Modifications, alterations, substitutions, combinations and simplifications should be equivalent substitutions within the scope of the invention.

[Additional Notes]
[Appendix 1]
A method for measuring and displaying muscle deformation during the motor process of aquatic animals.
A step to decompose the captured animal behavior video into multiple photographs in order to acquire the aquatic animal behavior video and use it when determining the posture of the animal during CT tomographic scanning.
Steps to acquire CT tomographic scans and
Furthermore, the step of dissecting the animal by video recording and CT tomographic scanning and analyzing the morphological structure of the muscle,
A step of determining muscle boundaries in CT tomographic data based on the anatomical structure of the muscle and performing the same processing on all CT tomographic data in different postures.
The muscle data is separated by the muscle boundaries of the labeled CT tomographic scan data, and not only can the spatial morphological structure of a muscle be described in a specific posture of the animal, but at the same time, the spatial morphological structure change process of a muscle in the motor process of the animal can be described. Steps to build a set of muscle feature point equations that can also be described,
A step to analyze the quantitative relationship between the size of an individual and the size of the muscle, and to calculate the spatial morphological structure of a muscle of an animal of a specific size using a group of equations for the relationship between the size of the individual and the size of the muscle. ,
We analyze the muscle morphological change process of the animal's motor process in the video taken in the field or in the field, decompose the video taken in the field or in the field into multiple pictures, and based on the size and posture of the animal in the picture. A method for measuring and displaying muscle deformation in an aquatic animal's motor process, which comprises a step of calculating the spatial morphological structure of one or more muscles using a group of muscle feature point equations.

[Appendix 2]
As a way to get animal behavior videos
It is characterized by taking motion videos of one animal from different angles using a plurality of cameras and acquiring spatial dynamic data of each point of the body in the movement process of the animal.
The method for measuring and displaying muscle deformation in the motor process of aquatic animals according to Appendix 1.

[Appendix 3]
As a CT tomographic scan
The limit scan, which performs CT tomographic scanning in the maximum activity-restricted posture of each active joint of the animal,
It is characterized by including a video posture scan in which a CT tomographic scan is performed in different postures of an animal in an animal behavior video.
The method for measuring and displaying muscle deformation in the motor process of aquatic animals according to Appendix 1.

[Appendix 4]
When determining a muscle boundary, if the boundary of a muscle studied on a CT photo is blurred and no boundary is visible, then the size of the anatomical structure of that muscle and the adjacent tomographic picture It is characterized by dividing the boundary based on the labeled muscle boundary data.
The method for measuring and displaying muscle deformation in the motor process of aquatic animals according to Appendix 1.

[Appendix 5]
As a concrete method of constructing a group of muscle feature point equations,
After separating all 3D data points within the muscle boundary of the CT tomographic scan data, the data is simplified to leave the main feature point data that can depict the 3D fine structure of the muscle.
Scan the spatial morphology of the muscle at the spatial distance and / or spatial angle of these key feature point data.
Perform the same processing on all CT tomographic scan data in different postures.
It is characterized by establishing a relational expression between the spatial distance / or spatial angle of different muscle feature points and the animal posture parameter, and forming a group of muscle feature point equations.
The method for measuring and displaying muscle deformation in the motor process of aquatic animals according to Appendix 1.

[Appendix 6]
Specifically, analyzing the quantitative relationship between the size of the individual and the size of the muscle is
Individuals of different sizes of the same species are taken, CT tomographic scans are performed in the same posture, and these animals are dissected to obtain the spatial size of the muscle to be studied. All three-dimensional data points within are separated, feature points are simplified, spatial distances and / or spatial angles of different muscle feature points and relational expressions between animal size are established, and individual size and muscle size. It is characterized by forming a set of equations that analyze the relationship of magnitude.
The method for measuring and displaying muscle deformation in the motor process of aquatic animals according to Appendix 1.

[Appendix 7]
Further including acquiring a muscle fluoroscopy effect video, specifically,
By superimposing a perspective view of a muscle having a specific spatial morphological structure on a photograph and connecting these photographs to a video, an animal locomotion video having a perspective effect on muscle activity can be obtained.
The method for measuring and displaying muscle deformation in the motor process of aquatic animals according to Appendix 1.

Claims (7)

A method for measuring and displaying muscle deformation during the motor process of aquatic animals.
A step to decompose the captured animal behavior video into multiple photographs in order to acquire the aquatic animal behavior video and use it when determining the posture of the animal during CT tomographic scanning.
Steps to acquire CT tomographic scans and
Furthermore, the step of dissecting the animal by video recording and CT tomographic scanning and analyzing the morphological structure of the muscle,
A step of determining muscle boundaries in CT tomographic data based on the anatomical structure of the muscle and performing the same processing on all CT tomographic data in different postures.
The muscle data is separated by the muscle boundaries of the labeled CT tomographic scan data, and not only can the spatial morphological structure of a muscle be described in a specific posture of the animal, but at the same time, the spatial morphological structure change process of a muscle in the motor process of the animal can be described. Steps to build a set of muscle feature point equations that can also be described,
A step to analyze the quantitative relationship between the size of an individual and the size of the muscle, and to calculate the spatial morphological structure of a muscle of an animal of a specific size using a group of equations for the relationship between the size of the individual and the size of the muscle. ,
We analyze the muscle morphological change process of the animal's motor process in the video taken in the field or in the field, decompose the video taken in the field or in the field into multiple pictures, and based on the size and posture of the animal in the picture. A method for measuring and displaying muscle deformation in an aquatic animal's motor process, which comprises a step of calculating the spatial morphological structure of one or more muscles using a group of muscle feature point equations. As a way to get animal behavior videos
It is characterized by taking motion videos of one animal from different angles using a plurality of cameras and acquiring spatial dynamic data of each point of the body in the movement process of the animal.
The method for measuring and displaying muscle deformation in the motor process of an aquatic animal according to claim 1. As a CT tomographic scan
The limit scan, which performs CT tomographic scanning in the maximum activity-restricted posture of each active joint of the animal,
It is characterized by including a video posture scan in which a CT tomographic scan is performed in different postures of an animal in an animal behavior video.
The method for measuring and displaying muscle deformation in the motor process of an aquatic animal according to claim 1. When determining a muscle boundary, if the boundary of a muscle studied on a CT photo is blurred and no boundary is visible, then the size of the anatomical structure of that muscle and the adjacent tomographic picture It is characterized by dividing the boundary based on the labeled muscle boundary data.
The method for measuring and displaying muscle deformation in the motor process of an aquatic animal according to claim 1. As a concrete method of constructing a group of muscle feature point equations,
After separating all 3D data points within the muscle boundary of the CT tomographic scan data, the data is simplified to leave the main feature point data that can depict the 3D fine structure of the muscle.
Scan the spatial morphology of the muscle at the spatial distance and / or spatial angle of these key feature point data.
Perform the same processing on all CT tomographic scan data in different postures.
It is characterized by establishing a relational expression between the spatial distance / or spatial angle of different muscle feature points and the animal posture parameter, and forming a group of muscle feature point equations.
The method for measuring and displaying muscle deformation in the motor process of an aquatic animal according to claim 1. Specifically, analyzing the quantitative relationship between the size of the individual and the size of the muscle is
Individuals of different sizes of the same species are taken, CT tomographic scans are performed in the same posture, and these animals are dissected to obtain the spatial size of the muscle to be studied. All three-dimensional data points within are separated, feature points are simplified, spatial distances and / or spatial angles of different muscle feature points and relational expressions between animal size are established, and individual size and muscle size. It is characterized by forming a set of equations that analyze the relationship of magnitude.
The method for measuring and displaying muscle deformation in the motor process of an aquatic animal according to claim 1. Further including acquiring a muscle fluoroscopy effect video, specifically,
By superimposing a perspective view of a muscle having a specific spatial morphological structure on a photograph and connecting these photographs to a video, an animal locomotion video having a perspective effect on muscle activity can be obtained.
The method for measuring and displaying muscle deformation in the motor process of an aquatic animal according to claim 1.

Images