JP6921589B2 - Information processing equipment, inspection system and information processing method - Google Patents

Description

The present invention relates to an information processing apparatus, an inspection system and an information processing method.

In the medical field, doctors make diagnoses using medical images taken by various modality (examination systems). Examples of the modality include an ultrasonic diagnostic apparatus and a photoacoustic imaging apparatus (hereinafter, referred to as a PAT (PhotoAcoustic Tomography) apparatus). Further, a magnetic resonance imaging device (hereinafter referred to as an MRI (Magnetic Resonance Imaging) device), a computer tomography device (hereinafter referred to as an X-ray CT (Computed Tomography) device), and the like can be mentioned.

There is known a system that determines (identifies) which part of a subject the medical image used for these diagnoses is based on the positional relationship between the examination system and the subject. Patent Document 1 discloses a technique in which a sensor is installed on the floor of an examination system to discriminate (identify) a site (left and right breast) under examination based on a position where a subject as a subject stands on the floor. Further, Patent Document 2 discloses a technique of detecting the orientation of the face of a subject (subject) in contact with the inspection system and discriminating (identifying) the site (left and right of the breast) under examination.

Japanese Patent No. 5025156 Japanese Unexamined Patent Publication No. 2012-10772

However, in the prior art, there is a problem that there is a possibility that the determination (identification) of the site may be erroneous. The present invention has been made in view of such problems, and an object of the present invention is to identify an inspection site with high accuracy.

Therefore, the present invention is an information processing apparatus, which is an information processing apparatus, and is an acquisition means for acquiring an appearance image in which at least a part of an inspection device and a subject is photographed by an imaging means, and the inspection device based on the appearance image. It is characterized by having a site specifying means for acquiring the positional relationship between the subject and at least a part of the subject and specifying the test site of the subject based on the positional relationship and the type of the test device.

According to the present invention, the inspection site can be specified with high accuracy.

It is an overall view of the inspection system which concerns on 1st Embodiment. It is a figure which shows the state at the time of inspection. It is a figure which shows the hardware configuration of an information processing apparatus. It is a flowchart which shows the inspection control processing. It is an overall view of the inspection system which concerns on 2nd Embodiment. It is a figure which shows the state at the time of inspection. It is a flowchart which shows the inspection control processing. It is a flowchart which shows the discriminating process of the inspection part which concerns on 3rd Embodiment. It is a figure which shows the discrimination line. It is a figure which shows the center line.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(First Embodiment)
FIG. 1 is an overall view of the inspection system 100 according to the first embodiment. FIG. 1A is a side view of the inspection system 100, and FIG. 1B is a top view of the inspection system 100. The examination system 100 according to the present embodiment is a PAT device, and examines the breast using a human body as a subject. At this time, the inspection system 100 further automatically discriminates between the left and right breasts.

The inspection system 100 includes an inspection table 110, an inspection unit 112, an imaging device 120, and an information processing device 130. The examination table 110 is a table on which a subject (human body) is placed. The subject lies on the examination table 110 in the prone position and the examination is performed. Further, the examination table 110 is provided with a circular recess 111 for inserting the breast, which is the examination site of the subject. The recess 111 is installed so as to be embedded in the inspection table 110, and the installation position is fixed. The recess 111 is located at the position where the chest of the subject is located at the time of examination in the length direction A of the examination table 110, and at a position on the center line 170 which bisects the examination table 110 along the length direction A. It is provided.

The inspection unit 112 is arranged below the recess 111, and includes an element that irradiates a pulsed laser beam and an element that detects ultrasonic waves. Further, the inspection unit 112 includes an AD converter that converts the detected ultrasonic waves into digital signals. The inspection unit 112 irradiates the human body with pulsed laser light (laser pulse) that emits light for a short time, and weak ultrasonic waves (photoacoustic waves) generated when hemoglobin or the like in the blood vessel absorbs the light and causes thermal expansion. Is detected. The detected ultrasonic analog signal is converted into a digital signal (photoacoustic signal) and sent to the information processing apparatus 130. The information processing device 130 generates a photoacoustic image based on the digital signal obtained by the inspection unit 112.

The imaging device 120 is installed above the examination table 110 and photographs an image including the examination table 110 and the subject. In the present embodiment, it is assumed that the photographing apparatus 120 is arranged at a position directly above the center line 170. In the present embodiment, a surveillance camera that captures visible light is used as the imaging device 120. The photographing device 120 is not limited to a camera that photographs visible light. As another example, the photographing device 120 may be a camera or a thermo camera that photographs infrared light. The information processing device 130 determines an inspection site corresponding to the photoacoustic image obtained by the inspection unit 112 based on the image taken by the photographing device 120. Hereinafter, for convenience of explanation, the image taken by the photographing apparatus 120 will be referred to as an external appearance image, and the photoacoustic image generated based on the ultrasonic waves detected by the inspection unit 112 will be referred to as an inspection image.

FIG. 2 is a diagram showing a state at the time of inspection. Subject P lies on the examination table 110 in the prone position. The breast of the subject P is inserted into the recess 111 of the examination table 110. The recess 111 is not shown in FIG. 2 because it is located at the bottom of the subject P. In this state, the photographing apparatus 120 captures an external image including at least a part of the subject P and at least a part of the examination table 110. In addition, in this embodiment, it is assumed that the photographing range of the appearance image photographed by the photographing apparatus 120 includes at least a part of the subject P, more specifically, at least the upper body of the subject P. .. Further, it is assumed that the imaging range includes the entire inspection table 110. The information processing device 130 analyzes the appearance images of the examination table 110 and the subject P photographed by the imaging device 120, recognizes the examination table 110 from the images, and calculates the center line 170.

FIG. 3 is a diagram showing a hardware configuration of the information processing apparatus 130 according to the first embodiment. The information processing device 130 includes a CPU 301, a ROM 302, a RAM 303, an HDD 304, a display unit 305, an input unit 306, and a communication unit 307. The CPU 301 reads the control program stored in the ROM 302 and executes various processes. The RAM 303 is used as a temporary storage area for the main memory, work area, etc. of the CPU 301. The HDD 304 stores various data, various programs, and the like. The functions and processes of the information processing apparatus 130, which will be described later, are realized by the CPU 301 reading a program stored in the ROM 302 or the HDD 304 and executing this program.

The display unit 305 displays various information. For example, an inspection image, an appearance image, or the like is displayed on the display unit 305. The input unit 306 has a keyboard and a mouse, and receives various operations by the user. The communication unit 307 performs communication processing with an external device such as an image forming device via a network.

FIG. 4 is a flowchart showing an inspection control process by the information processing apparatus 130. In S401, when the CPU 301 receives the inspection start instruction in response to the user operation, the CPU 301 controls the inspection unit 112 to start the inspection. The inspection unit 112 starts measuring the photoacoustic signal for the subject P. Next, in S402, the CPU 301 receives a photoacoustic signal from the inspection unit 112. Then, the CPU 301 generates an inspection image by performing an image reconstruction process on the photoacoustic signal. The CPU 301 stores the obtained inspection image in a storage unit such as the HDD 304.

Next, in S403, the CPU 301 instructs the photographing device 120 to photograph. The photographing device 120 photographs the appearance image according to the instruction, and transmits the appearance image to the information processing device 130. The CPU 301 acquires the appearance image and stores the appearance image in the storage unit. The CPU 301 identifies the appearance image by the file path of the appearance image or the like.

Next, in S404, the CPU 301 determines whether the examination site is the left breast or the right based on the center line 170 of the examination table 110 and the position of the upper body of the subject P based on the appearance image obtained in S403. Determine if it is a breast. Specifically, the CPU 301 learns the image template of the inspection table 110 and the image template of the upper body of a human in advance, and recognizes the area of the inspection table 110 by matching with the image template of the inspection table 110. Then, the CPU 301 calculates the line connecting the midpoint of the upper side and the midpoint of the lower side of the recognized area as the center line 170 of the inspection table 110. Further, the CPU 301 recognizes the area of the upper body of the subject P by matching with the image template of the upper body of the human.

Then, the CPU 301 has an area of the upper body located in the area 171 (FIG. 2) corresponding to the left side of the subject P with the center line 170 as the boundary and the area 172 corresponding to the right side of the subject P with the center line 170 as the boundary. Compare with the area of the upper body located in (Fig. 2). Then, when the area of the area 171 corresponding to the right side is larger than the area of the area 172 corresponding to the left side (Yes in S404), the CPU 301 advances the process to S405. On the other hand, when the area of the area 172 corresponding to the left side is equal to or less than the area of the area 171 corresponding to the right side (No in S404), the CPU 301 proceeds to S406. The position of the inspection device (inspection unit 112) on the inspection table is fixed, that is, the process of S404 is an example of the position identification process for specifying the positional relationship between at least a part of the subject and the inspection device.

In S405, the CPU 301 determines that the inspection site of the inspection image generated in S402 is the left breast, and then proceeds to the process to S407. On the other hand, in S406, the CPU 301 determines that the inspection site of the inspection image generated in S402 is the right breast, and then proceeds to S407. The treatments of S405 and S406 are an example of the site identification process for specifying the inspection site. In S407, the CPU 301 associates the inspection site determined in S405 or S406 with the inspection image and stores it in the storage unit. Here, the inspection image is an example of the inspection result, and the process of S407 is an example of the preservation process of storing the inspection site in association with the inspection result.

Next, in S408, the CPU 301 processes the appearance image so that it cannot be seen. Specifically, the CPU 301 encrypts the appearance image. Further, as another example, the CPU 301 may anonymize the appearance image so that the individual cannot be identified. Further, as another example, the CPU 301 may delete the appearance image from the storage unit instead of processing.

Next, in S409, the CPU 301 confirms whether or not the end instruction has been accepted in response to the user operation. When the CPU 301 receives the end instruction (Yes in S409), the CPU 301 ends the inspection control process. On the other hand, if the CPU 301 does not accept the end instruction (No in S409), the CPU 301 advances the process to S401 and continues the process.

The processing of the information processing apparatus 130 described with reference to FIG. 4 may be realized by coordinating a plurality of CPUs, ROMs, RAMs, etc., or may be realized by different hardware circuits. good. As yet another example, the processing of the information processing device 130 may be realized by a plurality of devices.

As described above, in the inspection system 100 of the present embodiment, the information processing apparatus 130 determines the inspection site based on the appearance image corresponding to the inspection image. This makes it possible to accurately identify the inspection site. The information processing device 130 can discriminate between the left breast and the right breast, especially in a breast examination.

As a first modification of the first embodiment, the information processing apparatus 130 stores the inspection image and the appearance image in the storage unit in the process related to the acquisition of the inspection image and the appearance image, and then stores the inspection image and the appearance image in the storage unit. The inspection site may be discriminated at another timing. In this case, the CPU 301 stores the inspection image and the appearance image in the storage unit in association with the shooting time (acquisition time), respectively. Then, when the CPU 301 determines the inspection site corresponding to the inspection image, the CPU 301 identifies the appearance image at the shooting time closest to the shooting time of the inspection image to be processed, and the inspection site is based on the identified appearance image. Should be determined. Further, the shooting timing of the appearance image may be before and after the shooting of the inspection image.

Further, as a second modification, the CPU 301 may control the inspection image and the appearance image to be appropriately displayed on the display unit 305 in the inspection control process. For example, the CPU 301 may be controlled to display the inspection image in S402 and S407. Further, for example, the CPU 301 may be controlled to display an appearance image in S404.

Further, as a third modification, the process for the information processing apparatus 130 to determine the position of the center line 170 of the inspection table 110 is not limited to the embodiment. As another example, an image marker may be used. For example, image markers are installed at positions forming rectangular vertices at the four corners of the inspection table 110. Then, the CPU 301 recognizes the image marker installed on the inspection table 110 by matching with the image marker template. The CPU 301 calculates the position of the center line 170 of the inspection table 110 as a line connecting the midpoint of the upper side and the midpoint of the lower side of the rectangle formed by the positions of the image markers.

Further, as another example, a plurality of image markers may be arranged at the position of the center line 170 of the inspection table 110. In this case, the CPU 301 may recognize at least two image markers and calculate the center line 170 of the inspection table 110 as a line connecting the positions. Further, in the method using the image marker, the appearance image taken by the photographing apparatus 120 does not have to include the entire examination table 110, and may include the image marker and a part of the subject P.

As a fourth modification, the inspection system 100 is not limited to the PAT device. As another example, it may be an ultrasonic diagnostic apparatus that images an ultrasonic echo. In this case, the inspection unit 112 has a function of performing an ultrasonic inspection, and an ultrasonic inspection image is generated as an inspection image.

As a fifth modification, the inspection system 100 is applied when the position and orientation of the subject with respect to the inspection system change when inspecting the left organ and the right organ, and the image can be photographed with a camera or the like. can do. An example of such an examination is an X-ray mammography examination of the breast. In an X-ray mammography examination, the examination system 100 shall include a component that fixes the breast. The position and posture of the subject change depending on whether the left breast is examined or the right breast is examined. Therefore, the inspection system 100 can determine whether the inspection site is the left breast or the right breast by photographing the subject from behind or laterally with a camera or the like.

As a sixth modification, the information processing apparatus 130 may specify the inspection site based on the appearance image, and the specific processing for that purpose is not limited to the embodiment. For example, the information processing apparatus 130 detects the dent 111 from the external image of the examination table 110 in a state where there is no subject, and stores the position of the center of gravity of the dent 111 in advance. Then, the information processing apparatus 130 is based on whether the left side or the right side of the upper body of the subject is located on the position of the center of gravity of the recess 111 in the appearance image of the examination table 110 in the state where the subject P is lying down. The inspection site may be determined. Further, as described above, when the image markers are arranged at the four corners of the inspection table 110, the positions of the centers of gravity of the positions of the four image markers may be used.

As a seventh modification, the inspection system 100 includes a plurality of photographing devices 120, and the information processing device 130 creates a depth map from the appearance images taken by the plurality of photographing devices 120 and analyzes the depth map. You may. In this case, the information processing apparatus 130 may, for example, measure the distance from the photographing apparatus 120 to the examination table 110 in advance, and set a region shorter than this distance as the region of the subject. As another example, the inspection system 100 may be provided with a range sensor or the like that can directly acquire a depth map (distance image) instead of the plurality of photographing devices 120.

As an eighth modification, the process for recognizing the upper body of the subject by the information processing apparatus 130 is not limited to the embodiment. The information processing apparatus 130 may recognize the upper body of the subject by using the chroma key technique, for example, by utilizing the difference in color between the examination table 110 and the subject P. As another example, the information processing apparatus 130 may recognize the upper body of the subject based on the difference from the appearance image of the inspection table 110 in the state where the subject P is not present.

As a ninth modification, the information processing apparatus 130 may store information indicating the positional relationship between the photographing apparatus 120 and the inspection table 110 in advance. In this case, the information processing apparatus 130 may determine the inspection site based on the appearance image of only the subject and the information indicating the positional relationship.

(Second embodiment)
Next, the inspection system according to the second embodiment will be described. In the inspection system according to the second embodiment, the inspection unit is not provided on the inspection table, but the inspector holds the inspection device in his / her hand to perform the inspection. Hereinafter, the inspection system according to the second embodiment will be described as being different from the inspection system according to the first embodiment.

FIG. 5 is an overall view of the inspection system 500 according to the second embodiment. FIG. 5A is a side view of the inspection system 500, and FIG. 5B is a top view of the inspection system 500. The examination system 500 according to the present embodiment is an ultrasonic diagnostic apparatus, and examines the breast using a human body as a subject. At this time, the inspection system 500 further automatically discriminates between the left and right breasts. In the inspection system 500 according to the present embodiment, since the inspection is performed by the probe 540, the inspection table 510 is not provided with an inspection unit. The test is performed while the subject lies on the test table 510 in a supine position.

The probe 540 is an example of an inspection device and acquires an inspection image. The probe 540 is designed to be held and operated by the inspector. The probe 540 has an element for generating ultrasonic waves and an element for receiving ultrasonic waves, and receives the ultrasonic waves reflected from the contacted inspection target and processes them as an image. The inspection system 500 can obtain an ultrasonic image as an inspection image. Further, the probe 540 is provided with a freeze button (not shown), and an instruction to acquire a still image of ultrasonic inspection at the time when the freeze button is pressed can be input as an inspection image. The imaging device 520 captures an external image of the subject and the probe 540 from the upper part of the examination table 510. The hardware configuration of the information processing device 530 is the same as the hardware configuration of the information processing device 130 described with reference to FIG. 3 in the first embodiment.

FIG. 6 is a diagram showing a state at the time of inspection. Subject P lies on the examination table 510 in the supine position. Operator Q holds the probe 540 in his hand and brings it into contact with the inspection site.

FIG. 7 is a flowchart showing an inspection control process by the information processing apparatus 130. In S701, when the CPU 301 receives the instruction to start the inspection in response to the user operation, it instructs the probe 540 to start the inspection, receives the moving image of the ultrasonic echo from the probe 540, and saves the moving image in the storage unit. Next, in S702, the CPU 301 acquires a still image of the ultrasonic echo from the probe 540 as an inspection image. When the probe 540 receives an instruction to acquire a still image in response to a user pressing the freeze button of the probe 540, the probe 540 acquires a still image of an ultrasonic echo corresponding to the timing of receiving the acquisition instruction, and the information processing apparatus 530 Send to.

Next, in S703, the CPU 301 instructs the photographing device 520 to photograph. The imaging device 520 captures an external image of the subject P and the probe 540 according to the instruction, and transmits the external image to the information processing device 530. The CPU 301 acquires the appearance image and stores the appearance image in the storage unit. The CPU 301 identifies the appearance image by the file path of the appearance image or the like.

Next, in S704, the CPU 301 identifies the contact portion in contact with the probe 540 in the subject P by image recognition with respect to the appearance image acquired in S703. Examples of contact sites include the head, neck, chest, breast, abdomen, upper limbs, lower limbs, and the like. The CPU 301 identifies the contact portion by, for example, image recognition by template matching. The CPU 301 learns the image template of the human body and the image template of the probe 540 in advance. Further, the CPU 301 learns the positional relationship in the human body such as the head, neck, chest, breast, abdomen, upper limbs, and lower limbs. Then, the CPU 301 recognizes the region of the human body of the subject 601 by matching with the image template of the human body. The CPU 301 also acquires the position of the probe 540 by matching with the image template of the probe 540. Further, the CPU 301 calculates the contact portion by matching the region of the human body of the subject 601 and the position of the probe 540 with the positional relationship of the human body portion in the human body.

Next, in S705, the CPU 301 identifies the type of probe 540. Examples of the types of the probe 540 include a linear type, a convex type, and a sector type. Next, in S706, the CPU 301 identifies the inspection site based on the contact site specified in S704 and the type of probe specified. For example, when the type of the probe 540 is a linear type or a convex type, the CPU 301 performs an inspection near the body surface, and therefore determines the contact site as the inspection site. When the contact site is the chest and the type of the probe 540 is the sector type, the CPU 301 determines that the deep part is being examined and the heart is the examination site.

Next, in S707, the CPU 301 associates the inspection site determined in S706 with the inspection image and stores it in the storage unit. Subsequent processing of S708 and S709 is the same as the processing of S408 and S409 described with reference to FIG. 4 in the first embodiment, respectively. The other configurations and processes of the inspection system 500 according to the second embodiment are the same as the configurations and processes of the inspection system 100 according to the first embodiment.

As described above, in the inspection system 500 of the present embodiment, the information processing apparatus 530 can accurately discriminate the inspection site based on the appearance image corresponding to the inspection image. The information processing device 130 can discriminate between the left breast and the right breast, especially in a breast examination.

As a first modification of the second embodiment, the probe 540 may be provided with a button as a user interface for inputting an inspection start and inspection end instruction. In this case, the CPU 301 receives the inspection start and inspection end instructions from the probe 540.

As a second modification, the inspection system 500 may use a PAT device instead of the ultrasonic diagnostic device. In this case, the probe 540 acquires the inspection information of PAT. That is, the probe 540 includes an element that irradiates a pulsed laser beam and an element that detects ultrasonic waves. Further, the probe 540 includes an AD converter that converts the detected ultrasonic waves into a digital signal. In addition, a user interface such as a freeze button or an input unit can be used as a functional component for issuing an instruction to acquire inspection information of optical ultrasonic imaging.

As a third modification, for example, when the position and orientation of the subject on the examination table 510 at the time of inspection are determined, the position of the subject with respect to the imaging device 520 is known in advance. In this case, the information processing device 530 stores information indicating the positional relationship between the subject and the photographing device 520 in advance. Then, the information processing apparatus 530 may specify the contact portion based on the appearance image of only the probe 540 and the information indicating the positional relationship. The information processing apparatus 530 may identify the contact site based on the appearance image of at least a part of the inspection device, and the entire probe 540 need not be included in the appearance image. Further, when the subject is not captured in this way, it is not necessary to anonymize, encrypt, or delete the appearance image.

(Third Embodiment)
Next, the inspection system 500 according to the third embodiment will be described. The configuration of the inspection system 500 according to the third embodiment is the same as that of the inspection system 500 according to the second embodiment. Hereinafter, the difference between the inspection system 500 according to the third embodiment and the inspection system 500 according to the second embodiment will be described. FIG. 8 is a flowchart showing a process for discriminating the inspection site according to the third embodiment. The CPU 301 performs the discrimination process shown in FIG. 8 after the process of S704 described with reference to FIG. 7 in the second embodiment.

In S801, the CPU 301 confirms whether or not the contact site is the chest from the external image. In the case of the chest (Yes in S801), the CPU 301 advances the process to S802. On the other hand, if the CPU 301 is not the chest (No in S801), the CPU 301 advances the process to S811. In S802, the CPU 301 confirms whether or not the contact site is the breast. In the case of a breast (Yes in S802), the CPU 301 advances the process to S803. On the other hand, when the contact site is not the breast (No in S802), the CPU 301 proceeds to the process in S808.

In S803, the CPU 301 identifies the position of the probe 540 on the right side or the left side of the upper body of the subject based on the appearance image. Specifically, the CPU 301 first recognizes the upper body and the head of the subject P in the appearance image based on the image template of the upper body and the head of the human body. Further, the CPU 301 determines that the head is on the upper side of the image and recognizes the probe 540 based on the image template of the probe 540. The CPU 301 further calculates the apex, which is the uppermost point of the head, and the center point of the probe 540. The CPU 301 calculates, for example, the center of the smallest circle including the probe 540 as the center point of the probe 540. Then, the CPU 301 calculates a straight line connecting the apex and the center point of the probe 540 as a discrimination line.

FIG. 9 is a diagram showing a discrimination line 900. In S803, the CPU 301 is located in the area of the upper body of the subject P located in the area 901 corresponding to the right side of the subject P with the discrimination line 900 as the boundary and in the area 902 corresponding to the left side of the subject P with the discrimination line 900 as the boundary. Compare with the area of the upper body of the subject P. When the area of the upper body of the subject P located in the area 901 is larger than the area of the upper body of the subject P located in the area 902, the CPU 301 determines that the probe 540 is located on the left side of the upper body. On the other hand, when the area of the upper body located in the area 902 is equal to or less than the area of the upper body located in the area 901, the CPU 301 determines that the probe 540 is located on the right side of the upper body.

Returning to FIG. 8, after the processing of S803, in S804, the CPU 301 identifies the type of the probe 540. This process is the same as the process of S705 shown in FIG. When the type of the probe 540 is a linear type (Yes in S804), the CPU 301 advances the process to S805. On the other hand, if the CPU 301 is not a linear type (No in S804), the CPU 301 proceeds to S808. In S805, when the CPU 301 determines in S803 that the probe 540 is located on the left side of the upper body (Yes in S805), the processing proceeds to S806. On the other hand, when the CPU 301 determines in S803 that the probe 540 is located on the right side of the upper body (No in S805), the CPU 301 proceeds to the process in S807. In S806, the CPU 301 determines the left breast as the examination site, and then proceeds to the process in S707 shown in FIG. In S807, the CPU 301 determines the right breast as an examination site, and then proceeds to the process in S707.

Further, in S808, the CPU 301 specifies the type of the probe 540. When the type of the probe 540 is a sector type (Yes in S808), the CPU 301 advances the process to S809. On the other hand, if the CPU 301 is not a sector type (No in S808), the CPU 301 proceeds to S810. In S809, the CPU 301 determines the heart as an examination site and then proceeds to process S707. On the other hand, in S810, the CPU 301 determines the chest as an examination site, and then proceeds to the process in S707.

Further, in S811, the CPU 301 determines the contact site specified in S704 as an inspection site, and then proceeds to the process in S707. The other configurations and processes of the inspection system 500 according to the third embodiment are the same as the configurations and processes of the inspection system according to the other embodiments.

As described above, in the inspection system 500 according to the third embodiment, the information processing apparatus 530 determines the inspection site based on the positional relationship between the inspection device and the subject. As a result, the information processing apparatus 530 can accurately determine the inspection site. The information processing device 530 can discriminate between the left breast, the right breast, and the heart as examination sites, especially when the probe (inspection device) is in the chest.

As a modification of the third embodiment, the process of specifying the position of the probe (S803) is not limited to the embodiment. As another example, as shown in FIG. 10, the information processing apparatus 530 recognizes the upper body of the subject P, and the left and right sides of the upper body are centered on a straight line connecting the target center position and the crown. Specified as line 1000. In this case, the CPU 301 determines that the probe 540 is located on the right side of the upper body when the probe 540 is in the area 1001 corresponding to the right side of the subject P with the center line 1000 as the boundary. On the other hand, when the probe 540 is in the area 1002 corresponding to the left side of the subject P with the center line 1000 as the boundary, the CPU 301 determines that the probe 540 is located on the left side of the upper body.

Although the present invention has been described in detail based on the preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various embodiments within the scope of the gist of the present invention are also included in the present invention. included. Some of the above embodiments may be combined as appropriate.

<Other Embodiments>
Although examples of embodiments have been described in detail above, the present invention can take embodiments as, for example, a system, an apparatus, a method, a program, a storage medium (or a recording medium), or the like. Specifically, it may be applied to a system composed of a plurality of devices (for example, a host computer, an interface device, a photographing device, a web application, etc.), or it may be applied to a device composed of one device. good.

Needless to say, the object of the present invention is achieved by doing the following. That is, a storage medium storing a software program code (computer program) that realizes the functions of the above-described embodiment is supplied to the system or device. Needless to say, the storage medium is a computer-readable storage medium. Then, the computer (or CPU or MPU) of the system or device reads and executes the program code stored in the storage medium. In this case, the program code itself read from the storage medium realizes the function of the above-described embodiment, and the storage medium storing the program code constitutes the present invention.

100 Inspection system 110 Inspection table 120 Imaging device 130 Information processing device

Claims (14)

An acquisition means for acquiring an appearance image in which at least a part of the inspection device and the subject is photographed by the photographing means,
Based on the appearance image, the positional relationship between the inspection device and at least a part of the subject is acquired, and the site identification for specifying the inspection site of the subject based on the positional relationship and the type of the inspection device. An information processing device characterized by having means. The acquisition means acquires an external image showing the state of the upper body of the subject at the time of inspection, and obtains an external image.
The information processing apparatus according to claim 1, wherein the site specifying means identifies whether the inspection site is a left breast or a right breast. The information processing apparatus according to claim 1 or 2, further comprising a storage means for storing the test site specified by the site specifying means in a storage means in association with the test result of the subject. The information processing apparatus according to claim 1 or 2 , further comprising a storage means for storing the test result of the subject and the appearance image in association with each other based on the acquisition time. The acquisition means acquires the appearance image in which the image marker arranged at the position of the center line of the examination table on which the inspection device is installed and the subject is placed and at least a part of the subject are photographed. death,
The site identifying means acquires the positional relationship between the inspection device and at least a part of the subject based on the positional relationship between the inspection table and at least a part of the subject shown in the external image. The information processing apparatus according to any one of claims 1 to 4. The acquisition means acquires the appearance image in which the entire examination table on which the inspection device is installed and the subject is placed and at least a part of the subject are photographed.
The site identifying means acquires the positional relationship between the inspection device and at least a part of the subject based on the positional relationship between the inspection table and at least a part of the subject shown in the external image. The information processing apparatus according to any one of claims 1 to 4. The site identifying means is at least of the inspection device and the subject based on the information indicating the positional relationship between the inspection device or the inspection table on which the inspection device is installed and the imaging means, and the appearance image. The information processing apparatus according to any one of claims 1 to 4, wherein the information processing apparatus obtains a positional relationship with a part of the device. The information processing apparatus according to any one of claims 1 to 7 , further comprising a deleting means for deleting the appearance image after identifying the inspection site by the site specifying means. The information processing apparatus according to any one of claims 1 to 7 , further comprising a processing means for processing the appearance image invisible after identifying the inspection site by the site specifying means. An acquisition means for acquiring an appearance image in which at least a part of the inspection device and the subject is photographed by the photographing means,
A position identifying means for specifying the positional relationship between the inspection device and at least a part of the subject based on the appearance image, and
A site identifying means for identifying the test site of the subject based on the positional relationship, and
An information processing device comprising a processing means for anonymizing the appearance image so that the subject cannot be identified . Testing means for testing subjects and
An imaging means for capturing an external image including the inspection device and at least a part of the subject.
Based on the appearance image, the positional relationship between the inspection device and at least a part of the subject is acquired, and the site identification for specifying the inspection site of the subject based on the positional relationship and the type of the inspection device. An inspection system characterized by having means. Testing means for testing subjects and
An imaging means for capturing an external image including the inspection device and at least a part of the subject.
A position identifying means for specifying the positional relationship between the inspection device and at least a part of the subject based on the appearance image, and
A site identifying means for identifying the test site of the subject based on the positional relationship, and
An inspection system comprising a processing means for anonymizing the appearance image so that the subject cannot be identified. It is an information processing method executed by an information processing device.
An acquisition step of acquiring an appearance image of the test device and at least a part of the subject by the imaging means.
Based on the appearance image, the positional relationship between the inspection device and at least a part of the subject is acquired, and the site identification for specifying the inspection site of the subject based on the positional relationship and the type of the inspection device. An information processing method characterized by including steps. It is an information processing method executed by an information processing device.
An acquisition step of acquiring an appearance image of the test device and at least a part of the subject by the imaging means.
A position identification step for specifying the positional relationship between the inspection device and at least a part of the subject based on the appearance image, and
A site identification step for identifying the test site of the subject based on the positional relationship, and
An information processing method including a processing step of anonymizing the appearance image so that the subject cannot be identified.

Images