JP7528840B2 - Control System - Google Patents

Description

The present invention relates to a control system.

In recent years, a technology for identifying drugs based on an image obtained by photographing a drug to be identified has been known. For example, an imaging device for photographing a drug to be identified has been disclosed (see, for example, Patent Document 1). In such a technology for identifying drugs, it is common for the imaging control of the drug to differ depending on the type of drug. For example, the imaging control of the drug may differ depending on whether the drug is a loose drug or a packaged drug. For this reason, it is common for an operator to input an operation to select the type of drug to be identified before imaging control is started.

International Publication No. 2015/152225

However, there may be cases where the operator mistakenly inputs the operation to select the type of drug to be identified. In such cases, the operator needs to re-input the operation to select the correct type of drug, but once imaging control has begun, it is generally not possible to input the operation to select the type of drug until imaging is completed. As a result, the convenience of the drug identification system for the operator has not improved.

The present invention has been made in consideration of the above problems, and the object of the present invention is to provide a technology that can improve the convenience of the operator of a drug identification system in which drug photography control differs depending on the type of drug to be identified.

In order to solve the above problem, according to one aspect of the present invention, there is provided a control system having an imaging device and a control device, wherein the imaging device controls imaging of the medicine based on a type of medicine, the type of medicine corresponding to whether the medicine is a loose medicine or a single package medicine, and the imaging control includes, when the type of medicine is a loose medicine, having a camera capture an image of the medicine at one location, and when the type of medicine is a single package medicine, having the camera capture an image of the medicine at a plurality of locations, and the control device includes an output unit that outputs the type of medicine to the imaging device, and a control unit that receives an operation to change the type of medicine after the imaging control is started by the imaging device. A control system is provided which includes a control unit which controls the display of a type change object, and an operation unit which accepts an operation to change the type of the drug, wherein the output unit outputs to the photographing device a notice that the type of the drug has been changed based on the operation to change the type of the drug being accepted by the operation unit, and the photographing device, when the type of the drug is a loose drug and when the output unit has output that the type of the drug has been changed, causes the camera to photograph the drug at multiple locations, and when the type of the drug is a single dose drug and when the output unit has output that the type of the drug has been changed, causes the camera to photograph the drug at one location .

The photographing control may include at least one of an operation of moving the medicine toward a photographing position and an operation of causing the camera to photograph the medicine at the photographing position.

The control unit may control the display of an interruption operation object for receiving an operation to interrupt the shooting control after the shooting control has been started.

As described above, the present invention provides a technology that can improve the convenience of the operator of a drug identification system in which drug imaging control differs depending on the type of drug to be identified.

1 is a diagram showing an example of the configuration of a drug discrimination system according to a first embodiment of the present invention; FIG. 2 is a diagram illustrating an example of a functional configuration of the drug discrimination system according to the embodiment. FIG. 13 is a diagram showing an example of a tray ejection instruction screen. 11 is a top view of the tray ejected outside the device housing. FIG. FIG. 13 is a diagram showing an example of a shooting start screen. FIG. 2 is a top view of a petri dish on which a bulk drug is placed. FIG. 2 is a top view showing a state in which the petri dish is placed on the tray. FIG. 2 is a diagram showing an example of the appearance of a single-dose medicine package. FIG. 2 is a top view showing a state in which a packaged drug is placed on a tray. 13 is a side view seen from the right side showing a state in which a tray is transported from the outside to the inside of the device housing. FIG. FIG. 13 is a diagram illustrating an example of a shooting position. FIG. 13 is a diagram showing an example of a screen during shooting. FIG. 13 is a diagram showing an example of a captured image confirmation screen. 13 is a flowchart for explaining an example of the operation of the medicine discrimination system according to the embodiment. FIG. 13 is a diagram showing an example of a shooting start screen. 11 is a diagram for explaining an example of a method for recognizing the type of medicine based on image data. FIG. FIG. 13 is a diagram showing an example of the configuration of a drug identification system according to a third embodiment of the present invention. FIG. 2 is a diagram illustrating an example of a functional configuration of the drug discrimination system according to the embodiment. 11A and 11B are diagrams for explaining examples of the meaning of operations on a touch sensor; FIG. 2 is a top view of a petri dish equipped with a drug type detector. 11A and 11B are diagrams for explaining examples of the meaning of operations on a touch sensor; FIG. 13 is a side view showing the movement of a tray on which a packaged drug is placed directly. FIG. 13 is a side view showing the movement of a tray on which the bulk medicine is placed via a petri dish. FIG. 2 is a diagram illustrating a hardware configuration of an information processing device as an example of a control device according to an embodiment of the present invention.

The preferred embodiment of the present invention will be described in detail below with reference to the attached drawings. Note that in this specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals to avoid redundant description.

In addition, in this specification and drawings, multiple components having substantially the same functional configuration are distinguished by adding different numbers after the same reference numeral. Similarly, similar components in different embodiments are distinguished by adding different letters after the same reference numeral. However, when there is no particular need to distinguish between multiple components having substantially the same functional configuration, only the same reference numerals are used.

1. First embodiment
First, a first embodiment of the present invention will be described.

[1-1. Configuration of drug identification system]
First, a configuration example of a drug identification system according to a first embodiment of the present invention will be described. As an example, the drug identification system can function as a brought-medicine identification system that identifies drugs brought by patients (brought-in medicines). For example, the drug identification system can be installed in a hospital or a pharmacy. The drug identification system is mainly operated by an operator (e.g., a pharmacist). The drug identification system can also function as a control system that controls the photography and identification of drugs.

Fig. 1 is a diagram showing an example of the configuration of a drug identification system according to a first embodiment of the present invention. As shown in Fig. 1, the drug identification system 1 includes a control device 10 and an imaging device 20. The control device 10 and the imaging device 20 are connected via a predetermined interface. For example, the interface may be a USB (Universal Serial Bus) interface.

The control device 10 is a computer that controls the entire drug discrimination system 1. For example, the control device 10 includes a main body 180, an operation unit 112, and a display unit 114. The operation unit 112 and the display unit 114 are each connected to the main body 180. The operation unit 112 and the display unit 114 may constitute a GUI (Graphical User Interface) unit 110 (FIG. 2) that will be described later. The main body 180 discriminates drugs based on images of the drugs captured by the imaging device 20.

The operation unit 112 is configured with an input device that accepts operations by an operator. Here, it is mainly assumed that the operation unit 112 is realized by a mouse and a keyboard. However, the operation unit 112 may be realized by an input device other than a mouse and a keyboard (e.g., a touch panel, etc.). The operation of the operator accepted by the operation unit 112 is provided to the main body unit 180. Note that in the example shown in FIG. 1, the operation unit 112 exists inside the control device 10. However, the operation unit 112 may exist outside the control device 10.

The display unit 114 is configured with a display. The type of display is not particularly limited, and may be a liquid crystal display, for example. For example, the display unit 114 displays various information according to the control of the main body unit 180. The various information displayed by the display unit 114 is visually recognized by the operator. In the example shown in FIG. 1, the display unit 114 is present inside the control device 10. However, the display unit 114 may be present outside the control device 10.

The imaging device 20 photographs medications (e.g., medications brought with the patient) to obtain a photographed image. For example, the imaging device 20 includes a box-shaped device housing 220. A tray discharge port 290 is provided in the center in the vertical direction on the front surface of the device housing 220. The imaging device 20 can expose the tray to the outside of the device housing 220 by discharging the tray forward from this tray discharge port 290, and can store the tray inside the device housing 220 by pulling the tray discharged forward back.

The tray ejection port 290 is provided with a shutter 292. The shutter 292 is open when the tray is ejected and closed when the tray is stored.

[1-2. Functional configuration of the drug identification system]
Next, an example of a functional configuration of the drug discrimination system 1 according to the first embodiment of the present invention will be described.

Figure 2 is a diagram showing an example of the functional configuration of the drug discrimination system 1 according to the first embodiment of the present invention. As shown in Figure 2, the drug discrimination system 1 includes a control device 10 and an imaging device 20. The control device 10 includes a GUI unit 110, a discrimination controller 120, a device control unit 130, a discrimination unit 150, a discrimination result storage unit 160, and a drug database 170. As described above, the GUI unit 110 includes an operation unit 112 and a display unit 114.

The discrimination controller 120, the device control unit 130, and the discrimination unit 150 may be realized by a control unit (not shown) of the control device 10. The control unit (not shown) may include a CPU (Central Processing Unit) and the like, and may realize its functions by the CPU expanding a program stored in a non-volatile storage device into a RAM (Random Access Memory) and executing the program. At this time, a computer-readable recording medium on which the program is recorded may also be provided. Alternatively, the control unit (not shown) may be configured by dedicated hardware, or may be configured by a combination of multiple hardware components.

The discrimination result storage unit 160 and the drug database 170 can be realized by a storage unit (not shown). The storage unit (not shown) is a storage device capable of storing programs and data for operating a control unit (not shown). The storage unit (not shown) can also temporarily store various data required in the course of operation of a control unit (not shown). For example, the storage device may be a non-volatile storage device.

The hardware control unit 210 may be realized by a control unit (not shown) of the imaging device 20. The control unit (not shown) may include a CPU, and its functions may be realized by the CPU expanding a program stored in a non-volatile storage device into a RAM and executing the program. At this time, a computer-readable recording medium on which the program is recorded may also be provided. Alternatively, the control unit (not shown) may be configured by dedicated hardware, or may be configured by a combination of multiple pieces of hardware.

Drug database 170 stores database images (registered images) of multiple drugs in advance. More specifically, database images and features (e.g., drug shape, color, engraved text, etc.) of the front and back sides of each drug are registered in advance in drug database 170.

The identification controller 120 controls the display of the tray ejection instruction screen by the display unit 114 to accept an instruction to eject the tray.

Figure 3 is a diagram showing an example of a tray ejection instruction screen. Referring to Figure 3, a tray ejection instruction screen G10 is shown. The tray ejection instruction screen G10 includes a tray ejection instruction button G11 for inputting an instruction to eject the tray. When the operation unit 112 accepts an operation from the operator to select the tray ejection instruction button G11, the discrimination controller 120 outputs a tray ejection instruction to the imaging device 20 via the device control unit 130. In the imaging device 20, when the hardware control unit 210 accepts the input of the tray ejection instruction, it controls so that the tray is ejected from the tray ejection port 290.

Figure 4 is a top view of the tray ejected outside the device housing 220. As shown in Figure 4, the tray 230 is attached to the slide rail 221, and is ejected from and stored in the device housing 220 as the slide rail 221 slides in the forward and backward directions.

The tray 230 is provided with a tray 232. The tray 232 is made of a transparent material, and the medicine to be identified can be placed on the tray 232. Furthermore, the tray 230 is provided with a tray position detector 231. The tray position detector 231 is a part that is detected by a tray position sensor 240 (FIG. 10) that will be described later. For example, if the tray position sensor 240 is made of an optical sensor, the tray position detector 231 may be made of a light-blocking material.

The identification controller 120 controls the display of the start shooting screen on the display unit 114.

Figure 5 is a diagram showing an example of the image capture start screen. Referring to Figure 5, image capture start screen G20 is shown. Image capture start screen G20 includes a bulk drug selection button G21 for accepting an operation to select bulk drugs as the type of drug, and a packaged drug selection button G22 for accepting an operation to select packaged drugs as the type of drug. The operator places the drug to be identified on tray 230 (Figure 4). Below, the placement of bulk drugs will be described with reference to Figures 6 and 7, and the placement of packaged drugs will be described with reference to Figures 8 and 9.

Figure 6 is a top view of a petri dish in which a loose drug has been placed. As shown in Figure 6, the petri dish 30 has an opaque material area 31 made of an opaque material and a transparent material area 32 made of a transparent material. The opaque material area 31 is configured so that the transparent material area 32 can be attached, and forms the frame of the petri dish 30.

Capsule placement members 33a and 33b are provided in the transparent material area 32, and capsules M1 can be placed between the capsule placement members 33a and 33b. This allows capsules M1 to be stably placed on the petri dish 30. Similarly, capsules can be placed between the capsule placement members 33c and 33d. On the other hand, tablets M2 have a shape that makes them difficult to roll, so they can be placed in an area of the transparent material area 32 where capsule placement members 33a to 33d are not provided. Note that there is no particular limit to the number of capsules M1 and tablets M2 placed on the petri dish 30.

Figure 7 is a top view showing the state in which the petri dish 30 is placed on the tray 230. Referring to Figure 7, the petri dish 30 on which the capsules M1 and tablets M2 are placed is placed on the tray 232 of the tray 230. In this way, when the drug to be differentiated is a bulk drug, the drug to be differentiated is placed directly on the petri dish 30, and the petri dish 30 is placed directly on the tray 232 of the tray 230, so that the drug to be differentiated can be placed on the tray 230 via the petri dish 30.

Figure 8 is a diagram showing an example of the appearance of a single-packaged drug. As shown in Figure 8, a single-packaged drug 40 is handled in a state in which capsules M1 and tablets M2 are wrapped in a transparent bag. In other words, capsules M1 and tablets M2 can be identified by drug identification system 1 while wrapped in a transparent bag. Note that there is no particular limit to the number of capsules M1 and tablets M2 each wrapped in a transparent bag.

Figure 9 is a top view showing the state in which a single-packaged drug is placed on the tray 230. Referring to Figure 9, the single-packaged drug 40, in which the capsules M1 and tablets M2 are wrapped in a transparent bag, is placed directly on the tray 232 of the tray 230. In this way, when the single-packaged drug 40 is identified, the capsules M1 and tablets M2 can be identified while still wrapped in the transparent bag.

In this way, when the operator places the drug to be differentiated on the tray 230 exposed to the outside of the device housing 220 and the operation unit 112 accepts an operation from the operator to select the loose drug selection button G21 (FIG. 5) or the packaged drug selection button G22 (FIG. 5), the differentiation controller 120 functions as an output unit that outputs an imaging start instruction including the type of drug to the imaging device 20 via the device control unit 130. In the imaging device 20, when the hardware control unit 210 accepts input of the imaging start instruction, it controls the tray 230 to be stored inside the device housing 220.

Figure 10 is a side view from the right side showing the tray 230 being transported from the outside to the inside of the device housing 220. As described above, the tray 230 is accommodated inside the device housing 220 as the slide rail 221 slides rearward. Inside the device housing 220, a tray position detection sensor 240 that detects the tray 230 is provided. For example, the tray position detection sensor 240 is an optical sensor composed of a light-emitting unit and a light-receiving unit, and detects the tray 230 when light emitted by the light-emitting unit is blocked by the tray position detection detector 231 and the light is no longer detected by the light-receiving unit. Axis 242 indicates the axis of the tray position detection sensor 240.

In addition, a camera 250 that photographs the medicine is provided inside the device housing 220. Axis 252 indicates the optical axis of the camera 250. The camera 250 includes an upper camera and a lower camera, and the upper camera and lower camera photograph both sides of the medicine placed on the tray 230. For example, after the tray 230 is detected by the tray position detection sensor 240, the hardware control unit 210 sets the position where the tray 230 is transported a predetermined distance into the device housing 220 as the photographing position, and controls so that the medicine placed on the tray 230 is photographed at the photographing position.

The photographing control of the drug to be identified by the hardware control unit 210 varies depending on the type of drug. The photographing control includes at least one of the following: an operation of moving the drug toward the photographing position and an operation of having the camera 250 photograph the drug at the photographing position. For example, if the type of drug is loose medicine, the front and back of the drug are photographed at one location inside the device housing 220. On the other hand, if the type of drug is a packaged drug, the front and back of the drug are photographed at three locations inside the device housing 220.

The reason why the number of photographs taken varies depending on the type of medication is as follows. For example, if the medication is a single-dose medication, the position of the capsule in the bag is not fixed, so there is a possibility that the imprinted part of the capsule is not facing straight up or straight down. Therefore, if the medication is a single-dose medication, it is desirable to photograph the medication from three locations so that the imprinted part can be photographed. Note that the number of locations to be photographed is not necessarily limited to three.

On the other hand, if the type of medication is loose medicine, the operator can place the capsule in the petri dish with the engraved part facing directly upwards. Therefore, if the type of medication is loose medicine, the engraved part can be reliably photographed by simply photographing the medication from one location.

Figure 11 is a diagram showing an example of a shooting position. Referring to Figure 11, a side view of trays 230-1 to 230-5 being transported inside the device housing 220 is shown from the right side. Also referring to Figure 11, the device housing 220, axis 242 of the tray position detection sensor, and axis 252 which is the optical axis of the camera are shown. Here, tray 230-1 indicates tray 230 that has been ejected from the device housing 220.

Tray 230-2 indicates a tray that has been transported to a position for photographing loose medicines. If the medicine to be identified is a loose medicine, the medicine is photographed at the position of tray 230-2 (one location). On the other hand, trays 230-3 to 230-5 indicate trays that have been transported to a position for photographing packaged medicines. If the medicine to be identified is a packaged medicine, the medicine is photographed in turn at the positions of trays 230-3 to 230-5 (three locations).

Meanwhile, in the control device 10, the discrimination controller 120 controls the display of the during-shooting screen by the display unit 114 after shooting control in the imaging device 20 has started. The timing to start control of the display of the during-shooting screen may be before or after shooting control in the imaging device 20 has started. In other words, even if the timing to start control of the display of the during-shooting screen is before shooting control in the imaging device 20 has started, it is sufficient that the during-shooting screen continues to be displayed even after shooting control in the imaging device 20 has started.

Fig. 12 is a diagram showing an example of a during-shooting screen. Referring to Fig. 12, a during-shooting screen G30 is shown. The during-shooting screen G30 includes a type change button G31 (type change object) for accepting an operation to change the type of the drug to be identified, and an during-shooting interrupt button G32 (interruption operation object) for accepting an operation to interrupt the shooting control.

When the operation of selecting the type change button G31 is received from the operator by the operation unit 112, the differentiation controller 120 outputs to the imaging device 20 via the device control unit 130 that the type has been changed based on the reception of such operation. In the imaging device 20, when the hardware control unit 210 receives input that the type has been changed, it changes the type of the drug based on the reception of such input and controls imaging of the drug according to the changed type.

When the operation unit 112 receives an operation from the operator to select the image capture interruption button G32, the identification controller 120 outputs an image capture interruption instruction to the image capture device 20 via the device control unit 130 based on the reception of such operation. In the image capture device 20, when the hardware control unit 210 receives an image capture interruption instruction input, it interrupts image capture control of the medicine based on the reception of such input, and controls the tray to be ejected from the tray ejection port 290 so that the medicine can be removed from the tray. Then, the identification controller 120 again controls the display unit 114 to display the image capture start screen.

If no operation is input to select either the change type button G31 or the interrupt shooting button G32, shooting control of the drug is performed according to the type of drug selected on the shooting start screen G20. Then, the hardware control unit 210 controls the tray 230 to be discharged to the outside of the device housing 220, and outputs the captured image of the drug to the discrimination controller 120 via the device control unit 130. The discrimination controller 120 controls the display by the display unit 114 of the captured image confirmation screen to allow the operator to confirm the captured image of the drug.

FIG. 13 is a diagram showing an example of a captured image confirmation screen. Referring to FIG. 13, a captured image confirmation screen G40 is shown. The captured image confirmation screen G40 includes a captured image G43 of a drug. Furthermore, the captured image confirmation screen G40 includes a retake button G41 for inputting an operation to instruct the user to retake an image, and a confirm button G42 for inputting an operation to confirm the captured image.

When the operation unit 112 receives an instruction from the operator to select the re-photograph button G41, the discrimination controller 120 again controls the display unit 114 to display the start of photography screen. On the other hand, when the operation unit 112 receives an instruction from the operator to select the confirm button G42, the discrimination controller 120 outputs the photographed image of the drug to the discrimination unit 150 and requests discrimination.

The classification unit 150 classifies drugs based on the captured image of the drug. The classification unit 150 acquires the features of the database image for each drug from the drug database 170, extracts the features of the captured image, and calculates the similarity (hereinafter also referred to as the "similarity score") between the features for each combination of the database image and the captured image.

The discrimination unit 150 assigns a higher rank to the database image having a higher similarity score with the captured image. The rank assigned in this manner is included in the discrimination result for the drug to be discriminated. That is, the discrimination result may include at least the ID (drug ID) of each of the multiple candidate drugs corresponding to the drug to be discriminated, and the similarity score rank of each candidate drug (e.g., first candidate, second candidate, ..., Nth candidate, etc.).

The discrimination unit 150 outputs the discrimination results thus obtained to the discrimination controller 120. The discrimination controller 120 then controls the display of the drug discrimination results by the display unit 114.

The above describes an example of the functional configuration of the drug identification system 1 according to the first embodiment of the present invention.

[1-3. Operation of the drug identification system]
Next, an operation example of the drug discrimination system 1 according to the first embodiment of the present invention will be described with reference to Fig. 14 (and also with reference to Figs. 1 to 13 as appropriate). Note that in the description of the operation example here, attention is focused on the procedure until the operator adopts the image captured by the imaging device 20 as the image to be discriminated. Also, various screens displayed on the display unit 114 in the following operation example can be displayed by the functions of the drug discrimination application.

Fig. 14 is a flowchart for explaining an example of the operation of the drug discrimination system 1 according to the first embodiment of the present invention. As shown in Fig. 14, first, in the control device 10, the discrimination controller 120 controls the display unit 114 to display a tray discharge instruction screen G10 (Fig. 3) for receiving an instruction to discharge the tray (S11). When the operation unit 112 receives an instruction from the operator to select the tray discharge instruction button G11, the discrimination controller 120 outputs a tray discharge instruction to the imaging device 20 via the device control unit 130.

In the imaging device 20, when the hardware control unit 210 receives the input of the tray ejection instruction, it controls so that the tray is ejected from the tray ejection port 290 (S12). Next, the discrimination controller 120 controls the display of the imaging start screen G20 (FIG. 5) by the display unit 114 (S13).

The operator places the drug to be identified on the tray following the instructions displayed on the shooting start screen G20. For example, if the drug to be identified is a loose drug, the operator places the drug on a petri dish 30 (Fig. 6) and places the petri dish 30 with the drug on it on the tray 232 of the tray 230 (Fig. 7). On the other hand, if the drug to be identified is a packaged drug, the operator places the packaged drug directly on the tray 232 of the tray 230 (Fig. 9).

The operator inputs an operation to the operation unit 112 to select the loose drug selection button G21 (FIG. 5) or the packaged drug selection button G22 (FIG. 5) according to the type of drug to be differentiated. When the operation unit 112 accepts an operation to select the loose drug selection button G21 or the packaged drug selection button G22 from the operator, the differentiation controller 120 outputs an image capture start command including the type of drug to the imaging device 20 via the device control unit 130.

Furthermore, the discrimination controller 120 controls the display of the imaging in progress screen G30 (FIG. 12) by the display unit 114 (S14). The imaging in progress screen G30 continues to be displayed until the tray is ejected (i.e., until S41 is completed). This allows the operator to change the type of the drug to be differentiated or interrupt imaging control by inputting an operation to select the type change button G31 or the imaging interruption button G32 included in the imaging in progress screen G30 until the tray is ejected.

In the imaging device 20, when the hardware control unit 210 receives an input of an instruction to start imaging, it controls the tray 230 to be stored inside the device housing 220 (S15).

In the imaging device 20, the hardware control unit 210 determines the type of medication included in the imaging start instruction (S16). More specifically, if the type of medication is a loose medication ("Bulk Medication" in S16), the hardware control unit 210 transitions the operation to S21. On the other hand, if the type of medication is a packaged medication ("Packaged Medication" in S16), the hardware control unit 210 transitions the operation to S31.

When the operation proceeds to S21, the hardware control unit 210 performs the imaging control (hereinafter also referred to as "Bulk Drug Imaging Control 1") that is performed up until the type change determination in S22, among the entire imaging control when the type of drug is bulk drug (S21). Then, the operation proceeds to S22. Here, it is assumed that bulk drug imaging control 1 includes an operation of moving tray 230 (Figure 11) to the position of tray 230-2. However, as will be explained later, the operations included in bulk drug imaging control 1 are not limited to such operations.

When the operation proceeds to S31, the hardware control unit 210 performs the imaging control (hereinafter also referred to as "single-drug imaging control 1") that is performed up until the type change determination in S32, among the entire imaging control when the type of the drug is a single-drug package (S31). Then, the operation proceeds to S32. Here, it is assumed that the single-drug imaging control 1 includes an operation of moving the tray 230 (FIG. 11) to the position of tray 230-3, an operation of controlling the camera so that the drug is photographed at the position of tray 230-3, and an operation of moving the tray 230 to the position of tray 230-4. However, as will be explained later, the operations included in the single-drug imaging control 1 are not limited to such operations.

When the operation proceeds to S22, the discrimination controller 120 performs a type change determination (S22). That is, when the discrimination controller 120 receives an operation from the operator to select the type change button G31 (FIG. 12) by the operation unit 112 ("YES" in S22), it outputs to the imaging device 20 via the device control unit 130 that the type has been changed. Such a determination allows the type to be easily changed. In the imaging device 20, when the hardware control unit 210 receives an input that the type has been changed, it changes the type of the drug based on the reception of the input, and proceeds to the operation of S31 according to the changed type.

In S31, the tray 230 (FIG. 11) is moved to the position of tray 230-3 as the packaged drug photographing control 1, but if the tray 230 has already been moved to the position of tray 230-2 in S21, the tray 230 is moved from the position of tray 230-2 to the position of tray 230-3. This is expected to reduce processing time compared to the general technology in which the tray 230 is ejected and then the type is reselected on the photographing start screen G20 (FIG. 5), in which the tray 230, once ejected outside the device housing 220, must be moved to the position of tray 230-3.

On the other hand, if the operation of selecting the type change button G31 (FIG. 12) using the operation unit 112 is not accepted by the operator ("NO" in S22), the discrimination controller 120 transitions the operation to S23.

When the operation proceeds to S32, the discrimination controller 120 performs a type change determination (S32). That is, when the discrimination controller 120 receives an operation from the operator to select the type change button G31 (FIG. 12) via the operation unit 112 ("YES" in S32), it outputs to the imaging device 20 via the device control unit 130 that the type has been changed. Such a determination allows the type to be easily changed. In the imaging device 20, when the hardware control unit 210 receives an input that the type has been changed, it changes the type of the drug based on the reception of the input, and proceeds to the operation of S21 according to the changed type.

In S21, as loose medicine photography control 1, an operation is performed to move tray 230 (FIG. 11) to the position of tray 230-2, but if tray 230 has already moved to the position of tray 230-4 in S31, an operation is performed to move tray 230 from the position of tray 230-4 to the position of tray 230-2. This is expected to reduce processing time compared to the general technology in which tray 230 is ejected and then the type is reselected on photography start screen G20 (FIG. 5), in which tray 230, once ejected outside device housing 220, must be moved to the position of tray 230-2.

On the other hand, if the discrimination controller 120 does not accept an operation from the operator to select the type change button G31 (FIG. 12) using the operation unit 112 ("NO" in S32), the discrimination controller 120 transitions the operation to S33.

When the operation proceeds to S23, the discrimination controller 120 performs a determination as to whether or not to suspend imaging (S23). That is, when the discrimination controller 120 receives an operation from the operator to select the imaging suspension button G32 (FIG. 12) via the operation unit 112 ("YES" in S23), it outputs an instruction to suspend imaging to the imaging device 20 via the device control unit 130. Unlike a type change, suspending imaging ejects the tray 230 to the outside of the device housing 220. Therefore, suspending imaging is suitable for cases such as when the wrong medicine is placed on the tray 230 and the medicine needs to be placed on the tray 230 again.

When the hardware control unit 210 of the imaging device 20 receives an input of an instruction to interrupt imaging, it interrupts the imaging control of the medicine and controls the tray to be ejected from the tray ejection port 290 so that the medicine can be removed from the tray (S24). Then, the operation proceeds to S13.

On the other hand, if the operation of selecting the shooting interruption button G32 (FIG. 12) is not accepted from the operator via the operation unit 112 ("NO" in S23), the discrimination controller 120 transitions the operation to S25.

When the operation proceeds to S33, the identification controller 120 performs a shooting interruption determination (S33). That is, when the operation unit 112 receives an operation to select the shooting interruption button G32 (FIG. 12) from the operator ("YES" in S33), the identification controller 120 outputs a shooting interruption instruction to the shooting device 20 via the device control unit 130.

When the hardware control unit 210 of the imaging device 20 receives an input of an instruction to interrupt imaging, it interrupts the imaging control of the medicine and controls the tray to be ejected from the tray ejection port 290 so that the medicine can be removed from the tray (S34). Then, the operation proceeds to S13.

On the other hand, if the discrimination controller 120 does not accept an operation from the operator to select the shooting interruption button G32 (Figure 12) via the operation unit 112 ("NO" in S33), the discrimination controller 120 transitions the operation to S35.

When the operation proceeds to S25, the hardware control unit 210 performs the imaging control (hereinafter also referred to as "Bulk Medicine Imaging Control 2") that is performed from the continuation of bulk medicine imaging control 1 of S21 to the end of the entire imaging control when the type of medicine is bulk medicine (S25). Then, the operation proceeds to S41. Here, it is assumed that bulk medicine imaging control 2 includes an operation of controlling the camera so that the medicine placed on tray 230 stopped at the position of tray 230-2 (Figure 11) is imaged by bulk medicine imaging control 1 of S21. However, as will be explained later, the operations included in bulk medicine imaging control 2 are not limited to such operations.

When the operation proceeds to S35, the hardware control unit 210 performs the imaging control (hereinafter also referred to as "single-packaged drug imaging control 2") that is performed from the continuation of S31 single-packaged drug imaging control 1 to the end of the entire imaging control when the type of drug is a single-packaged drug (S35). Then, the operation proceeds to S41. Here, it is assumed that single-packaged drug imaging control 2 includes an operation of controlling the camera so that the drug placed on the tray 230 stopped at the position of tray 230-4 (FIG. 11) by single-packaged drug imaging control 1 of S31 is imaged, an operation of moving the tray 230 to the position of tray 230-5, and an operation of controlling the camera so that the drug is imaged at the position of tray 230-5. However, as will be explained later, the operations included in single-packaged drug imaging control 2 are not limited to these operations.

The hardware control unit 210 controls the tray 230 to be ejected outside the device housing 220 (S41), and outputs the captured image of the drug to the discrimination controller 120 via the device control unit 130. The discrimination controller 120 controls the display unit 114 to display a captured image confirmation screen G40 (FIG. 13) for allowing the operator to confirm the captured image of the drug (S42). The operator confirms the displayed captured image, and if the captured image is to be used for discrimination, inputs an operation to select the confirm button G42, or if the operator wishes to retake the image, inputs an operation to select the retake button G41.

The discrimination controller 120 performs a re-shooting determination (S43). That is, when the discrimination controller 120 receives an operation from the operator to select the re-shoot button G41 via the operation unit 112, the discrimination controller 120 transitions the operation to S13. On the other hand, when the discrimination controller 120 receives an operation from the operator to select the confirm button G42 via the operation unit 112, the discrimination controller 120 outputs the photographed image of the drug to the discrimination unit 150 and requests discrimination.

The above describes an example of the operation of the drug identification system 1 according to the first embodiment of the present invention.

[1-3. Effects of the first embodiment]
As described above, according to the medicine discrimination system 1 according to the first embodiment of the present invention, when the operator wants to change the medicine type after starting the image capture control, he or she only needs to press the type change button on the image capture screen. Therefore, it is not necessary to perform operations such as issuing an instruction to re-capture the medicine after the image capture of the medicine is completed and waiting for the tray to be discharged outside the device housing, and then reselecting the correct medicine type.

In addition, with the drug identification system 1 according to the first embodiment of the present invention, when it is necessary not only to change the type of drug but also to replace the drug placed on the tray and retake the image, it is possible to interrupt the image capture by pressing the image capture interruption button. This simplifies the work of the operator, and is expected to reduce the work time because it is no longer necessary to wait for the image capture to be completed.

[1-4. Modification of the first embodiment]
In the above example, as shown in Fig. 14, the type change judgment (S22) and the shooting interruption judgment (S23) are made between the loose medicine shooting control 1 (S21) and the loose medicine shooting control 2 (S25), and the type change judgment (S32) and the shooting interruption judgment (S33) are made between the packaged medicine shooting control 1 (S31) and the packaged medicine shooting control 1 (S35). However, the timing of the type change judgment and the shooting interruption judgment is not limited to this example.

For example, the type change decision and the shooting interruption decision may be made for each stage included in the shooting control. This allows the operator's instruction to change the type or interrupt shooting to be reflected in a more timely manner, which is expected to reduce processing time.

In other words, if the type of medication is loose medication, the decision to change the type and the decision to stop photographing may be made after the tray 230 moves to the position of tray 230-2 (Figure 11) and after the medication is photographed at the position of tray 230-2.

On the other hand, if the type of medication is a single-dose medication, the type change judgment and the photographing interruption judgment may be made after the tray 230 moves to the position of tray 230-3, after the medication is photographed at the position of tray 230-3, after the tray 230 moves to the position of tray 230-4, after the medication is photographed at the position of tray 230-4, after the tray 230 moves to the position of tray 230-5, and after the medication is photographed at the position of tray 230-5.

Alternatively, the type change decision and shooting interruption decision may be made after shooting control ends.

The above describes the first embodiment of the present invention.

2. Second embodiment
Next, a second embodiment of the present invention will be described. As a diagram showing an example of the configuration of a drug discrimination system 1 according to the second embodiment of the present invention, the diagram ( FIG. 1 ) showing an example of the configuration of the drug discrimination system 1 according to the first embodiment of the present invention will be used.

[2-1. Functional configuration of the drug identification system]
First, an example of the functional configuration of a drug discrimination system 1 according to a second embodiment of the present invention will be described. As a diagram showing an example of the functional configuration of a drug discrimination system 1 according to the second embodiment of the present invention, the diagram ( FIG. 2 ) showing an example of the functional configuration of a drug discrimination system 1 according to the first embodiment of the present invention will be used. Below, of the functions of the drug discrimination system 1 according to the second embodiment of the present invention, functions that are different from the functions of the drug discrimination system 1 according to the first embodiment of the present invention will be mainly described.

In the first embodiment of the present invention, a case has been mainly described in which the type of drug is recognized depending on whether the loose drug selection button G21 or the packaged drug selection button G22 is selected on the shooting start screen G20 (Fig. 5). On the other hand, in the second embodiment of the present invention, attention is focused on the fact that if the drug is a packaged drug, the drug is placed directly on the tray 230 (Fig. 9), and if the drug is a loose drug, the drug is placed directly on the tray 230 via the petri dish 30 (Fig. 7).

That is, the hardware control unit 210 functions as a recognition unit that recognizes the type of drug by recognizing whether the drug to be identified is placed directly on the tray 230 (FIG. 9) or on the tray 230 via a petri dish 30 (FIG. 7) based on predetermined detection data. This eliminates operational errors by the operator when selecting the type of drug, and is expected to improve the accuracy and efficiency of work.

As will be explained in a later modified example, various types of data can be used as the detection data, but here we will mainly assume that image data captured by the camera 250 (Figure 10) is used as the detection data. The following describes in detail how to recognize the type of drug.

As in the first embodiment of the present invention, the discrimination controller 120 controls the display of the tray ejection instruction screen G10 (FIG. 3) by the display unit 114, and when the discrimination controller 120 receives an operation from the operator to select the tray ejection instruction button G11 by the operation unit 112, it outputs a tray ejection instruction to the imaging device 20 via the device control unit 130. In the imaging device 20, when the hardware control unit 210 receives the input of the tray ejection instruction, it controls the tray to be ejected from the tray ejection port 290.

The identification controller 120 controls the display of the start shooting screen on the display unit 114.

Figure 15 is a diagram showing an example of a shooting start screen. Referring to Figure 15, shooting start screen G50 is shown. In the first embodiment of the present invention, the shooting start screen G20 (Figure 5) included a loose medicine selection button G21 and a packaged medicine selection button G22, but in the second embodiment of the present invention, instead of the loose medicine selection button G21 and the packaged medicine selection button G22, a shooting start button G51 is included in the shooting start screen G50.

When the operator places the drug to be identified on the tray 230 exposed to the outside of the device housing 220 and the operation unit 112 accepts an operation from the operator to select the image capture start button G51, the identification controller 120 outputs an image capture start instruction to the image capture device 20 via the device control unit 130. At this time, the image capture start instruction does not need to include the type of drug.

In the photographing device 20, when the hardware control unit 210 receives an input of an instruction to start photographing, it controls the tray 230 to be accommodated inside the device housing 220. The hardware control unit 210 moves the tray 230 to a position where the camera 250 (FIG. 10) can photograph the tray 230, and controls the camera 250 so that the tray 230 is photographed by the camera 250.

The hardware control unit 210 recognizes the type of drug by determining whether the drug to be identified is placed directly on the tray 230 (FIG. 9) or on the tray 230 via a petri dish 30 (FIG. 7) based on image data obtained by photographing with the camera 250. Below, an example of a method for recognizing the type of drug based on image data is described.

Figure 16 is a diagram illustrating an example of a method for recognizing the type of drug based on image data.

When the drug to be identified is a loose drug, as shown in FIG. 16, the petri dish 30 is placed on the receptacle 232 of the tray 230, and the area R1 of the receptacle 232, which is made of a transparent material and is indicated by hatched lines in FIG. 16, is covered by the opaque material area 31 of the petri dish 30. On the other hand, when the drug to be identified is a packaged drug, the packaged drug is placed directly on the receptacle 232 of the tray 230, and most of the area R1 indicated by hatched lines in FIG. 16 is not covered by the opaque material.

The discrimination controller 120 therefore determines in advance the position of area R1 of the tray 232 made of a transparent material that is covered by the opaque material area 31 of the petri dish 30, and recognizes whether area R1 is covered by an opaque material in the image data (e.g., whether the brightness is lower than a threshold value), thereby recognizing whether the type of drug to be discriminated is a loose drug or a packaged drug. Thereafter, as in the first embodiment of the present invention, the hardware control unit 210 controls the imaging of the drug according to the type of drug.

The above describes an example of the functional configuration of the drug identification system 1 according to the second embodiment of the present invention.

[2-2. Operation of the Drug Identification System]
Next, an example of the operation of the drug discrimination system 1 according to the second embodiment of the present invention will be described. Again, the explanation will be given with reference to FIG. 14 used in the explanation of the example of the operation of the drug discrimination system 1 according to the first embodiment of the present invention. First, S11 to S12 shown in FIG. 14 are executed in the same manner as in the first embodiment of the present invention. The discrimination controller 120 controls the display of the imaging start screen G50 (FIG. 15) by the display unit 114 (S13).

The operator places the drug to be identified on the tray according to the instructions displayed on the imaging start screen G50. Regardless of the type of drug to be identified, the operator inputs an operation to select the imaging start button G51 to the operation unit 112. When the operation unit 112 accepts an operation to select the imaging start button G51 from the operator, the identification controller 120 outputs an imaging start instruction to the imaging device 20 via the device control unit 130.

Similar to the first embodiment of the present invention, steps S14 to S15 shown in FIG. 14 are executed.

The hardware control unit 210 moves the tray 230 to a position where the camera 250 (FIG. 10) can capture an image of the tray 230, and controls the camera 250 so that the tray 230 is captured by the camera 250. Here, the position at which the tray 230 is captured is not particularly limited. For example, the position at which the tray 230 is captured may be the capture position for capturing an image of loose medicine, or the initial capture position for capturing an image of a packaged medicine.

The hardware control unit 210 recognizes the type of drug by recognizing whether the drug to be identified is placed directly on the tray 230 (FIG. 9) or on the tray 230 via a petri dish 30 (FIG. 7) based on the image data (S16). As an example, the hardware control unit 210 recognizes whether the type of drug to be identified is a loose drug or a packaged drug by recognizing whether area R1 (FIG. 16) in the image data is covered by an opaque material.

When the hardware control unit 210 recognizes that the type of the drug to be differentiated is a loose drug, the operation proceeds to S21. On the other hand, when the hardware control unit 210 recognizes that the type of the drug to be differentiated is a packaged drug, the operation proceeds to S31. The subsequent operations are performed in the same manner as in the first embodiment of the present invention.

The above describes an example of the operation of the drug identification system 1 according to the second embodiment of the present invention.

[2-3. Effects of the second embodiment]
As described above, the type of the medicine to be distinguished is recognized by the medicine distinguishing system 1. This eliminates the possibility of an operator making an error in selecting the type of medicine, and is expected to improve the accuracy and efficiency of the work.

[2-4. Modification of the second embodiment]
In the above example, the case where image data is used as an example of the detection data used to recognize the type of medicine has been mainly described, but the detection data is not limited to image data.

For example, the detection data may be sensor data detected by an optical sensor. In this case, the hardware control unit 210 may acquire sensor data of area R1 detected by an optical sensor when the tray 230 is accommodated inside the device housing 220 in S15 (FIG. 14), and recognize whether area R1 is covered by an opaque material in the sensor data (e.g., whether it is light-shielded or not), thereby recognizing whether the type of drug to be identified is a loose drug or a packaged drug.

In addition, if the tray position detection sensor 240 is configured as an optical sensor, the tray position detection sensor 240 may be used as an optical sensor.

Alternatively, the detection data may be weight data measured by a weight sensor provided on the tray 230. In this case, when the tray 230 is discharged outside the device housing 220 in S12 (FIG. 14), the weight of the object placed on the tray 230 is measured by the weight sensor, and the hardware control unit 210 may recognize whether the type of drug to be identified is a loose drug or a packaged drug depending on whether the weight of the object placed on the tray 230 corresponds to the weight of the petri dish 30 (e.g., exceeds a threshold value).

The hardware control unit 210 may automatically store the tray 230 inside the device housing 220 and start controlling the imaging of the medicine when a predetermined time has elapsed since the weight of the petri dish 30 began to be measured. As a result, when the type of medicine is a loose medicine, the imaging control of the medicine begins simply by placing the petri dish 30 on the tray 230, eliminating the need for the operator to input the operation to select the imaging start button G51, thereby further simplifying the operation. The operator places the medicine after ejecting the tray in S12 (FIG. 14) and before pressing G51 in FIG. 15 displayed in S13. Measurement by the weight sensor may be performed at the stage when S15 begins after G51 is pressed.

The above mainly describes the case where the type of drug is recognized based on image data. In this case, the hardware control unit 210 may recognize the type of drug and determine whether the drug is placed correctly based on the image data.

If the hardware control unit 210 determines that the medicine is not placed correctly, it may eject the tray 230 to the outside of the device housing 220. Then, the discrimination controller 120 may display an instruction to prompt the user to place the medicine correctly on the display unit 114 using the function of the medicine discrimination application.

The state in which the medicine is not placed correctly may be a state in which a packaged medicine is placed on the petri dish 30 for photographing loose medicine, or a state in which loose medicine is placed directly on the tray 230 (without going through the petri dish 30). Alternatively, the state in which the medicine is not placed correctly may be a state in which a capsule is placed somewhere other than between capsule placement members 33a (FIG. 6) and 33b, and between capsule placement members 33c and 33d, or a state in which a tablet is placed in the area where capsule placement members 33a to 33d are provided.

The above mainly describes the case where the type change determinations S22 and S32 shown in FIG. 14 are performed. However, in the second embodiment of the present invention, since the drug type is determined by the drug identification system 1, it is expected that the drug type will not be erroneously recognized and the operator will not need to change the drug type. Therefore, the type change determinations S22 and S32 shown in FIG. 14 do not need to be performed.

The above describes the second embodiment of the present invention.

<3. Third embodiment>
Next, a third embodiment of the present invention will be described.

[3-1. Configuration of drug identification system]
First, a configuration example of a drug discrimination system according to a third embodiment of the present invention will be described. In the following, the configuration of the drug discrimination system according to the third embodiment of the present invention that is different from the drug discrimination system 1 according to the first embodiment of the present invention will be mainly described.

Fig. 17 is a diagram showing an example of the configuration of a drug discrimination system according to a third embodiment of the present invention. As shown in Fig. 17, a drug discrimination system 2 according to a third embodiment of the present invention includes a control device 10 and an imaging device 22. The imaging device 22 also includes a touch sensor 280. Note that in the example shown in Fig. 17, the touch sensor 280 is provided on the device housing 220, but the position at which the touch sensor 280 is provided is not limited to the device housing 220. For example, the touch sensor 280 may be connected to the device housing 220 via a wire or wirelessly.

[3-2. Functional configuration of the drug identification system]
Next, an example of a functional configuration of the drug discrimination system 2 according to the third embodiment of the present invention will be described. Among the functions of the drug discrimination system 2 according to the third embodiment of the present invention, the following mainly describes functions that are added to the drug discrimination system 1 according to the first embodiment of the present invention.

Fig. 18 is a diagram showing an example of the functional configuration of a drug discrimination system 2 according to a third embodiment of the present invention. As shown in Fig. 18, the drug discrimination system 2 includes a control device 10 and an imaging device 22. Compared to the imaging device 20 (Fig. 2), the imaging device 22 includes a touch sensor driver 260.

The touch sensor driver 260 may be realized by a control unit (not shown) of the imaging device 22. The control unit (not shown) may include a CPU (Central Processing Unit) and the like, and may realize its functions by the CPU expanding a program stored in a non-volatile storage device into a RAM (Random Access Memory) and executing the program. At this time, a computer-readable recording medium on which the program is recorded may also be provided. Alternatively, the control unit (not shown) may be configured by dedicated hardware or a combination of multiple pieces of hardware.

As in the first embodiment of the present invention, the discrimination controller 120 controls the display of the tray ejection instruction screen G10 (FIG. 3) by the display unit 114. When the discrimination controller 120 receives an operation from the operator to select the tray ejection instruction button G11 by the operation unit 112, it outputs a tray ejection instruction to the imaging device 22 via the device control unit 130. In the imaging device 22, when the hardware control unit 210 receives the input of the tray ejection instruction, it controls the tray 230 to be ejected from the tray ejection port 290.

After placing the drug to be classified on the tray 230, the operator inputs an operation to the touch sensor 280. In the following description, it is mainly assumed that the operation input by the operator to the touch sensor 280 is an operation to specify both the type of drug and whether or not to continue photographing and classifying the drug. However, the operation input by the operator to the touch sensor 280 may also be an operation to specify either the type of drug or whether or not to continue photographing and classifying the drug.

Continuous photography means photographing the next medication (second medication) following the photography of the medication currently placed on the tray 230. In other words, the presence of continuous photography means that there is a medication to be photographed next, and the absence of a medication to be photographed means that there is no continuous photography.

Continued sorting refers to sorting the next drug (second drug) following sorting the drug currently placed on the tray 230. In other words, the presence of continued sorting means that there is a drug to be sorted next, and the absence of continued sorting means that there is no drug to be sorted next.

The touch sensor driver 260 functions as a recognition unit that recognizes the type of drug (first drug) currently placed on the tray 230 based on an input operation from the operator to the touch sensor 280. Furthermore, the touch sensor driver 260 recognizes whether or not continuous imaging and continuous identification are to be performed based on an input operation from the operator to the touch sensor 280.

FIG. 19 is a diagram for explaining an example of the meaning of an operation on the touch sensor 280. Referring to FIG. 19, an operation on the touch sensor 280 corresponds to the meaning of the operation on the touch sensor 280 (i.e., the type of drug, and the presence or absence of continued photography and continued discrimination). The touch sensor driver 260 recognizes the type of drug and the presence or absence of continued photography and continued discrimination based on the correspondence between the operation on the touch sensor 280 and the meaning of the operation on the touch sensor 280 shown in FIG. 19 and the operation on the touch sensor 280.

The touch sensor driver 260 outputs the recognized type of drug and whether or not to continue photographing and continue identification to the hardware control unit 210. The hardware control unit 210 then controls the tray 230 to be housed inside the device housing 220. Then, as in the first embodiment of the present invention, the hardware control unit 210 controls photographing of the drug according to the type of drug.

When the hardware control unit 210 has finished controlling the photographing of the medicine, it controls the tray 230 to be ejected to the outside of the device housing 220, and outputs the photographed image of the medicine to the classification controller 120 via the device control unit 130. The classification controller 120 outputs the photographed image of the medicine to the classification unit 150 and requests classification.

When the touch sensor driver 260 recognizes that there is no continuous shooting or continuous classification, the classification controller 120 controls the display unit 114 to display the classification result obtained by the classification unit 150. On the other hand, when the touch sensor driver 260 recognizes that there is continuous shooting or continuous classification, the hardware control unit 210 controls the tray to be ejected from the tray ejection port 290 based on the recognition that there is continuous shooting or continuous classification.

When the tray is discharged from the tray discharge port 290, the operator places the next drug on the tray and similarly inputs an operation to the touch sensor 280 to specify both the type of drug and whether or not to continue photographing and identifying the drug. Then, the hardware control unit 210 controls the photographing of the next drug. Thereafter, the drug identification system 1 repeatedly executes the same operations.

The above describes an example of the functional configuration of the drug identification system 2 according to the third embodiment of the present invention.

[3-3. Effects of the third embodiment]
As described above, according to the drug discrimination system 2 according to the third embodiment of the present invention, the operator can input an operation to specify the type of drug to be discriminated into the touch sensor 280 provided in the photographing device 22. Therefore, after placing the drug on the tray 230 of the photographing device 22, the operator does not have to go back from the photographing device 22 to the control device 10 and input an operation to select the type of drug into the operation unit 112 of the control device 10. This is expected to improve the convenience for the operator and shorten the working time.

Furthermore, according to the drug discrimination system 2 of the third embodiment of the present invention, the operator can input an operation to specify whether or not to perform continuous photographing and continuous discrimination into the touch sensor 280 provided on the photographing device 22. Therefore, after placing the drug on the tray 230 of the photographing device 22, the operator does not have to go back from the photographing device 22 to the control device 10 and input an operation to specify whether or not to perform continuous photographing and continuous discrimination into the operation unit 112 of the control device 10. This is expected to improve the convenience for the operator and shorten the working time.

The above describes the third embodiment of the present invention.

<4. Fourth embodiment>
Next, a fourth embodiment of the present invention will be described. As a diagram showing an example of the configuration of a drug discrimination system 2 according to the fourth embodiment of the present invention, the diagram ( FIG. 17 ) showing an example of the configuration of a drug discrimination system 2 according to the third embodiment of the present invention will be used.

[4-1. Functional configuration of the drug identification system]
First, an example of the functional configuration of a drug discrimination system 2 according to a fourth embodiment of the present invention will be described. As a diagram showing an example of the functional configuration of a drug discrimination system 2 according to the fourth embodiment of the present invention, the diagram ( FIG. 18 ) showing an example of the functional configuration of a drug discrimination system 2 according to the third embodiment of the present invention will be used. Below, of the functions of the drug discrimination system 2 according to the fourth embodiment of the present invention, functions that differ from the functions of the drug discrimination system 2 according to the third embodiment of the present invention will be mainly described.

In the third embodiment of the present invention, a case has been mainly described in which the touch sensor driver 260 recognizes the type of drug (first drug) currently placed on the tray 230 based on an input operation from the operator to the touch sensor 280. On the other hand, in the fourth embodiment of the present invention, the type of drug currently placed on the tray 230 is recognized based on whether or not a part provided on the petri dish (hereinafter also referred to as a "drug type determination detector") is detected.

Figure 20 is a top view of a petri dish provided with a drug type detector. Referring to Figure 20, a drug type detector 233 is provided on the petri dish 30. A tray position detector 231 is also provided on the tray 230. The drug type detector 233 is a part that is detected by the tray position sensor 240 (Figure 10) like the tray position detector 231. For example, if the tray position sensor 240 is configured with an optical sensor, the drug type detector 233 may be configured with a light-blocking material.

The positions at which the tray position detector 231 and the drug type detector 233 are provided are not limited. However, it is preferable that the tray position detector 231 and the drug type detector 233 are provided at positions offset in the front-rear direction so that both are detected by the tray position detection sensor 240. Furthermore, it is preferable that the tray position detector 231 and the drug type detector 233 are provided with no gap between them in the front-rear direction when viewed from directly above so that they are continuously detected by the tray position detection sensor 240.

As in the third embodiment of the present invention, the discrimination controller 120 controls the display of the tray ejection instruction screen G10 (FIG. 3) by the display unit 114. When the discrimination controller 120 receives an operation from the operator to select the tray ejection instruction button G11 by the operation unit 112, the discrimination controller 120 outputs a tray ejection instruction to the imaging device 22 via the device control unit 130. In the imaging device 22, when the hardware control unit 210 receives the input of the tray ejection instruction, it controls the tray to be ejected from the tray ejection port 290.

After placing the medicine to be identified on the tray 230, the operator inputs an operation to the touch sensor 280. In the fourth embodiment of the present invention, the operation input by the operator to the touch sensor 280 is an operation to specify whether or not to continue photographing and identifying the medicine.

The touch sensor driver 260 functions as a recognition unit that recognizes whether or not to continue photographing and continue classification based on the input operation from the operator to the touch sensor 280.

21 is a diagram for explaining an example of the meaning of an operation on the touch sensor 280. Referring to FIG. 21, an operation on the touch sensor 280 corresponds to the meaning of the operation on the touch sensor 280 (i.e., whether or not continuous shooting and continuous classification are performed). The touch sensor driver 260 recognizes whether or not continuous shooting and continuous classification are performed based on the correspondence between the operation on the touch sensor 280 and the meaning of the operation on the touch sensor 280 shown in FIG. 21 and the operation on the touch sensor 280.

The touch sensor driver 260 functions as an output unit that outputs the recognized presence or absence of continued photography and continued identification to the hardware control unit 210. After that, the hardware control unit 210 controls the tray 230 to be accommodated inside the device housing 220. When the tray 230 is moving inside the device housing 220, the hardware control unit 210 functions as a recognition unit that recognizes the type of drug placed on the tray 230 based on whether or not the drug type determination detector 233 has been detected.

Figure 22 is a side view showing the movement of a tray 230 on which a single-dose drug is placed directly. Referring to Figure 22, a tray position detector 231 is present on the tray 230. On the other hand, since a single-dose drug is placed directly on the tray 230, a petri dish 30 is not placed on the tray 230, and a drug type determination detector 233 provided on the petri dish 30 does not move with the tray 230.

In such a case, the time at which the tray position detection sensor 240 detects the light blocking (hereinafter also referred to as "the time at which the tray position detection sensor 240 turns ON") is the detection time of the tray position detection detector 231 (more specifically, the time corresponding to the front-to-rear width of the tray position detection detector 231), as shown in the time series data F1. Therefore, the time at which the tray position detection sensor 240 turns ON is relatively short.

Figure 23 is a side view showing the movement of a tray 230 on which loose medicines are placed via a petri dish. Referring to Figure 23, a tray position detector 231 is present on the tray 230. Furthermore, since loose medicines are placed on the tray 230 via a petri dish, a medicine type determination detector 233 provided on the petri dish 30 also moves together with the tray 230.

In such a case, the time when the tray position detection sensor 240 turns ON is the detection time of the tray position detection detector 231 and the drug type determination detector 233 (more specifically, the time corresponding to the sum of the front-to-rear widths of the tray position detection detector 231 and the drug type determination detector 233), as shown in the time series data F2. Therefore, the time when the tray position detection sensor 240 turns ON is relatively long.

The hardware control unit 210 determines the type of drug based on whether the time when the tray position detection sensor 240 turns ON matches the detection time of the tray position detection detector 231 or matches the detection time of the tray position detection detector 231 and the drug type determination detector 233.

More specifically, if the time when the tray position detection sensor 240 turns ON matches the detection time of the tray position detection detector 231, the hardware control unit 210 determines that the drug placed on the tray 230 is a single-dose drug. On the other hand, if the time when the tray position detection sensor 240 turns ON matches the sum of the detection time of the tray position detection detector 231 and the detection time of the drug type determination detector 233, the hardware control unit 210 determines that the drug placed on the tray 230 is a loose drug.

Then, as in the third embodiment of the present invention, the hardware control unit 210 controls the imaging of the drug according to the type of drug. The subsequent operations are performed in the same manner as in the third embodiment of the present invention.

The above describes an example of the functional configuration of the drug identification system 2 according to the fourth embodiment of the present invention.

[4-3. Effects of the fourth embodiment]
As described above, according to the drug discrimination system 2 according to the fourth embodiment of the present invention, the drug discrimination system 2 determines the type of the drug placed on the tray depending on whether the drug type determination detector 233 provided on the petri dish is detected. Therefore, after placing the drug on the tray 230 of the imaging device 22, the operator does not have to go back from the imaging device 22 to the control device 10 and input an operation to select the type of drug into the operation unit 112 of the control device 10. This is expected to improve the convenience for the operator and shorten the working time.

Furthermore, according to the drug discrimination system 2 of the fourth embodiment of the present invention, as in the third embodiment of the present invention, the operator can input an operation to specify whether or not to continue photographing and continue discrimination into the touch sensor 280 provided on the photographing device 22. Therefore, after placing the drug on the tray 230 of the photographing device 22, the operator does not have to go back from the photographing device 22 to the control device 10 and input an operation to specify whether or not to continue photographing and continue discrimination into the operation unit 112 of the control device 10. This is expected to improve the convenience for the operator and shorten the working time.

5. Hardware configuration example
Next, a hardware configuration example of the control device 10 according to the embodiment of the present invention will be described. Below, a hardware configuration example of the information processing device 900 will be described as a hardware configuration example of the control device 10 according to the embodiment of the present invention. Note that the hardware configuration example of the information processing device 900 described below is merely one example of the hardware configuration of the control device 10. Therefore, the hardware configuration of the control device 10 may be such that unnecessary configurations are deleted from the hardware configuration of the information processing device 900 described below, or new configurations may be added.

Fig. 24 is a diagram showing the hardware configuration of an information processing device 900 as an example of a control device 10 according to an embodiment of the present invention. The information processing device 900 includes a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, a RAM (Random Access Memory) 903, a host bus 904, a bridge 905, an external bus 906, an interface 907, an input device 908, an output device 909, a storage device 910, and a communication device 911.

The CPU 901 functions as an arithmetic processing device and control device, and controls the overall operation of the information processing device 900 in accordance with various programs. The CPU 901 may also be a microprocessor. The ROM 902 stores programs and arithmetic parameters used by the CPU 901. The RAM 903 temporarily stores programs used in the execution of the CPU 901 and parameters that change appropriately during the execution. These are interconnected by a host bus 904 consisting of a CPU bus, etc.

The host bus 904 is connected to an external bus 906, such as a PCI (Peripheral Component Interconnect/Interface) bus, via a bridge 905. Note that the host bus 904, bridge 905, and external bus 906 do not necessarily need to be configured separately, and these functions may be implemented on a single bus.

The input device 908 is composed of input means for the user to input information, such as a mouse, keyboard, touch panel, button, microphone, switch, and lever, and an input control circuit that generates an input signal based on the user's input and outputs it to the CPU 901. By operating this input device 908, the user who operates the information processing device 900 can input various data to the information processing device 900 and instruct the information processing device 900 to perform processing operations.

The output device 909 includes, for example, display devices such as a CRT (Cathode Ray Tube) display device, a Liquid Crystal Display (LCD) device, an OLED (Organic Light Emitting Diode) device, and a lamp, as well as audio output devices such as a speaker.

The storage device 910 is a device for storing data. The storage device 910 may include a storage medium, a recording device for recording data on the storage medium, a reading device for reading data from the storage medium, and a deleting device for deleting data recorded on the storage medium. The storage device 910 is, for example, configured with a HDD (Hard Disk Drive). This storage device 910 drives the hard disk and stores the programs executed by the CPU 901 and various data.

The communication device 911 is, for example, a communication interface configured with a communication device for connecting to a network. The communication device 911 may support either wireless communication or wired communication.

The above describes an example of the hardware configuration of the control device 10 according to an embodiment of the present invention.

＜６． Summary＞

The above describes in detail preferred embodiments of the present invention with reference to the attached drawings, but the present invention is not limited to such examples. It is clear that a person with ordinary knowledge in the technical field to which the present invention pertains can conceive of various modified or revised examples within the scope of the technical ideas described in the claims, and it is understood that these also naturally fall within the technical scope of the present invention.

For example, although the first embodiment to the fourth embodiment of the present invention have been described separately above, any two or more of the first embodiment to the fourth embodiment of the present invention may be implemented in combination as appropriate. For example, the drug type determination according to the first embodiment of the present invention or the second embodiment of the present invention may be implemented in combination with the determination of the presence or absence of continuous imaging and continuous differentiation according to the third embodiment of the present invention or the fourth embodiment of the present invention.

REFERENCE SIGNS LIST 1, 2 Drug discrimination system 10 Control device 110 GUI section 112 Operation section 114 Display section 120 Discrimination controller 130 Device control section 150 Discrimination section 160 Discrimination result storage section 170 Drug database 180 Main body section 20, 22 Imaging device 210 Hardware control section 220 Device housing 230 Tray 221 Slide rail 231 Tray position detection detector 232 Receptacle 233 Drug type determination detector 240 Tray position detection sensor 250 Camera 260 Touch sensor driver 280 Touch sensor 290 Tray discharge port 292 Shutter 30 Petri dish 31 Opaque material area 32 Transparent material area

Claims (3)

A control system having an imaging device and a control device,
The imaging device is
Controlling the imaging of the medicine based on the type of the medicine;
The type of the medicine corresponds to whether the medicine is a loose medicine or a single-pack medicine,
The photographing control includes, when the type of the medicine is a loose medicine, having the camera photograph the medicine at one location, and when the type of the medicine is a single-package medicine, having the camera photograph the medicine at multiple locations,
The control device includes:
an output unit that outputs the type of the medicine to the imaging device;
A control unit that controls display of a type change object for receiving an operation to change the type of the medicine after the photography control is started by the photography device;
An operation unit that accepts an operation to change the type of the medicine;
Equipped with
The output unit outputs to the imaging device that the type of the medicine has been changed based on the operation of changing the type of the medicine being accepted by the operation unit,
When the type of the medicine is a loose medicine and when the output unit outputs that the type of the medicine has been changed, the photographing device causes the camera to photograph the medicine at multiple locations, and when the type of the medicine is a single-package medicine and when the output unit outputs that the type of the medicine has been changed, the photographing device causes the camera to photograph the medicine at one location.
Control system. The photographing control includes at least one of an operation of moving the medicine toward a photographing position and an operation of photographing the medicine with the camera at the photographing position.
The control system of claim 1 . The control unit controls display of an interruption operation object for receiving an operation to interrupt the shooting control after the shooting control is started.
A control system according to claim 1 or 2 .

Images