JP7748338B2 - Symbol extraction device, program, and symbol extraction method - Google Patents

Description

The present invention relates to a symbol extraction device, program, and symbol extraction method for extracting symbols from image data such as drawings.

When constructing electrical equipment, air conditioning equipment, or other facilities, it is necessary to extract the materials and equipment needed for the work from the blueprints and estimate the costs. Extracting these materials and equipment manually takes time and places a burden on the person in charge, so there is a need to automate this extraction process (process it by computer).

To find materials and equipment, it is necessary to search within the drawing for symbols (graphics) that represent the materials and equipment. In other words, the system searches for a partial image in the image data of the drawing that matches the image of the symbol. It is rare for the image of the symbol to perfectly match the partial image in the drawing, and it is generally determined that the symbol represents a material or component if the similarity is above a certain threshold.
In such a method, if the threshold is large, the probability that the detected partial image is a symbol (accuracy) increases, but more symbols are overlooked (detection failures). Conversely, if the threshold is small, fewer symbols are overlooked, but accuracy decreases.

The image matching device described in Patent Document 1 is composed of an image input unit that inputs an input image, a template setting unit that sets a desired area in a reference image as a template, a measurement position setting unit that sets an area in the input image that corresponds to the template as a comparison area, a matching threshold setting unit that sets a matching threshold, an image data matching unit that calculates the normalized absolute difference value between the template and the comparison area, a matching judgment unit that compares the matching threshold with the normalized absolute difference value to judge the similarity between the template and the comparison area, a judgment result output unit that outputs the judgment result by the matching judgment means, and a memory that stores each of the data.

Japanese Patent Application Laid-Open No. 2008-204307

According to the image matching device described in Patent Document 1, the similarity between two images is expressed as a numerical value between 0 and 1, so it is not necessary to set a matching threshold for determining the similarity between two images according to the size of the template area, the brightness of the template or comparison area, etc., and it is possible to easily set the matching threshold. However, setting a threshold is necessary, and the work of confirming that the found (extracted) partial image is a symbol (a desired partial image) and searching for overlooked symbols must be done manually, which still places a heavy workload on the person in charge.
The present invention has been made in consideration of the above background, and aims to provide a symbol extraction device, program, and symbol extraction method that reduce the burden (human burden, etc.) of searching for a desired partial image within an image.

In order to solve the above-mentioned problems, the symbol extraction device of the present invention includes a template setting unit that sets a template image to be extracted from an image; an analysis condition setting unit that obtains and sets a threshold value used to determine whether the extraction is appropriate; a matching unit that extracts from the image partial images whose similarity to the template image is equal to or greater than the threshold value; and an extraction result management unit that displays extraction results including at least one item of the extracted partial images, the identification number of the partial images, their position within the image, and the similarity between the partial images and the template image, and the extraction result management unit has a sorting function based on one item selected from the identification number of the displayed partial images, their position within the image, and the similarity between the partial images and the template image.
a matching unit that extracts partial images from the image whose similarity to the template image is equal to or greater than the threshold; an extraction result management unit that displays extraction results including at least one item of the extracted partial images, the identification numbers of the partial images, the positions of the partial images within the image, and the similarity between the partial images and the template image; and a learning unit that generates a learning model that determines whether an image is the template image using learning data including the partial images included in the extraction results, wherein the similarity is calculated based on a template matching technique, and the matching unit extracts partial images whose similarity calculated based on the template matching technique is equal to or greater than the threshold and that are determined to be the template image using the learning model.

The present invention provides a symbol extraction device, program, and symbol extraction method that reduce the burden of searching for a desired partial image within an image. Issues, configurations, and advantages other than those described above will become clear from the description of the following embodiments.

4 is a flowchart showing a procedure for a user who uses the symbol extraction device according to the first embodiment. 3 shows a screen displaying a drawing read by the symbol extraction device according to the first embodiment. 1 is a screen of the symbol extraction device displaying a template setting window according to the first embodiment. 1 is a screen of the symbol extraction device displaying an analysis condition setting window according to the first embodiment. 10 is a screen showing an extraction result when a threshold value of 0.85 is used according to the first embodiment. 10 is a screen showing an extraction result when a threshold value of 0.65 is used according to the first embodiment. 1 is a screen of the symbol extraction device displaying an extraction result window according to the first embodiment. FIG. 1 is a functional block diagram of a symbol extraction device according to a first embodiment. FIG. 3 is a data configuration diagram of an extraction result database according to the first embodiment. 10 is a flowchart of a symbol extraction process according to the first embodiment. 10 is a flowchart of an extraction result screen process according to the first embodiment. FIG. 10 is a functional block diagram of a symbol extraction device according to a second embodiment.

<Outline of the symbol extraction device>
A symbol extraction device according to an embodiment of the present invention will be described below. The symbol extraction device searches an image of a drawing (drawing image) to extract images of symbols contained therein. The symbol images are set as template images. The symbol extraction device scans the drawing image to find (extract) partial images (symbol images) of the drawing image whose similarity to the template image is equal to or greater than a set threshold (similar to the template image).

The symbol extractor displays an extraction result window containing a list of the identification numbers of the found partial images and their positions within the drawing image. When an item in this list is specified, the corresponding partial image is displayed.
Users of the symbol extraction device set a low similarity threshold to reduce the chance of missing partial images (missed extraction/missed detection). The list in the extraction result window contains erroneous extractions (misrecognitions), but users can select items in the list one after another to display similar partial images one after another, delete the erroneous extractions, and obtain the final extraction results. In this way, users can efficiently extract symbols from drawing images.

<<How to use the symbol extraction device>>
Before describing the configuration of the symbol extraction device 100 (see FIG. 8 described later), we will explain the procedure for using the symbol extraction device 100. Fig. 1 is a flowchart showing the procedure for a user who uses the symbol extraction device 100 according to the first embodiment.
In step S11, the user of the symbol extraction device 100 specifies (the file name of) a design drawing for which symbols are to be searched. The symbol extraction device 100 then reads and displays the design drawing (see FIG. 2, which will be described later). FIG. 2 shows a screen 310 that displays the drawing read by the symbol extraction device 100 according to the first embodiment.

Returning to Figure 1, we will continue to explain the usage procedure. In step S12, the user sets a symbol image as a template. Figure 3 shows a screen 320 of the symbol extraction device 100 on which a template setting window 321 according to the first embodiment is displayed. The user sets and saves the template image by specifying an area containing a symbol in the drawing (for example, an area containing the symbol indicated by reference numeral 322). The user may set the template image by specifying a file containing the template image, or may set the template image by selecting a template image that has already been set.

Returning to Figure 1, we will continue explaining the usage procedure. In step S13, the user sets analysis conditions, which are the conditions for extracting symbols from a drawing. Figure 4 shows a screen 330 of the symbol extraction device 100 displaying an analysis condition setting window 331 according to the first embodiment. The image in the upper right corner of the analysis condition setting window 331 is an image (template image) of the symbol to be found (extracted) from the drawing, which was set in step S12. The user sets a threshold and rotation angle. The threshold is a threshold for the similarity between a partial image of the drawing and the template image, which is referenced when determining whether the partial image is a symbol. If the similarity between the partial image of the drawing and the template image is equal to or greater than the set threshold, the symbol extraction device 100 extracts the partial image as a symbol.

The rotation angle is the unit of rotation angle used when calculating the similarity between a partial image in a drawing and a template image by rotating the template image. For example, if a rotation angle of 90 degrees is specified, the similarity between the partial image in the drawing and the template image as is, the template image rotated 90 degrees, the template image rotated 180 degrees, and the template image rotated 270 degrees is calculated, and if any of the similarities is above a threshold, that partial image is extracted as a symbol.

The user presses the "Specify Extraction Target Area" button at the bottom of the analysis condition setting window 331, and on the displayed extraction target area specification screen (not shown), specifies the extraction target area, which is the area in the drawing where symbols will be found. A drawing may contain a symbol legend, and the user specifies the extraction target area so as to exclude the legend area. If a drawing contains multiple figures and only some of the figures are extraction target areas, the user specifies those figures as the extraction target areas.

Returning to Figure 1, the explanation of the usage procedure will continue. In step S14, the user presses the "Execute Extraction" button in the analysis condition setting window 331 (see Figure 4) to instruct extraction of a partial image similar to the template image. Note that the user can also instruct extraction by selecting "Execute Extraction" in the "File" menu.
In step S15, the user checks the extraction result, and if it is OK (step S15→OK), proceeds to step S16, and if it is NG (step S15→NG), return to step S13 and reset the threshold value.

Figure 5 is a screen 340 showing the extraction results when a threshold value of 0.85 is used in the first embodiment. The extracted partial images are highlighted by a rectangle, and an identification number is displayed near the rectangle (see reference numeral 343). However, it can be seen on screen 340 that symbols (partial images) that should have been extracted have not been extracted (see reference numerals 342 and 344). The user determines that the current threshold value of 0.85 is too high and many symbols have been missed, so a reset and re-extraction is necessary. The user returns to step S13, resets the threshold to a value lower than 0.85, for example, 0.65, and instructs re-extraction in step S14. Figure 6 is a screen 350 showing the extraction results when a threshold value of 0.65 is used in the first embodiment. Because all symbols have been extracted, the user determines that re-extraction is not necessary and proceeds to step S16.

Returning to Figure 1, the explanation of the usage procedure will be continued. In step S16, the user edits the extraction results. In detail, the user operates an extraction result window 361 (see Figure 7 described later) to remove erroneous extractions contained in the extraction results and add unextracted (omitted) symbols, thereby editing the extraction results.
7 shows a screen 360 of the symbol extraction device 100 displaying an extraction result window 361 according to the first embodiment. The extraction result window 361 displays a list including the following items: identification number (denoted as "#" in FIG. 7), position, angle (denoted as "angle" in FIG. 7), category, and adoption/rejection (denoted as "adoption" in FIG. 7).

The identification number is a number assigned to the extracted symbol (partial image of the symbol). The position is the position (coordinates) of the symbol in the design drawing. The angle is the rotation angle of the template image when the symbol was extracted (the similarity is equal to or greater than the threshold) (see the rotation angle in the analysis condition setting window 331 in FIG. 4).
The classification is either "automatic" or "manual," and symbols extracted by the symbol extraction device 100 are classified as "automatic." When the user finds an unextracted (undetected) symbol (see reference numeral 368), the user presses the "add" button 363, specifies the area containing the symbol, and adds it to the extraction results. The classification of symbols added to the extraction results by user specification is "manual."

The "Accept" or "Reject" indicates whether the extraction result should be adopted as the final extraction result (O/X). When any item (row) in the list is specified, a partial image of the symbol corresponding to that item is displayed in area 362. By displaying the extracted symbols, the user can check whether the extraction results contain any erroneous extractions. If there are any erroneous extractions, the user can press the "Delete" button 364 to remove the erroneous extraction from the extraction results.
The extraction result list may include the degree of similarity.

<Configuration of the symbol extraction device>
8 is a functional block diagram of the symbol extraction device 100 according to the first embodiment. The symbol extraction device 100 is a computer and includes a control unit 110, a storage unit 120, and an input/output unit 180. User interface devices such as a display, keyboard, and mouse are connected to the input/output unit 180. The input/output unit 180 may include a communication device, enabling transmission and reception of data (e.g., drawings) with other devices. A media drive may also be connected to the input/output unit 180, enabling data exchange using a recording medium.

<Symbol extraction device: memory unit>
The storage unit 120 is configured to include storage devices such as a ROM (Read Only Memory), a RAM (Random Access Memory), and an SSD (Solid State Drive). The storage unit 120 stores design drawing data 130, an extraction result database 140, template information 121, and a program 128. The template information 121 includes information such as template images, names, thresholds, rotation angles, and extraction target regions related to symbols to be extracted (see the analysis condition setting window 331 in FIG. 4). The program 128 includes a description of the procedures for the symbol extraction process (see FIGS. 10 and 11), which will be described later. The design drawing data 130 is image data of drawings.

Figure 9 is a data structure diagram of the extraction result database 140 according to the first embodiment. The extraction result database 140 is, for example, data in a table format, with each row (record) containing information related to one extracted partial image. A record in the extraction result database 140 contains columns (attributes) of identification number (denoted as "#" in Figure 9), position, angle, category, acceptance/rejection, similarity, and image. The identification number, position, angle, category, and acceptance/rejection correspond to the identification number, position, angle, category, and acceptance/rejection in the extraction result window 361 (see Figure 7), respectively. The similarity is the similarity with the template image. The image is data on the extracted partial image.

<Symbol extraction device: control unit>
8 , the control unit 110 will be described. The control unit 110 is configured to include a CPU (Central Processing Unit), and has a drawing display control unit 111, a template setting unit 112, an analysis condition setting unit 113, a matching unit 114, and an extraction result management unit 115.

<Control unit: Drawing display control unit>
The drawing display control unit 111 displays a drawing (see screen 310 in FIG. 2). When symbol extraction is instructed, the drawing display control unit 111 displays a screen including the extraction results (see screens 340 and 350 in FIGS. 5 and 6).

As described above, the symbol extraction device 100 includes an image display control unit (drawing display control unit 111) that highlights and displays a partial image within an image (a region of the drawing to be extracted) that corresponds to an extracted partial image (partial image of a symbol), and displays an identification number corresponding to that partial image near that partial image (see screens 340 and 350 in Figures 5 and 6).

<Control section: template setting section, analysis condition setting section>
The template setting unit 112 displays a template setting window 321 (see FIG. 3 ). The template setting unit 112 also acquires a template image of the symbol to be extracted, designated by the user, and stores it in the template information 121.
The analysis condition setting unit 113 also displays an analysis condition setting window 331 (see FIG. 4 ). The analysis condition setting unit 113 also acquires the threshold value and rotation angle, which are conditions for extracting symbols specified by the user, and stores them in the template information 121.

As described above, the symbol extraction device 100 includes the template setting unit 112 that sets a template image (of a symbol image) to be extracted from an image (an extraction target region of a drawing).
The symbol extraction device 100 also includes an analysis condition setting unit 113 that acquires and sets a threshold value used to determine whether extraction is appropriate.
The analysis condition setting unit 113 also acquires the rotation angle of the template image.

<Control unit: Collation unit>
The matching unit 114 scans the image of a specified region of the drawing (extraction target region) and extracts a partial image that matches the template image. More specifically, the matching unit 114 scans the specified region of the drawing and extracts a partial image that is a partial image of the specified region of the drawing and has a similarity to the template image that is equal to or greater than a threshold. The matching unit 114 rotates the partial image (see the rotation angle in the analysis condition setting window 331) to calculate the similarity. Examples of similarity calculation methods include template matching such as zero-mean normalized cross-correlation, but other methods may also be used.

If the similarity between a partial image and the template image is equal to or greater than a threshold, the matching unit 114 determines that the partial image matches the template image and adds it to the extraction result database 140 (see Figure 9). In more detail, the matching unit 114 adds a new record to the extraction result database 140, and stores the identification number, position, angle, category, acceptance/rejection, similarity, image, serial number, coordinates of the partial image in the drawing (e.g., the upper left coordinates), the rotation angle of the partial image if there is a match, "automatic", "yes", similarity, and partial image.

As described above, the symbol extraction device 100 includes the matching unit 114 that extracts, from an image (a region of a drawing to be extracted), a partial image whose similarity to a template image is equal to or greater than a threshold value.
Furthermore, the matching unit 114 extracts from the image a partial image whose similarity to an image obtained by rotating the template image by one or more rotation angles is equal to or greater than a threshold value.
The similarity is calculated based on a template matching method.

<<Control unit: Extraction result management unit>>
The extraction result management unit 115 refers to the extraction result database 140 (see FIG. 9 ) and displays the extraction result window 361 (see FIG. 7 ). The displayed contents may be sorted by items such as identification number or position. Furthermore, in accordance with a user's operation (instruction) on the extraction result window 361, the extraction result management unit 115 performs processing such as displaying a partial image corresponding to a selected item, adding a designated omitted extraction symbol (partial image in the drawing, see reference numeral 368 in FIG. 7 ) to the extraction results, and accepting an instruction on whether to accept or reject the extraction. Details of the processing by the extraction result management unit 115 will be described later with reference to FIG. 11 .

As described above, the symbol extraction device 100 includes an extraction result management unit 115 that displays an extraction result (see extraction result window 361) that includes at least one item among the extracted partial image, the identification number of the partial image, the position of the partial image within the image (the area of the drawing to be extracted), and the similarity between the partial image and the template image.
The extraction result management unit 115 adds the partial image of the specified image to the extraction result.
The extraction result management unit 115 displays the identification number of the partial image.
The extraction result management unit 115 receives an instruction as to whether the partial image is to be included in the extraction result.
The extraction result management unit 115 has a sorting function based on one selected item from the identification number of the displayed partial image, the position of the partial image within the image, and the similarity between the partial image and the template image.

Symbol extraction processing
10 is a flowchart of the symbol extraction process according to the first embodiment. The symbol extraction process executed by the symbol extraction device 100 will be described with reference to FIG.
In step S21, the drawing display control unit 111 acquires the drawing designated by the user and displays it on the screen (see FIG. 2).

In step S22, the drawing display control unit 111 accepts a user operation and branches to the processing corresponding to that operation. When the drawing display control unit 111 accepts an operation to instruct template setting (e.g., "Template Setting" in the "Settings" menu) (step S22 → Template Setting), it proceeds to step S23. When the drawing display control unit 111 accepts an operation to instruct analysis condition setting (e.g., "Analysis Condition Setting" in the "Settings" menu) (step S22 → Analysis Condition Setting), it proceeds to step S25. When the drawing display control unit 111 accepts an operation to instruct extraction (e.g., the "Extract" button in the analysis condition setting window 331 shown in Figure 4 or "Extract" in the "File" menu) (step S22 → Extraction Execution), it proceeds to step S27. When the drawing display control unit 111 accepts an operation to instruct display of extraction results (e.g., "Edit Extraction Results" in the "Settings" menu) (step S22 → Extraction Results), it proceeds to step S29. When the drawing display control unit 111 receives an instruction to save the extraction results (for example, "Save Extraction Results" in the "File" menu) (step S22 → Save), it proceeds to step S30. When the drawing display control unit 111 receives an instruction to end (for example, "Exit" in the "File" menu) (step S22 → End), it ends the symbol extraction process.

In step S23, the template setting unit 112 displays the template setting window 321 (see FIG. 3) (denoted as "setting screen" in FIG. 10).
In step S24, the template setting unit 112 saves the template image, which is the content set in the template setting window 321, in the template information 121.

In step S25, the analysis condition setting unit 113 displays the analysis condition setting window 331 (see FIG. 4) (denoted as "setting screen" in FIG. 10).
In step S26, the analysis condition setting unit 113 stores the threshold value, angle setting, and other settings set in the analysis condition setting window 331 in the template information 121.

In step S27, the matching unit 114 scans the image of the designated area (extraction target area) of the drawing, extracts a partial image that matches the template image, and stores it in the extraction result database 140 (see FIG. 9).
In step S28, the drawing display control unit 111 displays a screen showing the extraction results (see screens 340 and 350 in FIGS. 5 and 6).

In step S29, the extraction result management unit 115 executes extraction result screen processing (see FIG. 11, which will be described later).
In step S30, the extraction result management unit 115 saves the extraction result database 140 (see FIG. 9 ) in a specified file. For example, the extraction result management unit 115 saves the identification number, position, angle, classification, acceptance/rejection, and similarity in a CSV (Comma-Separated Values) format file, and the image in an image file.

<<Extraction result screen processing>>
11 is a flowchart of the extraction result screen processing according to the first embodiment. Details of step S29 (see FIG. 10) will be described with reference to FIG.
In step S41, the extraction result management unit 115 displays the extraction result window 361 (see FIG. 7).

In step S42, the extraction result management unit 115 accepts an operation on the extraction result window 361 and branches to the processing corresponding to that operation. When the extraction result management unit 115 accepts an operation to select an item (a row in the extraction result list on the left side of the extraction result window 361) (step S42 → select item), it proceeds to step S43. When the extraction result management unit 115 accepts an operation to change the acceptance/rejection (step S42 → change acceptance/rejection), it proceeds to step S44. When the extraction result management unit 115 accepts pressing of the "Add" button 363 (step S42 → add), it proceeds to step S46. When the extraction result management unit 115 accepts pressing of the "Delete" button 364 (step S42 → delete), it proceeds to step S50. When the extraction result management unit 115 accepts pressing of the "Close" button (step S42 → close), it ends the extraction result screen processing.

In step S43, the extraction result management unit 115 displays the partial image corresponding to the specified item (row in the extraction result list) in the area 362 (see FIG. 7), and then returns to step S42.
In step S44, the extraction result management unit 115 alternately displays whether the specified item is adopted or not.
In step S45, the extraction result management unit 115 updates the acceptance/rejection attributes of the records corresponding to the specified items in the extraction result database 140 (see Figure 9, written as "DB" in Figure 11) so as to alternate, and then returns to step S42.

In step S46, the extraction result management unit 115 acquires the area on the drawing designated by the user.
In step S47, the extraction result management unit 115 acquires a partial image of the area designated in step S46.

In step S48, the extraction result management unit 115 displays the partial image acquired in step S47 in area 362. The extraction result management unit 115 also adds information related to the partial image to the extraction result list in extraction result window 361 and displays it. The position, angle, category, and acceptance/rejection of the list are the coordinates of the specified area (for example, the upper right coordinates), "0,""manual," and "o," respectively. The angle may be the angle at which the template image is rotated to maximize the similarity with the partial image.
In step S49, the extraction result management unit 115 adds the displayed content and partial images added to the extraction result list in step S48 to the extraction result database 140 (see FIG. 9), and the process returns to step S42.

In step S50, the extraction result management unit 115 deletes the currently specified item (row in the extraction result list) and displays the list.
In step S51, the extraction result management unit 115 deletes the record from the extraction result database 140 that corresponds to the item deleted in step S50, and the process returns to step S42.

<Features of the symbol extraction device>
The symbol extraction device 100 calculates the similarity between the template image of the specified symbol and the partial image of the drawing, and extracts it if the similarity is equal to or greater than a threshold. The extracted partial image is highlighted on the drawing (see reference numeral 343 in FIG. 5 ), allowing the user to easily confirm the extraction result.
In response to a user's instruction, the symbol extraction device 100 adds partial images of the drawing that were not extracted to the extraction result and deletes erroneous detections from the extraction result, thereby editing the extraction result. By adjusting the threshold value to lower the threshold value if there are many extraction omissions and to raise the threshold value if there are many erroneous extractions, the user can efficiently extract symbols by editing the extraction result.

Second Embodiment
The matching unit 114 in the first embodiment extracts a partial image similar to a template image using a template matching method such as zero-mean normalized cross-correlation. The extracted results may be matched using a trained learning model. FIG. 12 is a functional block diagram of a symbol extraction device 100A according to the second embodiment. Compared to the symbol extraction device 100 of the first embodiment, a learning unit 116 is added to the control unit 110, and a learning model 122 is added to the storage unit 120. In addition, the matching unit 114A of the control unit 110 is modified.

The learning model 122 is a learning model for machine learning technology. The input (explanatory variables) of the learning model 122 is a partial image of a drawing, and the output (objective variable) is whether or not the partial image matches a template image.
The learning unit 116 trains the learning model 122 using images in the records of the extraction result database 140 (see FIG. 9) as learning data (makes the learning model 122 learn the learning data).

For a partial image that has been determined to be similar to the template image using the template matching method, the matching unit 114A further determines whether it matches the template image using the learning model 122. In other words, the matching unit 114A determines that a partial image matches (is similar to) the template image when both the template matching method and the learning model 122 determine that the partial image matches (is similar to) the template image.

As described above, the symbol extraction device 100A further includes a learning unit 116 that generates a learning model 122 for determining whether an image (a region to be extracted in a drawing) is a template image, using learning data including a partial image included in the extraction result. The learning unit 116 also generates the learning model 122 using the extraction result.
The similarity is calculated based on a template matching method.
The matching unit 114A provided in the symbol extraction device 100A extracts partial images whose similarity calculated based on a template matching method is equal to or greater than a threshold value and which are determined to be template images using the learning model 122.

Features of the Second Embodiment
The symbol extraction device 100A performs matching using machine learning technology, and is therefore able to extract partial images of symbols with higher accuracy than the symbol extraction device 100.

<<Variations>>
Although several embodiments of the present invention have been described above, these embodiments are merely illustrative and do not limit the technical scope of the present invention. For example, the extraction result list on the left side of the extraction result window 361 (see FIG. 7 ) is displayed in order of identification number, but may be sorted and displayed by similarity. By assuming that extraction results with high similarity do not contain erroneous detections and checking extraction results with low similarity for erroneous extractions, the user can efficiently check the extraction results. Furthermore, the template information 121 and learning model 122 may be shared among multiple drawings and symbol extraction devices 100 and 100A.

The present invention may take on various other embodiments, and various modifications, such as omissions and substitutions, may be made without departing from the spirit of the present invention. These embodiments and their variations are included within the scope and spirit of the invention described in this specification, etc., and are also included in the scope of the invention described in the claims and their equivalents.

100, 100A Symbol extraction device 111 Drawing display control unit (image display control unit)
112 Template setting unit 113 Analysis condition setting unit 114 Collation unit 115 Extraction result management unit 116 Learning unit 121 Template information 122 Learning model 128 Program 130 Design drawing data (image)
140 Extraction result database

Claims (11)

a template setting unit that sets a template image to be extracted from the image;
an analysis condition setting unit that acquires and sets a threshold value used to determine whether extraction is appropriate;
a matching unit that extracts, from the image, a partial image whose similarity to the template image is equal to or greater than the threshold;
an extraction result management unit that displays an extraction result including at least one item of an extracted partial image, an identification number of the partial image, a position of the partial image within the image, and a similarity between the partial image and the template image ;
The extraction result management unit
The system has a sorting function based on one selected from the identification number of the displayed partial image, the position of the partial image within the image, and the similarity between the partial image and the template image.
Symbol extraction device. a template setting unit that sets a template image to be extracted from the image;
an analysis condition setting unit that acquires and sets a threshold value used to determine whether extraction is appropriate;
a matching unit that extracts, from the image, a partial image whose similarity to the template image is equal to or greater than the threshold;
an extraction result management unit that displays extraction results including at least one item of an extracted partial image, an identification number of the partial image, a position of the partial image within the image, and a similarity between the partial image and the template image ;
a learning unit that generates a learning model that determines whether an image is the template image using learning data that includes a partial image included in the extraction result,
the similarity is calculated based on a template matching technique;
The matching unit extracts a partial image whose similarity calculated based on a template matching technique is equal to or greater than the threshold value and which is determined to be the template image using the learning model.
Symbol extraction device. The extraction result management unit
The symbol extraction device according to claim 1 or 2 , wherein a partial image of the specified image is added to the extraction result. The analysis condition setting unit
obtaining a rotation angle of the template image;
The collation unit
The symbol extraction device according to claim 1 or 2, further comprising: extracting from the image a partial image having a similarity equal to or greater than the threshold value with an image obtained by rotating the template image at least once by the rotation angle. further comprising an image display control unit;
The extraction result management unit
Displaying the identification number of the partial image;
The image display control unit
3. The symbol extraction device according to claim 1, wherein a partial image of the image corresponding to the extracted partial image is displayed in an emphasized manner, and an identification number corresponding to the partial image is displayed near the partial image. The symbol extraction device according to claim 1 , wherein the similarity is calculated based on a template matching technique. The extraction result management unit
Accept an instruction as to whether the partial image should be included in the extraction result;
The symbol extraction device according to claim 2 , wherein the learning unit generates the learning model using the extraction result. Computer,
a template setting unit that sets a template image to be extracted from the image;
an analysis condition setting unit that acquires and sets a threshold value used to determine whether extraction is appropriate;
a matching unit that extracts, from the image, a partial image whose similarity to the template image is equal to or greater than the threshold;
an extraction result management unit that displays an extraction result including at least one item of an extracted partial image, an identification number of the partial image, a position of the partial image within the image, and a similarity between the partial image and the template image ;
The extraction result management unit
The system has a sorting function based on one selected from the identification number of the displayed partial image, the position of the partial image within the image, and the similarity between the partial image and the template image.
A program that functions as a symbol extraction device. Computer,
a template setting unit that sets a template image to be extracted from the image;
an analysis condition setting unit that acquires and sets a threshold value used to determine whether extraction is appropriate;
a matching unit that extracts, from the image, a partial image whose similarity to the template image is equal to or greater than the threshold;
an extraction result management unit that displays extraction results including at least one item of an extracted partial image, an identification number of the partial image, a position of the partial image within the image, and a similarity between the partial image and the template image ;
a learning unit that generates a learning model that determines whether an image is the template image using learning data that includes a partial image included in the extraction result,
the similarity is calculated based on a template matching technique;
The matching unit extracts a partial image whose similarity calculated based on a template matching technique is equal to or greater than the threshold value and which is determined to be the template image using the learning model.
A program that functions as a symbol extraction device. The symbol extraction device
A step of setting a template image to be extracted from the image;
A step of acquiring and setting a threshold value used to determine whether extraction is appropriate;
extracting a partial image from the image, the partial image having a similarity to the template image equal to or greater than the threshold;
displaying an extraction result including at least one item of an extracted partial image, an identification number of the partial image, a position of the partial image within the image, and a similarity between the partial image and the template image ;
and sorting the extraction results by one selected item from the identification number of the displayed partial image, the position of the partial image within the image, and the similarity between the partial image and the template image.
Symbol extraction methods. The symbol extraction device
A step of setting a template image to be extracted from the image;
A step of acquiring and setting a threshold value used to determine whether extraction is appropriate;
extracting a partial image from the image, the partial image having a similarity to the template image equal to or greater than the threshold;
displaying an extraction result including at least one item of an extracted partial image, an identification number of the partial image, a position of the partial image within the image, and a similarity between the partial image and the template image ;
and generating a learning model for determining whether an image is the template image using learning data including the partial image included in the extraction result;
the similarity is calculated based on a template matching technique;
In the step of extracting the partial image, a partial image whose similarity calculated based on a template matching technique is equal to or greater than the threshold value and which is determined to be the template image using the learning model is extracted.
Symbol extraction methods.