JP4392392B2 - Visual inspection device - Google Patents

Description

  The present invention relates to a visual inspection apparatus that can inspect an inspection object by visual inspection. More specifically, the inspection data obtained by an automatic inspection apparatus is effectively used to improve the efficiency of visual inspection. It relates to a visual inspection device.

2. Description of the Related Art Conventionally, there are many devices described in Patent Document 1, Patent Document 2, and the like as devices capable of visually inspecting a printed circuit board. In general, these inspection apparatuses display an image captured from a printed circuit board to be inspected, display an image of a regular printed circuit board (hereinafter referred to as “reference image”), and visually check these images. The inspection can be performed by comparing with the above.
JP 2004-333288 A JP 2002-009500 A

  However, since such a conventional visual inspection apparatus is generally provided completely independently of an automatic inspection apparatus, when inspection is performed by visual inspection, it is necessary to newly perform an inspection from scratch. For this reason, there is a problem that inspection efficiency is lacking. Moreover, when trying to inspect a printed circuit board with a fine pattern and a complicated pattern, it takes time, and the concentration of the inspector is reduced, resulting in the quality of the inspection. May be reduced.

  Accordingly, the present invention has been made paying attention to the above-described problems, and an object thereof is to provide a visual inspection apparatus that improves inspection efficiency by utilizing inspection data inspected by an automatic inspection apparatus. .

That is, in order to solve the above-mentioned problem, the present invention includes an inspection date and time from a database storing inspection data of an inspection object inspected by an automatic inspection apparatus in a visual inspection apparatus for visually inspecting an inspection object. Reading means for reading the history information and position data of the defective part of the inspection object, and the history information read by the reading means are displayed on the display so as to be selectable, and any of the displayed history information is selected. Thus, when the item selection means for displaying the list of position data of the defective portion of the selected inspection object in a selectable manner and the position data of the defective portion are selected by the item selection means, the selected inspection An overall image display means for displaying an entire image of the object and displaying a rectangular area of the selected defective portion; A first display means for displaying an enlarged image of a rectangular area in the body image on the first screen, and a defective portion displayed on the first screen by reading the reference image from the position data selected by the item selection means And a second display means for displaying the reference image of the rectangular area on the second screen in conjunction with the enlargement ratio and scrolling of the image .

In this way, if the inspection data of the automatic inspection apparatus is utilized to display only the portion determined to be defective, only the defective portion can be visually inspected, so that the inspection efficiency can be improved. become. At this time, not only the image of the defective portion but also the entire image of the inspection object is displayed, and the portion of the entire image that is displayed on the first screen as the defective portion is displayed in the entire image. In this way, it is possible to know which part of the whole is currently being visually inspected, and to grasp the overall image of the work process.

In the present invention, in the visual inspection apparatus for visually inspecting the inspection object, history information including the inspection date and time from the database storing the inspection data of the inspection object inspected by the automatic inspection apparatus, and the defective part of the inspection object Reading means for reading the position data, and history information read by the reading means is selectably displayed on the display, and one of the displayed history information is selected, whereby the selected inspection object An item selection means for displaying a list of position data of defective parts of the object in a selectable manner, and when the position data of the defective part is selected by the item selection means, the whole image of the selected inspection object is displayed. A whole image display means for displaying a rectangular area of the selected defective portion, and an enlargement of the rectangular area in the whole image A first display means for displaying an image on the first screen, and a reference image is read from the position data selected by the item selection means, and the enlargement ratio and scroll of the image of the defective portion displayed on the first screen In conjunction with the second display means for displaying the reference image of the rectangular area on the second screen, the inspection data of the automatic inspection apparatus is effectively used to improve the efficiency of visual inspection. Will be able to. At this time, not only the image of the defective portion but also the entire image of the inspection object is displayed, and the portion of the entire image that is displayed on the first screen as the defective portion is displayed in the entire image. In this way, it is possible to know which part of the whole is currently being visually inspected, and to grasp the overall image of the work process.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1 shows an outline of an appearance inspection system 1 according to an embodiment of the present invention, and FIG. 2 is a functional block diagram of an automatic inspection device 10 and a visual inspection device 20 constituting the appearance inspection system 1. Is shown. FIG. 3 shows an example of a screen configuration for visual inspection displayed on the display 20a of the visual inspection apparatus 20, and FIGS. 4 and 5 show primary inspection (automatic inspection) and second inspection of the printed circuit board 2. FIG. The flowchart at the time of the next inspection (visual inspection) is shown.

  The appearance inspection system 1 in this embodiment includes an automatic inspection device 10 that automatically inspects the formation state of pads, resists, and the like formed on the surface of the printed circuit board 2 and inspection data obtained by the automatic inspection device 10. And a visual inspection device 20 that can be visually inspected.

  First, the automatic inspection apparatus 10 in the appearance inspection system 1 will be described. As shown in FIG. 1, the automatic inspection apparatus 10 stacks the printed circuit boards 2 and stacks the printed circuit boards 2 one by one from the stacker 11. The pickup mechanism 12 taken out and placed on the stage 13 for inspection, and the printed circuit board 2 placed on the stage 13 by the pickup mechanism 12 are moved to the illumination device 14 or the light receiving device 15 side, and the print obtained there An inspection device 17 that inspects an image of the substrate 2 and a recovery mechanism 16 that distributes and recovers the printed circuit boards 2 according to the quality based on the determination result by the inspection device 17 are provided.

  The operation of the automatic inspection apparatus 10 will be described. The printed circuit board 2 stacked on the stacker 11 is lifted by a lifter (not shown) and sequentially taken out from above by the pickup mechanism 12. The pickup mechanism 12 is provided with a plurality of suction members facing downward, and sucks and lifts the printed circuit board 2 by sucking it to a portion other than the through hole of the printed circuit board 2. The printed circuit board 2 lifted by the pickup mechanism 12 is moved to the stage 13 as it is, and is lowered there and placed on the stage 13. A suction mechanism (not shown) for fixing the printed circuit board 2 is provided on the surface of the stage 13, and the printed circuit board 2 being moved can be prevented from being displaced by sucking the printed circuit board 2 onto the stage 13. I am doing so. In FIG. 1, two stages 13 are provided in the depth direction of the paper surface, and the stage 13 moves with the printed circuit board 2 placed thereon. On the return path, the stage 13 is lowered and can move without interfering with each other. I am doing so. Next, the printed circuit board 2 moved in this way is moved to below the illumination device 14 configured in a semicircular arc shape, and an image of the surface is acquired there. The illuminating device 14 is formed by arranging LEDs in a semicircular arc shape. The illuminating device 14 irradiates the printed circuit board 2 with light from a plurality of angles and receives the reflected light by a light receiving device 15 constituted by a line sensor or the like. Let Then, the received image is automatically inspected by the inspection device 17.

  Specifically, the inspection device 17 is constituted by a personal computer equipped with a CPU, a memory, and the like. The preprocessing means 170 and the storage means 171 as shown in FIG. The pass / fail judgment means 173 and the output means 174 are made to function.

  Among these, the preprocessing unit 170 performs A / D conversion on the 256 grayscale image acquired by the light receiving device 15 and stores the image in the storage unit 171. At the time of this A / D conversion, the average luminance value of the acquired 256-gradation image is used, and “1” is set for a pixel having a luminance higher than the average luminance value. “0” is set for a pixel having a small luminance. Of course, the inspection may be performed with 256 gradations without performing such binarization processing, or the color image may be inspected.

  In addition to the image of the printed circuit board 2 binarized by the preprocessing unit 170, the database constituting a part of the storage unit 171 is acquired with 256 gradations for visual inspection to be performed later. The entire image is stored as it is.

  After the binarization processing is performed by the preprocessing unit 170, next, the pass / fail judgment of the printed circuit board 2 is performed based on the binarized image. The pass / fail judgment means 173 judges pass / fail by comparing the binarized image of the printed circuit board 2 to be inspected with a reference image stored in the storage means 171 in advance. Specifically, when inspecting the formation status of patterns, resists, pads, and silk, the difference between the average luminance of a small area divided into rectangles as the inspection target area and the average luminance of the corresponding reference image area is obtained. If the average luminance difference is larger than a certain value, the inspection target area is determined to be defective. The pass / fail judgment based on the brightness difference is performed for each pattern, silk, and resist. Based on the brightness of the metal color for the pattern inspection, the brightness of the white for the silk, and the brightness of the green for the resist inspection. Determined. Note that the determination method is not limited to such a determination method, and other determination methods may be used as appropriate. The inspection data determined to be acceptable by such a determination method is stored in the storage unit 171 and also stored in the database 172 for visual inspection performed later. Information stored in the database 172 includes, for example, date / time when the printed circuit board 2 is automatically inspected, information on the number of printed circuit boards (hereinafter referred to as “history information”), Information on the position determined as a defective portion, an enlarged image of the defective portion, and the like.

  The output means 174 outputs the final determination result of the quality of the printed circuit board 2 in a reportable manner when the inspection of all areas of the printed circuit board 2 is completed. For example, when there is no defective portion on the printed circuit board 2, a green lamp is turned on, and when there are more than a predetermined number of defective portions on the printed circuit board 2, red light is turned on. Moreover, even if there are few defective parts, red is lit according to the importance. In addition to the lamp, it is also possible to output the determination result by sound so as to be notified.

  Next, the configuration of the visual inspection apparatus 20 will be described. The visual inspection device 20 is constituted by a computer integrated with the automatic inspection device 10 or a personal computer provided separately, and is connected to at least the database 172 of the automatic inspection device 10. This connection method is generally connected via a communication line such as a LAN. However, inspection data can be acquired by taking a portable storage medium such as a CD or DVD into the visual inspection device 20. May be.

  The visual inspection apparatus 20 will be described in detail. The visual inspection apparatus 20 includes a CPU, a memory, a display 20a, a keyboard 20b, and the like incorporated in the apparatus, a reading unit 21, an item selection unit 22, and an entire image display unit 23. The first display unit 24, the second display unit 25, the storage unit 26, the visual result input unit 27, and the like are caused to function.

  Among these, the reading means 21 is connected to the database 172 of the automatic inspection apparatus 10 and reads the inspection data. When a communication line such as a LAN is not connected, the inspection data is read from a storage medium storing the inspection data via a CD drive or a DVD drive.

  The item selection means 22 displays the inspection result of the printed circuit board 2 determined to be defective among the inspection data read by the reading means 21 on the display 20a. At the time of this display, as shown on the right side of FIG. 3, in addition to the date and time of inspection by the automatic inspection apparatus 10, history information as to which printed circuit board is inspected is also displayed. FIG. 3 shows a state in which the 44th printed circuit board automatically inspected on July 16, 2005 is selected. When a desired printed board is clicked with a mouse or the like in the information displayed on this screen, a list of position data of defective portions of the printed board 2 is displayed on the upper side. This position data is displayed in coordinates of a location determined as a defective location, and is a pixel unit in the x and y directions when the reference mark of the printed circuit board 2 is (x, y) = (0, 0) as the origin. Indicated by

  The whole image display means 23 displays the whole image of the printed circuit board 2 selected by the item selection means 22 on the left side of the display 20a. This whole image is displayed with a relatively small enlargement ratio in order to make it easy to grasp a defective portion in the whole printed circuit board 2. When the item selection means 22 selects a defective portion to be visually inspected, a small rectangular area 23a including the defective portion is displayed to make it easy for the inspector to understand the defective portion.

  The first display means 24 displays an enlarged image of the rectangular area 23a in the entire image on the first screen 24a. When an image of a defective part is displayed by the first display means 24, an enlarged image stored in the database 172 of the automatic inspection apparatus 10 is acquired, and a process of attaching a circle to the image is performed. Is displayed on the screen 24a. This makes it easy for the inspector to grasp the target portion of the visual inspection.

  The second display means 25 displays a reference image corresponding to the image displayed on the first screen 24a. Here, the “reference image” refers to an image of a printed board that does not include a defective portion. This reference image is stored in the database 172 in advance, but if it is not stored in the database 172, it may be stored in the storage means 26 of the visual inspection apparatus 20. When the reference image is displayed on the second screen 25a by the second display means 25, an enlarged image of the reference image is read from the coordinates of the defective part selected by the item selection means 22, and the enlarged image is displayed on the display 20a. Let At this time, the enlargement ratio of the image displayed on the second screen 25a and the image displayed on the first screen 24a are set to be the same. When either one of the screens is scrolled, the other screen is also scrolled in conjunction with the scroll, and the rectangular area 23a displayed on the entire image display means 23 corresponding to the scroll. The same position is also moved.

  On the other hand, the visual result input means 27 constitutes the first input means and the second input means in the present invention, and among the defective portions displayed by the first display means 24, the determination is made by visual inspection. Accept input of results. The visual input of the determination result is performed, for example, by pressing a predetermined function key of the keyboard 20b. For example, if the inspection data determined to be defective by the automatic inspection apparatus 10 is false, If the inspection data by the automatic inspection apparatus 10 is actually defective, for example, if the inspection data is a pad, “scratches, dents, protrusions, Information such as "discoloration", information such as "clogging and overloading" if it is a hole, information such as "scratch / peeling and adhesion" if it is a resist, and information such as "scratching / peeling and adhesion" if it is silk Made. These pieces of information are sequentially stored in the storage means 26 of the visual inspection apparatus 20 so that they can be output as statistical information later.

  Next, a flowchart in the case of inspecting the printed circuit board 2 using the appearance inspection system 1 configured as described above will be described with reference to FIGS.

  First, when inspecting the printed circuit board 2, the automatic inspection apparatus 10 is used as a primary inspection. When performing the automatic inspection, the printed circuit board 2 to be inspected is stacked on the stacker 11 in advance, and the automatic inspection apparatus 10 is turned on. Then, the printed circuit board 2 in the stacker 11 is lifted by a lifter or the like (step T1), and the printed circuit board 2 is taken out one by one from the top by the pickup mechanism 12 (step T2). The taken out printed circuit board 2 is positioned on the way by a positioning mechanism (not shown) or the like (step T3) and is carried onto the stage 13. When the printed circuit board 2 is placed on the stage 13 (step T4), it is moved horizontally along with the stage 13 (step T5), and moved to below the illumination device 14 and the light receiving device 15 to obtain a surface image. (Step T6). The acquired image is stored in the database 172 and the storage unit 171 as a 256-gradation image (step T7), and the image binarized by the binarization processing unit (step T8) is also stored in the storage unit 171. Stored in Then, the binarized image and the reference image stored in advance in the storage unit 171 are compared and determined by a comparison algorithm, and the presence / absence of a defective portion is inspected (step T9). If it is determined that a defective part exists (step T10), the coordinates of the defective part and the enlarged image of the area including the defective part are stored in the database 172 together with the history information of the printed circuit board 2. (Step T11). When all areas of the printed circuit board 2 have been inspected and there are more than a predetermined number of defective pixels (step T12), an output indicating that the defective pixels are defective is output (step T13). Is less than the predetermined number, an output indicating that the product is non-defective is performed (step T14). The printed circuit board 2 is sorted and collected by the collection mechanism 16 based on the pass / fail judgment result.

  Next, when visual inspection is performed as a secondary inspection, first, the visual inspection device 20 is connected to the database 172 of the automatic inspection device 10 (step S1), and among the inspection data stored in the database 172, First, the inspection data of the printed circuit board 2 determined to be defective is read (step S2), and history information regarding the date and time and the number of sheets is displayed on the display 20a (step S3). When predetermined history information is selected by the inspector (step S4), data related to the defective portion of the printed circuit board 2 is now displayed in a list on the display 20a (step S5). Therefore, when the inspector selects a predetermined defective portion for visual inspection (step S6), the entire image of the printed board 2 is displayed on the display 20a, and the printed board 2 with the marking 24b attached to the defective portion. Is displayed on the first screen 24a, and a reference image corresponding to the first screen 24a is displayed on the second screen 25a (step S7). Then, the image displayed on the first screen 24a and the second screen 25a enables the inspector to compare and determine the defective portion.

  Then, when the inspector inputs the result of the visual judgment on the defective portion based on the whole image and the image displayed on the first screen 24a and the second screen 25a in this way (step S8), the result is visually checked. The data is sequentially stored in the storage means 26 of the inspection device 20 (step S9), and the visual inspection of all items is completed (step S10), so that the quality of the printed circuit board 2 is comprehensively determined.

As described above, according to the above-described embodiment, when the printed circuit board 2 is visually inspected, the history information including the inspection date and the inspection object are stored from the database 172 storing the inspection data of the printed circuit board 2 inspected by the automatic inspection apparatus 10. The position data of the defective part of the object is read, and by selecting any of the history information, a list of position data of the defective part of the selected printed circuit board 2 is displayed in a selectable manner, and the position of the defective part is displayed. When data is selected, an entire image of the printed circuit board 2 including the rectangular area 23a of the selected defective portion, an enlarged image of the rectangular area 23a, and a reference image corresponding to the position data are displayed. As a result, the visual inspection can be efficiently performed using the inspection data of the automatic inspection apparatus 10. At this time, since the entire image of the printed circuit board 2 and the enlarged image of the partial area including the defective part are displayed, it is possible to grasp which part of the printed circuit board 2 is visually inspected. The overall picture of the work process can be grasped.

  In addition, this invention is not limited to the said embodiment, It can implement in a various aspect.

  That is, in the above-described embodiment, the case where the printed circuit board 2 is inspected has been described. However, the present invention is not limited to this. can do. Of course, it can be applied to fields other than printed circuit boards and liquid crystal panels.

  Moreover, in the said embodiment, although the round mark is attached as the marking 24b of a defective location, you may enable it to specify a defective location by not only this but a cross mark, a square mark, etc. FIG. Further, instead of marking in this way, the image of the defective part may be displayed in red. In this case, in the relationship with the present invention, the image portion displayed in red corresponds to marking.

  Further, in the above embodiment, the enlarged image around the defective part is stored in the database 172 on the automatic inspection apparatus 10 side. However, even if the resolution of the whole image is increased, there is no problem in the storage capacity. An image acquired at a high resolution may be stored in the database 172.

  In the above embodiment, the database 172 provided as part of the storage unit 171 of the automatic inspection apparatus 10 has been described as an example of the database. However, the present invention is not limited to this, and the automatic inspection apparatus 10 is not limited thereto. It may be a database provided at an independent position. In this case, the inspection data from the automatic inspection apparatus 10 is stored in the database via the LAN or the like, and is read out to the visual inspection apparatus 20 via the reading means 21.

The figure which shows the outline | summary of the external appearance inspection system in one embodiment of this invention Functional block diagram of an appearance inspection system in the same form Screen configuration example of visual inspection device in the same form Flow chart for automatic inspection of printed circuit board in the same form Flow chart for visual inspection of printed circuit board in the same form

DESCRIPTION OF SYMBOLS 1 ... Appearance inspection system 2 ... Printed circuit board 10 ... Automatic inspection apparatus 17 ... Inspection apparatus 172 ... Database 173 ... Pass / fail judgment means 174 ... Output means 20 ... Visual inspection Inspection device 21 ... Reading means 22 ... Item selection means 23 ... Whole image display means 23a ... Rectangle area 24 ... First display means 24a ... First screen 24b ... Marking 25 ... second display means 25a ... second screen 26 ... storage means 27 ... visual result input means

Claims (1)

In a visual inspection device for visually inspecting an inspection object,
Reading means for reading the position data of the defective portion of the history information and the inspection object including from the database examination date storing the inspection data of the inspection object which is inspected by automatic inspection device,
The history information read by the reading means is displayed on the display so as to be selectable, and any one of the displayed history information is selected, so that a list of position data of defective portions of the selected inspection object is displayed. An item selection means for displaying a selectable item,
When the position data of the defective part is selected by the item selection means, the whole image display means for displaying the entire image of the selected inspection object and displaying the rectangular area of the selected defective part;
First display means for displaying an enlarged image of a rectangular area in the whole image on the first screen;
A reference image is read from the position data selected by the item selection means, and the reference image of the rectangular area is displayed on the second screen in conjunction with the enlargement ratio and scroll of the image of the defective part displayed on the first screen. A second display means for
A visual inspection apparatus characterized by comprising:

Images