JP6730505B2 - Mounting detection device, camera unit, and mounting detection program - Google Patents

Description

The present invention relates to a mounting detection device that detects mounting of a restraint device, a camera unit, and a mounting detection program.

Generally, a vehicle is provided with a restraint device (hereinafter referred to as a seat belt). The seat belt is attached, for example, by pulling out a strap (webbing) stored in the storage portion and fixing the strap next to the seat. The strap and the seat are fixed by connecting a tongue plate attached to the strap to a buckle fixed to the seat.

Conventionally, there is provided a wearing detection device that detects whether the occupant is wearing the seat belt by detecting that the buckle and the tongue plate are connected.

Japanese Patent No. 4403102

The conventional wearing detection device determines whether the seat belt is worn by detecting that the tongue plate is connected to the buckle. Therefore, for example, when a passenger who does not like wearing a seat belt connects a dummy tongue plate that is not attached to the strap to the buckle, the attachment detection device erroneously detects that the seat belt is attached. That is, in the attachment detection by the mechanical method, it is possible to easily cause the attachment detection device to make an erroneous detection.

An object of the present invention is to provide a mounting detection device, a camera unit, and a mounting detection program that can detect mounting of a restraint device without using a mechanical method.

According to the embodiment, the attachment detection device includes the restraint device, the image capturing device, and the control unit. The restraint device is attached to restrain a passenger seated in a seat, and a strap whose exposed range is changed between wearing and non-wearing is provided, and the passenger seated in the seat is restrained. The identification member is added to the first region pulled out to the shoulder upper position and the second region in the vicinity of the fixture when worn . The image capturing device captures an image including the strap of the restraint device. The control unit detects a first identification image corresponding to the identification member in the first region in the image from the image captured by the image capturing device, and detects the first identification image in the second region in the image as the identification member. The corresponding second identification image is detected, and when both the first identification image and the second identification image are detected , a detection result indicating that the restraint device is attached is output.

FIG. 1 is a block diagram showing the configuration of a mounting detection device according to the first embodiment. FIG. 2 is a diagram showing the inside of an automobile in which the wearing detection device of the first embodiment is mounted. FIG. 3 is a diagram showing an example of a left seat of an automobile equipped with the wearing detection device according to the first embodiment. FIG. 4 is a diagram showing a configuration of a three-point seat belt provided on the right seat in the first embodiment. FIG. 5 is a diagram for explaining a range of the identification member added to the strap of the seat belt according to the first embodiment. FIG. 6 is a diagram showing an example of an identification member added to the strap according to the first embodiment. FIG. 7 is a flow chart for explaining the operation of the mounting detection device in the first embodiment. FIG. 8 is a flowchart for explaining the operation of the seatbelt wearing detection process in the first embodiment. FIG. 9 is a diagram illustrating an example of an image input from the camera according to the first embodiment. FIG. 10 is a block diagram showing the configuration of the wearing detection device according to the second embodiment.

Hereinafter, embodiments will be described with reference to the drawings.
(First embodiment)
FIG. 1 is a block diagram showing a configuration of a mounting detection device 10 according to the first exemplary embodiment. The wearing detection device 10 is mounted in, for example, an automobile provided with a restraint device (hereinafter referred to as a seat belt). An automobile is provided with, for example, a plurality of seats, and each seat is provided with a seat belt. The wearing detection device 10 has a function of detecting whether the seatbelt is worn by the passenger when the passenger is in the seat.

As shown in FIG. 1, the wearing detection device 10 includes a seat belt (seat belt 4 shown in FIG. 3), a control unit 20, a camera 22 (22A, 22B, 22C), a key sensor 24, and a display device (output device) 28. Have.

The seat belt is worn to restrain an occupant seated in the seat, and is provided with a strap whose exposed range is changed between wearing and non-wearing. The detailed structure of the seat belt is shown in FIG.

At least one camera 22 is provided to capture an image of the inside of the automobile. The camera 22 is used, for example, to capture an image for detecting the presence or absence of a passenger, the motion of the passenger, and the wearing of the seat belt. Therefore, the camera 22 is installed at a position where an image including the occupant and the seat belt (at least the strap) can be captured.

In addition, in the first embodiment, the camera 22 is assumed to be equipped with a light emitting device that can capture an image of light having a specific wavelength other than visible light, and that emits light having a specific wavelength other than visible light. As the camera 22, for example, a near infrared camera is used. In this case, the camera 22 is provided with a light emitting device such as a near infrared LED (Light Emitting Diode) that emits near infrared light.

By using the camera 22 capable of photographing with near-infrared light, an image is photographed for detecting the wearing of the seat belt 4 even in a situation where photographing is not possible under a visible light environment such as at night or in a tunnel. be able to. Although a light emitting device that emits visible light is required for photographing with visible light at night or the like, driving may be hindered. In the first embodiment, by taking an image of light of a specific wavelength other than visible light, there is no risk of driving problems.

The camera 22 may be a near-ultraviolet camera, for example. In this case, the camera 22 is provided with a light emitting device that emits near-ultraviolet light.

The control unit 20 is for controlling each part constituting the automobile according to inputs of signals from various sensors and image data from the camera 22. The control unit 20 can be realized by, for example, an engine control unit (ECU) (or an engine computer) mounted on an automobile. Further, the control unit 20 can be configured as an independent dedicated unit (computer) separately from the ECU mounted in a general automobile. In this case, the control unit 20 is realized as a seat belt wearing detection device, and is configured to operate in cooperation with the ECU.

The control unit 20 realizes a function of detecting, for example, whether a passenger is seated in a seat and whether or not the passenger wears a seat belt based on an image captured by the camera 22. The control unit 20 determines whether the seat belt is worn by detecting the identification image corresponding to the identification member (recognition marking) added to the area exposed when the strap is worn from the image captured by the camera 22. ..

Further, the control unit 20 can realize not only the function of detecting the seating of the passenger in the seat and the presence/absence of wearing of the seatbelt by the passenger, but also the function of detecting the motion of the passenger, for example. For example, the control unit 20 detects the driver's line-of-sight direction, operation of the steering wheel, etc., based on the image captured by the camera 22, and executes processing for supporting driving.

The display device 28 is for displaying the processing result by the control unit 20, and is provided on, for example, an instrument panel (dashboard). For example, the display device 28 displays the result of detection of the identification image of the seat belt by the control unit 20, that is, the determination result of wearing the seat belt.

As shown in FIG. 1, the control unit 20 includes a processor 20A, a RAM 20B, a storage device 20C, an input circuit 20D and an output circuit 20E.

The processor 20A executes various programs stored in the storage device 20C to realize various functions. The processor 20A executes seatbelt wearing detection processing for detecting wearing of the seatbelt based on the image input from the camera 22 based on the wearing detection program.

The RAM 20B stores temporary data and the like associated with the processing by the processor 20A.

The storage device 20C stores programs and data for controlling the operation of the control unit 20, and is realized by a storage medium such as an EEPROM (registered trademark) (Electrically Erasable and Programmable ROM).

The input circuit 20D inputs signals from various sensors including, for example, the key sensor 24 and data from devices such as the camera 22.

The output circuit 20E outputs the processing result by the processor 20A to each unit. The output circuit 20E outputs, for example, the result of the wearing detection processing by the processor 20A to the display device 28 to display the seat belt wearing state.

The control unit 20 is provided with a function capable of communicating with an external information device (for example, a personal computer) or a network, and can change programs and data stored in the storage device 20C. For example, the control unit 20 can store (install) the mounting detection program in the storage device 20C from an external information device. As a result, the control unit 20 can execute the mounting detection process.

FIG. 2 is a diagram showing the inside of an automobile in which the wearing detection device 10 according to the first embodiment is mounted. FIG. 2 shows an example of a configuration provided with, for example, a three-row seat (first-row seat 30, second-row seat 31, third-row seat 32). For example, the first-row seat 30 is provided with seats for two passengers, the second-row seat 31 has three passengers, and the third-row seat 32 has three passengers. Each seat is provided with a seat belt for restraining the seated passenger. It should be noted that the second-row seat 31 is movable in the front-back direction, for example, as compared with the first-row seat 30 and the third-row seat 32, and the arrangement of the seats can be changed.

In the case of a three-row seat, three cameras 22A, 22B, 22C corresponding to the respective row seats are installed in order to photograph the inside of the vehicle. The camera 22A is provided, for example, on the ceiling in the vicinity of the room mirror 34 so that the passengers seated in the first row seats 30 and images including seat belts of the respective seats can be captured. The camera 22B is installed, for example, on the ceiling above the first-row seat 30 so that the passengers seated in the second-row seat 31 and the image including the seat belt of each seat can be taken. The camera 22C is installed, for example, on the ceiling above the second-row seat 31 so that the passengers seated in the third-row seat 32 and the image including the seat belt of each seat can be taken.

The example shown in FIG. 2 shows an example in which three cameras 22A, 22B, and 22C corresponding to each of the three rows of seats are installed, but the number and installation position of the cameras 22 are similar to those shown in FIG. Not limited. Examples of installation positions other than the ceiling include the dashboard, the back side of the front seat, and the pillar.

For example, a plurality of cameras 22 may be provided in association with one row of seats. In this case, a plurality of cameras 22 are installed at distant positions so that the same range is captured in duplicate. As a result, it is possible to reduce the range of blind spots that cannot be captured by the camera 22. In this case, for each of the images captured by the plurality of cameras 22, the identification image attached to the strap of the seat belt is detected. Then, the wearing of the seat belt is determined by combining the detection results corresponding to the plurality of cameras 22. This makes it possible to reliably determine whether or not the seat belt is worn.

In addition, a single camera 22 may be capable of photographing seats in a plurality of rows of seats. Further, a camera 22 corresponding to each seat may be provided, or a dedicated camera for seat belt wearing detection may be provided. Further, in the case of an automobile provided with seats having a shape other than the three-row seat, the number of cameras 22 and installation positions are determined according to the shape of the seats.

The display device 28 is provided on an instrument panel (dashboard) as shown in FIG. The display device 28 displays information indicating whether or not the seat belt is worn, which is detected by the wearing detection device 10, for example.

FIG. 3 is a diagram showing an example of a left seat 30A (first-row seat 30) of an automobile equipped with the wearing detection device 10 according to the first embodiment. FIG. 3 shows the configuration of the three-point seat belt 4 provided on the seat 30A. The seat belt 4 is worn to restrain the passenger H1 seated in the seat 30A. FIG. 3 shows a state in which the seatbelt 4 is worn by the passenger H1.

The seat belt 4 can restrain the occupant H1 by wrapping the strap (webbing) 40 around the occupant H1 seated in the seat 30A and fixing the strap 40 at three points. One end of the strap 40 is stored in, for example, a storage portion 44 provided in the pillar 35, and the other end is fixed to one side surface (a side facing the pillar 35) of the seat 30A. The strap 40 stored in the storage portion 44 is retractably wound around a retractor 42 (a retractor with a built-in load limiter) provided in the storage portion 44.

The strap 40 is in a state of being stored in the storage portion 44 when the seat belt 4 is not worn, and is pulled out from the storage portion 44 when the seat belt 4 is worn and fixed to the other side surface of the seat 30A via the tongue plate 45. To be done. The tongue plate 45 is slidably attached to the strap 40. A buckle 46 engageable with the tongue plate 45 is fixed to the other side surface (the side not facing the pillar 35) of the seat 30A. The tongue plate 45 and the buckle 46 act as a fixing tool for fixing the strap 40 pulled out from the storage section 44. The buckle 46 may be attached to the strap 40 and the tongue plate 45 may be provided on the seat 30A.

The pillar 35 is provided with a belt guide 41 at a position higher than the shoulder of the passenger H1 seated in the seat 30A. The belt guide 41 (guide member) guides the strap 40 to a position higher than the shoulder of the occupant H1 by suspending the strap 40 pulled out from the storage portion 44. As a result, the strap 40 laterally extends across the shoulder belt of the occupant H1 and the shoulder belt of the occupant H1 that is slanted from the upper side of the shoulder to the waist of the occupant H1 by engaging the tongue plate 45 and the buckle 46. It is used as a lap belt that is stretched in the direction (vehicle width direction).

As shown in FIG. 3, when the seat belt 4 is worn, identification members 40A and 40B are added as identification markings to the exposed area of the strap 40. In FIG. 3, the identification members 40A and 40B are illustrated so as to be distinguishable, but the identification members 40A and 40B are configured so as not to be visible in a normal visible light environment. In the first embodiment, the identification members 40A and 40B are configured to reflect light having a specific wavelength other than visible light, for example, near infrared light.

The identification member 40A is provided in a range exposed around the position above the shoulder of the occupant of the strap 40 guided by the belt guide 41 when the strap 40 is fixed by the tongue plate 45 and the buckle 46. That is, the identification member 40A is added so as to appear within a range in which the camera 22 can reliably capture an image. In the vicinity of the position above the shoulders of the occupant, the strap 40 is not hidden by the occupant's body (for example, arms, head, hair, etc.), luggage, clothes, etc. carried by the occupant. Therefore, it is possible to reliably determine whether or not the identification member 40A is detected based on the image around the shoulder position of the occupant taken by the camera 22.

The identification member 40A is provided in a range that appears in the shooting range of the camera 22A when the strap 40 is attached to the seat 30A with no passenger. Further, the identification member 40A is displayed around the position above the shoulders of the occupant from the state in which no occupant is present in the seat 30A to the state in which the occupant H1 having the assumed maximum body size is on board. , Strap 40 is continuously added.

When the identification member 40A is exposed, it can be considered that the strap 40 is pulled out from the storage portion 44 and the tongue plate 45 and the buckle 46 are engaged with each other. That is, it is possible to determine that the seat belt 4 is worn.

The strap 40 shown in FIG. 3 is further provided with an identification member 40B in addition to the identification member 40A. The identification member 40B is added to a range in the vicinity of the tongue plate 45 and the buckle 46 when the tongue plate 45 is engaged with the buckle 46.

Therefore, when the identification member 40B is exposed in the vicinity of the tongue plate 45 and the buckle 46, the strap 40 is pulled out from the storage portion 44 and the tongue plate 45 and the buckle 46 are engaged with each other. I can see it. That is, by detecting the state in which both the identification member 40A and the identification member 40B are exposed, it can be reliably determined that the seat belt 4 is worn.

At least the identification member 40A may be added to the strap 40, and the identification member 40B may not be added.

FIG. 4 shows the configuration of the three-point seat belt 4 provided on the right seat 32A (third row seat 32). FIG. 4 shows a state in which the seat belt 4 is worn to restrain the passenger H2 seated in the seat 32A. The seat belt 4 shown in FIG. 4 is basically the same as the seat belt 4 shown in FIG. 3, but the position of the belt guide 41 differs depending on the shape of the seat.

In the seat belt 4 shown in FIG. 3, the storage portion 44 is provided in the pillar 35, but in FIG. 4, the storage portion 44 (not shown) is provided on the back surface of the seat 32A. An outlet for pulling out the strap 40 from the storage portion 44 is provided near the upper end of the seat 32A. Therefore, the pull-out port functions as a belt guide 41, and the strap 40 can be pulled out from a position higher than the shoulder of the passenger H2 seated in the seat 32A.

As shown in FIG. 4, also in the right seat 32A, when the seat belt 4 is worn, the identification members 40A and 40B added to the strap 40 are exposed. That is, the identification member 40A is exposed near the position of the strap 40 on the shoulder of the passenger, and the identification member 40B is exposed near the tongue plate 45 and the buckle 46.

FIG. 5 is a diagram for explaining the range of the identification member 40A added to the strap 40 of the seat belt 4 in the first embodiment.
FIG. 5A shows a state of the strap 40 when the seat belt 4 is not worn. As shown in FIG. 5A, when the seat belt 4 is not worn, the strap 40 is wound up by the retractor 42 provided inside the storage section 44. Therefore, the range 40AH in which the identification member 40A is added to the strap 40 is stored in the storage portion 44. That is, the identification member 40A is not exposed and is not photographed by the camera 22.

FIG. 5B shows a state of the strap 40 when the seat belt 4 is worn. As shown in FIG. 5B, when the seat belt 4 is worn, the strap 40 is pulled out from the storage section 44. As a result, the range 40AH in which the identification member 40A is added to the strap 40 is exposed to the outside of the storage section 44 and can be photographed by the camera 22.

Since the range 40AH to which the identification member 40A is added is provided according to the occupant having the largest expected body size, it is exposed at least around the occupant's shoulder position.

FIG. 6 is a view showing an example of the identification member 40A added to the strap 40.
The strap 40 is formed by knitting polyester fiber, for example. For example, the identification member 40A is formed by weaving a material for the identification member that can be photographed by the camera 22 (can reflect near infrared light) at the stage of manufacturing the strap 40. For example, the fibrous material for the identification member may be knitted together with the polyester fiber, or the material for the identification member may be knitted between two strip-shaped members formed of the polyester fiber. As the material that can be photographed by the camera 22, for example, silicon, metal, resin, cloth having a specific mesh roughness, etc. can be used. In addition, it is also possible to use other materials (materials). That is, in the image captured by the camera 22, any material can be used as long as it can distinguish the range to which the identification member 40A is added and the range to which the identification member 40A is not added.

Further, as shown in (A), (B), (C), and (D) of FIG. 6, the identification member 40A can easily identify the identification image corresponding to the identification member 40A from the image captured by the camera 22. As described above, a specific pattern (shape) can be obtained.

The pattern of the identification member 40A1 shown in FIG. 6(A) shows an example in which it is formed in a planar shape. Since the identification member 40A1 is added to, for example, the substantially entire surface of the strap 40, it is easy to take a picture with the camera 22 regardless of the wearing state of the strap 40.

The pattern of the identification member 40A2 shown in FIG. 6B shows an example in which a plurality of linear patterns are continuously arranged at a predetermined interval. The pattern of the identification member 40A3 shown in FIG. 6C is an example in which a grid pattern is arranged. The pattern of the identification member 40A4 shown in FIG. 6D is an example in which a plurality of patterns of a predetermined shape (for example, a circle) having different sizes are arranged. Since the patterns of the identification members 40A2, 40A3, 40A4 are simple patterns, they can be easily identified from the image captured by the camera 22. Further, since the identification members 40A2 and 40A3 are arranged in a linear pattern in accordance with the fiber directions of the strap 40, it is possible to easily weave a material for the identification member when the strap 40 is manufactured. The identification member 40A4 can be formed by sandwiching a pattern of a predetermined shape between two strip-shaped members forming the strap 40.

By thus forming the identification member 40A with a specific pattern, it is possible to facilitate identification from the image captured by the camera 22. Further, even if not only the identification member 40A but other objects existing in the vehicle are detected by the image capturing using the near-infrared light by the camera 22, it is possible to easily identify based on the pattern of the identification member 40A. It will be possible. Therefore, it is desirable that the identification member 40A be added in a pattern that allows the object to be discriminated even if there are objects that can be photographed with near-infrared light inside the vehicle.

The patterns (A) to (C) shown in FIG. 6 are uniformly added to the strap 40 in the same shape, but the shapes may be changed depending on the position of the strap 40. good.

For example, in the pattern of the identification member 40A1 shown in FIG. 6A, gradation is formed in the image captured by the camera 22. For example, the pattern is formed so as to gradually change from the end of the identification member 40A1. Further, in the identification members 40A2 and 40A3, the interval between the linear patterns or the thickness of the linear patterns is changed according to the position added to the strap 40.

In this way, by changing the shape of the identification member 40A according to the position added to the strap 40, the length of the strap 40 pulled out from the storage portion 44 is identified based on the identification image corresponding to the identification member 40A. It is also possible.

Although only the identifying member 40A is described, the identifying member 40B can have the same pattern as the identifying member 40A. Since the identification members 40A and 40B are detected at different positions of the image captured by the camera 22, they can be identified even if they have the same pattern.

Further, the identification member 40B can have a pattern different from that of the identification member 40A. In this case, the identification images corresponding to the identification members 40A and 40B can be clearly distinguished from the image captured by the camera 22 based on the difference in the pattern of the identification images.

Further, the pattern of the identification member 40A (or the identification member 40B) added to the strap 40 of the seat belt 4 may be different for each seat. For example, by making the pattern of the identification member 40A different for each seat, it is easy to identify the identification members 40A of the seat belts 4 provided on a plurality of seats from the images taken by one camera 22. Becomes

In the first embodiment, the identification members 40A and 40B are added to the strap 40 so that they cannot be visually recognized with visible light. This makes it difficult for a malicious passenger to add a dummy identification member in order to deceive wearing of the seat belt 4. That is, making the dummy identification members difficult by making the material and pattern of the identification members 40A and 40B visually unrecognizable.

If the identification members 40A and 40B are allowed to be in the form of being visible, a special paint (for example, high solar radiation reflection) that can control the reflection characteristics of light in the near infrared region with respect to the strap 40 is used. It is also possible to form the identification members 40A and 40B by applying a rate paint. Further, a material that can be photographed with near infrared light may be attached to the strap 40. This makes it possible to simplify the manufacture of the strap 40 to which the identification members 40A and 40B are added.

Next, the operation of the mounting detection device 10 according to the first embodiment will be described.
FIG. 7 is a flowchart for explaining the operation of the mounting detection device 10 according to the first embodiment.
When notified by the key sensor 24 that the key has been turned on, the processor 20A executes a detection process for detecting the presence or absence of a passenger. Based on the image data input from the camera 22, the processor 20A identifies whether or not the passenger is photographed in the photographed image by using the existing image processing technique. For example, the processor 20A detects a moving object in the area corresponding to the seat in the image. Then, when a moving object is detected, it is determined whether the shape of the object corresponds to a person. This makes it possible to detect the presence or absence of a passenger. The processor 20A executes a detection process for all seats based on the image input from the camera 22.

When the processor 20A detects that the passenger is present (step A1, Yes), the processor 20A executes the seatbelt wearing detection process for detecting whether the passenger wears the seatbelt 4 based on the wearing detection program. (Step A2).

FIG. 8 is a flowchart for explaining the operation of the seatbelt wearing detection process in the first embodiment.
The processor 20A inputs the image data of the captured image from the camera 22 capturing the seat in which it is determined that there is a passenger (step B1). As described above, the camera 22 captures an image with near infrared light, for example.

The processor 20A detects an identification image corresponding to the recognition marking (identification members 40A, 40B) from the image input from the camera 22 (step B2). For example, the processor 20A extracts an image area corresponding to the identification image, and performs recognition processing on this image area based on the pattern of the identification members 40A and 40B.

FIG. 9 shows an example of an image input from the camera 22 in the first embodiment. In FIG. 9, an image of a region corresponding to one seat is shown. In FIG. 9, a region SA1 is a region corresponding to the vicinity of the position above the shoulders of the occupant, and a region SA2 is a region corresponding to the vicinity of the fixture for the seat.

The processor 20A detects the identification image 50 corresponding to the identification member 40A from the area SA1. Further, the processor 20A detects the identification image 52 corresponding to the identification member 40B from the area SA2. Note that FIG. 9 shows an example in which the identification members 40A and 40B having the pattern shown in FIG. 6A are used, and an identification image of a uniform pattern captured by near infrared light is included. ing. By detecting the identification image for the areas SA1 and SA2, the processing time can be shortened as compared with the case where the entire image is processed, and an image that does not correspond to the identification members 40A and 40B is less likely to be detected. False recognition of the identification image can be avoided.

When the identification area is detected (Yes in step B3), the processor 20A outputs the detection result that the seat belt is worn (step B4). It should be noted that the control unit 20 outputs the presence of the seat belt when at least the identification image corresponding to the identification member 40A is detected. However, when the identification images corresponding to both the identification members 40A and 40B are detected, the presence of the seat belt may be output.

When the presence of the seat belt is detected by the seat belt wearing detection process (Yes in step A3), the processor 20A causes the display device 28 to display information indicating that the seat belt of the seat is worn (step A4). In this case, the processor 20A executes the seatbelt wearing detection process (step A2) until the key is turned off (step A8, No), for example, at regular intervals (1 minute interval) (step A2). Make sure it is installed.

On the other hand, if the presence of the seat belt is not determined by the seat belt wearing detection process (step A3, No), that is, if the identification image is not detected from the image captured by the camera 22, the processor 20A displays the display device 28. In step S5, information indicating that the seat belt of the seat is not worn (not worn) is displayed. In this case, the processor 20A confirms whether the seat belt 4 is worn by executing the seat belt wearing process (step A2) until the key is turned off (step A8, No), for example, at regular intervals. To do. When the mounting is detected, the processor 20A causes the display device 28 to display the mounting as described above.

The processor 20A outputs an alarm for notifying that the seatbelt 4 is not worn when the traveling is started in a state where all the passengers are not wearing the seatbelt 4 (step A6, Yes). .. For example, the processor 20A causes the display device 28 to display information indicating an alarm and causes a speaker (not shown) to output an alarm sound.

After the traveling is started, the processor 20A continuously executes the seatbelt wearing detection processing, and continues to output the alarm until the wearing of the seatbelt 4 in all seats where the occupant is present is detected. The seatbelt wearing detection process during alarm output is executed at intervals (for example, one second intervals) shorter than a fixed period when the wearing is detected.

In the above description, one camera 22 captures one seat, but when one seat captures multiple (eg, two) cameras 22, multiple cameras 22 The seatbelt wearing detection process can be executed for one seat targeting the image captured by. In this case, for example, when it is determined that the seatbelt wearing condition is not detected as a result of the image captured by the first camera 22, the image captured by the second camera 22 is targeted. The seat belt wearing detection process is executed. As a result, when the identification image is detected, it is determined that the seat belt is worn. That is, the processing results for the images captured by the plurality of cameras 22 are combined to determine whether the seat belt is worn in one seat. This makes it possible to reliably determine whether or not the seat belt is worn.

In this way, the mounting detection device 10 according to the first embodiment does not use a mechanical method such as detecting the mounting of the tongue plate 45 and the buckle 46, but the passengers can be detected based on the image captured by the camera 22. It is possible to detect the wearing of the seat belt 4 in each seat. Further, the wearing detection device 10 determines whether or not there is a passenger in each seat based on the image captured by the camera 22. Therefore, it is not necessary to provide a weight sensor for detecting the presence or absence of an occupant in each seat and a mounting sensor for detecting mounting of the tongue plate 45 and the buckle 46. Therefore, it is not necessary to provide a cable for sending signals from the weight sensor and the mounting sensor to the mounting detection device 10, and the number of wirings in the vehicle can be reduced. In particular, the cable arranged from the seat does not become an obstacle because it can be moved largely like the second row seat 31.

(Second embodiment)
Next, a second embodiment will be described.
In the configuration of the first embodiment shown in FIG. 1, the control unit 20 inputs image data from a plurality of cameras 22 and the control unit 20 executes the seatbelt wearing detection process. In the second embodiment, the seat belt wearing detection process is executed in the camera unit, and the detection result is output to the control unit.

FIG. 10 is a block diagram showing the configuration of the attachment detection device 110 according to the second embodiment. The same parts as those in the configuration shown in FIG. 1 are designated by the same names, and detailed description thereof will be omitted.

In FIG. 10, for example, three camera units 122 (122A, 122B, 122C) are provided. The camera unit 122A has the same configuration as the camera units 122B and 122C.

The camera unit 122A has a detection circuit 120 and a camera 121. The camera 121 is configured similarly to the camera 22 in the first embodiment. That is, the camera 121 can capture an image with near infrared light, for example.

The detection circuit 120 can detect an identification image corresponding to a member that reflects light of a specific wavelength from the image captured by the camera 121. That is, the detection circuit 120 has a function of detecting an identification image similar to the control unit 20 in the first embodiment. The detection circuit 120 executes seat belt wearing detection processing based on the image from the camera 121.

When the detection circuit 120 detects the identification area, the detection circuit 120 outputs to the control unit 119 that the seat belt is worn as a detection result. In this case, the control unit 119 causes the display device 128 to display information indicating that the seat belt of the relevant seat is worn. On the other hand, when the detection circuit 120 does not detect the identification area, the control unit 119 causes the display device 128 to display information indicating that the seat belt of the relevant seat is not worn (not worn).

In this way, in the second embodiment, the camera unit 122 can be used as a seatbelt wearing detection sensor by providing the camera unit 122 with the detection circuit 120 that executes seatbelt wearing detection processing. Therefore, the existing ECU can be configured to input the signal from the camera unit 122 (indicating presence/absence of attachment detection) instead of the signal from the sensor that detects attachment of the tongue plate 45 and the buckle 46. ..

In the description of each of the above-described embodiments, an automobile provided with a seat belt (restraint device) is described as an example, but the present invention can be applied to other vehicles provided with a seat belt. For example, when a vehicle installed in an amusement facility is provided with a restraint device, the present invention can be applied to detection of wearing of the restraint device.

Further, in the above description of each embodiment, the result of detection of the seatbelt identification image by the control unit 20, that is, the determination result of seatbelt wearing is displayed on the display device. However, outputs other than the display device are displayed. A device may be used. For example, it is possible to output a sound from a speaker or generate a vibration by a vibration device such as a vibrator according to the result of detection of the identification image.

Further, although the seat belt 4 shown in FIGS. 3 and 4 is described by taking a three-point type seat belt as an example, the seat belt can be applied to, for example, a two-point type or a four-point type seat belt. In the case of a four-point type seat belt, the identification member provided on the strap is detected for each of the two straps that are pulled out from two locations, as described above. This makes it possible to detect whether each of the two straps is attached.

The method described in each of the above-described embodiments is used as a program (mounting detection program) that can be executed by a computer, such as a magnetic disk (flexible disk, hard disk, etc.), optical disk (CD-ROM, DVD, etc.), magneto-optical disk. It can also be distributed by storing it in a storage medium such as a disk (MO) or a semiconductor memory.

The storage medium may have any storage format as long as it can store a program and is readable by a computer.

Further, the storage medium in each embodiment is not limited to a medium independent of a computer, and includes a storage medium in which a program transmitted via a LAN, the Internet, etc. is downloaded and stored or temporarily stored.

Further, the number of storage media is not limited to one, and a case where the processing in each of the above-described embodiments is executed from a plurality of media is also included in the storage medium of the present invention, and the medium configuration may be any configuration.

The computer in each embodiment executes each process in each of the above-described embodiments based on a program stored in a storage medium. One computer, such as a personal computer, or a plurality of devices is a network. It may have any configuration such as a connected system.

In addition, the computer in each embodiment is a general term for equipment and devices that include an arithmetic processing unit, a microcomputer, and the like included in information processing equipment, and that can realize the functions of the present invention by a program.

Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the scope of equivalents thereof.

Claims (5)

A strap that is attached to restrain a passenger seated in a seat and has a strap that changes the exposed area when the passenger is seated and not seated, and the shoulder position of the passenger seated in the seat is provided. A restraint device in which an identification member is added to the first region pulled out to the second region and the second region in the vicinity of the fixture when mounted,
A photographing device for photographing an image including the strap of the restraint device;
A first identification image corresponding to the identification member is detected in the first area of the image from the image captured by the image capturing device, and a second identification image corresponding to the identification member is detected in the second area of the image. A mounting detection device including a control unit that detects an identification image and outputs a detection result indicating that the restraint device is mounted when both the first identification image and the second identification image are detected. The mounting detection device according to claim 1, wherein the identification member is formed with a specific pattern. A plurality of the seats and the restraint device are installed,
The identification member is configured in a specific pattern different for each of the plurality of restraint devices,
The photographing device photographs an image including a plurality of straps of the restraint device,
The control unit detects the first identification image and the second identification image for each of the plurality of restraint devices, and indicates the presence of the restraint device that detects both the first identification image and the second identification image. The mounting detection device according to claim 2, wherein the detection result is output. A strap that is attached to restrain a passenger seated in a seat and has a strap that changes the exposed area when the passenger is seated and not seated, and the shoulder position of the passenger seated in the seat is provided. An image capturing device for capturing an image of a specific wavelength light outside visible light, including the strap of the restraint device in which the identification member is added to the first region pulled out to the second region and the second region in the vicinity of the fixture at the time of mounting; ,
A first identification image corresponding to the identification member is detected in the first area of the image from the image captured by the image capturing device, and a second identification image corresponding to the identification member is detected in the second area of the image. A camera unit having a detection circuit that detects an identification image and outputs a detection result indicating that the restraint device is attached when both the first identification image and the second identification image are detected. Computer,
Provided with a strap whose exposed area changes between wearing and non-wearing, distinguishing between the first area pulled out to the position above the shoulder of the passenger seated in the seat and the second area near the fixture when wearing. A means for photographing an image of the restraint device to which the member is added by a photographing device;
A first identification image corresponding to the identification member is detected in the first area of the image from the image captured by the image capturing device, and a second identification image corresponding to the identification member is detected in the second area of the image. A mounting detection program for detecting an identification image and causing it to function as a means for outputting a detection result indicating that the restraint device is mounted when both the first identification image and the second identification image are detected.