JP4385973B2 - Car window management device - Google Patents

Description

  The present invention relates to a vehicle window management device that manages the state of a vehicle window that can be opened and closed in an automobile.

Conventionally, as this kind of vehicle window management device, for example, a device described in Patent Document 1 is known. FIG. 12 shows an outline of the apparatus described in Patent Document 1.
As shown in FIG. 12, the vehicle window management device includes a limit switch 100, an ignition switch 110, and an alarm device 120. Of these, the limit switch 100 is provided, for example, in a window glass storage portion, whether the window is in a closed state, that is, whether the window is in an open state (switch-on) or a closed state (switch-off). ) Is transmitted to the alarm device 120 as window opening / closing information (on / off information). The ignition switch 110 is a known switch for operating start and stop of an in-vehicle engine (not shown), and its switch state information (on / off information) is also transmitted to the alarm device 120. Based on the information transmitted to the alarm device 120, when the ignition switch 110 is in an off state (when the vehicle is stopped), information indicating the open state of the window from the limit switch 100 (switch on) It is a device that judges that the window has been forgotten to be closed on the condition that (information) is output, and warns the driver accordingly. By mounting such a vehicle window management device on a vehicle (automobile), inconveniences such as the driver forgetting to close the window when getting off the vehicle can be avoided.
Japanese Utility Model Publication No. 2-7162

  By the way, in the case of the above conventional vehicle window management device, although it is possible to avoid the inconvenience such as parking the vehicle with the window open, the driver notices that the window forgets to close the window by the alarm device. When the driver is forced to close the window by the driver's own operation, the device for managing the state of the vehicle window still leaves room for improvement. Moreover, in recent years, it has been desired to realize vehicle window management that allows the driver to concentrate on driving the vehicle even when the vehicle is running.

  The present invention has been made in view of such circumstances, and the purpose thereof is a vehicle window management device capable of realizing more appropriate automatic management related to opening and closing of windows according to the situation of each time a vehicle is placed. Is to provide.

In order to achieve such an object, according to the first aspect of the present invention, as a vehicle window management device that automatically manages the state of a vehicle window that can be opened and closed in an automobile, a change in the physical environment in which the vehicle is located is monitored. And a control unit that controls the state of the vehicle window according to a change in the monitored physical environment, and the monitoring unit captures an image in front of the vehicle from the passenger compartment. A vehicle front imaging device, and an image processing device that extracts a feature amount corresponding to a change in the physical environment from image information of an image captured through the vehicle front imaging device and detects a change in the physical environment, and The control means controls the state of the vehicle window based on the detected change in the physical environment so that the environment in the vehicle interior is maintained in a state suitable for the changed physical environment. The change in the physical environment detected through the monitoring means is detection of a large vehicle in front of the vehicle, and the control means fully closes the vehicle window based on detection of the large vehicle in front of the vehicle. We decided to control it.

According to such a configuration as the vehicle window management device, the situation of each time the vehicle is placed is monitored through the monitoring means, and more appropriate automatic management relating to opening and closing of the window according to the situation of each time is performed by the control means. It will be done through.
Further, in the above configuration, as the monitoring means, a vehicle front imaging device that captures an image in front of the vehicle from the passenger compartment and a change in the physical environment from image information of an image captured through the vehicle front imaging device. And an image processing device that detects changes in the physical environment and maintains the vehicle interior environment suitable for the changed physical environment based on the detected physical environment change. As described above, since the control means for controlling the state of the vehicle window is provided, it is easy to realize automatic management of the vehicle window that allows the driver to concentrate on driving the vehicle, particularly when the vehicle is traveling. .
In addition, in the above configuration, when the change in the physical environment detected through the monitoring unit is detection of a large vehicle in front of the vehicle, the control unit detects the large vehicle in front of the vehicle. Accordingly, the vehicle window is controlled to be fully closed, so that the exhaust gas of a large vehicle traveling in front of the vehicle is prevented from entering the vehicle compartment. That is, the air in the passenger compartment is kept clean.

In the vehicle window management device according to claim 1, in the invention according to claim 2, the vehicle interior imaging device that captures an image in the vicinity of the vehicle window that can be opened and closed from the vehicle interior as the monitoring means. When, along with further comprising an image processing device for detecting a change in the extracted and the physical environment feature amount corresponding to the change of the physical environment from the image information of the image captured through該車indoor imaging device, this is detected The control means for controlling the state of the vehicle window so that the environment in the vehicle interior is maintained in a state suitable for the changed physical environment based on a change in the physical environment. With such a configuration, it is also easy to realize automatic management of the vehicle window so that the driver can concentrate on driving the vehicle, particularly when the vehicle is traveling.

  Specifically, in the vehicle window management device according to claim 2, as in the invention according to claim 3, for example, the change in the physical environment detected through the monitoring means is the attachment of raindrops to the vehicle window. When the control means controls the vehicle window to be fully closed based on the detection of the attachment of the raindrop, for example, when the vehicle is running with the vehicle window opened, it suddenly starts raining. However, since the vehicle window is controlled to be fully closed by the control means, rain does not enter the vehicle interior.

  Further, in the vehicle window management device according to claim 2 or 3, when the change in the physical environment detected through the monitoring means is a transition from daytime to nighttime, for example, according to the invention according to claim 4, If the control means controls the vehicle window to be fully closed based on the detection of the shift to night, for example, the vehicle is stopped or parked with the vehicle window open at night. Is prevented in advance.

  Further, in the vehicle window management device according to any one of claims 2 to 4, for example, according to the invention according to claim 5, a change in a physical environment detected through the monitoring means is detected in the vicinity of the vehicle window. If the control means stops the control over the state of the vehicle window while the detection of the passenger in the vicinity of the vehicle window is maintained, for example, the passenger removes the hand from the window. While it is detected that the vehicle is being released, control over the state of the vehicle window is prohibited, so that the vehicle window can be managed in consideration of the safety of passengers.

In the vehicle window management device according to any one of claims 1 to 5, for example, according to the invention according to claim 6,
(A) The monitoring means further includes means for detecting a change in temperature in the vehicle interior as a change in the physical environment based on temperature information from a temperature sensor that measures the temperature in the vehicle interior, and the control means includes the detection The opening degree of the vehicle window is controlled in such a manner that a temperature rise in the vehicle interior is suppressed based on a change in the temperature in the vehicle interior.
Or, according to the invention of claim 7,
(B) The monitoring means includes a temperature difference between the outside and inside of the vehicle as a change in the physical environment based on temperature information from a temperature sensor that measures the temperature inside the vehicle and temperature information from a temperature sensor that measures the temperature outside the vehicle. change further comprising means for detecting the said control means controls the car window opening in a manner that temperature rise in the vehicle compartment based on a change in temperature difference between the vehicle cabin outer issued該検is suppressed.
Adopting such a configuration is also effective in keeping the temperature in the passenger compartment at an appropriate temperature.

  That is, according to the configuration of (a) above, for example, when the vehicle is parked under hot weather, the temperature rise in the passenger compartment is suitably suppressed, so that discomfort when the occupant gets into the vehicle can be reduced. become able to. Further, according to the configuration (b), the opening of the vehicle window is controlled based on the change in the temperature difference between the inside and outside of the vehicle interior, so that the temperature rise in the vehicle interior can be more accurately suppressed.

  Further, in the vehicle window management device according to any one of claims 1 to 7, as in the invention according to claim 8, the control means is configured such that the ignition switch of the vehicle is off. If the control related to the state of the vehicle window is executed as a condition, the above-described automatic management of the vehicle window is performed even when the vehicle is parked.

Further, in the vehicle window management device according to any one of claims 1 to 8 , for example, according to the invention according to claim 9 , a change in physical environment detected through the monitoring means is detected in front of the vehicle. When the tunnel is detected in front of the vehicle, the control means controls the vehicle window to be fully closed based on the detection of the tunnel in front of the vehicle. Intrusion into the room is prevented in advance, and a decrease in the temperature in the passenger compartment is also prevented. That is, the air in the passenger compartment is kept clean and temperature changes in the passenger compartment are suppressed.

Further, in the car window management apparatus according to any one of the claims 1-9, in the invention according to claim 1 0, while the control means, in a state in which the car window is open, its occupants It is further provided with a display means for displaying a warning to that effect. This makes it possible to call attention to the fact that the vehicle window is open while performing automatic management of the vehicle window.

  1 to 11 show an embodiment of a vehicle window management device according to the present invention. In this embodiment, as will be described in detail below, the vehicle interior imaging device that constitutes the monitoring means detects the attachment of raindrops to the vehicle window, the transition from daytime to nighttime, or passengers near the vehicle window, and The temperature sensor constituting the monitoring means measures the temperature inside the vehicle interior and the temperature outside the vehicle interior. Furthermore, the presence or absence of a large vehicle or a tunnel in front of the vehicle is detected by a vehicle front imaging device that also constitutes monitoring means. Then, by driving the window motor based on these detection results (monitoring results), appropriate automatic management relating to opening and closing of the window is realized according to the situation each time the vehicle is placed.

  First, the configuration of the vehicle window management apparatus according to this embodiment will be described with reference to FIGS. 1 and 2. FIG. 1A is a side view showing an outline of the configuration of the apparatus according to this embodiment, and FIG. 1B is an enlarged view of a part of FIG. FIG. FIG. 2 is a block diagram showing an electrical connection mode and signal flow between the components constituting the apparatus of this embodiment.

As shown in FIGS. 1 and 2, the window management device of this embodiment is largely
A case 12 provided between the front window 10 of the vehicle and a room mirror 11 provided in the passenger compartment, in contact with the front window 10 from the inside of the passenger compartment.
A vehicle interior imaging device 20 that captures an image in the vicinity of the vehicle window that is accommodated in the case 12 toward the vehicle interior and that can be opened and closed from the vehicle interior.
A vehicle forward imaging device 30 that is accommodated in the case 12 toward the front of the vehicle and captures an image in front of the vehicle from the passenger compartment.
A temperature sensor 40 that is disposed at a predetermined position of the vehicle and measures the temperature inside the vehicle compartment and the temperature outside the vehicle compartment.
An image processing unit (image processing device) 50a that extracts a feature amount corresponding to a change in the physical environment from image information captured through the vehicle interior imaging device 20 and the vehicle front imaging device 30, and detects the change in the physical environment.
A storage unit 50b that stores and holds information such as a master pattern necessary when the image processing unit 50a performs image processing.
Based on the change in the physical environment detected through the image processing unit 50a and the temperature sensor 40, the vehicle window 70 is passed through the window motor 60 so that the environment in the vehicle interior is maintained in a state compatible with the changed physical environment. Determination / control unit (control means) 50c for controlling the state of
-It is arranged at a predetermined position of the vehicle, receives window opening / closing information output from the microcomputer 50 (judgment / control unit 50c), and displays a warning to the passenger while the vehicle window 70 is open. Display device (display means) 80
And so on.

  Here, in this embodiment, a CCD (Charge Coupled Device) camera, for example, is employed as the vehicle interior imaging device 20 and the vehicle front imaging device 30. Among these, the vehicle interior imaging device 20 includes a lens, a CCD, and the like therein, and the depth of focus is set to about 1 m, for example. That is, on the CCD of the vehicle interior imaging device 20, the scenery outside the vehicle window 70 (that is, outside the vehicle) is not imaged, but raindrops adhering to the vehicle window 70, passengers existing in the vicinity of the vehicle window 70, and a half-open state An image such as an upper end portion of a certain car window 70 is mainly formed. And this vehicle interior imaging device 20 is outputting this imaged image information to the microcomputer 50 (image processing part 50a) as vehicle interior image IMG1. On the other hand, like the vehicle interior image pickup device 20, the vehicle front image pickup device 30 also includes a lens, a CCD, and the like therein, and its focal length is set to infinity, for example. In other words, dirt and raindrops on the front window 10 are not imaged on the CCD of the vehicle front imaging device 30, and an image of a large vehicle such as a tunnel or a truck that exists in front of the vehicle is mainly formed. I am trying to be imaged. The vehicle front imaging device 30 outputs the image information formed in this way to the microcomputer 50 (image processing unit 50a) as a vehicle front image IMG2. The vehicle interior imaging device 20 and the vehicle front imaging device 30 are respectively based on feature amounts corresponding to changes in the physical environment in the vehicle interior image IMG1 and the vehicle front image IMG2 obtained as described above. It has a sufficient resolution that each physical quantity can be detected.

On the other hand, as described above, the image processing unit 50a is based on the vehicle interior image IMG1 input from the vehicle interior imaging device 20, and
(A1) Raindrops attached to the vehicle window 70.
(A2) A passenger near the vehicle window 70.
(A3) The upper end portion of the vehicle window 70 in the half-open state.
(A4) Transition from daytime to nighttime.
Etc., and various flags are set or canceled according to the detection results.

  Among these, when detecting the above (A1) to (A3), the vehicle interior image IMG1 input from the vehicle interior imaging device 20 is subjected to, for example, the outline of raindrops in the image through a Laplacian filter, etc. The contour and the contour of the upper end of the vehicle window 70 in the half-open state are extracted, and the extracted contour is further converted into a binarized image. Then, each detection is performed by performing pattern matching based on a comparison between each feature amount in the binarized image and a master pattern stored and held in the storage unit 50b built in the microcomputer 50 itself. .

  FIG. 3A shows an example of an original image captured by the vehicle interior imaging device 20 in a state where raindrops are attached to the vehicle window 70, and FIG. 3B shows through the image processing unit 50 a. An example of the binarized image processed and binarized as described above is shown. In the detection of (A1), when raindrops W are attached to the vehicle window 70, as a feature amount corresponding to a change in the physical environment, a black dot is displayed in the binarized image IMG11b as shown in FIG. Is extracted. Therefore, it is determined whether or not raindrops W are attached to the vehicle window 70 through pattern matching based on comparison with the master pattern stored and held in the previous storage unit 50b. Based on the determination result, the rain flag is set or canceled.

  4A shows an example of an original image captured by the vehicle interior imaging device 20 when an occupant is present in the vicinity of the vehicle window 70 when the vehicle window 70 is in a half-open state. ) Shows an example of a binarized image processed and binarized as described above through the image processing unit 50a. In the detection of (A2) above, when the occupant H is present in the vicinity of the vehicle window 70, the feature value corresponding to the change in the physical environment is included in the binarized image IMG12b as shown in FIG. 4B. A curve is extracted. Therefore, an occupant existing in the vicinity of the vehicle window 70 is detected through pattern matching based on comparison with the master pattern stored and held in the previous storage unit 50b. That is, when a curve is extracted in the binarized image IMG12b, it is determined that there is an occupant H present near the vehicle window 70. Conversely, when a curve is not extracted, it is determined that there is no occupant H present near the vehicle window 70. Based on the determination result, the person detection flag is set or canceled.

  In the detection of (A3), when the vehicle window 70 is in a half-open state, a straight line is displayed in the binarized image IMG12b in the form shown in FIG. 4B as a feature amount corresponding to a change in the physical environment. Extracted. Therefore, it is detected whether or not the vehicle window 70 is in a half-open state through pattern matching based on comparison with the master pattern stored and held in the storage unit 50b in addition to detection of the presence or absence of the previous passenger. When a straight line is extracted, the opening degree of the vehicle window 70 is also detected based on the position in the binarized image IMG12b from which the straight line is extracted. That is, it is determined that the opening degree of the vehicle window 70 is small when a straight line is detected in the upper part of the window frame, and conversely, the opening degree of the vehicle window 70 is determined to be large when a straight line is detected in the lower part of the window frame. Based on the determination result, the window opening flag is set when the vehicle window 70 is in the half-open state, and the window opening flag is canceled when the vehicle window 70 is fully closed.

  In the detection of the above (A4), the sum of the luminance of each pixel of the vehicle interior image IMG1 input from the vehicle interior imaging device 20 to the image processing unit 50a is calculated, and the light amount is detected based on this sum. I do. That is, when the sum of the brightness of each pixel is smaller than the predetermined threshold, it is determined that it is nighttime, and the night flag is set. Conversely, when the sum of the brightness of the pixels is greater than the predetermined threshold, it is determined that it is daytime. Then cancel the night flag.

On the other hand, as described above, the image processing unit 50a is based on the vehicle front image IMG2 input from the vehicle front image pickup device 30.
(B1) A large vehicle existing in front of the vehicle.
(B2) A tunnel existing in front of the vehicle.
Etc., and various flags are set or canceled according to the detection results.

  Also in the detection of the above (B1) and (B2), for example, a Laplacian filter or the like is applied to the vehicle front image IMG2 input from the vehicle front imaging device 30 as in the detection of (A1) to (A3) above. To extract the outline of the large vehicle and the outline of the tunnel in the front image of the vehicle, and further convert the extracted outline into a binarized image. Then, pattern matching is performed based on a comparison between the feature amount corresponding to each change in the physical environment in the binarized image and the master pattern stored and held in the storage unit 50b built in the microcomputer 50 itself. Thus, each detection is performed.

  FIG. 5A shows an example of an original image of a large vehicle (for example, a truck) and a passenger car obtained through the vehicle front imaging device 30, and FIG. 5B is binarized by the image processing unit 50a. An example of the binarized image obtained is shown. As shown in FIGS. 5A and 5B, the large vehicle Tr tends to have a higher vehicle height and a larger aspect ratio than the passenger car C. Therefore, in the detection of (B1) above, when a large vehicle is present in front of the vehicle, the feature value corresponding to the change in the physical environment is included in the binarized image IMG21b in the form shown in FIG. 5B. A rectangle with a large aspect ratio is extracted. Therefore, it is determined whether or not there is a large vehicle ahead of the vehicle through pattern matching based on comparison with the master pattern stored and held in the previous storage unit 50b. That is, when the aspect ratio of the rectangle extracted in this way is larger than a predetermined aspect ratio, it is determined that the vehicle is a large vehicle, and a large vehicle detection flag is set. And the large vehicle detection flag is canceled.

  FIG. 6A shows an example of an original image of a tunnel obtained through the vehicle forward imaging device 30, and FIG. 6B shows a binary image processed by the image processing unit 50a as described above. An example of the digitized image is shown. As shown in FIG. 6B, the tunnel Tu has a semicircular shape, and the inside (that is, the front of the vehicle) tends to be dark. Therefore, at the time of detection of (B2) above, when a tunnel is present in front of the vehicle, as a feature amount corresponding to a change in the physical environment, the inside of the binarized image IMG22b in the form shown in FIG. A semicircle with a small luminance is extracted. Therefore, it is determined whether or not there is a tunnel ahead of the vehicle through pattern matching based on the comparison with the master pattern stored and held in the previous storage unit 50b. That is, when the inside of the semicircle extracted in this way is smaller than a predetermined luminance, it is determined that the tunnel is a tunnel, and a tunnel detection flag is set. Cancel the tunnel detection flag.

Based on the various detection results detected as described above and the temperature measured by the temperature sensor 40, the determination / control unit 50c
(C1) Control for fully closing the vehicle window 70 through the driving of the window motor 60 based on the detection of the attachment of raindrops on the vehicle window 70.
(C2) Control for fully closing the vehicle window 70 through driving of the window motor 60 based on detection of transition from daytime to nighttime.
(C3) Stop of control related to the state of the vehicle window 70 while occupant detection in the vicinity of the vehicle window 70 is maintained.
(C4) Control of the opening degree of the vehicle window 70 in a mode in which a temperature increase in the vehicle interior is suppressed based on a change in temperature difference between the vehicle interior and exterior detected through the temperature sensor 40.
(C5) Control for fully closing the vehicle window 70 through driving of the window motor 60 based on the detection of a large vehicle in front of the vehicle.
(C6) Control for fully closing the vehicle window 70 through driving of the window motor 60 based on the detection of a tunnel in front of the vehicle.
And so on.

  Among these processes, in the control for controlling the vehicle window 70 to be fully closed through the driving of the window motor 60 based on the detection of the attachment of raindrops on the vehicle window 70 (the control in (C1) above), first, The detection of (A1) detects the attachment of raindrops on the car window 70. When raindrops are detected, the vehicle window 70 is automatically closed by driving the window motor 60 in order to prevent the vehicle interior from being exposed to rain.

  Further, in the control (the control of (C2) described above) in which the vehicle window 70 is fully closed through the driving of the window motor 60 based on the detection of the transition from daytime to nighttime, the detection of (A4) is first performed. Detects the transition from daytime to nighttime. When the shift to the nighttime is detected, the vehicle window 70 is automatically closed by driving the window motor 60 from the viewpoint of crime prevention.

  Furthermore, when stopping the control of the state of the vehicle window 70 while the detection of the occupant in the vicinity of the vehicle window 70 is stopped (stop of (C3) above), first, in the vicinity of the vehicle window 70 by the detection of (A2) above. The presence or absence of a passenger is detected. And when a passenger | crew is detected, the control concerning the state of the vehicle window 70 is stopped by forcibly stopping the drive of the window motor 60 for safety of a passenger | crew.

  In the control of the opening degree of the vehicle window 70 (control of the above (C4)) in a mode in which the temperature rise in the vehicle interior is suppressed based on the change in the temperature difference between the vehicle interior and exterior detected through the temperature sensor 40, first, The temperature in the passenger compartment is measured through the temperature sensor 40. Based on the change in the temperature difference between the vehicle interior and the exterior detected through the temperature sensor 40 and the detection of (A3), the vehicle window 70 is controlled to an appropriate opening degree by driving the window motor 60. Specifically, when the vehicle interior temperature is high and the vehicle exterior temperature is low, the window motor 60 is driven to increase the opening of the vehicle window 70, and when there is almost no temperature difference between the vehicle interior and the interior, The opening degree of the vehicle window 70 is maintained without driving the window motor 60. Further, when the vehicle interior temperature is high and the vehicle interior temperature is higher than the vehicle interior temperature, the window motor 60 is driven to reduce the opening of the vehicle window 70 in order to prevent inflow of air from outside the vehicle interior to the vehicle interior. Make it smaller.

  On the other hand, in the control for fully closing the vehicle window 70 through the driving of the window motor 60 based on the detection of a large vehicle in front of the vehicle (the control in (C5) above), first, the detection in (B1) above is performed. To detect a large vehicle in front of the vehicle. When a large vehicle is detected, the vehicle window 70 is controlled to be fully closed through driving of the window motor 60 in order to prevent the exhaust gas from entering the vehicle interior and keep the air in the vehicle interior clean.

  Further, in the control for fully closing the vehicle window 70 by driving the window motor 60 based on the detection of the tunnel in front of the vehicle (the control in (C6) above), first, the detection in (B2) above is performed. Detect the tunnel ahead of the vehicle. When a tunnel is detected, the vehicle window 70 is controlled to be fully closed through the driving of the window motor 60 in order to prevent the exhaust gas trapped in the tunnel from entering the vehicle interior and keep the air in the vehicle interior clean. To do.

  FIGS. 7 to 11 show the processing procedure for the vehicle window control executed through the microcomputer 50. Hereinafter, the vehicle window control of this embodiment will be described with reference to FIGS. This process will be described in detail.

  In the window management apparatus of this embodiment, as shown in FIG. 7, it is first determined in step S10 whether or not an ignition switch (not shown) is off. If it is determined that the ignition is off, the process proceeds to the stoppage process shown in FIG. 8 as the process of step S20 regardless of whether or not an occupant is on the vehicle. On the other hand, when it is determined that the ignition is on, the process proceeds to the running process shown in FIG. 10 as the process of step S30. Then, after each of the stopping process and the running process is finished, the process related to the vehicle window control is once finished. In addition, the process concerning this vehicle window control is repeatedly performed, for example in "33 milliseconds".

  As shown in FIG. 8, at the start of the stop-in process, first, as the process of step S201, the vehicle interior image IMG1 obtained through the previous vehicle interior imaging device 20 is taken into the microcomputer 50, and this captured vehicle For the indoor image IMG1, the image processing of the vehicle interior image IMG1 shown in FIG.

  That is, as shown in FIG. 9, in the image processing of the vehicle interior image IMG1 by the image processing unit 50a, first, as a process of step S401, for example, through a Laplacian filter etc. The opening degree of 70 and the outline of raindrops attached to the vehicle window 70 are extracted. In step S402, the extracted contour is converted into a binarized image, and these detection target features are extracted in step S403.

  After each feature is extracted, it is determined whether or not a human body has been detected in the vicinity of the vehicle window as a process of step S404. Specifically, as described above, when an occupant is present in the vicinity of the vehicle window 70, a curve is extracted from the binarized image as a feature amount corresponding to a change in the physical environment. That is, when a curve is extracted from the binarized image, it is determined that an occupant is present in the vicinity of the vehicle window, and the person detection flag Fm is set as the process of step S405. On the other hand, if no curve is extracted from the binarized image, it is determined that no occupant is present in the vicinity of the vehicle window, and the human detection flag Fm is reset as the process of step S406.

  In the subsequent step S407, it is determined whether or not the vehicle window is open. Specifically, as described above, when the vehicle window is open, a straight line is extracted from the binarized image as a feature amount corresponding to the change in the physical environment. That is, when a straight line is extracted from the binarized image, it is determined that the vehicle window is open, and the window opening flag Fwo is set as the process of step S408. On the other hand, when a straight line is not extracted from the binarized image, it is determined that the vehicle window is not open, and the window opening flag Fwo is reset as a process of step S409.

  Further, it is determined whether or not raindrops are attached as the process of step S410. Specifically, as described above, when raindrops are attached, black spots are extracted from the binarized image as feature amounts corresponding to changes in the physical environment. That is, when a black dot is extracted from the binarized image, it is determined that raindrops are attached, and the rain detection flag Fr is set as the process of step S411. On the other hand, if no black spot is extracted from the binarized image, it is determined that no raindrop is attached, and the rain detection flag Fr is reset as the process of step S412.

  Note that it is determined whether or not a shift from daytime to nighttime has occurred through the processing in step S413 and the processing in step S414. Specifically, as described above, as the processing in step S413, the sum of the luminances of the pixels in the vehicle interior image IMG1 input from the vehicle interior imaging device 20 is calculated. In step S414, it is determined whether the total luminance of each pixel is smaller than a predetermined threshold value. If the sum of the luminance of each pixel is smaller than a predetermined threshold, it is determined that it is nighttime, and the nighttime flag Fn is set as the processing of step S415. On the other hand, when the sum of the luminances of the respective pixels is larger than a predetermined threshold value, it is determined that it is daytime, and the nighttime flag Fn is reset as processing of step S416. After setting various flags in this way, the process proceeds to the process of step S202 shown in FIG.

  In step S202, it is determined whether the person detection flag Fm is set. If the person detection flag Fm is set, an occupant is present near the vehicle window 70. This is when there is a risk of taking a hand out of the vehicle. Therefore, as the process of step S203, the control of the state of the vehicle window 70 is stopped by stopping the driving of the window motor 60.

  If the human detection flag Fm is not set in the process of step S202, the process proceeds to the subsequent step S204. In step S204, it is determined whether the window opening flag Fwo is set. When the window opening flag Fwo is set, it is determined whether or not the rain detection flag Fr is set as the process of step S205. When the rain detection flag Fr is set, that is, since the window is open despite rain, the vehicle window 70 is fully closed as a process of step S206. On the other hand, even when the rain detection flag Fr is not set, when the night flag Fn is set in the process of step S207, that is, it is not raining but it is night and the window is open. Therefore, from the viewpoint of crime prevention, the vehicle window 70 is also fully closed in the process of step S206.

  On the other hand, if the window opening flag Fwo is not set (fully closed) in the process of the previous step S204, or the nighttime flag Fn is not set in the process of the previous step S207 (it is not raining in the daytime) ), The opening degree of the vehicle window 70 is controlled in such a manner that the temperature increase in the passenger compartment is suppressed through the subsequent steps S208 to S211.

  That is, as a process in step S208, the vehicle interior temperature TH measured through the temperature sensor 40 is taken, and in a subsequent step S209, whether the vehicle interior temperature TH is greater than a predetermined temperature threshold Thr (for example, 40 degrees). Is judged. Here, if it is determined that the vehicle interior temperature TH is smaller than the temperature threshold Thr, it is determined that control of the opening degree of the vehicle window 70 is unnecessary, and the processing during the stoppage and thus the processing related to the vehicle window control is performed. Exit once. On the other hand, when it is determined that the vehicle interior temperature TH is higher than the temperature threshold Thr, it is determined that the opening degree of the vehicle window 70 needs to be controlled, and the process proceeds to the subsequent step S210.

  In the process of step S210, the opening degree of the vehicle window 70 is controlled based on a change in the temperature difference between the vehicle interior and the exterior detected through the temperature sensor 40. That is, when the vehicle interior temperature is high and the vehicle exterior temperature is low, the window motor 60 is driven to increase the opening of the vehicle window 70, and when there is almost no temperature difference between the vehicle interior and exterior, the window motor 60 is The opening of the vehicle window 70 is maintained without being driven. Further, when the vehicle interior temperature is high and the vehicle interior temperature is higher than the vehicle interior temperature, the window motor 60 is driven to reduce the opening of the vehicle window 70 in order to prevent inflow of air from outside the vehicle interior to the vehicle interior. Make it smaller. At this time, as a process of step S211, a warning is displayed to the passenger through the display device 80 while the vehicle window is open. Then, the stop process and the process related to the vehicle window control are temporarily terminated.

  On the other hand, if it is determined in step S10 in FIG. 7 that the ignition switch is on, the process proceeds to the running process shown in FIG. This running process will be described with reference to FIG.

  At the start of the running process, as a process of step S301, the vehicle interior image IMG1 obtained through the vehicle interior image pickup device 20 and the vehicle front image IMG2 obtained through the vehicle front image pickup device 30 are stored in the image processing unit 50a. take in. Based on the vehicle interior image IMG1 among these images, through the image processing of the previous step S40, various flags such as the human detection flag Fm, the window opening flag Fwo, the rainfall detection flag Fr, and the nighttime flag Fn are set or released. Execute. Then, as the processing of subsequent step S50, the image processing of the vehicle front image IMG2 shown in FIG. 11 is executed.

  That is, as shown in FIG. 11, in the image processing of the vehicle front image IMG2 by the image processing unit 50a, first, as a process in step S501, for example, a large vehicle and a tunnel existing in front of the vehicle through a Laplacian filter or the like. Extract the outline of. In step S502, the extracted contour is converted into a binarized image. In step S503, feature amounts corresponding to changes in the physical environment are extracted.

  After the feature amount is extracted, it is determined in step S504 whether or not there is a large vehicle in front of the vehicle. Specifically, as described above, when a large vehicle Tr is present in front of the vehicle, a rectangle having a large aspect ratio is extracted from the binarized image as a feature amount corresponding to the change in the physical environment. The That is, when a rectangle larger than a predetermined aspect ratio is extracted from the binarized image, a large vehicle is traveling in front of the vehicle, and thus the large vehicle detection flag Ftr is set as the process of step S505. On the other hand, if a rectangle is not extracted from the binarized image, or if a rectangle smaller than the predetermined aspect ratio is extracted even if the rectangle is extracted, it is a normal passenger car that exists in front of the vehicle. As a process of S506, the large vehicle detection flag Ftr is reset.

  In step S507, it is determined whether a tunnel exists in front of the vehicle. Specifically, as described above, when the tunnel Tu exists in front of the vehicle, a semicircle is extracted from the binarized image as a feature amount corresponding to a change in the physical environment. That is, when a semicircle is extracted from the binarized image, a tunnel exists in front of the vehicle. Therefore, the tunnel detection flag Ftu is set as the process of step S508. On the other hand, if a semicircle is not extracted from the binarized image, or if the semicircle is extracted but the internal brightness is high, there is no tunnel in front of the vehicle, so the tunnel detection flag Ftu is processed as step S509. To reset.

After various flags are thus set based on the determination based on the vehicle front image IMG2, the process proceeds to step S302 in the running process shown in FIG.
In the process of step S302, it is determined whether or not the window opening flag Fwo is set. If the window opening flag Fwo is not set, the running process is unconditionally terminated, and the process related to the vehicle window control is temporarily ended.

  On the other hand, when the window opening flag Fwo is set, vehicle window management that allows the driver to concentrate on driving the vehicle is achieved through the processing of subsequent steps S303 to S307.

  That is, whether or not the rain detection flag Fr is set as the process of step S303, whether or not the large vehicle detection flag Ftr is set as the process of subsequent step S304, and further the tunnel detection flag Ftu is set as the process of step S305. It is determined whether or not it has been done. If any one of the rain detection flag Fr, the large vehicle detection flag Ftr, and the tunnel detection flag Ftu is set, the vehicle window 70 is fully closed as a process of step S306. On the other hand, when none of the rain detection flag Fr, the large vehicle detection flag Ftr, and the tunnel detection flag Ftu is set, as a process in step S307, while the vehicle window is open, A warning is displayed to the passenger. Then, the stop process and the process related to the vehicle window control are temporarily terminated.

As described above, according to the window management device according to this embodiment, many excellent effects listed below can be obtained.
(1) As a monitoring means for monitoring a change in a physical environment where the vehicle is located, a vehicle interior imaging device 20 that captures an image near the vehicle window, a vehicle front imaging device 30 that captures an image in front of the vehicle, and these An image processing unit 50a that detects a change in the physical environment by extracting a feature amount corresponding to the change in the physical environment from the image information of the image captured through the imaging device is provided. Further, as a control means, based on the detected change in the physical environment, a judgment / control unit 50c for controlling the state of the vehicle window 70 so that the environment in the vehicle interior is maintained in a state suitable for the changed physical environment. I decided to prepare. As a result, the situation of each time the vehicle is placed is monitored through the monitoring means, and more appropriate automatic management regarding the opening and closing of the window according to the situation of each time is performed through the determination / control unit 50c. In addition, it is easy to realize automatic management of the vehicle window so that the driver can concentrate on driving the vehicle, particularly while the vehicle is running.

  (2) Based on the detection of the attachment of raindrops to the vehicle window 70 through the vehicle interior imaging device 20, the control for fully closing the vehicle window 70 through the driving of the window motor 60 is executed. Thus, for example, even if sudden rain starts when the vehicle window is opened, the window 70 is controlled to be fully closed by the window motor 60, so that rain does not enter the vehicle interior. It becomes like this.

  (3) Based on the detection of the transition from daytime to nighttime through the vehicle interior imaging device 20, control for fully closing the vehicle window 70 through the driving of the window motor 60 is executed. As a result, for example, the vehicle can be prevented from being parked or parked at night with the car window open.

  (4) While the detection of an occupant in the vicinity of the vehicle window 70 is maintained through the vehicle interior imaging device 20, the control relating to the state of the vehicle window 70 is stopped. As a result, for example, while detecting that an occupant has taken a hand out of the window, control of the state of the vehicle window is stopped, so the vehicle window can be managed in consideration of the safety of the occupant. become able to.

  (5) Based on the change in the temperature difference between the vehicle interior and the exterior detected through the temperature sensor 40, the opening degree of the vehicle window 70 is controlled in such a manner that the temperature increase in the vehicle interior is suppressed. Thereby, for example, when the vehicle is parked under hot weather, the temperature rise in the passenger compartment is accurately suppressed, so that discomfort when an occupant gets into the vehicle can be reduced.

  (6) The control related to the state of the vehicle window 70 is executed on condition that the ignition switch of the vehicle is off. Thereby, even when the vehicle is parked, the above-described automatic management of the vehicle window is performed.

  (7) Based on the fact that a large vehicle is detected in front of the vehicle through the vehicle front imaging device 30, control is performed to fully close the vehicle window 70 by driving the window motor 60. As a result, the exhaust gas of a large vehicle traveling in front of the vehicle is prevented from entering the vehicle compartment, and the air in the vehicle compartment is kept clean.

  (8) Based on the fact that a tunnel is detected in front of the vehicle through the vehicle front imaging device 30, the control for fully closing the vehicle window 70 through the driving of the window motor 60 is executed. As a result, the exhaust gas confined in the tunnel is prevented from entering the passenger compartment, and the temperature in the passenger compartment is prevented from decreasing. That is, this also keeps the air in the passenger compartment clean and suppresses temperature changes in the passenger compartment.

  (9) While the vehicle window 70 is in an open state, the display device 80 that displays a warning to the passenger is provided. As a result, it is possible to alert the occupant that the vehicle window is open.

  Note that the vehicle window management device according to the present invention is not limited to the configuration exemplified in the above-described embodiment, and can be implemented as, for example, the following form in which the embodiment is appropriately changed.

  In the above embodiment, as the process in step S211 in the previous stop process in FIG. 8 or the process in step S307 in the previous travel process in FIG. 10, while the vehicle window 70 is in the open state, Although the display device 80 that displays a warning to that effect is provided, a configuration in which these processes are omitted may be employed. Alternatively, the vehicle may further include a door sensor and a buzzer, and the vehicle window 70 is open, and the door sensor detects that the door is opened, and the passenger is warned to that effect through the buzzer. Even with the changed configuration, it is possible to obtain an effect according to the effect of the above (9).

  In the above-described embodiment, the vehicle window 70 is driven through the driving of the window motor 60 based on the fact that the tunnel is detected in front of the vehicle through the vehicle front imaging device 30 as the processing in step S305 in the traveling processing of FIG. However, this may be omitted. Also by this, the effect according to the effect of said (1) can be acquired.

  In the above embodiment, as the processing in step S304 in the above-described traveling process of FIG. 10, the vehicle window is driven through the driving of the window motor 60 based on the fact that a large vehicle is detected in front of the vehicle through the vehicle front imaging device 30. Although the control is executed to fully close 70, this may be omitted. Also by this, the effect according to the effect of said (1) can be acquired.

  In the above embodiment, as the process of step S10 in the vehicle window control process of FIG. 7, the control related to the state of the vehicle window 70 is executed on condition that the ignition switch of the vehicle is turned off. However, the present invention is not limited to this. That is, instead of this, the control for the state of the vehicle window 70 may be executed on condition that it is detected that there is no passenger in the vehicle interior through the vehicle interior imaging device 20 or other sensors. The effect according to the effect of can be obtained.

  In the above embodiment, the temperature increase in the vehicle interior is suppressed based on the change in the temperature difference between the vehicle interior and the exterior detected through the temperature sensor 40 as the processing in steps S208 to S210 in the previous stop processing of FIG. However, the present invention is not limited to this. That is, instead of this, by providing predetermined temperature thresholds in a plurality of stages with respect to changes in the temperature in the vehicle interior detected through the temperature sensor 40, the opening of the vehicle window 70 is controlled in a manner that suppresses an increase in the temperature in the vehicle interior. Even in the configuration in which the degree control is executed, it is possible to obtain an effect according to the effect (5).

  In the above embodiment, as the process of step S202 in the previous stop process of FIG. 8, while the detection of the occupant in the vicinity of the vehicle window 70 is maintained through the vehicle interior image pickup device 20, the control relating to the state of the vehicle window 70 is performed. However, this may be omitted. Also by this, the effect according to the effect of said (1) can be acquired.

  In the above embodiment, the vehicle window is driven through the driving of the window motor 60 based on the fact that the transition from daytime to nighttime is detected through the vehicle interior imaging device 20 as the processing in step S207 in the stopping processing of FIG. Although the control is executed to fully close 70, this may be omitted. Also by this, the effect according to the effect of said (1) can be acquired.

  In the above embodiment, as the processing of step S205 in the stopping processing of FIG. 8 above, the attachment of raindrops on the vehicle window 70 is detected through the vehicle interior imaging device 20, and the window motor 60 is driven. Although the configuration is such that the control for fully closing the vehicle window 70 is performed, a configuration in which this is omitted may be employed. Also by this, the effect according to the effect of said (1) can be acquired.

BRIEF DESCRIPTION OF THE DRAWINGS (a) is a side view which shows typically the structure of the whole about one Embodiment of the vehicle window management apparatus concerning this invention from a side surface direction. (B) is a side view showing (a) in an enlarged manner with the imaging device as the center. The block diagram which shows the flow of the electrical signal between the structure and each element about the vehicle window management apparatus of the embodiment. (A) And (b) is a figure which shows an example of the original image of the raindrop imaged with the vehicle interior imaging device of the embodiment, and its binarized image. (A) And (b) is a figure which shows an example of the original image of the passenger | crew's hand of the vehicle window vicinity imaged with the vehicle interior imaging device of the embodiment, and its binarized image. (A) And (b) is a figure which shows an example of the original image of the large vehicle and passenger car imaged with the vehicle front imaging device of the embodiment, and its binarized image. (A) And (b) is a figure which shows an example of the original image and binarized image of a tunnel imaged with the vehicle front imaging device of the embodiment. The flowchart which shows the process sequence about the vehicle window control by the vehicle window management apparatus of the embodiment. The flowchart which shows the process sequence about the process in the time of the stop of the vehicle by the vehicle window management apparatus of the embodiment. The flowchart which shows the process sequence about the image process of the image imaged through the vehicle interior imaging device employ | adopted with the vehicle window management apparatus of the embodiment. The flowchart which shows the process sequence about the process in driving | running | working of the vehicle by the vehicle window management apparatus of the embodiment. The flowchart which shows the process sequence about the image processing of the image imaged through the vehicle front imaging device employ | adopted with the vehicle window management apparatus of the embodiment. The block diagram which shows the flow of the signal between each component about an example of the conventional vehicle window management apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Front window, 11 ... Room mirror, 12 ... Case, 20 ... Vehicle interior imaging device (monitoring means), 30 ... Vehicle front imaging device (monitoring means), 40 ... Temperature sensor (monitoring means), 50 ... Microcomputer, DESCRIPTION OF SYMBOLS 50a ... Image processing part (image processing apparatus), 50b ... Memory | storage part, 50c ... Judgment / control part (control means), 60 ... Motor for windows, 70 ... Car window, 80 ... Display apparatus, 100 ... Limit switch, 110 ... Ignition Switch, 120 ... alarm device.

Claims (10)

A vehicle window management device that automatically manages the state of a vehicle window that is provided in a car that can be opened and closed,
Monitoring means for monitoring a change in a physical environment where the vehicle is located, and a control means for controlling the state of the vehicle window according to the change in the monitored physical environment ,
The monitoring means extracts a feature amount corresponding to a change in the physical environment from a vehicle front imaging device that captures an image in front of the vehicle from a vehicle interior and image information of an image captured through the vehicle front imaging device. And an image processing device for detecting a change in the physical environment, and the control means is configured to maintain the environment in the vehicle interior in a state suitable for the changed physical environment based on the detected change in the physical environment. And controlling the state of the vehicle window,
The change in the physical environment detected through the monitoring means is detection of a large vehicle in front of the vehicle, and the control means fully closes the vehicle window based on detection of the large vehicle in front of the vehicle. A vehicle window management device characterized in that the vehicle window management device is controlled . The monitoring means responds to a change in the physical environment from a vehicle interior imaging device that captures an image in the vicinity of the vehicle window that can be opened and closed from a vehicle interior, and image information of an image captured through the vehicle interior imaging device. further comprising an image processing device for detecting a change in the extracted and the physical environment feature amount, the control means, based on a change in the physical environment that this is detected, the physical environment in which the vehicle interior environment is said change The vehicle window management device according to claim 1, wherein a state of the vehicle window is controlled so as to be maintained in a compatible state. The change in the physical environment detected through the monitoring means is attachment of raindrops to the vehicle window, and the control means controls the vehicle window to be fully closed based on detection of attachment of the raindrops. Vehicle window management device as described in 4. The change in the physical environment detected through the monitoring unit is a transition from daytime to nighttime, and the control unit controls the vehicle window to be fully closed based on detection of the transition to nighttime. Or the vehicle window management apparatus of 3. The change in the physical environment detected through the monitoring means is detection of an occupant in the vicinity of the vehicle window, and the control means performs control related to the state of the vehicle window while the detection of the occupant in the vicinity of the vehicle window is maintained. The vehicle window management device according to any one of claims 2 to 4. The monitoring means further includes means for detecting a change in the temperature in the vehicle interior as a change in the physical environment based on temperature information from a temperature sensor that measures the temperature in the vehicle interior, and the control means detects the detected vehicle. The vehicle window management device according to any one of claims 1 to 5, wherein the opening degree of the vehicle window is controlled in a manner in which a temperature increase in the vehicle interior is suppressed based on a change in the temperature of the vehicle interior. The monitoring means detects a change in temperature difference between the vehicle interior and the exterior as a change in the physical environment based on temperature information from a temperature sensor that measures the temperature inside the vehicle interior and temperature information from a temperature sensor that measures the temperature outside the vehicle interior. 6. The apparatus according to claim 1, further comprising detecting means, wherein the control means controls the opening of the vehicle window in such a manner that an increase in temperature in the vehicle interior is suppressed based on the detected change in temperature difference between the vehicle interior and exterior. The vehicle window management device according to any one of the above. The vehicle window management device according to any one of claims 1 to 7, wherein the control unit performs control related to a state of the vehicle window on condition that an ignition switch of the vehicle is turned off. The change in the physical environment detected through the monitoring means is detection of a tunnel in front of the vehicle , and the control means controls the vehicle window to be fully closed based on detection of a tunnel in front of the vehicle. The vehicle window management device according to any one of claims 1 to 8. Before SL control means, while in the state before Symbol car window is open, the car window management apparatus according to any one of claims 1 to 9, further comprising display means for warning to that effect to the occupant.

Images