JP5521990B2 - Adherence notification device for in-vehicle camera - Google Patents

Description

  The present invention relates to a technique for informing the presence of an adhering substance adhering to a lens of a camera, and more particularly to an in-vehicle camera adhering substance notifying apparatus adapted for in-vehicle use.

  2. Description of the Related Art Conventionally, for example, a back monitor device is known as a vehicular imaging device equipped with a small camera for checking the periphery of a vehicle. The back monitor device includes an in-vehicle camera provided on the rear side outside the vehicle and a display device installed in the vehicle for monitoring an image photographed by the camera.

  By the way, since this in-vehicle camera is usually installed outside the vehicle, the image may become unclear due to dirt (that is, a deposit) on the lens surface of the camera.

  In order to solve this problem, a plurality of image data captured at different times by an in-vehicle camera is acquired, difference image data between these image data is generated, and the previous difference image and the current difference image are each The pixels are compared, and the current difference image is updated with the pixel having the larger difference. When the number of update of the difference image reaches a predetermined number, based on the difference image, the presence or absence of lens dirt on the in-vehicle camera is judged. If the judgment is “dirty”, the synthesized voice is output from the speaker of the notification unit An imaging apparatus is known that notifies the user of the presence of dirt by doing so (for example, Patent Document 1).

JP 2007-318355 A

  However, the conventional technology does not consider when and when to notify the user of the presence of lens contamination. For this reason, for example, when the user knows that the lens dirt of the imaging apparatus exists after getting on the vehicle, it is necessary to go out of the vehicle again and wipe off the dirt by the user himself / herself. In particular, when the user is informed of dirt on the in-vehicle camera after the vehicle travels, there is a problem that the removal timing is delayed, and the user has to take time and effort to stop and repeat the boarding / exiting.

  In any case, this is a problem that occurs because Patent Literature 1 does not have the technical idea of notifying a person outside the vehicle.

  In view of the above problems, an object of the present invention is to provide an in-vehicle camera deposit notification device capable of notifying that there is a deposit on the in-vehicle camera when the user is outside the vehicle.

In order to achieve the above object, an in-vehicle camera attached matter notification device according to claim 1 is an image processing unit that performs image processing on an image captured by an in-vehicle camera provided outside the vehicle, and an image that displays the image captured by the image processing unit. Determining whether or not the display means, the presence / absence determination means for determining whether or not there is an attachment attached to the in-vehicle camera, and whether or not a predetermined condition for determining that the user is outside the vehicle are satisfied A user condition determining means, a selecting means for selecting whether or not to use the adhering matter presence determining means, and a notifying means for notifying information that there is an adhering matter, and the notifying means includes a user condition determining means. If it is determined that the condition that the user is outside the vehicle is satisfied, the selection means uses the presence / absence determination means, and the presence / absence determination means determines that there is an attachment Informs that the deposit is present, the image display means determines that the condition that the user is outside the vehicle is satisfied by the user condition determination means, and does not use the deposit presence / absence determination means by the selection means. Is selected, the imaging is displayed .

According to this configuration, by the Turkey set whether the detection deposits presence advance, When users located outside the vehicle, can be provided with information according to user preferences.

Moreover, the image display means in the adhering matter notification apparatus for a vehicle-mounted camera according to claim 2 is characterized in that it can display each of the different images to be photographed.

  According to this configuration, since each user can see images having different shooting targets, it is possible to visually confirm whether or not there is an attachment.

Further, the predetermined condition of the user condition determining means in the in-vehicle camera deposit notification apparatus according to claim 3 is based on a plurality of determination information used for determining whether or not the user is outside the vehicle. It is characterized by being determined.

  According to this configuration, since the condition for the user to be outside the vehicle can be determined in detail by using a plurality of pieces of determination information in combination, the certainty that the user is actually outside the vehicle can be improved. Can do.

It is a schematic diagram of the adhesion information system for in-vehicle cameras in Embodiment 1 of the present invention. It is a block diagram of the adhesion information system for in-vehicle cameras in Embodiment 1 of the present invention. It is a flowchart which shows the control processing of ECU for monitoring in Embodiment 1 of this invention. It is a flowchart which shows the control processing of ECU for monitoring in Embodiment 2 of this invention. It is a flowchart which shows the control processing of ECU for monitoring in Embodiment 3 of this invention.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments of an in-vehicle camera deposit notification apparatus and an in-vehicle camera deposit notification system according to the present invention will be described with reference to the drawings.

(Embodiment 1)
1 and 2 show an overall view of an in-vehicle camera deposit notification system 1 using a camera used for a back monitor of a vehicle, and FIG. 1 shows a schematic diagram of the in-vehicle camera deposit notification system 1. These show the block diagram of the adhesion information system 1 for vehicle-mounted cameras.

  1, an in-vehicle camera attached matter notification system 1 according to an embodiment of the present invention includes an in-vehicle camera 2, an in-vehicle network unit 3, a monitoring ECU (ECU: Electronic Control Unit) 10, an informing unit 20, a keyless key 30, and a mobile phone. The apparatus 40 and the vehicle-mounted battery are provided. Each of these components will be described below with reference to FIG.

  The in-vehicle camera 2 is attached to a rear portion outside the vehicle in order to obtain an image of the rear view of the vehicle by photographing, and is further connected to the monitoring ECU 10 so as to be communicable. Further, when the in-vehicle camera 2 receives an instruction signal for instructing photographing from the monitoring ECU 10, the in-vehicle camera 2 transmits an image of the photographed rear view of the vehicle to the input / output unit 14 of the monitoring ECU 10. In addition, although the vehicle-mounted camera 2 of this embodiment is demonstrated using the back camera, the arrangement | positioning and number of cameras which can alert | report the presence of a deposit | attachment are not restricted to this. For example, it may be attached to the front outside the vehicle to obtain an image of the front field of view of the vehicle, or may be attached to the lateral side of the vehicle to obtain an image of the left and right field of view of the vehicle. Various combinations of cameras may be attached to the outside of the vehicle, and the imaging of the field of view may be transmitted to the monitoring ECU 10. The monitoring ECU 10 will be described in detail after explanation of each component.

  The in-vehicle network unit 3 is communicably connected between the monitoring ECU 10 and each ECU (referred to here as a door ECU 3a, a seat ECU 3b, and a navigation ECU 3c) via the in-vehicle network. Each ECU satisfies a condition that a user (in this case, a driver or an occupant or a person using the vehicle such as a family member) is outside the vehicle (that is, a condition that the user is expected to be outside the vehicle is satisfied). ) For determining whether or not (details of the information for determination will be described later) are transmitted to the monitoring ECU 10. Each ECU also receives notification information about dirt (attachment) that obstructs the field of view taken by the in-vehicle camera 2.

  Note that the notification information is information for notifying that there is an attached substance on a lens or the like. For example, image information indicating an area where the attached substance exists in an image displaying an image with an arrow or the like, There are image information of characters that display “with kimono”, audio information that pronounces “with attachment”, sound information to make a single beep, light emission information to emit light using a light source, etc. The same applies to notification information). Next, functions of each ECU will be described.

  Although not shown, the door ECU 3a includes a control function for opening / closing the door of the vehicle and a door lock / unlock control, and a wireless communication unit for remotely operating the control function using the keyless key 30. 3d. Further, the door ECU 3a transmits the notification information received from the monitoring ECU 10 to the keyless key 30 via the wireless communication unit 3d, and the keyless key 30 notifies based on the notification information.

  Although not shown, the seat ECU 3b has a control function for changing the seat position of the vehicle and a seat sensor function for detecting the weight applied to the seat to know whether or not a person is sitting on the seat.

  Although not shown, the navigation ECU 3c includes a function for navigating the traveling direction of the vehicle using a display device or the like, and a wireless communication unit 3e that wirelessly communicates with the portable device 40. The navigation ECU 3c transmits the notification information received from the monitoring ECU 10 to the portable device 40 via the wireless communication unit 3e, and the portable device 40 notifies based on the notification information.

  The notification unit 20 is communicably connected to the monitoring ECU 10. In addition, the notification unit 20 includes an image display unit 21 and a speaker unit 22, and the image display unit 21 is provided in front of the driver's seat in the vehicle so that the user can see from the position of the driver's seat in the vehicle and the position near the door outside the vehicle. It is arranged on a certain meter instrumentation (not shown) side. The image display unit 21 includes a liquid crystal display device for displaying an image captured by the in-vehicle camera 2 or displaying a character image. The image display unit 21 receives notification information from the monitoring ECU 10 using the display function of the liquid crystal display device. It is functioning so that the displayed image information can be displayed. Note that the display device used in the present embodiment is not limited to the liquid crystal, and may be another display device such as an organic EL display or a plasma display (the display device described below is also the same).

  In addition, the speaker unit 22 has an output unit (not shown) that converts received audio information into sound (sound) and outputs the same, and notifies the notification information received from the monitoring ECU 10 as with the video display unit 21. In order to be able to do so, it functions so as to be able to generate sound information of a predetermined sound such as a single sound or synthesized speech such as “with attached matter” from the output unit.

  Next, functions of the keyless key 30 and the portable device 40 will be described.

  The keyless key 30 includes an information presentation unit 31, a speaker unit 32, a wireless communication unit 33, and an input operation unit 34.

  Although not shown, the information presentation unit 31 includes a liquid crystal display device for displaying an image. Using the display function of the liquid crystal display device, notification of characters and the like indicating “attached” is received from the monitoring ECU 10. It functions so that information can be reported. Although not shown, the information presenting unit 31 includes a light emitting diode (LED) light source to issue a warning, and functions to be able to notify the notification information received from the monitoring ECU 10 when the LED emits light. ing.

  In addition, the speaker unit 32 has a voice output unit such as a speaker (not shown), and generates a sound such as a predetermined single sound or a synthesized voice such as “with attached matter”, thereby providing the information presentation unit 31. It functions so that the received notification information can be notified in the same manner.

  The wireless communication unit 33 has a function capable of wireless communication with the door ECU 3 a, receives notification information of the monitoring ECU 10 through the door ECU 3 a, and outputs the notification information to the information presentation unit 31 and the speaker unit 32. Further, the input operation unit 34 transmits an instruction signal for locking or unlocking the door of the vehicle and opening / closing of the door to the door ECU 3a via the wireless communication unit 33 by a user operation.

  On the other hand, the portable device 40 includes an image display unit 41, a speaker unit 42, a wireless communication unit 43, and an input operation unit 44.

  Although not shown, the image display unit 41 includes a liquid crystal display device for displaying an image. Using the display function of the liquid crystal display device, notification of characters or the like indicating “attached” is received from the monitoring ECU 10. It functions so that information can be reported.

  In addition, the speaker unit 42 has a sound output unit such as a speaker (not shown), and generates a sound such as a predetermined single sound or a synthesized sound such as “there is a deposit”, whereby the image display unit 41. It functions so that the received notification information can be notified in the same manner.

  The wireless communication unit 43 has a function capable of wireless communication with the wireless communication unit 3e of the navigation ECU 3c, and is configured to be able to transmit and receive information to and from the monitoring ECU 10 via the wireless communication unit 3e. The wireless communication unit 43 receives the notification information output from the monitoring ECU 10 via the navigation ECU 3 c and outputs the notification information to the image display unit 41 and the speaker unit 42.

  In addition, the input operation unit 44 transmits determination information indicating that the user is outside the vehicle to the communication interface unit 15 of the monitoring ECU 10 via the navigation ECU 3c and the in-vehicle network. The determination information transmitted from the portable device 40 determines that the user is outside the vehicle. When the monitoring ECU 10 receives the determination information transmitted from the portable device 40, the determination information is received. And determining that the user is outside the vehicle.

  The monitor ECU 10 includes a read only memory (ROM) 12 and a random access memory (RAM) 13 in a central processing unit (CPU) 11 composed of a microcomputer serving as a main control unit, and a system bus. Are connected to each other. The monitoring ECU 10 includes an input / output unit 14 having an interface for directly communicating with the monitor ECU 1 without using the vehicle-mounted network such as the vehicle-mounted camera 2, and communication for communicating with each ECU via the vehicle-mounted network. An interface unit 15 and an image processing unit 16 that performs image processing on captured images obtained by the in-vehicle camera 2 and a non-volatile memory 17 that stores captured images and processed images are further connected to each other via the system bus. ing. The monitoring ECU 10 is also provided with a counter function (not shown) for counting the number of updates of the difference image described later. The monitoring ECU 10 is connected to an in-vehicle battery so that it can operate even after the vehicle is turned off. Further, although not shown, the ECUs of the notification unit 20 and the in-vehicle network unit 3 are also configured to be supplied with power from the in-vehicle battery so that the operation according to the present embodiment can be performed even after the vehicle is turned off. Yes.

  The ROM 12 includes a program for processing various signals received by the input / output unit 14 and the communication interface unit 15, a program for issuing processing instructions to the ECUs of the notification unit 20, the in-vehicle camera 2, and the in-vehicle network unit 3. Is saved. For example, in the ROM 12, image display processing for displaying an image obtained by photographing with the in-vehicle camera 2 on an image display unit such as the notification unit 20 or the portable device 40, and dirt (adherent matter) that obstructs the field of view of the imaging region of the in-vehicle camera 2. ) Is attached to the lens of the in-vehicle camera 2 and a notification process for notifying the presence of the attached substance when the attached substance is attached is defined. The CPU 11 executes a program stored in the ROM 12. Further, the RAM 13 has a function of storing the result of arithmetic processing by the CPU 11 and the received various signals. In addition, although not shown, a timer counter that measures the time interval at which each data is received is also provided.

  The image processing unit 16 performs image processing on the image pickup stored in the nonvolatile memory 17 based on the control from the CPU 11. As the contents of the image processing, one is to display an image on a device (here, a liquid crystal display device) having an image display function such as the image display unit 21 of the notification unit 20 as a back monitor that displays the rear part of the vehicle. Processes image size adjustment, brightness and color difference adjustment, etc. Further, as another process of the image processing unit 16, in order to perform the adhering matter detection process, a difference image of data captured at different times is generated. Specifically, a plurality of image data captured from the non-volatile memory 17 at different times and timings (for example, when the vehicle is running, when the door of the vehicle is opened, when the door is unlocked, etc.) by the in-vehicle camera 2. And the difference image data which is the difference between these image data is generated. The generated difference image of the previous time (stored in the nonvolatile memory 17) and the current difference image are compared for each pixel, and the current difference image is updated with the pixel having the larger difference. The updated difference image is output to the nonvolatile memory 17 and stored in the nonvolatile memory 17. The counter counts the number of times the difference image has been updated, and if the count value reaches a predetermined number (that is, recognizes that the number of times the difference image has been updated has reached the predetermined number), notifies the main control unit accordingly. .

  Based on the latest difference image output from the image processing unit 16, the main control unit determines the presence or absence of a deposit such as a lens in the in-vehicle camera 2. In order to notify the user, a warning signal such as a video signal or sound is transmitted as notification information to the notification unit 20 or the like.

  As the image processing method for detecting an adhering matter as described above, a well-known general method such as the above-mentioned Patent Document 1 can be adopted, and thus detailed description thereof is omitted here.

  Further, as a method for determining the presence / absence of adhering matter, the above description has been made using image processing. However, the present embodiment is not limited to this, and the presence / absence of adhering matter may be determined by another method, for example, as follows. You may judge.

  The lens can be irradiated with light (infrared light) from a light source (not shown) such as an LED installed in the lens of the in-vehicle camera 2 or in the vicinity of an external lens. Irradiation of light from the light source is repeatedly turned on / off every time, and this light is captured by an imaging element (not shown) inside the camera. Based on the result of light reception from the image sensor, the monitor ECU 10 is imaged to detect the amount of light received when the lens is not soiled when the lens is not turned on (previously stored in the nonvolatile memory 17) and the attached matter. Compare the difference in the amount of light received when turning on / off. If the lens is dirty, the difference in the amount of received light that is compared becomes large, so that the adhered matter (dirt) can be determined.

  In addition, the light from a light source (not shown) such as an LED installed in the camera of the in-vehicle camera 2 may be irradiated at an angle that totally reflects the lens surface. If light from the light source is irradiated and the lens surface is not dirty, the light is totally reflected and returns to the inside of the camera. On the other hand, when the lens surface is dirty, total reflection on the lens surface does not occur, and light does not return to the inside. The reflection of the light on the lens surface is captured by an image sensor (not shown) inside the camera, and the monitor ECU 10 determines whether the lens surface is totally reflected based on the light reception result from the image sensor. Kimono (dirt) can be judged.

  The notification unit 20 receives the notification information from the monitor ECU 10 and displays an image of a warning character “existing matter” on the liquid crystal display device of the image display unit 21 or displays an image indicating the position of the attachment with an arrow or the like. Or a warning indicating that “there is a deposit” is given by voice or the like on the speaker of the speaker unit 22. Further, the notification method is not limited to the output from the notification unit 20, and is sent from the monitoring ECU 10 to the keyless key 30 or the portable device 40 via each ECU (here, the door ECU 3 a and the navigation ECU 3 e) of the in-vehicle network unit 3. A video signal, warning signal, or the like indicating “there is a deposit” may be output and notified using the corresponding liquid crystal display device (31, 41), speaker (32, 42), or LED light emission (31).

  Further, the notification unit 20 is not limited to this embodiment, and a wireless communication unit 23 is provided in the notification unit 20 in place of the wireless communication units (3d, 3e) of the door ECU 3a and the navigation ECU 3e. You may comprise so that direct wireless communication with the apparatus 40 is attained. By providing the wireless communication unit 23 in the notification unit 20, for example, even when the navigation ECU 3c capable of wireless communication is not mounted on the vehicle, data can be exchanged with the portable device 40.

  In addition, the time for displaying or warning to the liquid crystal display device may be a time that is noticed by the user, and is 30 seconds to 1 minute here. Furthermore, when the user notices the notification, a function of stopping the notification by an input operation of the input unit provided in the notification unit 20, the keyless key 30, or the portable device 40 is provided, thereby suppressing wasteful power consumption. It may be configured to be able to.

  FIG. 3 is a flowchart showing a control process of the monitoring ECU 10 according to the present embodiment having the above-described configuration.

  In FIG. 3, as described above, the monitoring ECU 10 opens and closes information when the vehicle door is opened and closed, lock information when the vehicle door is locked or unlocked, and whether the user is sitting on the vehicle seat. The user is out of the vehicle, such as seating information indicating whether or not the user is away from the seating state, information indicating that the user has transitioned from the seating state to the leaving state, and information indicating that the user is transmitted from an external terminal such as the portable device 40. When the determination information that can be determined to be in (or move to a state outside the vehicle) is received, the flow process is started.

  Here, an example of determining whether the condition that the user is outside the vehicle is satisfied using the determination information will be described in detail for a case where the user gets on the vehicle and a case where the user gets off the vehicle. In the present embodiment, the condition that the user is outside the vehicle is basically when the user performs an operation performed on the vehicle when getting on or off the vehicle. As another method, it is determined that the condition that the user is outside the vehicle is also established when the user directly instructs the monitoring ECU 10 that the user is outside the vehicle using a portable device or the like.

(When the user gets into the vehicle)
The monitoring ECU 10 receives the unlocking information when the door is unlocked by the input operation of the keyless key 30 or the key operation of the vehicle door by the user and the door opening information when the vehicle door is opened as the determination information. Then, based on any of the determination information, it is determined whether or not a condition that the user is outside the vehicle is satisfied. Here, in order to reduce the possibility of misjudgment due to an erroneous operation by the user and further increase the certainty that the user is outside the vehicle, information for each determination such as door unlock information and door open information is provided. In combination, it may be determined whether the condition that the user is outside the vehicle is satisfied. Specifically, when the monitoring ECU 10 receives door unlocking information and door opening information in order within a predetermined time (for example, within 10 seconds after receiving the unlocking information), the user leaves the vehicle. It may be determined that the condition of being present (in this case, trying to get into the car) is satisfied. As another method, when the user unlocks the door (or opens the door), no one sits on the seat from the seat ECU 3b together with the door unlock information (or door opening information) (no weight is applied). The monitoring ECU 10 receives the non-seating information indicating that within a predetermined time (for example, within 10 seconds after receiving the lock release information) as determination information. Then, it may be determined that the user is outside the vehicle based on the combination result of the determination information.

  In this way, if the determination is made by combining the determination information so that it is similar to the procedure for the user to get into a normal car, the user is more likely to be outside the vehicle (especially immediately before getting in the car), or simply There is a high possibility that it is not a user's erroneous operation.

(When the user gets off the vehicle)
Unlocking information when the door is unlocked by the input operation of the keyless key 30 or the key operation of the vehicle door by the user, door opening information when the vehicle door is opened, the user stood the vehicle seat (weight is A condition in which the monitoring ECU 10 receives information indicating that the user has been out of the vehicle based on one of the pieces of determination information. Whether or not is established is determined. In this case as well, each determination information such as door unlock information and door opening information is used to increase the certainty that the user is outside the vehicle while reducing the possibility of erroneous determination due to a user's erroneous operation. May be combined to determine whether or not the condition that the user is outside the vehicle is satisfied. Specifically, when the user gets off the vehicle, for example, when the monitoring ECU 10 receives the door opening information of the vehicle and the leaving information in order within a predetermined time (for example, within 20 seconds), the user It may be determined that the condition of being outside the vehicle (here, getting off from the car) is satisfied.

  In this way, if the determination is made by combining the determination information so that it is similar to the procedure for the user to get off the normal car, the user is more likely to be outside the vehicle (especially immediately after getting off the car). There is a high possibility that it is not a user's erroneous operation.

  When the determination information used for such a combination is received at a predetermined time, if the condition is such that the user is outside the vehicle and can determine that it is immediately before getting on or just after getting off, the user is more sure of the in-vehicle camera 2. Information indicating that there is an adhering substance attached to the lens or the like at a position close to the lens can be notified.

  By determining the position condition of the user based on the determination information as described above, it is possible to determine that the user is almost out of the vehicle, although the probability that the user is out of the vehicle is not 100%.

  In step S10, it is determined whether or not a condition that the user is outside the vehicle is satisfied based on the determination information obtained by combining one or more of the received determination information. If the condition that the user is outside the vehicle is satisfied, the process proceeds to step S11. If the condition that the user is outside the vehicle is not satisfied, the process of FIG. 3 is terminated (that is, the process proceeds to END).

  In step S <b> 11, the in-vehicle camera 2 is instructed to perform imaging, and imaging is acquired from the in-vehicle camera 2. Thereafter, the process proceeds to step S12.

  In step S12, the difference image with the latest image imaged in step S11 is compared by the above-described adhering matter detection process, and whether or not the adhering matter is present on the in-vehicle camera 2 itself (for example, a surface portion such as a lens). Determine. If it is determined that there is a deposit, the process proceeds to step S13. If it is determined that there is no deposit, the process in FIG. 3 is terminated.

  In step S13, information (notification information) indicating that the deposit is present on the in-vehicle camera 2 is obtained by using at least one of the notification unit 20, the portable device 40, or the keyless key 40, an image, sound or sound, or a light source. The presence / absence of an adhering matter is notified using the emitted light, and the process of FIG. 3 is terminated. In addition, when notifying using the some apparatus (notification part 20, keyless key 30, portable device 40) which can be alert | reported, the timing may be alert | reported simultaneously or you may alert | report in order.

  As described above, according to the present embodiment, when it is determined that the user is outside the vehicle, the user can be notified of the presence of dirt (attachment) such as the lens of the in-vehicle camera 2. Therefore, the user may know the presence of deposits after boarding the vehicle as in the past, go out of the vehicle again to wipe off the deposits, and perform a two-time operation of getting on again Therefore, the removal of deposits can be completed more quickly than before.

(Embodiment 2)
Embodiment 1 of the present invention has been described by taking as an example a configuration in which whether or not the lens of the in-vehicle camera 2 is contaminated in the system in advance has been described as an example. However, when the user is outside the vehicle, For the purpose of confirming the adhered matter (dirt) reflected in the imaging area of the attached in-vehicle camera 2 from the image processing result of imaging, it is automatically determined whether or not there is an attached matter on the lens of the in-vehicle camera 2 or the like. This is not always necessary, and it may be determined by visual confirmation by the user himself whether the vehicle-mounted camera 2 has an attachment when the user is outside the vehicle.

  The vehicle-mounted camera deposit notification system 1 used in the second embodiment has the same components as the vehicle-mounted camera deposit notification system 1 shown in the first embodiment. The same processes in the flowchart showing the control process are denoted by the same reference numerals, and detailed description thereof is omitted.

  FIG. 4 is a flowchart illustrating a control process of the monitoring ECU 10 of the camera deposit notification system 1 according to the second embodiment.

  In step S10, as in the first embodiment, it is determined whether the condition that the user is outside the vehicle is satisfied based on the determination information obtained by combining one or more of the received determination information. If the condition that the user is outside the vehicle is satisfied, the process proceeds to step S11. If the condition that the user is outside the vehicle is not satisfied, the process of FIG. 4 is terminated (proceeds to end).

  In step S11, the in-vehicle camera 2 is instructed to perform imaging, the imaging is acquired from the in-vehicle camera 2, and the process proceeds to step S20. It should be noted that the imaging to be confirmed by the user is preferably as fresh as possible in order to prevent misjudgment. Here, the in-vehicle camera 2 immediately after it is determined in step S10 that the condition that the user is outside the vehicle is satisfied. Have been filmed. For the purpose described above, the shooting timing is not limited to the present embodiment. For example, immediately before determining whether or not the condition that the user is outside the vehicle is satisfied in step S10 (specifically, information for determination such as opening of the vehicle door). May be taken after processing is started and before the processing of step S10).

  In step S <b> 20, the image data processed so as to display the captured image is transmitted to the notification unit 20, the portable device 40, or the keyless key 40. Then, at least one of the liquid crystal display device which is an image displayable device provided in the image display unit 21 of the notification unit 20, the image display unit 41 of the portable device 40, or the information display unit 31 of the keyless key 40 is used. The image data received from the monitoring ECU 10 is displayed.

  According to the above, when the user is outside the vehicle, the user can visually confirm by himself / herself the image displayed on the liquid crystal display device that the deposit is attached to the in-vehicle camera 2. Therefore, it is possible for the user to determine whether to remove it immediately or later, depending on the degree of deposits.

  Further, in the process of step S20, it may be notified that the image is displayed with sound using not only the image display but also a device having a speaker function.

  In addition, as a method for displaying an image of this captured image, a single image displayable device may be used, or a plurality of image displayable devices may be used. In the case of using a device capable of displaying a plurality of images, the display may be performed simultaneously or in an order.

  Moreover, the imaging | photography of the vehicle-mounted camera 2 of this embodiment can utilize various methods, and is not restricted to the method of imaging | photography one predetermined object. For example, a motor 2a (described in FIG. 2) having a movable function for moving the in-vehicle camera 2 left and right and up and down is provided, and the monitoring ECU 10 selects a plurality of different objects (for example, the ground, wall, sky, and the like as imaging objects). You may connect so that the drive of the motor 2a may be controlled so that imaging | photography is possible. In step S11, images obtained by photographing a plurality of objects are transmitted to at least one of the notification unit 20, the portable device 40, and the keyless key 40 as a plurality of image data in step S20. The image data received from the monitoring ECU 10 is displayed using the liquid crystal display device provided in the image display unit 21 of the notification unit 20, the image display unit 41 of the portable device 40, or the information display unit 31 of the keyless key 40. To do.

  By making it possible to shoot different objects in this way, the user can see multiple images with different shooting targets as to whether or not there is an attachment. Even if it sees, since the location of the deposit | attachment is reflected in a shadow, the presence or absence of an deposit | attachment can be confirmed more reliably.

(Embodiment 3)
As another embodiment, for example, as shown in FIG. 5, a selection unit (step S30) may be provided so that the control process similar to the first embodiment and the control process similar to the second embodiment in the monitoring ECU 10 can be selected. Good.

  The vehicle-mounted camera deposit notification system 1 used in the third embodiment includes the same components as the vehicle-mounted camera deposit notification system 1 shown in the first embodiment. The same processes in the flowchart showing the control process are denoted by the same reference numerals, and detailed description thereof is omitted.

  Here, the user operates the input operation unit 24 (shown in FIG. 2) that outputs a control instruction to the monitoring ECU 10 of the notification unit 20, and the setting result indicating whether the notification is performed in the first embodiment or the second embodiment is nonvolatile. Recorded in the memory 17. This selection means performs a selection process for selecting whether or not to detect the presence or absence of an adhering substance based on the setting result recorded in the nonvolatile memory 17. When detecting the presence / absence of adhered matter (by the monitoring ECU 10), the process proceeds to step S11a (YES side) (that is, proceeds to the side performing the same processing as in the first embodiment), and when the presence / absence of the adhered matter is not detected. Then, the process proceeds to step S11b (NO side) (that is, the process proceeds to the side performing the same processing as in the second embodiment).

  If it carries out as mentioned above, when a deposit | attachment is detected like Embodiment 1, the alerting | reporting means which alert | reports the presence of the deposit using an image, a sound, a light source, etc. will be employ | adopted, or imaging will be carried out like Embodiment 2. It is possible to determine in advance whether to adopt an image display means for displaying the image as it is, and when the user is outside the vehicle, information can be provided in a manner according to the user's preference.

  As described above, the in-vehicle camera deposit notification device and the in-vehicle camera deposit notification system used in the vehicle of the present invention have been described, but the present invention is limited to the above-described embodiment. However, the present invention can be applied without departing from the gist of the invention according to each claim of the claims. For example, a laser radar camera or a millimeter wave camera may be used instead of the in-vehicle camera that captures images and videos. In each of the above-described embodiments, part or all of the functions of the monitoring ECU 10 may be realized by a navigation ECU or another ECU.

  Finally, the relationship between the description of the above embodiment and the description of the claims will be described.

  The monitoring ECU 10 in the above embodiment corresponds to the in-vehicle camera deposit notification device of the present invention, and the notification unit 20 (21, 22), keyless key 30 (31, 32), and portable device 40 (41 in the above embodiment). , 42) corresponds to the notification means of the in-vehicle camera deposit notification apparatus of the present invention. The image processing unit 16 in the above embodiment corresponds to the image processing means of the present invention. The image display units (21, 41) and the information presentation unit 31 in the above embodiment correspond to the image display means of the present invention.

  Further, the processing function (step S12) of the monitoring ECU 10 in the above embodiment corresponds to the adhering matter presence / absence determining means of the present invention. The processing function (step S10) of the monitoring ECU 10 in the above embodiment corresponds to the user condition determining means of the present invention.

DESCRIPTION OF SYMBOLS 1 Adherence information system for vehicle-mounted camera 2 Vehicle-mounted camera 3 Vehicle-mounted network part 10 Monitor ECU
20 Notification unit 30 Keyless key 40 Portable device

Claims (3)

Image processing means for image processing of an image taken by an in-vehicle camera provided outside the vehicle;
Image display means for displaying the imaging by the image processing means;
A deposit presence / absence determining means for determining whether there is a deposit attached to the in-vehicle camera itself;
User condition determining means for determining whether or not a predetermined condition for determining that the user is outside the vehicle is satisfied;
Selecting means for selecting whether or not to use the adhering matter presence / absence determining means;
An informing means for informing information indicating the presence of the deposit,
The notification means includes
The user condition determining means determines that the condition that the user is outside the vehicle is established,
And when the selection means selects that the deposit presence / absence determination means is used, and the deposit presence / absence determination means determines that the deposit is present,
Informing the information that the deposit is present,
The image display means includes
When the user condition determining means determines that the condition that the user is outside the vehicle is satisfied, and the selecting means selects not to use the adhering matter presence / absence determining means, the imaging is displayed. An in-vehicle camera deposit notification device. The in-vehicle camera has a movable function capable of shooting by changing a shooting target,
The image display means, vehicle camera deposit notification apparatus according to claim 1, characterized in that can display different respective imaging of said imaging target. 2. The predetermined condition of the user condition determination means is determined based on a plurality of the determination information used for determining whether or not the user is outside the vehicle. Or the in-vehicle camera attached matter notification device according to 2;

Images