JP6658095B2 - Awakening maintenance device and program - Google Patents

Description

  The present invention relates to a wakefulness maintenance device and a program, and more particularly, to a wakefulness maintenance device for maintaining a wakefulness state of a user.

  There is a technique for presenting information about a warning without causing a driver to feel troublesome (Japanese Patent Application Laid-Open No. H10-163873). In this technique, as shown in FIG. 13, a radar for detecting a situation around the own vehicle, a display device for displaying information related to a warning, a notifying device for generating a notification, and a surrounding for the own vehicle detected by the radar. Is displayed on the display device for a short time within the range of the consciousness based on the judgment on the situation.

  In addition, there is a technique of displaying alert information at a point or a section where accidents frequently occur to a driver without causing the driver to feel troublesome (Patent Document 2). In this technique, as shown in FIG. 14, an alert display control device that generates alert information based on accident statistical information, generates an alert image based on the alert information, and controls the display of the alert image. And a HUD for displaying a reminder image output from the reminder display control device. The reminder display control device outputs the reminder image to the driver while the vehicle is traveling in an accident-prone location or section. Is controlled so as to be repeatedly displayed with a display duration within the range of the sub-threshold perception.

  Further, there is a technique for minimizing confusion given to a driver when providing an oncoming vehicle display screen and a pedestrian display screen. In this technique, as shown in FIG. 15, even when an image is switched in accordance with the stop / progress of the own vehicle, an image already displayed faintly before the switching is easily recognized as a leading clue and the image after the switching is easily recognized. To be able to.

JP 2005-231381 A JP 2005-241516 A JP 2006-40119 A

  In the technique of Patent Document 1, the visual information is first displayed subliminally, and the degree of attention to the visual information to be displayed next is emphasized. However, in Patent Literature 1, the priming stimulus is simply used, and the effect of the priming stimulus can speed up the recognition of a warning. However, the guiding rate (gaze tracking rate) of the subsequent saccade-inducing stimulus is improved. It's not like that.

  Further, Patent Literature 2 aims at not inconvenience alerting by subliminal visual information, and does not emphasize attention of a stimulus to be displayed next.

  The present invention has been made in view of the above circumstances, and provides an awakening maintenance device and a program that can maintain an awakening state of a user without causing the user to feel troublesome and uncomfortable. Aim.

  In order to achieve the above object, the arousal maintenance device according to the first invention includes a stimulus presenting unit that presents a visual stimulus from at least two or more positions left and right apart in a peripheral visual region of a user; Control means for presenting a main stimulus by the stimulus presenting means so as to move the user's line of sight in the left-right direction in order to maintain the user's awake state, and immediately before presenting the main stimulus by the control means, A priming stimulus presentation control unit that causes the stimulus presentation unit to present a priming stimulus that is a preceding stimulus of the main stimulus to a position corresponding to a position where the main stimulus is first presented.

  Further, in the alertness maintaining apparatus according to the first invention, the stimulus presenting means is configured to present a visual stimulus having a predetermined intensity corresponding to an upper limit of the intensity of the visual stimulus that can be perceived by the user without any burden. You may.

  Further, in the alertness maintaining apparatus according to the first invention, the control means may cause the stimulus presenting means to present a visual stimulus so as to cause a saccade movement of the user's eye.

  The awakening maintenance device according to a second aspect of the present invention includes a detection unit configured to detect a detection target from a front view of a driver of the vehicle, and at least one predetermined position in a front view of the driver on the vehicle. Presenting a visual stimulus at each position within the front field of view of the driver, at least one location corresponding to an area where the detection target is detected by the at least one location away from the at least one location in the left-right direction, and The stimulus presenting means, and the stimulus presenting means at a timing corresponding to the timing at which the detection target is detected by the detecting means so as to move the driver's line of sight in the left-right direction to maintain the driver's awake state Control means for presenting a main stimulus by means, and immediately before the main stimulus is presented by the control means, The a super is priming stimulation is configured to include a priming stimulus presentation control means for presenting a position corresponding to the position initially presenting the main stimulus.

  Further, in the alertness maintaining device according to the second invention, the stimulus presenting means is configured such that the intensity of the visual stimulus at at least one place other than at least one place corresponding to the area where the detection target is detected by the detection means is determined by the driver. The stimulus may have a minimum perceptible intensity.

  Further, in the awakening maintenance device according to the second invention, the control means, when a detection target object is not detected by the detection means during a predetermined stop period, the stimulus presentation means causes the stimulus presentation means to set the position at each of the positions. A visual stimulus may be presented.

  Further, in the alertness maintaining apparatus according to the second invention, the stimulus presenting means presents a visual stimulus having a predetermined intensity corresponding to an upper limit of the intensity of the visual stimulus that can be perceived by the driver without any burden. You may.

  In the arousal maintenance device according to the second invention, the control means presents a visual stimulus by the stimulus presenting means for a predetermined duration, and then presents the visual stimulus for a predetermined pause period. The stimulus presenting means may be controlled so as not to perform it.

  Further, in the alertness maintenance device according to the second invention, the stimulus presenting means presents the main stimulus or the priming stimulus on a windshield of the vehicle, a room mirror of the vehicle, or a side mirror of the vehicle. You may do so.

  Further, in the alertness maintaining apparatus according to the second invention, the control means may cause the stimulus presenting means to present a visual stimulus so as to cause a saccade movement of the driver's eyes.

  In the arousal maintenance device according to the first and second aspects of the present invention, the control means includes a main stimulus presented by the stimulus presentation means, a presentation order, a presentation cycle, a presentation start, a presentation stop, and a presentation. And at least one of the intensity of the color and the color of the presentation may be controlled.

  Further, in the alertness maintaining device according to the first and second inventions, the control means controls the stimulus presenting means so as to repeat presenting the main stimulus to each position in a predetermined order. Is also good.

  Further, in the alertness maintaining device according to the first and second inventions, the stimulus presenting unit may present the main stimulus or the priming stimulus by outputting blue light from each position. .

  Further, in the awakening maintenance device according to the first and second inventions, the apparatus further includes information detecting means for detecting surrounding information, wherein the priming stimulus presentation control means detects the information as the priming stimulus by the stimulus presenting means. The peripheral information detected by the means may be presented.

  A program according to the present invention is a program for causing a computer to function as each unit constituting the above-mentioned alertness maintenance device.

  ADVANTAGE OF THE INVENTION According to the awakening maintenance apparatus, method, and program of this invention, a user's awakening state can be maintained, without making a user feel troublesome and uncomfortable.

It is a figure which shows the example of the left-right blinking stimulus in which saccade guidance is possible. It is a block diagram showing composition of a wake maintenance device concerning a 1st embodiment of the present invention. It is a figure showing the example of the visual stimulus seen from the driver. It is a block diagram showing composition of a wakefulness maintenance device concerning a 2nd embodiment of the present invention. It is a flowchart which shows the alertness maintenance processing routine in the alertness maintenance device which concerns on the 2nd Embodiment of this invention. It is a figure showing an example of presentation of a visual stimulus in an arousal maintenance device of a 2nd embodiment. It is a figure showing a result of an example of an experiment. It is a figure showing a result of an example of an experiment. It is a figure showing a result of an example of an experiment. FIG. 13 is a diagram illustrating an example of presentation of a visual stimulus when presenting speed information of a surrounding vehicle as a priming stimulus in the awakening maintenance device according to the third embodiment. It is a block diagram showing the composition of the alertness maintenance device concerning a 3rd embodiment of the present invention. It is a flow chart which shows a wakefulness maintenance processing routine in a wakefulness maintenance device concerning a 3rd embodiment of the present invention. FIG. 11 is a diagram illustrating an example of a conventional technique. FIG. 11 is a diagram illustrating an example of a conventional technique. FIG. 11 is a diagram illustrating an example of a conventional technique.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings, substantially the same or equivalent components or portions are denoted by the same reference numerals.

<Principle of the invention>

  In the embodiment of the present invention, as shown in FIG. 1, visually recognizable stimuli such as light and display are sequentially or alternately output from two or more places left and right in front of a person, so that the left and right are mainly output. Induces directional saccade (impulsive) eye movements. The saccade eye movement is an eye movement peculiar to awakening, and when this eye movement is induced, a decrease in the awake state of a person is prevented, and the awake state can be maintained. In the present embodiment, causing a saccade movement of the eye is defined as a saccade eye movement.

  Further, in the embodiment of the present invention, in order to effectively induce saccade eye movements, a visual stimulus that the driver naturally turns his / her gaze is presented.

  In particular, in the embodiment of the present invention, in order to effectively induce the saccade eye movement, the “priming effect” is set so that the person naturally turns his or her eyes immediately before the presentation of the saccade-guided visual stimulus. Present a priming visual stimulus that causes The priming effect is known as an effect in which the processing of a subsequent stimulus (primer) promotes or suppresses the processing of a subsequent stimulus. For example, when the same stimulus is repeatedly presented, there is an effect that the recognition time for the second stimulus is reduced and the accuracy is increased. This effect enhances the gaze guidance to the subsequent saccade-guided visual stimulus, and the saccade is effectively and naturally guided. Since both the priming visual stimulus and the saccade-induced visual stimulus need only induce saccade eye movements, they may be presented not in the central vision of the person but in the peripheral vision region, and further strong stimulation is not required. Therefore, the stimulus may be presented with an intensity (brightness) near the limit that can be visually perceived. Thereby, since the user does not hinder the view or feels glare, the user can maintain the awake state without feeling troublesome or uncomfortable.

<Configuration of Arousal Maintenance Device According to First Embodiment>

  Next, the arousal maintenance device according to the first embodiment of the present invention will be described. As shown in FIG. 2, the alertness maintaining apparatus 100 according to the first embodiment of the present invention includes a control device 20 and an output device 90. In the first embodiment, a case will be described in which the arousal maintenance device is installed in a vehicle.

  The control device 20 is configured to include a priming stimulus presentation control unit 22 and a control unit 26. The control device 20 is configured to include a CPU, a RAM, and a ROM that stores a program for executing a control processing routine described later and various data, and controls the output device 90 by executing the program.

  The output device 90 is configured to blink two positions (a first position and a second position), and turns on the first position every second, turns on the second position, turns on the first position, and so on. The output device 90 is controlled so as to be alternately turned on at the first position and the second position. Here, the shape of the lighting portion is, for example, a circular figure having a diameter of 2 cm, and the brightness of the lighting portion is a predetermined brightness corresponding to the upper limit of the intensity of the visual stimulus that can be perceived without any burden on the driver. Is blue. Note that the color to be lit may be other than blue. Note that the driver is an example of a user. Lighting at the first position and the second position is an example of a visual stimulus.

  The output device 90 is a device that presents a visual stimulus from two positions separated to the left and right of the driver. In the first embodiment, the output device 90 includes a head-up display unit provided on the front windshield of the driver. Used. Here, as shown in FIG. 3, in the head-up display portion of the front windshield of the driver, two positions (first and second positions) that are left and right apart from the driver's front and are in the driver's peripheral viewing area. Position and the second position). Here, the peripheral vision region is a region having a vertical eccentricity of about 5 to 25 degrees with respect to a straight forward direction from a predetermined driver's line of sight. In the first embodiment, the head-up display unit of the windshield has a distance of about 80 cm from the driver's eyes, and the first and second positions for blinking are 10 cm left and right with respect to the front of the driver. At a depression angle of 10 degrees downward from the front of the driver.

  The priming stimulus presentation control unit 22 presents the priming stimulus, which is the preceding stimulus of the main stimulus, to the first position where the main stimulus is first presented by the output device 90 three seconds before the control unit 26 presents the main stimulus. Control to make it. Three seconds ago is an example immediately before. The time for presenting the priming stimulus is, for example, 1 second. The priming stimulus may output the same visual stimulus as the main stimulus. Further, the position where the priming stimulus is presented may be around the first position.

  The control unit 26 controls the output device 90 so as to present a visual stimulus for the main stimulus. Specifically, the output device 90 is configured to blink two positions (a first position and a second position), and every 0.5 seconds from the timing when the vehicle is detected in the detection target area. The output device 90 is controlled so that the first position is turned on, the second position is turned on, the first position is turned on, and so on, alternately at the first position and the second position. Here, the shape of the lighting portion is, for example, a circular figure having a diameter of 2 cm, and the brightness of the lighting portion is a predetermined brightness corresponding to the upper limit of the intensity of the visual stimulus that can be perceived without any burden on the driver. Is blue. Further, the control unit 26 controls the output device 90 to alternately light up the first position and the second position and repeat the lighting for 5 seconds. The lighting at the first position and the second position is an example of the visual stimulus. Further, 5 seconds is an example of the duration. Further, the duration may be about 3 to 7 seconds. Note that if the duration is too short, the effect is small, and if the duration is too long, the trouble may increase.

<Operation of Arousal Maintenance Device According to First Embodiment>

  Next, the operation of the alertness maintaining apparatus 100 according to the first embodiment of the present invention will be described. First, when the driver turns on the ignition key, the priming stimulus presentation control unit 22 in the control device 20 turns on the first position for one second before the control unit 26 turns on the light after a certain period of time. Then, the control unit 26 controls the output device 90 so that control for turning on the light at the first position and the second position and control for turning off the light are alternately repeated every minute. Thereby, the awake state of the driver is maintained.

  As described above, according to the arousal maintenance device 100 according to the first embodiment, the control is performed such that the priming stimulus is presented at the first position where the main stimulus is first presented immediately before the main stimulus is presented. After that, the driver turns on the driver's line of sight to move left and right in order to maintain the driver's awake state at two positions left and right in the peripheral visual region of the driver, thereby causing trouble and discomfort to the driver. It is possible to maintain the driver's arousal state without causing the driver to feel.

  The present invention is not limited to the above-described embodiment, and various modifications and applications can be made without departing from the gist of the present invention.

  In the first embodiment, the case where the head-up display unit provided on the front windshield of the driver is used as the device that presents the visual stimulus on the right side of the driver and the visual stimulus on the left side has been described. However, the present invention is not limited to this. For example, by performing control such that two or more visual stimuli are presented using two or more LED lights or the like, even if the driver presents the right visual stimulus and the left visual stimulus is presented. Good.

  In the first embodiment, the case where the presentation of the visual stimulus on the right side of the driver and the presentation of the visual stimulus on the left side are alternately presented every second has been described, but the present invention is not limited to this. . For example, the right and left visual stimuli may be presented alternately every 0.5 seconds or every 2 seconds. However, since a certain latency (150 to 250 ms) is required to start the saccade eye movement, the minimum time is about 0.5 seconds. Further, if the period is too long, the frequency of occurrence of saccade eye movements decreases, so the maximum is about 2 seconds.

  In the first embodiment, when the output device 90 performs control for presenting a visual stimulus for one minute, then performs control for not presenting a stimulus for one minute, and repeats the control every minute. Has been described, but the present invention is not limited to this. For example, the control may be repeated every two minutes or every 30 seconds. Further, the control of stopping the presentation of the visual stimulus may not be performed.

  In the first embodiment, the case where the visual stimulus is presented from two places has been described, but the present invention is not limited to this. For example, if a sufficient distance to induce saccade eye movement can be ensured, visual stimuli may be presented from two or more locations. In this case, the order in which the visual stimuli are presented is determined in advance, and the visual stimulus is presented periodically in that order.

  Further, in the first embodiment, the case where the awakening maintenance device 100 is installed in the vehicle has been described, but the invention is not limited to this. For example, it may be installed on vehicles other than vehicles, such as ships and airplanes. In addition, by using a small liquid crystal display or the like for the output device, for example, the device may be installed so as to be used during OA work in a home or office.

<Configuration of Arousal Maintenance Device According to Second Embodiment>

  Next, an alertness maintaining device according to a second embodiment of the present invention will be described. As shown in FIG. 4, the alertness maintenance device 200 according to the second embodiment of the present invention includes an imaging device 10, a control device 220, and an output device 90.

  The image capturing apparatus 10 captures an image of a range including a detection target area at the rear right and front right of the host vehicle and generates an image signal (not shown), and an image signal that is an analog signal generated by the image capturing section. An A / D conversion unit (not shown) for converting A / D into a digital signal, and an image memory (not shown) for temporarily storing the A / D converted image signal.

  The control device 220 includes the discriminator storage unit 18, the detection unit 21, the priming stimulus presentation control unit 222, the control unit 226, the time management unit 228, and the history storage unit 230. The control device 220 includes a CPU, a RAM, and a ROM that stores a program for executing a control processing routine described later and various data, and controls the output device 90 by executing the program.

  In the output device 90 according to the second embodiment, the intensity of the visual stimulus at at least one portion other than at least one portion corresponding to the region where the detection target is detected by the detection unit 21 is the minimum intensity that can be perceived by the driver. Stimulation of the

  In the present embodiment, a position superimposed on a lane on the right side of the traveling lane of the host vehicle is defined as a first position.

  The discriminator storage unit 18 stores a discriminator generated in advance by learning and referred to when the detection unit 21 detects the detection target. In the second embodiment, a case where the detection target is an automobile will be described. The case where the discriminator storage unit 21 is provided in the control device 220 will be described.

  The discriminator used in the second embodiment is learned from a plurality of detection target images and a plurality of non-detection target images. Specifically, first, for each of a plurality of detection target images and a plurality of non-detection target images, each of the partial regions is exhaustively scanned for each of a plurality of windows having different sizes. get. Next, the feature amount of each of the partial regions is calculated. Next, a learning process is performed based on each feature amount of the partial region and each of the classifications (whether or not the images are of the detection target) of the image from which the partial region has been acquired, and the classifier is learned.

  The detection unit 21 determines whether or not the detection target is detected based on the image input from the imaging device 10 and the classifier for detecting the detection target stored in the classifier storage unit 18. judge. When it is determined that the detection target has been detected, the result is output to the control unit 226. Specifically, first, the image input from the imaging device 10 is exhaustively scanned for each of a plurality of windows having different sizes, and each of the partial regions is acquired. Next, the feature amount of each of the partial regions is calculated. Next, it is determined whether or not the detection target is detected in the image based on the feature amount for each partial area and the classifier for detecting the detection target stored in the classifier storage unit 18. I do.

  The priming stimulus presentation control unit 222 receives the notification of the presentation of the visual stimulus from the control unit 226 and, immediately before the control unit 226 presents the main stimulus, uses the output device 90 to output the priming that is the preceding stimulus of the main stimulus. The stimulus is controlled to be presented at a first position where the main stimulus is presented first.

  When acquiring the result of detection of the detection target from the detection unit 21, the control unit 226 inquires of the time management unit 228 whether or not the visual stimulus can be presented. When acquiring the visual stimulus presentation instruction information, the priming stimulus presentation control is performed. The priming stimulus presentation control unit 222 controls the output device 90 to present the visual stimulus after the priming stimulus presentation control unit 222 presents the priming stimulus. It outputs to the time management unit 228 as the time at which the presentation was started. Further, when the detection unit 21 does not detect the detection target object, the control unit 226 controls the output device 90 to present the visual stimulus when acquiring the visual stimulus presentation instruction information from the time management unit 228, The current time is output to the time management unit 228 as the time at which the presentation of the visual stimulus was started.

  When acquiring the time at which the presentation of the visual stimulus is started from the control unit 226, the time management unit 228 sets the time obtained by adding 5 seconds, which is the presentation period of the visual stimulus, to the time as the presentation end time of the previous visual stimulus. It is stored in the history storage unit 230. Further, the time management unit 228 compares the current time with the previous end time of presentation of the visual stimulus stored in the history storage unit 230, and determines that the difference is a predetermined stop period, for example, 1 minute 30 seconds or more. In some cases, presentation instruction information of visual stimulus is output to the control unit 226. Further, when the control unit 226 inquires whether the visual stimulus can be presented, the time management unit 228 compares the current time with the previous visual stimulus presentation end time stored in the history storage unit 230. Then, when the difference is a predetermined pause period, for example, a period longer than 30 seconds, the control unit 226 outputs the visual stimulus presentation instruction information.

<Operation of Arousal Maintenance Device According to Second Embodiment>

  Next, the operation of the alertness maintenance device 200 according to the second embodiment of the present invention will be described. First, when the driver turns on the ignition key, the imaging device 10 starts imaging and outputs it to the control device 220 as needed. Then, the control device 20 executes the control processing routine shown in FIG.

  First, in step S200, a classifier for detecting a detection target stored in the classifier storage unit 18 is read.

  Next, in step S202, a captured image input from the imaging device 10 is received.

  Next, in step S204, based on the classifier for detecting the detection target acquired in step S200 and the captured image acquired in step S202, it is determined whether or not the detection target is detected in the image. judge. If it is determined that the detection target has been detected, the process proceeds to step S208. On the other hand, when it is determined that the detection target has not been detected, the process proceeds to step S206.

  In step S206, the previous visual stimulus presentation end time stored in the history storage unit 230 is read, and the visual stimulus is presented based on the current time and the previous visual stimulus presentation end time based on the current time and the previous visual stimulus presentation end time. It is determined whether not. If the presentation of the visual stimulus is not performed during the suspension period, the process proceeds to step S210. On the other hand, if the presentation of the visual stimulus is being performed during the suspension period, the process proceeds to step S202, and the processing from step S202 is repeated.

  In step S208, the previous visual stimulus presentation end time stored in the history storage unit 230 is read, and based on the current time and the previous visual stimulus presentation end time, the current visual stimulus presentation end time is stopped from the previous visual stimulus presentation end time. It is determined whether the period has elapsed. If the suspension period has elapsed since the previous presentation end time of the visual stimulus, the process proceeds to step S210. On the other hand, if the stop period has not elapsed since the previous presentation end time of the visual stimulus, the process proceeds to step S202.

  In step S210, the output device 90 is controlled so as to present the priming stimulus.

  Next, in step S212, the output device 90 is controlled so as to present a visual stimulus.

  Next, in step S214, it is determined whether or not a predetermined continuation period has elapsed since the output device 90 is controlled to present a visual stimulus in step S212. If the predetermined duration has elapsed, the process proceeds to step S216. On the other hand, if the predetermined duration has not elapsed, the process of step S214 is repeated.

  Next, in step S216, the output device 90 is controlled so that the presentation of the visual stimulus is stopped, the process proceeds to step S202, and the process from step S202 is repeated.

<Example of experiment>

  As an experimental example, a wake-up maintaining device according to the second embodiment, which presents a priming stimulus and a saccade stimulus in accordance with the timing at which a detection target vehicle is detected in the right lane, and a priming stimulus is presented. An experiment was performed using an awakening maintenance device that presents only a saccade stimulus (hereinafter, referred to as a comparison awakening maintenance device) in accordance with the timing at which the detection target vehicle is detected in the right vehicle. The results obtained are shown. FIG. 6 shows an example of priming stimulus presentation and saccade stimulus presentation when the arousal maintenance device according to the second embodiment is used.

  FIG. 7 shows an experimental example of gaze tracking when the priming stimulus and the saccade stimulus are presented. FIG. 7 is an example in which the priming stimulus is repeated once and the saccade stimulus is repeated four times in the presentation of the visual stimulus at the first position and the second position. In FIG. 7, when the driver's line of sight moves to the first position, the abscissa value becomes a large value. In FIG. 7, it can be seen that the eyes are accurately followed.

  FIG. 8 shows the gaze follow-up rate when the priming stimulus and the saccade stimulus are presented for 25 minutes. In the example of FIG. 8, s1 indicates gaze tracking in a case where presentation of a saccade stimulus occurs four times in the right direction. s2 indicates a gaze tracking rate in a case where presentation of priming stimulus once per minute, saccade stimulus four times, and visual stimulus a total of five times occurs in the right direction. s1 represents the result of the arousal maintenance device to be compared, and s2 represents the result of the arousal maintenance device according to the second embodiment. From the results of FIG. 8, it is found that the wakefulness maintenance device according to the second embodiment continues to induce saccade eye movements more effectively than the wakefulness maintenance device of the comparison target even after 25 minutes have elapsed. Understand. Actually, it is considered that the value of about 1 or more lasts after 10 minutes (average 1.16), and the effect appears over time.

  FIG. 9 shows the long-term eye closure rate (percentage of the total time of continuous eye closure of 0.5 seconds or more) per minute when simulated driving was performed for 45 minutes using a driving simulator under two stimulation conditions. Shows the time change. In the arousal maintenance device according to the second embodiment, a result was obtained in which the reduction in arousal was suppressed in the latter half of the experiment, as compared with the case of the arousal maintenance device to be compared. Note that the vertical axis in FIG. 9 is the long-term eye closing rate per minute (the ratio of the total time of continuous eye closing of 0.5 seconds or more), which is one of the indices indicating the arousal state. , Arousal, and drowsiness.

  As described above, according to the arousal maintenance device 200 according to the second embodiment, the detection target is detected, and at the timing corresponding to the timing at which the detection target is detected, immediately before the main stimulus is presented. Then, after controlling to present the priming stimulus to the first position where the main stimulus is first presented, the traveling lane of the vehicle is moved so that the driver's line of sight moves in the left-right direction in order to maintain the driver's awake state. By presenting a visual stimulus at a first position superimposed on the right lane of the vehicle and at a second position within the front view of the driver and separated from the first position in the left-right direction, bothersomeness to the user, The user's awake state can be maintained without causing discomfort.

  The present invention is not limited to the above-described embodiment, and various modifications and applications can be made without departing from the gist of the present invention.

  In the second embodiment, the case where the stop period is 1 minute and 30 seconds and the pause period is 30 seconds has been described, but the present invention is not limited to this. For example, the suspension period and the suspension period may be set as arbitrary periods.

  Next, a third embodiment will be described. Note that portions having the same configuration and operation as those of the first and second embodiments are denoted by the same reference numerals and description thereof is omitted.

  In the third embodiment, when presenting a visual stimulus, the first position is determined according to the position of the detected detection target, and the point of presenting the speed information of the surrounding vehicle as a priming stimulus. Are different from the second embodiment. FIG. 10 shows an example of priming stimulus presentation and saccade stimulus presentation when the speed information of the surrounding vehicle is presented in the awakening maintenance device according to the third embodiment.

<Configuration of Arousal Maintenance Device According to Third Embodiment>

  Next, an alertness maintaining device according to a third embodiment of the present invention will be described. As shown in FIG. 11, the alertness maintaining apparatus 300 according to the third embodiment of the present invention includes an imaging device 10, a control device 320, and an output device 390.

  The control device 320 includes a discriminator storage unit 18, a detection unit 321, a position storage unit 325, a priming stimulus presentation control unit 322, an information detection unit 324, and a control unit 326.

  The output device 390 is a device that presents visual stimuli from two positions separated to the left and right of the driver. In the third embodiment, a head-up display unit provided on the front windshield of the driver is used. Here, in the head-up display section of the front windshield of the driver, the center position is the second position with the driver's front as the center. In the head-up display section of the front windshield of the driver, a position that is superimposed on the lane on the right side of the traveling lane of the vehicle is defined as a first position. It is assumed that the first position changes every cycle period during which the visual stimulus is presented, based on the specific position at which the visual stimulus is input from the control unit 326. When the visual stimulus indicated by the priming stimulus presentation control unit 322 is presented, the estimated speed of the detection target object estimated by the information detection unit 324 is presented.

  The detection unit 321 determines whether or not a detection target is detected based on an image input from the imaging device 10 and a classifier for detecting the detection target stored in the classifier storage unit 18. judge. In addition, when the detection target is detected, the detection unit 321 acquires the coordinate value of the two-axis coordinates at which the detection target is detected, and outputs the coordinate value to the control unit 326. In the third embodiment, the origin is the viewpoint position of the driver, and the coordinates are two-axis coordinates using two axes perpendicular to the traveling direction of the vehicle.

  The information detection unit 324 estimates the speed of the detection target based on the detection target detected by the detection unit 321.

  When the priming stimulus presentation control unit 322 obtains the detection result of the detection target from the detection unit 321, the priming stimulus which is the preceding stimulus of the main stimulus is output by the output device 90 immediately before the control unit 326 presents the main stimulus. Is controlled to be presented at the first position where the main stimulus is presented first. At this time, the output device 90 is controlled so as to present the speed estimated by the information detection unit 324 as a priming stimulus.

  The position storage unit 325 stores the correspondence between each of the two-axis coordinate values used in the detection unit 321 and each of the specific positions of the head-up display unit provided on the front windshield of the driver. .

  When acquiring the result of detection of the detection target from the detection unit 321, the control unit 326 controls the output device 390 so as to present a visual stimulus after presentation by the control of the priming stimulus presentation control unit 322. Specifically, first, the control unit 326 presents a visual stimulus on the basis of the coordinate value at which the detection target input from the detection unit 321 is detected and the correspondence stored in the position storage unit 325. Then, a specific position to be determined is determined as a first position, and further, a second position in the front view of the driver and separated in the left-right direction from the first position is determined. Then, the output device 390 is controlled so as to present the visual stimulus at the determined first position and second position. Note that the first position may follow the detection target by changing the first position according to the speed estimated by the information detection unit 324.

<Operation of Arousal Maintenance Device According to Third Embodiment>

  Next, the operation of the alertness maintaining apparatus 300 according to the third embodiment of the present invention will be described. First, when the driver turns on the ignition key, the imaging device 10 starts imaging and outputs the image to the control device 320 as needed. Then, the control processing routine shown in FIG. 12 is executed by the control device 320.

  In step S300, each of the two-axis coordinate values used in the detection unit 321 stored in the position storage unit 325 and each of the specific positions of the head-up display unit provided on the front windshield of the driver are compared. Read the correspondence.

  In step S204, based on the classifier for detecting the detection target acquired in step S200 and the captured image acquired in step S202, it is determined whether or not the detection target is detected in the image. If it is determined that the detection target has been detected, the process proceeds to step S302. On the other hand, when it is determined that the detection target has not been detected, the process proceeds to step S101, and the processes from step S202 to step S204 are repeated.

  In step S302, the coordinate value of the position where the detection target is detected is acquired.

  Next, in step S304, a specific position of the head-up display unit is determined based on the correspondence acquired in step S300 and the coordinate values of the detection target acquired in step S302, and the first position is determined. Further, the second position is determined.

  In step S306, the speed of the detection target is estimated as peripheral information based on the detection target detected in step S204.

  In step S308, the output device 90 is controlled so that the estimated speed of the detection target object estimated in step S306 is presented as the priming stimulus to the first position determined in step S304.

  Next, in step S310, the output device 90 is controlled so as to present a visual stimulus to the first position and the second position determined in step S304.

  As described above, according to the arousal maintenance device 300 according to the third embodiment, the detection target is detected, and at the timing corresponding to the timing at which the detection target is detected, immediately before the main stimulus is presented. Then, after controlling so as to present the estimated speed of the detection target as the priming stimulus to the first position where the main stimulus is first presented, the driver's line of sight is moved left and right to maintain the driver's awake state. As described above, by presenting the visual stimulus to the first position and the second position determined based on the position where the detection target is detected, the user can be awakened without feeling troublesome and uncomfortable. The state can be maintained.

  The present invention is not limited to the above-described embodiment, and various modifications and applications can be made without departing from the gist of the present invention.

  Also in the third embodiment, similarly to the second embodiment, the output device is controlled so as not to present the visual stimulus for a certain period from the presentation of the visual stimulus, and to present the visual stimulus for a certain period. May be controlled so that a visual stimulus is presented when the visual stimulus is not performed. In this case, the position at which the visual stimulus is presented when the visual stimulus is not presented for a certain period of time may be predetermined or may be presented at the previous presentation position.

10 imaging device 18 discriminator storage unit 20, 220, 320 control unit 21, 321 detection unit 22, 222, 322 priming stimulus presentation control unit 26, 226, 326 control unit 90, 390 output device 100, 200, 300 alertness maintaining device 228 Time management unit 230 History storage unit 324 Information detection unit 325 Position storage unit

Claims (12)

Detecting means for detecting a detection target object from a forward view of a driver of the vehicle;
At least one predetermined location in the front view of the driver on the vehicle, and in the front view of the driver, separated from the at least one location in the left-right direction, and the detection target is detected by the detection unit. Stimulus presenting means for presenting a visual stimulus at each of at least one position corresponding to a region to be detected;
The main stimulus is presented by the stimulus presenting means at a timing corresponding to the timing at which the detection target is detected by the detecting means so as to move the driver's line of sight in the left-right direction in order to maintain the driver's awake state. Immediately before the main stimulus is presented by the control means, the priming stimulus which is a preceding stimulus of the main stimulus by the stimulus presentation means at a position corresponding to the position where the main stimulus is first presented. Priming stimulus presentation control means to be presented;
A wakefulness maintenance device, including: The stimulus presenting unit may be configured such that the intensity of the visual stimulus at a location other than at least one location corresponding to a region where the detection target is detected by the detection unit is a stimulus having a minimum intensity that can be perceived by the driver. Item 2. The alertness maintaining device according to Item 1 . Wherein, the predetermined stop period, when the detection object is not detected by said detecting means, by the stimulation presenting unit, according to claim 1 or 2 is presented the visual stimulus to the each position Awakening device. The alertness maintaining means according to any one of claims 1 to 3 , wherein the stimulus presenting means presents a visual stimulus having a predetermined intensity corresponding to an upper limit of the intensity of the visual stimulus that can be perceived by the driver without any burden. apparatus. The control means, after presenting a visual stimulus by the stimulus presenting means for a predetermined duration, controls the stimulus presenting means so as not to present the visual stimulus for a predetermined pause period. The arousal maintenance device according to any one of claims 1 to 4 . The arousal according to any one of claims 1 to 5 , wherein the stimulus presenting means presents the main stimulus or the priming stimulus on a windshield of the vehicle, a room mirror of the vehicle, or a side mirror of the vehicle. Maintenance device. The arousal maintenance device according to any one of claims 1 to 6 , wherein the control means causes the stimulus presentation means to present a visual stimulus so as to cause a saccade movement of the driver's eye. The control means controls at least one of a presentation order, a presentation cycle, a presentation start, a presentation stop, a presentation strength, and a presentation color of a main stimulus presented by the stimulus presentation means. Item 8. The alertness maintaining device according to any one of Items 1 to 7 . The arousal maintenance device according to any one of claims 1 to 8 , wherein the control means controls the stimulus presentation means so as to repeatedly present the main stimulus at each position in a predetermined order. The arousal maintenance device according to any one of claims 1 to 9 , wherein the stimulus presenting unit presents the main stimulus or the priming stimulus by outputting blue light from each position. Further including information detection means for detecting peripheral information,
The awakening maintenance device according to any one of claims 1 to 10 , wherein the priming stimulus presentation control unit causes the stimulus presentation unit to present, as the priming stimulus, the peripheral information detected by the information detection unit. Detecting means for detecting the detection target object from the front view of the driver of the vehicle,
At least one predetermined location in the front view of the driver on the vehicle, and in the front view of the driver, separated from the at least one location in the left-right direction, and the detection target is detected by the detection unit. Stimulus presenting means for presenting a visual stimulus at each of at least one position corresponding to the detected area, and moving the driver's line of sight in the left-right direction in order to maintain the driver's awake state. At a timing corresponding to the timing at which the detection target is detected by the detection means, a control means for presenting a main stimulus by the stimulus presentation means, and immediately before the main stimulus is presented by the control means, by the stimulus presentation means, Priming for presenting a priming stimulus which is a preceding stimulus of the main stimulus at a position corresponding to a position where the main stimulus is first presented; Stimulus presentation control means,
Program to function as