JP7692192B2 - Driving simulator and method for controlling driving simulator - Google Patents

Description

Article 30, paragraph 2 of the Patent Act applies. November 7, 2020. The applicant published information on the driving simulator and the control method of the driving simulator on the website (https://www.jsis.org/society/committee/2020/4th/TR-035-04-005.pdf).

Article 30, Paragraph 2 of the Patent Act applies. November 14, 2020: The applicant disclosed information regarding a driving simulator and a control method for the driving simulator at the 4th 2020 research meeting of the Japan Society for Information and Systems in Education (JSiSE).

Article 30, paragraph 2 of the Patent Act applies March 14, 2021 The applicant published information on the driving simulator and the control method of the driving simulator on the website (https://www.jsis.org/society/committee/2020/6th/TR-035-06-C-1-1.pdf)

Article 30, Paragraph 2 of the Patent Act applies March 21, 2021 The applicant disclosed information regarding a driving simulator and a control method for the driving simulator at the 6th 2020 research meeting of the Japan Society for Information and Systems in Education (JSiSE).

The present invention relates to a driving simulator and a control method for the driving simulator.

In recent years, driving simulation devices have been widely used for driving lessons for vehicles such as motorcycles, automobiles, and railroad cars. For example, Patent Document 1 describes a vehicle driving simulator device in which a mode switching unit switches from an operation proficiency mode to a main test mode when it is determined that the test subject has mastered braking operation. Patent Document 2 describes a driving simulator for lessons on time-sensitive tasks.

JP 2010-102171 A JP 2010-122477 A

Driving involves repeated processes of cognition, judgment, and operation. However, while the operation process can be checked using the devices described in Patent Documents 1 and 2, the cognition and judgment process cannot be checked even when using existing driving simulation devices. This has resulted in the problem that trainees are unable to accurately grasp the issues with their own cognition and judgment processes in driving, making it impossible to effectively conduct safety confirmation training, in which the cognition and judgment processes are important.

The present invention aims to provide a driving simulation device that can effectively conduct training on safety checks, including cognition and judgment while driving.

A driving simulation device according to an embodiment of the present invention is a driving simulation device that includes a control device, a display device, and a gaze detection device, and that simulates driving a vehicle. The control device includes an image generation unit that generates a simulated image to be displayed on the display device and outputs it to the display device, a gaze point acquisition unit that acquires the position of the gaze point of the student on the simulated image based on the direction of the student's gaze in the mock course detected by the gaze detection device, a memory unit that stores teacher data on the movement of the gaze point on the mock image, an evaluation unit that evaluates the student's degree of driving safety confirmation based on the similarity between the movement of the gaze point of the student on the mock image and the movement of the gaze point in the teacher data, and an operation acquisition unit that acquires from the operation device an operation signal representing the operation of the operation device by the student during the mock course. The image generation unit generates a simulated image to be displayed on the display device in response to the operation signal, and outputs it to the display device. The evaluation unit calculates the similarity between the movement of the student's gaze point and the movement of the gaze point in the teacher data when the student performs a specified operation on the operation device as the student's degree of driving safety confirmation .

A control method for a driving simulation device according to an embodiment of the present invention generates a simulated image to be displayed on a display device, outputs the simulated image to the display device, acquires the position of the trainee's gaze point on the simulated image based on the direction of the trainee's gaze in the simulated training detected by a gaze detection device, and evaluates the trainee's degree of safety awareness of driving based on the similarity between the movement of the trainee's gaze point on the simulated image and the movement of the gaze point in the teacher data.

The present invention provides a driving simulation device that can effectively conduct training on safety checks, including cognition and judgment while driving.

FIG. 1 is a diagram illustrating an example of a configuration of a driving simulation device. FIG. 2 is a diagram illustrating an example of a hardware configuration of a control device and an operation device. FIG. 2 is a functional block diagram of a memory unit and a control unit of the driving simulation device. 4 is a flowchart showing an example of a control method for the driving simulator. 13A and 13B are diagrams illustrating an example of the movement of the gaze point of a student and the movement of the gaze point of teacher data. FIG. 13 is a diagram showing an example of a reproduced image reproduced on a display device.

The driving simulation device of the present invention evaluates the degree of safety confirmation of a trainee's driving based on the similarity between the movement of the trainee's gaze point on a simulated image in a simulated training course in which the trainee drives a vehicle and the movement of the gaze point in the teacher data. As a result, the trainee's cognition and judgment process in driving is evaluated based on the movement of the trainee's gaze point on a simulated image, allowing the trainee to accurately grasp issues with safety confirmation, including cognition and judgment, in driving.

The following describes preferred embodiments with reference to the drawings. Note that the present invention is not limited to the following embodiments, and can be modified as appropriate without departing from the spirit of the invention. In addition, in each drawing, parts having the same or equivalent functions are given the same reference numerals, and their description may be omitted or simplified.

Figure 1 is a diagram showing an example of the configuration of a driving simulation device 1. The driving simulation device 1 includes a control device 2, a steering wheel 31, a deceleration operation means 32, an acceleration operation means 33, a display device 4, and a line of sight detection device 5. The driving simulation device 1 may further include a speaker, etc. Note that while Figure 1 shows an example of the configuration of a driving simulation device 1 for automobile training, the driving simulation device 1 may also be used for training on motorcycles, railway vehicles, etc.

The control device 2 is connected by wire or wirelessly to be able to communicate with the handlebars 31, deceleration operation means 32, acceleration operation means 33, display device 4, and gaze detection device 5, and controls the entire driving simulation device 1. The control device 2 also functions as a calculation device for simulating a virtual space in which the trainee's vehicle moves together with other vehicles 6a, 6b, pedestrians 7a, 7b, bicycles 8, etc., based on a simulated training scenario.

The steering wheel 31, deceleration operation means 32, and acceleration operation means 33 are operated by the trainee of the simulated training course to simulate driving a vehicle, and output operation signals indicating that they have been operated by the trainee to the control device 2. When the driving simulation device 1 is for a training course on automobiles, the steering wheel 31, deceleration operation means 32, and acceleration operation means 33 are a steering wheel, a brake pedal, and an accelerator pedal, respectively. When the driving simulation device 1 is for a training course on railway vehicles, the steering wheel 31 is omitted.

The display device 4 is disposed in front of the trainee, and displays the scenery in the virtual space that the trainee of the mock training will see from the vehicle in the virtual space as a simulated image 41. This simulated image 41 is generated by the control device 2 and output to the display device 4. For example, the simulated image 41 shown in FIG. 1 displays the scenery on the road in the virtual space that the trainee sees in front of the vehicle, and the scenery that the trainee sees behind the vehicle through the rearview mirror 42 in the virtual space is displayed in the upper right of the simulated image 41. The trainee of the mock training drives the vehicle in a simulated manner while operating the handlebars 31, the deceleration operation means 32, and the acceleration operation means 33 so that the vehicle does not collide with the objects of caution such as other vehicles 6a, 6b, pedestrians 7a, 7b, and bicycles 8 displayed on the simulated image 41. On the simulated image 41, the other vehicles 6b, pedestrians 7a, 7b, bicycles 8, etc. that the trainee should be careful of may be displayed with a figure 9 or in a different color to highlight them. The figure 9 is, for example, a circular frame shape, and is, for example, red in color. This allows the trainees' gaze to be appropriately guided to the object of attention, making driving safety training more effective.

The gaze detection device 5 is installed, for example, on the display device 4 arranged in front of the student as shown in FIG. 1, and detects the direction of the student's gaze and outputs it to the control device 2. As the gaze detection device 5, for example, one having a visible light or infrared camera and detecting the direction of the student's gaze based on the position of the pupil in an image of the student's eye captured by the visible light or infrared camera is used.

Figure 2 is a diagram showing an example of the hardware configuration of the control device 2 and the operation device 3. The control device 2 has a memory unit 21, a control unit 22, an external communication I/F 23, and a video output I/F 24, which are communicatively connected to each other via an internal bus 20. The operation device 3 has a handle 31, a deceleration operation means 32, and an acceleration operation means 33.

The storage unit 21 has a volatile memory such as a RAM (Random Access Memory) and a non-volatile memory such as a HDD (Hard Disk Drive) or a flash memory (registered trademark). The storage unit 21 also stores computer programs executed by the control unit 22 and data processed by the computer programs.

The control unit 22 has one or more processors and peripheral circuits, and executes a computer program stored in the memory unit 21 to control each part of the driving simulation device 1. The control unit 22 may be configured with an integrated circuit such as an FPGA (Field Programmable Gate Array) or an ASIC (Application Specific Integrated Circuit).

The external communication I/F 23 has a communication I/F circuit for connecting the control unit 22 to the operation device 3 and the line of sight detection device 5 via the communication line 30, and enables the control unit 22 to communicate with the operation device 3 and the line of sight detection device 5. The external communication I/F 23 receives signals output from the operation device 3 or the line of sight detection device 5 and transmits them to the control unit 22, and receives signals output from the control unit 22 and transmits them to the operation device 3 or the line of sight detection device 5.

The video output I/F 24 has a communication I/F circuit for connecting the control unit 22 to the display device 4 via a communication line 40, and enables the control unit 22 to communicate with the display device 4. The video output I/F 24 receives signals output from the display device 4 and transmits them to the control unit 22, and receives signals output from the control unit 22 and transmits them to the display device 4.

Figure 3 is a functional block diagram of the memory unit 21 and the control unit 22 of the driving simulation device 1. The memory unit 21 stores an image generation program 211, an operation acquisition program 212, an evaluation program 213, and a gaze point acquisition program 214 as software modules or firmware, etc. The control unit 22 functions as an image generation unit 221, an operation acquisition unit 222, an evaluation unit 223, and a gaze point acquisition unit 224 by reading and executing each computer program stored in the memory unit 21.

The storage unit 21 may also store teacher data 215, which will be described later, in non-volatile memory.

Figure 4 is a flowchart showing an example of a control method for the driving simulation device 1. This flowchart is executed by the control unit 22 in the control device 2 while and after a participant of the simulation course is operating the operation device 3 to simulate driving a vehicle so as not to collide with a cautionary object displayed on the simulation image 41.

In step S1, the image generation unit 221 generates a simulated image 41 to be displayed on the display device 4 and outputs it to the display device 4. In addition, the operation acquisition unit 222 acquires an operation signal from the operation device 3 indicating that a participant of the mock training has operated the operation device 3, and stores the operation signal in the memory unit 21 as operation data.

In step S2, the gaze point acquisition unit 224 acquires from the gaze detection device 5 a signal indicating the direction of the student's gaze detected by the gaze detection device 5, calculates the position of the student's gaze point on the simulated image 41 based on the acquired signal, and stores the position as gaze point data in the memory unit 21. Here, the gaze refers to the direction of the student's gaze detected by the gaze detection device 5, and the gaze point refers to the position coordinates of the viewpoint on the simulated image 41 that the student is gazing at, which is calculated by the gaze point acquisition unit 224 based on the direction of the student's gaze.

The image generation unit 221, the operation acquisition unit 222, and the gaze point acquisition unit 224 repeat steps S1 to S2 until the mock training scenario ends (No in step S3).

When the mock training scenario is completed (Yes in step S3), the evaluation unit 223 calculates the similarity between the movement of the gaze point of the trainee on the mock image 41 and the movement of the gaze point of the teacher data in step S4. Here, the teacher data used is, for example, the gaze movement acquired by having a model driver take the mock training scenario in advance and stored in the storage unit 21 as teacher data 215.

Figure 5 is a diagram showing an example of the movement 10 of the gaze point of the student and the movement 11 of the gaze point of the teacher data. In FIG. 5(a), the movement 10 of the gaze point of the student acquired by the gaze point acquisition unit 224 when the vehicle driven by the student approaches an intersection in a simulated training scenario, and the movement 11 of the gaze point of the teacher data stored in the storage unit 21 are superimposed on a simulated image 41. In addition, FIG. 5(b) shows the position coordinates pi, qi of the movement 10 of the gaze point of the student at time ti, and the position coordinates ri, si of the movement 11 of the gaze point of the teacher data at time ti. In addition, FIG. 5(c) shows the trajectory 12 of the gaze point of the student and the trajectory 13 of the gaze point of the teacher data, which are obtained by removing the time information from the movement 10 of the gaze point of the student and the movement 11 of the gaze point of the teacher data shown in FIG. 5(b).

When the vehicle approaches an intersection, the participant in the simulation course operates the deceleration operating means 32 at time t0 to decelerate the vehicle. At this time, the movement 10 of the participant's gaze point moves in this order over another vehicle 6a stopped on the road, a pedestrian 7a hiding in the blind spot of the other vehicle 6a, another vehicle 6b moving in the oncoming lane, and a pedestrian 7b trying to cross the crosswalk, before returning to the other vehicle 6a.

On the other hand, the movement 11 of the gaze point of the teacher data in which the model driver took the same simulated training scenario not only follows the movement 10 of the gaze point of the student, but also moves over the bicycle 8 approaching from behind as seen in the rearview mirror 42. In this way, by comparing the movement 10 of the gaze point of the student with the movement 11 of the gaze point of the teacher data, it is possible to know that the student overlooked the safety check for the bicycle 8 approaching from behind as seen in the rearview mirror 42.

Therefore, the evaluation unit 223 calculates the similarity between the movement 10 of the gaze point of the student and the movement 11 of the gaze point of the teacher data when the student performs a predetermined operation on the operation device 3. The predetermined operation is, for example, the operation of the deceleration operation means 32. In this case, the evaluation unit 223 can calculate the similarity between the movement 10 of the gaze point of the student shown in FIG. 5(b) and the movement 11 of the gaze point of the teacher data, for example, by the following formula (1).
Similarity = 1/Σ{(pi-ri) ² + (qi-si) ² } (1)

Here, Σ represents the sum for each time ti from time t0 to time t4. Time ti is normalized so that time t0, when the student operates the deceleration operation means 32, is the reference time, and time t4 is the time when a certain period of time has passed since time t0, and the certain period of time is, for example, 2 seconds.

Alternatively, the evaluation unit 223 may calculate the spatial similarity between the trajectory 12 of the gaze point of the student and the trajectory 13 of the gaze point of the teacher data within a certain period including the time when the student performed a predetermined operation. In this case, the evaluation unit 223 can calculate the similarity between the trajectory 12 of the gaze point of the student shown in FIG. 5C and the trajectory 13 of the gaze point of the teacher data as, for example, the reciprocal of the DTW (Dynamic Time Warping) distance described in the literature (Naito Hironobu, Matsuura Kenji, Kashiwabara Akihiro, Saito Rei, Toi Takeo, Kurita Genta: Awareness Support Environment When Driving a Car Introducing Line-of-Sight Guidance, 2020 Fourth Research Meeting of the Society for Information Systems in Education, Vol. 35, No. 4, 21-26, November 2020). This makes it possible to know whether the student has confirmed the attention object regardless of the order in which the attention object on the simulated image 41 was confirmed.

The predetermined operation that is the timing for calculating the similarity is not limited to the operation of the deceleration operation means 32, but may be a more complicated operation. For example, the predetermined operation may be the trainee operating the operation device 3 in the order of the deceleration operation means 32, the handle 31, and the acceleration operation means 33. In this case, the above-mentioned certain period for calculating the similarity may be, for example, the period from when the trainee operates the deceleration operation means 32 to when the trainee operates the acceleration operation means 33.

In step S5, the evaluation unit 223 evaluates the degree of the trainee's driving safety confirmation based on the similarity calculated in step S4. For example, the evaluation unit 223 can use the average of the similarities calculated for multiple scenes as the evaluation value of the trainee's driving safety confirmation. This associates the movement of the trainee's gaze point on the simulated image with the driving operation process to evaluate the trainee's driving safety confirmation, making it possible to comprehensively evaluate the trainee's driving cognition, judgment, and operation processes.

In step S6, the image generating unit 221 generates a playback image 43 of the mock training in accordance with the operation data of the student acquired during the mock training and stored in the memory unit 21, and plays the gaze point data of the student acquired during the mock training and stored in the memory unit 21 on the playback image 43 by superimposing it on the display device 4.

Figure 6 is a diagram showing an example of a playback image 43 played on the display device 4. The movement 10 of the trainee's gaze point and the movement 11 of the gaze point of the teacher data are superimposed on the playback image 43 shown in Figure 6, and the trainee can understand safety confirmation issues in his or her own driving by looking at the playback image 43 being played back. Note that in Figure 5 (a), for the sake of convenience of explanation, the movement 10 of the trainee's gaze point and the movement 11 of the gaze point of the teacher data are superimposed on the mock image 41, but it should be noted that they are not superimposed on the mock image 41 during the mock lesson.

The image generating unit 221 may highlight objects displayed on the reproduced image 43 that are not overlapped by the trainee's gaze point but are overlapped by the gaze point of the teacher data by displaying them on the simulated image using a graphic 9 or by changing the color. The graphic 9 may, for example, be a circular frame shape and may, for example, be red in color. This allows the trainee to know from the graphic 9 that, when checking for safety while driving, he or she overlooked a bicycle 8 approaching from behind reflected in the rearview mirror 42 shown in FIG. 6, for example, and thus makes it easier for the trainee to grasp problems with checking for safety while driving.

The image generating unit 221 may output the evaluation value of the trainee's driving safety confirmation calculated by the evaluating unit 223 to the display device 4 for display.

As described above, the driving simulation device is a driving simulation device that includes a control device, a display device, and a gaze detection device, and simulates driving of a vehicle. The control device has an image generation unit that generates a simulated image to be displayed on the display device and outputs it to the display device, a gaze point acquisition unit that acquires the position of the gaze point of the student on the simulated image based on the direction of the student's gaze in the mock course detected by the gaze detection device, a memory unit that stores teacher data on the movement of the gaze point on the mock image, an evaluation unit that evaluates the student's degree of safety confirmation of driving based on the similarity between the movement of the gaze point of the student on the mock image and the movement of the gaze point in the teacher data, and an operation acquisition unit that acquires from the operation device an operation signal representing the operation of the operation device by the student during the mock course , and the image generation unit generates a simulated image to be displayed on the display device in response to the operation signal and outputs it to the display device, and the evaluation unit calculates the similarity between the movement of the student's gaze point and the movement of the gaze point in the teacher data when the student performs a specified operation on the operation device as the student's degree of safety confirmation of driving . This provides a driving simulation device that can effectively conduct training on safety checks, including cognition and judgment while driving.

The above-described embodiments are merely examples of how the present invention can be implemented, and the technical scope of the present invention should not be interpreted in a limiting manner based on these. In other words, the present invention can be implemented in various forms without departing from its technical concept or main features.

REFERENCE SIGNS LIST 1 Simulated driving device 2 Control device 3 Operation device 4 Display device 5 Line-of-sight detection device 6a Other vehicle 6b Other vehicle 7a Pedestrian 7b Pedestrian 8 Bicycle 9 Graphic 31 Handle 32 Deceleration operation means 33 Acceleration operation means 41 Simulated image 42 Rearview mirror 43 Reproduced image 211 Image generation program 212 Operation acquisition program 213 Evaluation program 214 Gazing point acquisition program 221 Image generation section 222 Operation acquisition section 223 Evaluation section 224 Gazing point acquisition section

Claims (8)

A driving simulator that includes a control device, a display device, and a gaze detection device and that simulates driving a vehicle,
The control device includes:
an image generating unit that generates a simulated image to be displayed on the display device and outputs the simulated image to the display device;
a gaze point acquisition unit that acquires a position of a gaze point of the student on the simulated image based on a gaze direction of the student in the simulated training detected by the gaze detection device;
A storage unit that stores teacher data on the movement of the gaze point on the simulated image;
an evaluation unit that evaluates a degree of the student's driving safety confirmation based on a similarity between a movement of the gaze point of the student on the simulation image and a movement of the gaze point of the teacher data;
an operation acquisition unit that acquires an operation signal representing an operation of the operation device by the trainee during the mock training from the operation device;
having
the image generation unit generates a simulated image to be displayed on the display device in response to the operation signal, and outputs the simulated image to the display device;
The evaluation unit calculates the similarity between the movement of the gaze point of the student when the student performs a specified operation on the operating device and the movement of the gaze point of the teacher data as a degree of the student's confirmation of safety in driving. A driving simulator that includes a control device, a display device, and a gaze detection device and that simulates driving a vehicle,
The control device includes:
an image generating unit that generates a simulated image to be displayed on the display device and outputs the simulated image to the display device;
a gaze point acquisition unit that acquires a position of a gaze point of the student on the simulated image based on a gaze direction of the student in the simulated training detected by the gaze detection device;
A storage unit that stores teacher data on the movement of the gaze point on the simulated image;
an evaluation unit that evaluates a degree of the student's driving safety confirmation based on a similarity between a movement of the gaze point of the student on the simulation image and a movement of the gaze point of the teacher data;
an operation acquisition unit that acquires an operation signal representing an operation of the operation device by the trainee during the mock training from the operation device;
having
the image generation unit generates a simulated image to be displayed on the display device in response to the operation signal, and outputs the simulated image to the display device;
The evaluation unit calculates the spatial similarity between the trajectory of the gaze point of the student and the trajectory of the gaze point of the teacher data within a certain period of time including the time when the student performed a specified operation on the operating device as a degree of the student's confirmation of safe driving. A driving simulator that includes a control device, a display device, and a gaze detection device and that simulates driving a vehicle,
The control device includes:
an image generating unit that generates a simulated image to be displayed on the display device and outputs the simulated image to the display device;
a gaze point acquisition unit that acquires a position of a gaze point of the student on the simulated image based on a gaze direction of the student in the simulated training detected by the gaze detection device;
A storage unit that stores teacher data on the movement of the gaze point on the simulated image;
an evaluation unit that evaluates a degree of the student's driving safety confirmation based on a similarity between a movement of the gaze point of the student on the simulation image and a movement of the gaze point of the teacher data;
an operation acquisition unit that acquires an operation signal representing an operation of the operation device by the trainee during the mock training from the operation device;
having
the image generation unit generates a simulated image to be displayed on the display device in response to the operation signal, and outputs the simulated image to the display device;
After the participant has completed the mock training,
The image generation unit generates a playback image of the mock lesson in response to the operation signal acquired by the operation acquisition unit and stored in the memory unit, overlays the movement of the gaze point of the participant acquired by the gaze point acquisition unit and stored in the memory unit onto the playback image and displays it on the display device as the mock image, and highlights objects to be noted that are not overlapped by the gaze point of the participant but are overlapped by the gaze point of the teacher data on the playback image using a graphic or a different color, in a simulated driving device. The operating device includes a deceleration operating means,
The predetermined operation includes the student operating the deceleration operation means.
3. A driving simulation device according to claim 1 or 2 . The operating device includes a handle, a deceleration operating means, and an acceleration operating means,
The predetermined operation includes the trainee operating the deceleration operation means, the steering wheel, and the acceleration operation means in this order.
3. A driving simulation device according to claim 1 or 2 . A control method for a driving simulator that includes a control device, a display device, and a gaze detection device and that simulates driving a vehicle, comprising:
The control device,
generating a simulated image to be displayed on the display device and outputting the simulated image to the display device;
Based on the direction of gaze of the student in the mock training detected by the gaze detection device, a position of the gaze point of the student on the mock training image is acquired;
evaluating a degree of driving safety confirmation of the student based on a similarity between a movement of a gaze point of the student on the simulated image and a movement of a gaze point of the teacher data;
acquiring, from the operating device, an operation signal representing an operation of the operating device by the trainee during the mock training;
a simulated image to be displayed on the display device is generated in response to the operation signal, and the simulated image is output to the display device;
The similarity between the movement of the gaze point of the student when the student performs a predetermined operation on the operation device and the movement of the gaze point of the teacher data is calculated as a degree of driving safety confirmation of the student.
A method for controlling a driving simulator. A control method for a driving simulator that includes a control device, a display device, and a gaze detection device and that simulates driving a vehicle, comprising:
The control device,
generating a simulated image to be displayed on the display device and outputting the simulated image to the display device;
Based on the direction of gaze of the student in the mock training detected by the gaze detection device, a position of the gaze point of the student on the mock training image is acquired;
evaluating a degree of driving safety confirmation of the student based on a similarity between a movement of a gaze point of the student on the simulated image and a movement of a gaze point of the teacher data;
acquiring, from the operating device, an operation signal representing an operation of the operating device by the trainee during the mock training;
a simulated image to be displayed on the display device is generated in response to the operation signal, and the simulated image is output to the display device;
A spatial similarity between a trajectory of a gaze point of the student and a trajectory of a gaze point of the teacher data within a certain period including a time when the student performed a predetermined operation on the operation device is calculated as a degree of driving safety confirmation of the student.
A method for controlling a driving simulator. A control method for a driving simulator that includes a control device, a display device, and a gaze detection device and that simulates driving a vehicle, comprising:
The control device,
generating a simulated image to be displayed on the display device and outputting the simulated image to the display device;
Based on the direction of the gaze of the student in the mock training detected by the line of sight detection device, the position of the gaze point of the student on the mock training image is acquired and stored in a storage unit;
Evaluating a degree of the trainee's driving safety confirmation based on a similarity between a movement of the gaze point of the trainee on the simulated image and a movement of the gaze point of the teacher data read from the storage unit storing teacher data of the movement of the gaze point on the simulated image;
An operation signal representing an operation of an operating device by the trainee during the mock training is acquired from the operating device and stored in the storage unit;
a simulated image to be displayed on the display device is generated in response to the operation signal, and the simulated image is output to the display device;
After the participant has completed the mock training,
A replay image of the mock training is generated in response to the operation signal stored in the storage unit, and the movement of the gaze point of the student stored in the storage unit is superimposed on the replay image and displayed on the display device as the mock image, and a note object that is not overlapped by the gaze point of the student and is overlapped by the gaze point of the teacher data is highlighted by a graphic or a changed color on the replay image.
A method for controlling a driving simulator.

Images