JP7635792B2 - COMMUNICATION SYSTEM, VEHICLE, COMMUNICATION METHOD, COMPUTER PROGRAM, AND SERVER - Google Patents

Description

The present invention relates to a communication system, a vehicle, a communication method, a computer program, a terminal device, and a server.

Conventionally, methods have been proposed for vehicle drivers to communicate with the outside world while driving. For example, Patent Document 1 proposes a server that provides information to the driver by selecting a speaker that outputs only audio or a screen that outputs audio and images, and that realizes real-time two-way communication with a caller outside the vehicle using a microphone.

Japanese Patent Application Laid-Open No. 11-175895

However, there is a possibility that the driver may not be able to find someone to communicate with during times when it is difficult to talk to specific individuals, such as during long drives or during late-night breaks. In such cases, the driver cannot enjoy his or her time while driving.

For example, if a driver has the opportunity to communicate with an unspecified number of people, he or she can enjoy driving even when they cannot talk to specific individuals. In addition, communication participants can be provided with the opportunity to feel as if they are enjoying a drive with the driver.

The present invention has been made in consideration of the above circumstances, and aims to provide a communication system, vehicle, communication method, computer program, terminal device, and server that can provide communication opportunities between the driver and an unspecified number of people.

A communication system according to a first aspect of the present invention includes a first acquisition unit that acquires driver information related to the behavior of a driver of a vehicle and vehicle information related to the vehicle, a calculation unit that outputs face information of the driver and the vehicle information detected using the driver information, a second acquisition unit that acquires first voice information of the driver, a first generation unit that generates information of a driver model that operates based on the face information and the vehicle information, a second generation unit that generates vehicle video information corresponding to the environment in which the vehicle is traveling based on the vehicle information, and a communication unit that supplies the information of the driver model, the vehicle video information and the first voice information to an external platform, and supplies second voice information acquired from the external platform to the driver , wherein the vehicle information includes operation information of the vehicle by the driver, and the first generation unit creates movement information of the driver model using the operation information and supplies it to the external platform .
A vehicle according to a second aspect of the invention comprises a sensor for detecting driver information relating to the behaviour of a driver of the vehicle and vehicle information relating to said vehicle, and a communication system according to the first aspect.

A communication method according to a third aspect of the present invention includes generating facial information of a detected driver of a vehicle using driver information regarding the behavior of the driver, generating information of a driver model that operates based on the facial information and vehicle information regarding the vehicle, generating vehicle image information corresponding to the environment in which the vehicle is traveling based on the vehicle information, supplying the information of the driver model, the vehicle image information, and first audio information of the driver to an external platform, and supplying second audio information obtained from the external platform to the driver, wherein the vehicle information includes operation information of the vehicle by the driver, and creating movement information of the driver model using the operation information and supplying it to the external platform .

A computer program according to a fifth aspect of the present invention is a program for causing a computer to execute the communication method according to the third aspect.
A server according to a seventh aspect of the present invention comprises an acquisition unit that acquires first voice information of a driver of a vehicle, facial information of the driver, and vehicle information related to the vehicle, a first generation unit that generates information of a driver model that operates based on the facial information and the vehicle information, a second generation unit that generates vehicle video information corresponding to the environment in which the vehicle is traveling based on the vehicle information, and a communication unit that supplies the information of the driver model, the vehicle video information, and the first voice information to an external platform, and supplies second voice information acquired from the external platform to the driver, wherein the vehicle information includes operation information of the vehicle by the driver, and the first generation unit creates movement information of the driver model using the operation information and supplies it to the external platform.

The present invention provides a communication system, vehicle, communication method, computer program, terminal device, and server that can provide communication opportunities between a driver and an unspecified number of people.

FIG. 1 is a block diagram illustrating an example of a configuration of a communication system according to an embodiment. FIG. 2 is a diagram for explaining an example of the operation of the communication system of the embodiment. FIG. 3 is a block diagram illustrating an example of another configuration of the communication system according to the embodiment.

A communication system according to an embodiment will be described in detail below with reference to the drawings.
FIG. 1 is a block diagram illustrating an example of a configuration of a communication system according to an embodiment.
The communication system of this embodiment includes a controller 100 and a server 200 .

The controller 100 is, for example, a terminal device equipped with at least one processor and a memory in which a program executed by the processor is recorded, and can realize various functions described below by software or a combination of software and hardware.

The memory includes, for example, a main storage unit and an auxiliary storage unit.
The main memory unit may include, for example, a read-only memory (ROM) and a random-access memory (RAM). The ROM is a non-volatile memory used exclusively for reading data, and can store data and various setting values used by the processor when performing various processes. The RAM can be used as a so-called work area for temporarily storing data when the processor performs various processes.

The secondary storage unit is a non-transitory computer-readable storage medium of a processor-based computer, such as an electric erasable programmable read-only memory (EEPROM), a hard disk drive (HDD), or a solid state drive (SSD).
The auxiliary memory unit can store data used by the processor when performing various processes, data generated by the processor through processing, or various setting values.

The controller 100 is capable of communicating with various sensors (or ECUs (electronic control units) that obtain information from the various sensors) such as a camera CMR and a position measuring device SS mounted on the vehicle VCL via a network.
The controller 100 includes a first acquisition unit 101 and a calculation unit 102 .
The first acquisition unit 101 can acquire information about the vehicle VCL (vehicle information) and information about the behavior of the driver DVR of the vehicle VCL (driver information) from various sensors. The controller 100 may be mounted on the vehicle VCL or may be configured to be attachable to the vehicle VCL. The controller 100 can also communicate with an external server 200 via a network.

The vehicle information includes operation information from the driver DVR, such as the accelerator opening, brake pressure, and steering angle, position information of the vehicle VCL measured by the position measuring device SS, and information used for communication of the vehicle VCL (e.g., CAN information, etc.). The position information of the vehicle VCL measured by the position measuring device SS is position information measured using, for example, a GPS (global positioning system), and includes the position coordinates and time of the vehicle VCL.

The driver information includes an image (camera information) including the driver DVR captured by the camera CMR. The camera CMR is installed in at least one location inside the vehicle VCL, in a position where it can capture an image including the face of the driver DVR. Multiple cameras CMR may be installed in multiple locations in the vehicle VCL, and the information on the behavior of the driver DVR may include multiple images captured from various angles of the facial expressions and actions of the driver DVR.
The calculation unit 102 detects face information of the driver using the driver information, and outputs the face information corresponding to the driver information and the vehicle information to the server 200 via the network.

The server 200 has at least one processor and a memory in which a program executed by the processor is recorded, and can realize various functions described below by software or a combination of software and hardware.

The server 200 can communicate with, for example, a microphone and speaker attached to the driver DVR, the controller 100, and the platform 300 via the network.

The microphone of the driver DVR is, for example, a microphone mounted on the mobile terminal 1 (such as a smartphone or tablet terminal) used by the driver DVR, a microphone of a headset worn by the driver DVR, or a microphone mounted on the vehicle. The speaker of the driver DVR is, for example, a speaker of a headset worn by the driver DVR, a speaker mounted on the vehicle, or a speaker mounted on the mobile terminal 1 used by the driver DVR. The microphone and speaker of the headset worn by the driver DVR may be configured to be able to communicate with the mobile terminal 1 by, for example, short-range wireless communication, and can transmit and receive audio information to and from the server 200 via the communication function of the mobile terminal 1.
In this embodiment, the microphone and speaker of the driver DVR are mounted on the mobile terminal 1 used by the driver DVR. The microphone and speaker of the driver DVR are capable of transmitting and receiving audio information to and from the server 200 via the communication function of the mobile terminal 1.

The server 200 includes a second acquisition unit 201 , a first generation unit 202 , a second generation unit 203 , and a communication unit 204 .
The second acquisition unit 201 acquires the first voice information of the driver DVR, and the driver face information and vehicle information output from the controller 100 .
The first generating unit 202 generates facial expression and motion information of the driver model based on the face information and the vehicle information. For example, the server 200 can generate facial expression information of the driver model from the positions and shapes of the facial features (eyes, nose, mouth, eyebrows) included in the face information of the driver DVR. The facial expression information of the driver model may be information indicating the emotions and states of the driver DVR, such as joy, anger, sadness, happiness, surprise, hesitation, impatience, fatigue, etc., or may be information specifically indicating the size, position, and motion of the facial features.

The first generating unit 202 can generate motion information such as the movement of the driver model's limbs, the direction of the driver model's face, and the position of the head, based on the face information and the operation information. The motion information of the driver model may include, for example, the position coordinates and angles of representative joints of the driver model. The server 200 may generate the position coordinates and angles of the ankle and knee joints of the driver model from, for example, information on the accelerator opening and the brake pedal force. The server 200 may also generate the position of the driver model's hands gripping the steering wheel, the rotation direction of the steering wheel, and the position coordinates and angles of the driver model's wrist and elbow joints associated with the rotation of the steering wheel from, for example, information on the steering angle. The server 200 may also generate the rotation angle, tilt angle, and head position coordinates of the driver model's neck from the positions and shapes of the facial parts (eyes, nose, mouth, eyebrows) included in the face information of the driver DVR.

The second generating unit 203 determines the environment in which the vehicle VCL is traveling based on the position information included in the vehicle information, and generates vehicle image information corresponding to the traveling environment. The vehicle image information generated by the second generating unit 203 may be image information that reproduces the environment of the location where the vehicle VCL is actually traveling, or may be image information that reproduces the characteristics of the location where the vehicle VCL is traveling. In the latter case, the second generating unit 203 may generate vehicle image information to reproduce, for example, the characteristics of the location where the vehicle VCL is traveling (city, mountain, seaside, highway, residential area, tunnel, etc.), the characteristics of the environment at the time included in the position information (night view, brightness corresponding to the time, etc.), and the characteristics of nearby objects (intersections, railroad crossings, high-rise buildings, towers, temples and shrines, parks, bridges, overpasses, rivers, seas, forests, theme parks, etc.).

The vehicle video information does not necessarily have to reproduce the actual driving environment of the vehicle VCL. For example, the vehicle video information may be video from which pedestrians and oncoming vehicles that are actually present in the area where the vehicle VCL is driving have been removed, or may be video that includes objects such as pedestrians and oncoming vehicles that do not actually exist, or may be video of a non-existent environment. In this case, the vehicle VCL has a camera CMR2 that captures the surroundings of the vehicle VCL and the scenery seen from the vehicle window, and the vehicle video information may be generated based on the video captured by the camera CMR2 (external vehicle environment information). Note that the camera CMR2 is not a required component, and if the vehicle video information does not reproduce the actual driving environment, the camera CMR2 may be omitted.

In either case, the second generation unit 203 generates vehicle video information corresponding to the environment viewed from each of the front, rear, left and right windows of the driver DVR of the vehicle VCL, based on at least one of the position, direction of travel, driving speed and time of the vehicle VCL based on the position information of the vehicle VCL.
The server 200 may include a database in which image data and object data for generating vehicle image information are stored, or the server 200 may acquire image data and object data from a database external to the server 200 .

The communication unit 204 associates the driver model information, the vehicle image information, and the first audio information and supplies them to the platform 300, and also supplies the second audio information acquired from the platform 300 to a speaker attached to the driver DVR (or a speaker mounted on the vehicle VCL). The second audio information may be supplied from the server 200 to the in-vehicle speaker via an external service.

The controller 100 and the server 200 may set an identifier (travel ID) for each trip from the departure point to the destination, and may use the travel ID to associate the driver model information, the vehicle image information, and the first audio information. In this case, the travel ID is also assigned to the second audio signal supplied from the platform 300, and the server 200 can recognize the driver DVR to which the second audio signal should be supplied by the travel ID.
In addition, in the communication system of this embodiment, at least a part of the functions of the server 200 may be realized by the controller 100, or the controller 100 and the server 200 may be configured as an integrated unit and mounted on the vehicle VCL.

The platform 300 is a system that uses information generated by the server 200 to provide virtual space information, for example combining video, driver models, and audio, to one or more user terminals, and also provides a service of supplying audio information from the user terminals to the server 200.

The platform 300 can communicate with the server 200. As a specific example, the server (sending side) 200 and the platform (receiving side) 300 can communicate with each other using OSC (Open Sound Control), and information generated by the server 200 can be supplied to the platform 300.

The platform 300 uses the facial expression information of the driver model to adjust the position and shape of the facial features (eyes, nose, mouth, eyebrows, etc.) of the driver model to generate the facial expression of the driver model. The platform 300 may have in advance information on the position and shape of the facial features corresponding to the emotion or state of the driver DVR, for example, and when the facial expression information of the driver model indicates the emotion or state of the driver DVR, the platform 300 adjusts the position and shape of the facial features of the driver model as set.

The platform 300 also uses information on the driver model's movements to adjust the positions and angles of the joints of the driver model's limbs, head, and trunk, and generate the driver model's movements. The model corresponding to the driver DVR may be a three-dimensional model that reproduces the actual appearance of the driver DVR in a virtual reality space, or may be a three-dimensional model that reproduces the appearance of a virtual driver, such as a person or robot different from the driver DVR, in a virtual reality space.

The platform 300 uses the vehicle image information to generate the vehicle VCL and the environment viewed through the windows of the vehicle VCL in a virtual reality space.
The platform 300 generates virtual space information so that the driver model's movements and facial expressions, the first voice information, and the environmental image in which the vehicle VCL is traveling are synchronized, and supplies the generated virtual space information to a user terminal 400 connected to the platform 300.
In addition, when the platform 300 acquires voice information (second voice information) from the user terminal 400 to which the virtual space information has been provided, the platform 300 transmits the second voice information to the server 200 together with the corresponding running ID.

The virtual space presented to the user by the user terminal 400 may have a viewpoint set so that the driver DVR is viewed from inside the vehicle VCL (e.g., the passenger seat), for example, or the viewpoint position and direction within the vehicle VCL may be movable by operating the user terminal 400. In the latter case, the platform 300 moves the viewpoint position and direction within the virtual space supplied to the user terminal 400 based on operation information acquired from the user terminal 400.

2 is a diagram for explaining an example of the operation of the communication system according to the embodiment. In FIG. 2, the server 200 generates vehicle image information using the position information of the vehicle VCL, and does not use the vehicle exterior environment information captured by the camera CMR2.
First, an initial setting is performed between the controller 100, the server 200, and the mobile terminal 1 equipped with the microphone and speaker of the driver DVR. For example, the microphone and speaker may be installed in the vehicle or inside the vehicle VCL near the driver. In the initial setting, an identifier (driving ID) required for information handled by the controller 100, the server 200, and the mobile terminal 1 is set so that the information acquired by the controller 100, the audio information supplied from the microphone of the mobile terminal 1, and the audio information supplied to the speaker of the mobile terminal 1 can be associated with each other.

For example, the server 200 determines whether the vehicle VCL, microphone, and speaker are used by a common driver DVR based on the position information of the vehicle VCL supplied from the controller 100 and the position information of the device (e.g., the mobile terminal 1) equipped with the microphone and speaker. Then, based on the result of the determination, the server 200 can associate the information acquired by the controller 100, the audio information supplied from the microphone of the mobile terminal 1, and the audio information to be supplied to the speaker of the mobile terminal 1.

After the initial settings are completed, the controller 100 acquires vehicle information acquired from the vehicle VCL and driver information related to the behavior of the driver DVR, and generates face information of the driver DVR by face tracking using the driver information (block ST1). Specifically, the controller 100 converts the camera information (driver information) into face tracking information (face information). The controller 100 outputs the face information corresponding to the driver information and the vehicle information to the server 200 via the network. Note that if the controller 100 can acquire face tracking information instead of (or in addition to) the driver information, the operation of detecting the face tracking information (face information) can be omitted.

The server 200 acquires the vehicle information and face information from the controller 100, and acquires the first audio information from a microphone attached to the driver DVR. The server 200 associates the vehicle information and face information acquired from the controller 100 with the first audio information acquired from the microphone using common identification information (block ST2).

The server 200 converts the vehicle information and the face information into a movement of the driver model (block ST3), and generates information of the driver model that operates based on the movement and face information of the driver model (including information on the movement of the driver model toward the platform 300 and the facial expression of the driver model toward the platform 300). The server 200 also determines the scenery of the vehicle's traveling position from the position information included in the vehicle information, and creates vehicle image information (projected image of the vehicle window in the virtual space) that corresponds to the environment in which the vehicle VCL is traveling (block ST4).
The server 200 associates the driver model information, the vehicle image information, and the first audio information with each other using common identification information, and supplies the information to the platform 300.

The platform 300 associates the driver model information, vehicle image information, and first audio information supplied from the server 200 with each other using identification information, generates three-dimensional virtual space information and audio information so that the driver model's movements and facial expressions, the first audio information, and the environmental image in which the vehicle VCL is traveling are synchronized, and supplies the information to a user terminal connected to the platform 300. Note that the number of user terminals 400 connected to the platform 300 may be multiple or zero.

The user terminal 400 may be an electronic device such as a computer, for example, a PC (Personal Computer), a mobile terminal (for example, a tablet, a smartphone, a laptop, a feature phone, a portable game console, etc.), an HMD (Head Mounted Display), a game console, a television set (including Internet television), etc., but is not limited to these. The user terminal 400 provides the user with a virtual reality space image generated from the supplied virtual space information in a viewable manner.

The user terminal 400 can be operated to move the user's viewpoint position and orientation in the virtual reality space by the user operating buttons or moving the user's head. The user terminal 400 also includes a microphone and acquires audio information (second audio information) including the user's voice, assigns an identifier to it, and transmits it to the platform 300.

The platform 300 transmits the second voice information acquired from the user terminal 400 to the server 200. The server 200 associates the second voice information with information of the mobile terminal 1 of the driver DVR of the corresponding trip based on the identifier of the acquired second voice information (block ST2), and provides the second voice information to the driver DVR via the mobile terminal 1.
In addition, the platform 300 may check the identifier of the second audio information acquired from the user terminal 400, and provide the second audio information to the driver DVR of the corresponding trip. The server 200 or the platform 300 may supply the second audio information to an in-vehicle speaker of the vehicle VCL via an external service, for example, to a speaker attached to the driver DVR (or installed in the vicinity of the driver inside the vehicle VCL).

As described above, the communication system and method of the present embodiment allow the driver to have the opportunity to communicate with an unspecified number of people. Also, communication participants (users) can obtain information about the driver's operating status and the location where the vehicle is traveling without actually getting into the vehicle and without being limited by the number of participants.
As a result, according to the communication system and communication method of the present embodiment, even when a driver is driving alone, the driver can reduce a sense of loneliness by, for example, listening to and talking with many people, and can enjoy driving through communication via the system. Also, the communication participants (users of the platform 300) can be provided with an experience as if they were riding on a tourist bus, enjoying the view from the window, or enjoying a drive together with the driver.

In other words, this embodiment provides a communication system, a communication method, and a computer program that can provide communication opportunities between a driver and an unspecified number of people.

(Modification)
FIG. 3 is a block diagram illustrating an example of another configuration of the communication system according to the embodiment.
In this example, the controller 100 acquires first audio information via an in-vehicle microphone or the like and outputs the acquired first audio information to the server 200. The communication unit 204 also supplies second audio information output from the platform 300 to the controller 100, and the controller 100 supplies the second audio information to the driver DVR via the in-vehicle speaker. According to this example, the same effects as those of the above-mentioned embodiment can be obtained, and the driver DVR can enjoy the audio coming from the in-vehicle speaker, for example, as if listening to the radio or music. Furthermore, since audio information is transmitted and received between the controller 100 and the server 200, it is only necessary to perform initial settings by the controller 100 and the server 200, and there is no need to perform initial settings in the mobile terminal 1.
That is, according to the modified example shown in FIG. 3, it is possible to provide a communication system, a communication method, and a computer program capable of providing communication opportunities between a driver and an unspecified number of people, similar to the above-described embodiment.

In the above embodiment, the platform 300 provides the user with three-dimensional virtual reality space information, but the present invention is not limited to this, and a two-dimensional image of the virtual reality space may be provided to the user terminal. Even in this case, the same effects as those of the above embodiment can be obtained.
Also, for example, if the driver DVR listens to the sound of many people conversing as background music while driving, the supply of the first audio information to the server 200 and the platform 300 may be omitted.

Furthermore, the number of users who can access the platform 300 for each trip may be limited, and access may be permitted only to specific users. When multiple users are accessing the platform 300, the volume of the voice of each user may be adjusted when the second voice information is supplied from the server 200 to the driver DVR.
In addition, when the driver DVR is not driving, such as when the driver DVR has parked the vehicle VCL in a parking lot, the user's video and avatar may be displayed on a display mounted on the vehicle VCL. For example, when the vehicle is parked, the controller 100 may transmit a signal requesting the user's video to the server 200, and the server 200 may obtain the user's video information and avatar information from the platform 300 and supply them to the controller 100.

The present invention is not limited to the above-mentioned embodiment, and can be modified in various ways without departing from the gist of the present invention. The embodiments may be combined as appropriate, and in that case, the combined effect can be obtained. Furthermore, the above-mentioned embodiment includes various inventions, and various inventions can be extracted by combinations selected from the multiple components disclosed. For example, if the problem can be solved and the effect can be obtained even if some components are deleted from all the components shown in the embodiment, the configuration from which the components are deleted can be extracted as an invention.
[Appendix 1]
A first acquisition unit that acquires driver information related to a behavior of a driver of a vehicle and vehicle information related to the vehicle;
A calculation unit that outputs face information of the driver corresponding to the behavior of the driver and the vehicle information;
A second acquisition unit that acquires first voice information of the driver;
A first generation unit that generates information of a driver model that operates based on the face information and the vehicle information;
a second generating unit that generates vehicle image information corresponding to an environment in which the vehicle is traveling based on the vehicle information;
A communication system comprising: a communication unit that supplies the driver model information, the vehicle image information, and the first audio information to an external platform, and supplies second audio information obtained from the external platform to the driver.
[Appendix 2]
The driver information includes a driver image including a face of the driver,
the computing unit outputs the face information including facial expression information related to positions and sizes of the driver's facial features by face tracking using the driver video;
The communication system according to claim 1, wherein the first generation unit outputs information about the driver model including information associating the facial expression information with identification information of the driver model.
[Appendix 3]
The vehicle information includes operation information of the vehicle by the driver,
The communication system according to claim 1, wherein the first generation unit creates motion information of the driver model using the operation information and supplies the motion information to the external platform.
[Appendix 4]
A controller including the first acquisition unit and the calculation unit;
2. The communication system according to claim 1, further comprising: a server including the second acquisition unit, the first generation unit, the second generation unit, and the communication unit.
[Appendix 5]
a controller including the first acquisition unit, the calculation unit, and the second acquisition unit;
2. The communication system according to claim 1, further comprising: a server having the first generation unit, the second generation unit, and the communication unit.
[Appendix 6]
A communication system according to claim 1;
and a sensor for detecting the driver information and the vehicle information.
[Appendix 7]
obtaining driver information relating to the behavior of a driver of a vehicle and vehicle information relating to said vehicle;
generating face information of the driver corresponding to the driver information;
generating information of a driver model that operates based on the face information and the vehicle information;
generating vehicle image information corresponding to an environment in which the vehicle is traveling based on the vehicle information;
Providing the driver model information, the vehicle image information, and the first voice information of the driver to an external platform;
and providing second audio information obtained from the external platform to the driver.
[Appendix 8]
outputting, to an external platform, information for configuring, in a virtual space, a driver model that reproduces the actions and facial expressions of the driver in the vehicle and an environment in which the vehicle travels, based on driver information related to a behavior of a driver of a vehicle, vehicle information related to the vehicle, and first voice information of the driver;
and providing second audio information obtained from the external platform to the driver.
[Appendix 9]
A computer program causing a computer to execute the communication method according to claim 7 or 8.
[Appendix 10]
An acquisition unit that acquires driver information related to a behavior of a driver of a vehicle and vehicle information related to the vehicle;
A terminal device having a calculation unit that outputs face information of the driver corresponding to the driver information and the vehicle information.
[Appendix 11]
an acquisition unit that acquires first voice information of a driver of a vehicle, face information of the driver, and vehicle information related to the vehicle;
A first generation unit that generates information of a driver model that operates based on the face information and the vehicle information;
a second generating unit that generates vehicle image information corresponding to an environment in which the vehicle is traveling based on the vehicle information;
A server comprising: a communication unit that supplies the driver model information, the vehicle image information, and the first audio information to an external platform, and supplies second audio information obtained from the external platform to the driver.

REFERENCE SIGNS LIST 100: Controller 101: First acquisition unit 102: Calculation unit 200: Server 201: Second acquisition unit 202: First generation unit 203: Second generation unit 204: Communication unit 300: Platform DVR: Driver VCL: Vehicle CMR: Camera SS: Position measuring device

Claims (9)

A first acquisition unit that acquires driver information related to a behavior of a driver of a vehicle and vehicle information related to the vehicle;
A calculation unit that outputs face information of the driver corresponding to the behavior of the driver and the vehicle information;
A second acquisition unit that acquires first voice information of the driver;
A first generation unit that generates information of a driver model that operates based on the face information and the vehicle information;
a second generating unit that generates vehicle image information corresponding to an environment in which the vehicle is traveling based on the vehicle information;
a communication unit that supplies the driver model information, the vehicle image information, and the first voice information to an external platform, and supplies second voice information acquired from the external platform to the driver;
The vehicle information includes operation information of the vehicle by the driver,
The first generation unit creates motion information of the driver model using the operation information and supplies the motion information to the external platform. The driver information includes a driver image including a face of the driver,
the computing unit outputs the face information including facial expression information related to positions and sizes of the driver's facial features by face tracking using the driver video;
The communication system according to claim 1 , wherein the first generator outputs the information on the driver model including information associating the facial expression information with identification information of the driver model. A controller including the first acquisition unit and the calculation unit;
The communication system according to claim 1 , further comprising: a server including the second acquisition unit, the first generation unit, the second generation unit, and the communication unit. a controller including the first acquisition unit, the calculation unit, and the second acquisition unit;
The communication system according to claim 1 , further comprising: a server including the first generation unit, the second generation unit, and the communication unit. A communication system according to claim 1;
and a sensor for detecting the driver information and the vehicle information. obtaining driver information relating to the behavior of a driver of a vehicle and vehicle information relating to said vehicle;
generating face information of the driver corresponding to the driver information;
generating information of a driver model that operates based on the face information and the vehicle information;
generating vehicle image information corresponding to an environment in which the vehicle is traveling based on the vehicle information;
Providing the driver model information, the vehicle image information, and the first voice information of the driver to an external platform;
A method for providing second audio information obtained from the external platform to the driver, comprising:
The vehicle information includes operation information of the vehicle by the driver,
a communication method in which movement information of the driver model is created using the operation information and supplied to the external platform. outputting, to an external platform, information for configuring, in a virtual space, a driver model that reproduces the actions and facial expressions of the driver in the vehicle and an environment in which the vehicle travels, based on driver information related to a behavior of a driver of a vehicle, vehicle information related to the vehicle, and first voice information of the driver;
A method for providing second audio information obtained from the external platform to the driver, comprising:
The vehicle information includes operation information of the vehicle by the driver,
a communication method in which movement information of the driver model is created using the operation information and supplied to the external platform. A computer program for causing a computer to execute the communication method according to claim 6 or claim 7. an acquisition unit that acquires first voice information of a driver of a vehicle, face information of the driver, and vehicle information related to the vehicle;
A first generation unit that generates information of a driver model that operates based on the face information and the vehicle information;
a second generating unit that generates vehicle image information corresponding to an environment in which the vehicle is traveling based on the vehicle information;
a communication unit that supplies the driver model information, the vehicle image information, and the first voice information to an external platform, and supplies second voice information acquired from the external platform to the driver;
The vehicle information includes operation information of the vehicle by the driver,
The first generation unit creates motion information of the driver model using the operation information and provides the motion information to the external platform.