JP7508331B2 - Presentation information generating device and presentation information generating method - Google Patents

Description

The present invention relates to a presentation information generating device and a presentation information generating method for generating presentation information to assist the operation of a user in a remote location.

A virtual space generation/motion ride system is known that enhances the sense of realism of the participant by providing an instruction input system suited to the shape and movement of the object, and a blower that blows air to the participant in accordance with the movement of the object, and further allows third parties other than the participant to enjoy the virtual space by setting a desired viewpoint when observing images of the virtual world (Patent Document 1).

Japanese Patent Application Laid-Open No. 9-311948

However, the above conventional technology does not anticipate situations where someone other than the person experiencing the experience inputs instructions to the system, such as a user in a remote location opening and closing a vehicle window. In this case, the user in the remote location cannot grasp the window opening degree required to create the desired airflow state inside the vehicle, and may open the window too far, causing severe disturbance to the airflow inside the vehicle, or may not open the window enough to obtain the required airflow strength.

The problem that this invention aims to solve is to provide an apparatus and method for generating presentation information that allows a user who opens and closes a vehicle window from a remote location to understand the state of airflow inside the vehicle.

The present invention solves the above problem by estimating the airflow state inside the vehicle cabin based on at least the vehicle's driving condition and the opening degree of an opening/closing mechanism that separates the interior and exterior of the vehicle, generating an image including information representing the estimated airflow state inside the vehicle cabin , outputting the generated image to a display device provided at a remote location and communicatively connected via a server and a communication device, obtaining an opening/closing command to operate the opening/closing mechanism from an input device provided at the remote location and communicatively connected via the server and the communication device , and operating the opening/closing mechanism based on the obtained opening/closing command.

According to the present invention, a user who opens and closes a vehicle window from a remote location can be made aware of the state of airflow inside the vehicle.

1 is a block diagram showing a presentation information generating system including a presentation information generating method and a presentation information generating device according to the present invention. 2 is a block diagram showing an embodiment of a presentation information generating unit in FIG. 1 . 2 is a flowchart showing an example of an information processing procedure in the presentation information generating system of FIG. 1 .

Hereinafter, an embodiment of a presentation information generating device and a presentation information generating method according to the present invention will be described with reference to the drawings.

[Configuration of presentation information generation system]
1 is a block diagram showing a presentation information generating system 1 according to the present invention. The presentation information generating system 1 can be used, for example, when an assistant who assists a driver in driving at a remote location opens and closes a vehicle window while watching an image output from the vehicle at the remote location, or when an acquaintance who assists the driver in driving at a remote location virtually rides in the vehicle using an avatar (alter ego) and opens and closes a vehicle window while watching an image output from the vehicle at the remote location.

The presentation information generation system 1 is a system mounted on a vehicle, and includes a sensor 11, a camera 12, map information 13, a vehicle position detection device 14, an opening/closing mechanism 15, a communication device 16, and a presentation information generation device 17. The devices included in the presentation information generation system 1 are connected by a Controller Area Network (CAN) or other in-vehicle LAN, and can exchange information with each other.

The sensor 11 in this embodiment is a detection device that includes a vehicle speed sensor 111 and a steering angle sensor 112. The vehicle speed sensor 111 is not particularly limited as long as it is a sensor that can detect the traveling speed of the vehicle, and a known sensor can be used. Similarly, the steering angle sensor 112 is not particularly limited as long as it is a sensor that can detect the steering angle of the vehicle.

The cameras 12 include, for example, cameras equipped with an imaging element such as a CCD, ultrasonic cameras, infrared cameras, etc. The cameras 12 in this embodiment include exterior cameras 121 that are installed, for example, at the front, rear, right side, and left side of the vehicle and capture images of the vehicle's surroundings and acquire image data including objects present around the vehicle, and interior cameras 122 that are installed inside the vehicle, which is the living space of the driver and passengers, capture images of the interior of the vehicle, and acquire image data including objects present within the vehicle. Objects present within the vehicle's interior include the driver and passengers.

In this embodiment, the in-vehicle camera 122 can acquire image data including objects outside the vehicle in addition to objects inside the vehicle when capturing an image of the interior of the vehicle. Specifically, the in-vehicle camera 122 can acquire images of the interior and exterior of the vehicle as seen from the viewpoint of an occupant (including the driver; the same applies below) when the occupant is seated in one of the vehicle seats, such as the driver's seat, passenger seat, or rear seat. The range of the occupant's viewpoint is not particularly limited, and images can be acquired in all directions around the occupant, including in front of, behind, to the right, and to the left. In addition, the height of the occupant's viewpoint can be set to a predetermined height according to the height or sitting height of the user in the remote location.

Map information 13 is high-definition map information, and includes two-dimensional and/or three-dimensional position information at each map coordinate, road boundary information at each map coordinate, road attribute information, etc. Map information 13 is stored in a readable state in a storage device provided in an in-vehicle device or a server.

The vehicle position detection device 14 obtains the current position of the vehicle based on information obtained from the vehicle's GPS (Global Positioning System) unit, gyro sensor, and odometry.

The opening/closing mechanism 15 is a device that separates the interior of the vehicle, which is the living space of the driver and passengers, from the outside of the vehicle, which is the outside of the living space, such as a vehicle window. The opening/closing mechanism 15 of this embodiment is particularly one that can be opened and closed by a driving device 151 such as an actuator, such as a side window provided in a side door, a rear window provided in a back door, or a sunroof or moonroof provided in a roof panel. The opening/closing mechanism 15 of this embodiment also includes an opening sensor 152 that detects the opening degree indicating how open the opening/closing mechanism 15 is. The opening sensor 152 detects the opening degree of the opening/closing mechanism 15 from the amount of operation of the driving device 151, such as an encoder provided in the motor of the driving device 151.

The communication device 16 is not particularly limited as long as it is a communication device capable of communicating with other devices via a network such as the Internet, and a known in-vehicle communication device can be used. The communication device 16 of this embodiment is connected to the communication device 23 via the server 3, and information can be exchanged between the presentation information generation system 1 and the device 2 outside the vehicle. The communication device 23 is not particularly limited as long as it is a communication device capable of exchanging information with the communication device 16, and a known communication device including an in-vehicle communication device can be used. The server 3 is not particularly limited as long as it can exchange information between the presentation information generation device 17 and the device 2 outside the vehicle and provide these devices with predetermined functions as necessary. The communication device 16 and the communication device 23 may be directly connected through a network without going through the server 3.

The device 2 outside the vehicle includes a display device 21 and an input device 22 connected to a communication device 23 by known communication means such as a wired or wireless LAN. The display device 21 in this embodiment is not particularly limited as long as it is a device capable of displaying an image output by the presentation information generating device 17, and an example of such a device is a liquid crystal display. In addition, the display device 21 may be, for example, a headset that, when worn, provides a virtual experience of being a passenger in a vehicle driven by a driver. The input device 22 in this embodiment is a device for providing predetermined information and commands from the device 2 outside the vehicle to the presentation information generating device 17, and is, for example, a switch for providing a command to operate the opening and closing mechanism 15 to the presentation information generating device 17, such as a button for opening and closing a vehicle window. The objective input device 24 will be described later.

Returning to the presentation information generating system 1, the presentation information generating device 17 of this embodiment uses information acquired from devices included in the presentation information generating system 1 to generate and present an image to a user located away from the presentation information generating system 1 (hereinafter also referred to as a remote location). The presentation information generating device 17 of this embodiment also operates the drive device of the opening/closing mechanism 15 based on a command acquired via the communication device 16. The presentation information generating device 17 realizes these functions using the processor 18.

The processor 18 realizes the functions of the presentation information generating device 17 by making the various components of the presentation information generating system 1 work together. Specifically, the processor 18 includes a ROM (Read Only Memory) 182 in which a program is stored, a CPU (Central Processing Unit) 181 which is an operating circuit for functioning as the presentation information generating device 17 by executing the program stored in the ROM 182, and a RAM (Random Access Memory) 183 which functions as an accessible storage device. The program used by the processor 18 in this embodiment includes a presentation information generating unit 1000 for performing the functions of generating and outputting images and operating the drive device 151, and therefore, for convenience, FIG. 1 shows only the presentation information generating unit 1000.

Although the presentation information generating system 1 shown in FIG. 1 includes a presentation information generating device 17, the presentation information generating device 17 does not necessarily have to be included in the presentation information generating system 1. For example, the presentation information generating device 17 may be provided in the server 3 instead of in the vehicle. In this case, each device constituting the presentation information generating system 1 connects to the server using the communication device 16 and exchanges information with the presentation information generating device 17. Alternatively, only the presentation information generating unit 1000 of the presentation information generating device 17 may be provided in the server 3. In this case, the functions of the presentation information generating unit 1000 are executed using the CPU, ROM, and RAM of the server 3.

[Configuration of presentation information generation unit]
The presentation information generating unit 1000 of this embodiment has, for example, the configuration shown in the block diagram of Fig. 2. The presentation information generating unit 1000 shown in Fig. 2 includes a running state acquiring unit 1001, an opening degree acquiring unit 1002, an information acquiring unit 1003, an outside airflow estimating unit 1004, an inside airflow estimating unit 1005, a target input unit 1006, a recommended opening degree calculating unit 1007, an image generating unit 1008, an image output unit 1009, an opening/closing command output unit 1010, and an opening/closing mechanism control unit 1011. The functions of each unit will be described below.

The driving state acquisition unit 1001 has a function of acquiring the driving state of the vehicle. In this embodiment, the driving state of the vehicle refers to the driving speed and steering angle of the vehicle. The driving speed of the vehicle can be detected using the vehicle speed sensor 111, and the steering angle of the vehicle can be detected using the steering angle sensor 112.

The opening degree acquisition unit 1002 has a function of acquiring the opening degree of the opening/closing mechanism 15. The opening degree of the opening/closing mechanism 15 can be detected using the opening degree sensor 152. Typically, a vehicle is provided with multiple opening/closing mechanisms 15, but the opening degree acquisition unit 1002 of this embodiment acquires the opening degrees of all opening/closing mechanisms 15 provided in the vehicle.

The information acquisition unit 1003 has a function of acquiring information outside the vehicle, including at least one of the weather around the vehicle, an image of the vehicle's surroundings, and map information around the vehicle. In this embodiment, the weather around the vehicle includes data such as temperature, humidity, precipitation, wind speed, and wind direction in addition to weather classification such as sunny, cloudy, and rainy. These data can be acquired, for example, by connecting to a database that can acquire weather data via the communication device 16 and acquiring weather data at the position where the vehicle is traveling acquired by the vehicle position detection device 14. In addition, images around the vehicle can be acquired by the external camera 121 installed, for example, in the front, rear, right side, and left side of the vehicle. Furthermore, map information around the vehicle can be acquired from the map information 13 using the position where the vehicle is traveling acquired by the vehicle position detection device 14. In this embodiment, the map information around the vehicle includes, for example, surrounding topographical information such as being close to the sea, being in a mountainous area, or being on flat land, and information on surrounding obstacles such as an urban area with many high-rise buildings, a suburban area without tall buildings, and the inside of a tunnel. Note that the information acquisition unit 1003 is not a required component of the presentation information generation unit 1000 and may be provided as needed.

The outside-vehicle airflow estimation unit 1004 has a function of estimating the airflow outside the vehicle based on information including at least one of the weather around the vehicle, the image around the vehicle, and the map information around the vehicle acquired by the information acquisition unit 1003. When estimating the airflow outside the vehicle based on the weather information around the vehicle, the outside-vehicle airflow estimation unit 1004 of this embodiment estimates the airflow outside the vehicle by assuming that the speed and direction of the airflow outside the vehicle are approximately the same as the wind speed and wind direction around the vehicle, for example, using the information about the wind speed and wind direction around the vehicle acquired by the information acquisition unit 1003. Also, when estimating the airflow outside the vehicle based on the image around the vehicle, the outside-vehicle airflow estimation unit 1004 of this embodiment estimates the airflow outside the vehicle from the movement of the object in the image data acquired by the information acquisition unit 1003 using the outside-vehicle camera 121. For example, when the object in the image data includes a roadside tree, the outside-vehicle airflow estimation unit 1004 estimates the airflow outside the vehicle from the inclination of the roadside tree with respect to the ground. Furthermore, when estimating the airflow outside the vehicle based on map information about the surroundings of the vehicle, the outside-vehicle airflow estimation unit 1004 of this embodiment estimates airflow caused by the terrain, such as sea breeze or land breeze, from the terrain information acquired by the information acquisition unit 1003, and estimates the airflow outside the vehicle based on the estimated airflow caused by the terrain.

In addition, the vehicle exterior airflow estimation unit 1004 of this embodiment can estimate the airflow outside the vehicle by combining the information acquired by the information acquisition unit 1003. For example, even if the weather information around the vehicle includes information that the wind speed around the vehicle is fast, if the map information around the vehicle indicates that an obstacle that blocks the wind, such as a tunnel, is present around the vehicle, the vehicle exterior airflow estimation unit 1004 estimates the airflow outside the vehicle without taking into account the information on the wind speed around the vehicle. Note that the vehicle exterior airflow estimation unit 1004 is not an essential component of the presentation information generation unit 1000, and may be provided as necessary.

The vehicle interior airflow estimation unit 1005 has a function of estimating the state of airflow in the vehicle cabin using the vehicle driving state acquired by the driving state acquisition unit 1001 and the opening degree of the opening mechanism 15 acquired by the opening degree acquisition unit 1002. The state of airflow in this embodiment refers to the speed and direction of air flowing in the vehicle cabin. When estimating the speed and direction of air flowing in the vehicle cabin based on the vehicle driving state and the opening degree of the opening mechanism 15, the vehicle interior airflow estimation unit 1005 in this embodiment uses the correlation between the vehicle driving state (particularly the vehicle speed), the opening degree of the opening mechanism 15, and the speed and direction of air flowing in the cabin. The correlation is, for example, the relationship between the vehicle speed, the opening degree, and the speed and direction of air flow in the vehicle cabin when the vehicle has a driver's seat on the right side of the traveling direction and is driving with the window on the right side of the driver's seat and the window on the left side of the rear seat open, and the vehicle driving speed and the opening degree of the two windows are changed. The correlation can be found by changing the opening degree for each combination of the opening/closing mechanisms 15 to be operated within a predetermined range of vehicle speeds using a test vehicle or computer simulator that can measure the speed and direction of air flow in the vehicle cabin. In addition to or instead of this, the relationship between the vehicle speed, the opening degree, and the speed and direction of air flow in the vehicle cabin under predetermined conditions may be obtained from actual vehicle driving data, and the correlation may be found by machine learning using the obtained relationship. In the presentation information generating device 17 of this embodiment, the correlation is found in advance and stored in the ROM 182 of the processor 18 or another accessible storage device (not shown).

In addition, the in-vehicle airflow estimation unit 1005 of this embodiment may estimate the state of airflow inside the vehicle cabin using the airflow outside the vehicle estimated by the outside-vehicle airflow estimation unit 1004, in addition to the vehicle's running state and the opening degree of the opening/closing mechanism 15. For example, when the vehicle is running along the coastline during the day and the wind is blowing from the sea to the land, the in-vehicle airflow estimation unit 1005 adds the airflow outside the vehicle estimated taking into account the wind blowing from the sea to the land to the speed and direction of the airflow inside the vehicle cabin calculated using the correlation from the vehicle's running speed and the opening degree of the opening/closing mechanism 15, to estimate the final speed and direction of the airflow inside the vehicle cabin.

The purpose input unit 1006 has a function of inputting a purpose for operating the opening/closing mechanism 15 from the device 2 outside the vehicle. The purpose in this embodiment is, for example, the purpose of opening and closing the windows of a traveling vehicle. Specifically, for example, ventilation to wake up the driver when the driver feels drowsy, ventilation to keep the temperature inside the vehicle at a comfortable temperature for the occupants, ventilation to remove odors when an unpleasant odor permeates the interior, opening and closing of windows to check the sound of a railroad crossing alarm when crossing a railroad crossing, opening and closing of windows to receive purchased items at a drive-through store, etc. The purpose for operating the opening/closing mechanism 15 may be preset in the presentation information generating device 17 or the device 2 outside the vehicle, or may be input by a user at a remote location using characters or voice. These purposes are input using the purpose input device 24 of the device 2 outside the vehicle. Specifically, the purpose input device 24 is an input device including a touch panel display, a microphone set, a keyboard, and at least one of these. Note that the objective input unit 1006 is not a required component of the presentation information generation unit 1000 and may be provided as needed.

The recommended opening calculation unit 1007 has a function of calculating a recommended opening of the opening/closing mechanism 15 based on the state of airflow in the vehicle cabin estimated by the vehicle interior airflow estimation unit 1005. The recommended opening in this embodiment refers to an opening that realizes an airflow state in the vehicle cabin that the occupant feels comfortable. The airflow state in the vehicle cabin that the occupant feels comfortable refers to, for example, a state in which air flows in the vehicle cabin at a speed within a predetermined range. The recommended opening calculation unit 1007 in this embodiment compares the airflow speed in the vehicle cabin estimated by the vehicle interior airflow estimation unit 1005 with the predetermined range obtained in advance by experiments, computer simulations, etc., and calculates the recommended opening as an opening that brings the airflow speed in the vehicle cabin estimated by the vehicle interior airflow estimation unit 1005 into the predetermined range. The predetermined range can be set, for example, from the results of experiments or simulations using a test vehicle or simulator, and is stored as data in the ROM 182 of the processor 18 or in another accessible storage device (not shown).

Alternatively or in addition, the recommended opening in this embodiment may be an opening that realizes the purpose input to the purpose input unit 1006 from the device 2 outside the vehicle. For example, if the purpose is to ventilate the vehicle to wake up the driver when the driver feels drowsy, the largest opening within the range at which the occupant feels comfortable is calculated as the recommended opening so that the air in the vehicle cabin can be replaced in a short time. In this case, the range at which the occupant feels comfortable is set based on, for example, the speed of the airflow in the vehicle cabin estimated by the vehicle airflow estimation unit 1005, the volume of wind noise when the vehicle opening/closing mechanism is operated, and the opening that the user has adopted for the same purpose in the past. Specifically, the range at which the occupant feels comfortable is obtained in advance using a test vehicle or a simulator. Alternatively, the range may be set using machine learning from predetermined data.

For example, when the purpose is to ventilate the vehicle interior to keep the temperature inside the vehicle interior at a comfortable temperature for the occupants, the smallest opening within the range that can keep the temperature inside the vehicle interior at a predetermined temperature is calculated as the recommended opening. The range that can keep the temperature inside the vehicle interior at a predetermined temperature is set based on the temperature difference between the temperature inside the vehicle interior and the temperature outside the vehicle interior, the speed of the airflow inside the vehicle interior estimated by the vehicle interior airflow estimation unit 1005, the volume of wind noise when the vehicle opening/closing mechanism is operated, the opening that the user has previously adopted for the same purpose, and the like. The recommended opening calculation unit 1007 of this embodiment, for example, uses machine learning to find a correlation between the temperature outside the vehicle interior, the temperature inside the vehicle interior, the vehicle speed, and the opening of the opening/closing mechanism 15 from the user's past operation history of the opening/closing mechanism, and calculates the recommended opening using the correlation. Note that the recommended opening calculation unit 1007 is not an essential component of the presentation information generation unit 1000, and may be provided as necessary.

The image generating unit 1008 has a function of generating an image including information representing the state of the airflow estimated by the vehicle interior airflow estimating unit 1005. Here, the information representing the state of the airflow is particularly information indicating the speed of the airflow in the vehicle cabin, and is, for example, an image of an object in the vehicle cabin moving according to the speed of the airflow in the vehicle cabin. The object in the vehicle cabin is, for example, the hair of an occupant, and may be image data acquired from the in-vehicle camera 122 or an image prepared in advance. The movement of the object may increase continuously or discretely according to the speed of the airflow. Alternatively or in addition to this, the information representing the state of the airflow may be an image in which the airflow in the vehicle cabin is visualized using a line such as a wavy line. In this case, the wavy line may increase in amplitude according to the speed of the airflow, and the amplitude may increase continuously or discretely according to the speed of the airflow.

The image generated by the image generating unit 1008 may include an image seen from inside the vehicle. The image seen from inside the vehicle is image data of the interior and exterior of the vehicle seen from the viewpoint of the occupant, acquired by the in-vehicle camera 122. The image generating unit 1008 of this embodiment synthesizes an image of an object in the vehicle moving according to the state of the airflow in the vehicle and/or an image visualizing the airflow in the vehicle with the image data acquired by the in-vehicle camera 122 to form a single image. For example, the image generating unit 1008 overlays an image of an object in the vehicle moving according to the state of the airflow in the vehicle and/or an image visualizing the airflow in the vehicle on at least one of the upper right, lower right, upper left, or lower left of the image data acquired by the in-vehicle camera 122. The size of the image of an object in the vehicle moving according to the state of the airflow in the vehicle and the image visualizing the airflow in the vehicle is not particularly limited as long as it is smaller than the size of the image data acquired by the in-vehicle camera 122. The image seen from inside the vehicle may be pre-prepared virtual image data of the interior and exterior of the vehicle as seen from the passenger's viewpoint.

Furthermore, the image generating unit 1008 of this embodiment may include information representing the recommended opening calculated by the recommended opening calculation unit 1007 in the image data acquired by the in-vehicle camera 122, in addition to the image of an object moving in the vehicle depending on the state of the airflow in the vehicle and/or the image visualizing the airflow in the vehicle. The image generating unit 1008 of this embodiment may also process the image data acquired by the in-vehicle camera 122 and virtual image data of the interior and exterior of the vehicle as seen from the viewpoint of the occupant, which is prepared in advance. For example, when the image includes the faces of the driver and/or passengers, the image generating unit 1008 may mask the faces to prevent a remote user from identifying the driver and/or passengers.

The image output unit 1009 has a function of outputting the image generated by the image generation unit 1008 to the device 2 outside the vehicle. The presentation information generation device 17 of this embodiment uses the function of the image output unit 1009 to output image data from the communication device 16 of the presentation information generation system 1 to the communication device 23 of the device 2 outside the vehicle. The image data received by the communication device 23 is displayed on the display device 21 connected to the communication device 23. This allows a user in a remote location to intuitively grasp the state of the airflow inside the vehicle from the image.

The opening/closing command output unit 1010 has a function of acquiring an opening/closing command for operating the opening/closing mechanism 15 from the device 2 outside the vehicle, and outputting the acquired opening/closing command to the opening/closing mechanism control unit 1011 that operates the opening/closing mechanism 15. A user who intuitively grasps the state of the airflow inside the vehicle cabin from the image displayed on the display device 21 can input a command to operate the opening/closing mechanism 15 of the vehicle from a remote location as necessary. In this embodiment, the opening/closing command for controlling the drive device 151 of the opening/closing mechanism 15 is input using an input device 22 such as a window opening/closing operation button. The opening/closing command input to the input device 22 is output to the communication device 16 of the presentation information generation system 1 via the communication device 23 of the device 2 outside the vehicle that is connected to the input device 22.

The opening/closing mechanism control unit 1011 has a function of operating the opening/closing mechanism 15 based on the opening/closing command acquired from the opening/closing command output unit 1010. The presentation information generating device 17 of this embodiment acquires an opening/closing command from the communication device 16 by the function of the opening/closing mechanism control unit 1011, controls the driving device 151 based on the acquired opening/closing command, and operates the opening/closing mechanism 15. This allows a user in a remote location to set the opening/closing mechanism to an appropriate opening degree. The opening/closing mechanism control unit 1011 is provided in the presentation information generating device 17, but when the presentation information generating device 17 is provided in the server 3, and when only the presentation information generating unit 1000 of the presentation information generating device 17 is provided in the server 3, the opening/closing mechanism control unit 1011 may be provided in the driving device 151 of the opening/closing mechanism 15. Note that the opening/closing mechanism control unit 1011 is not an essential component of the presentation information generating unit 1000, so it may be provided as necessary.

[Processing of presentation information generation system]
The process of the presentation information generating device 17 presenting information will be described with reference to Fig. 3. Fig. 3 is an example of a flowchart showing information processing in the presentation information generating system 1 and the external device 2 of the present embodiment. The routine on the left side of the flowchart shows steps executed by the presentation information generating device 17, and the routine on the right side shows steps executed by the external device 2. The process described below is executed at predetermined time intervals by the processor 18 of the presentation information generating device 17 and the external device 2.

When the presentation information generating device 17 is in standby state and the driver and/or passenger of the vehicle instructs a user at a remote location to operate the opening/closing mechanism, the presentation information generating device 17 and the device 2 outside the vehicle start the series of processes shown in FIG. 3. The driver and/or passenger of the vehicle can request the user at a remote location to operate the opening/closing mechanism by, for example, voice communication via a network.

First, in step S1 of FIG. 3, the presentation information generating device 17 acquires the vehicle's driving state. Specifically, the driving state acquiring unit 1001 acquires the vehicle's driving speed using the vehicle speed sensor 111. In the following step S2, the presentation information generating device 17 acquires the opening degree of the opening/closing mechanism 15 from the opening degree sensor 152 using the function of the opening degree acquiring unit 1002.

In step S3, the presentation information generating device 17 acquires information outside the vehicle, including at least one of the weather around the vehicle, an image of the vehicle's surroundings, and map information around the vehicle, by using the function of the information acquiring unit 1003, and then in step S4, estimates the airflow outside the vehicle using the information acquired in step S3. The estimation of the airflow outside the vehicle is performed by the function of the outside-vehicle airflow estimating unit 1004. Note that steps S3 and S4 are not essential steps in the processing of the presentation information generating device 17.

When the presentation information generating device 17 is mounted on a vehicle, the presentation information generating device 17 acquires the vehicle's running state, the opening degree of the opening/closing mechanism 15, and information outside the vehicle through an in-vehicle LAN such as a CAN in steps S1 to S3. On the other hand, when the presentation information generating device 17 is provided in the server 3, the presentation information generating device 17 acquires the vehicle's running state, the opening degree of the opening/closing mechanism 15, and information outside the vehicle from the traveling vehicle via a network using the communication device 16 in steps S1 to S3.

In step S5, the presentation information generating device 17 estimates the state of airflow inside the vehicle cabin from the vehicle driving state acquired in step S1 and the opening degree of the opening/closing mechanism 15 acquired in step S2. The function of the in-vehicle airflow estimating unit 1005 is used to estimate the state of airflow inside the vehicle cabin. In addition, the airflow outside the vehicle estimated in step S4 may be added to the vehicle driving state and the opening degree of the opening/closing mechanism 15 to estimate the state of airflow inside the vehicle cabin.

In step S6, the purpose for operating the opening/closing mechanism 15 is inputted in the device 2 outside the vehicle. The purpose is inputted using the purpose input device 24 of the device 2 outside the vehicle, and the input purpose is outputted from the communication device 23 connected to the purpose input device 24 to the communication device 16 of the presentation information generating system 1. In step S7, the presentation information generating device 17 acquires the purpose received by the communication device 16, and calculates the recommended opening degree using the function of the recommended opening degree calculation unit 1007. Note that steps S6 and S7 are not essential steps in the processing of the presentation information generating device 17 and the device 2 outside the vehicle, and it is not essential to input the purpose for operating the opening/closing mechanism 15 in order to calculate the recommended opening degree.

In the next step S8, the presentation information generating device 17 generates an image to be displayed on the display device 21 of the device 2 outside the vehicle, using the function of the image generating unit 1008. In step S9, the generated image is output from the presentation information generating device 17 to the device 2 outside the vehicle. The presentation information generating device 17 outputs the generated image to the communication device 23 of the device 2 outside the vehicle via the communication device 16, using the function of the image output unit 1009.

In step S10, the image received by the communication device 23 is displayed on the display device 21 connected to the communication device 23. In the following step S11, the remote user, who has intuitively grasped the state of the airflow inside the vehicle, inputs an opening/closing command to the input device 22 to operate the opening/closing mechanism 15. The input opening/closing command is output to the communication device 16 of the presentation information generation system 1 via the communication device 23 connected to the input device 22.

In step S12, the presentation information generating device 17 acquires the opening/closing command received by the communication device 16 through the function of the opening/closing mechanism control unit 1011. In the following step S13, the presentation information generating device 17 outputs the acquired opening/closing command to the opening/closing mechanism control unit 1011 through the function of the opening/closing command output unit 1010. Then, in step S14, the presentation information generating device 17 acquires the opening/closing command through the function of the opening/closing mechanism control unit 1011, and controls the drive device 151 based on the acquired opening/closing command to operate the opening/closing mechanism 15. If the opening/closing mechanism control unit 1011 is provided in the drive device 151, the opening/closing mechanism control unit 1011 acquires the opening/closing command via a network through an in-vehicle LAN such as a CAN and the communication device 16. Note that step S14 is not an essential step in the processing of the presentation information generating device 17.

After operating the opening/closing mechanism 15 in step S14, the presentation information generating device 17 determines whether or not the operation of the opening/closing mechanism 15 has been completed. If the operation of the opening/closing mechanism 15 has been completed, the presentation information generating device 17 completes the series of processes. On the other hand, if the operation of the opening/closing mechanism 15 has not been completed, the presentation information generating device 17 returns to step S1 and resumes the series of processes.

In addition, the presentation information generating device 17 of this embodiment may repeat the process of steps S1 to S9 until it receives an opening/closing command from the device 2 outside the vehicle after outputting an image to the device 2 outside the vehicle in step S9. In addition, the presentation information generating device 17 of this embodiment may complete the series of processes if a predetermined time has elapsed without receiving an opening/closing command after outputting an image to the device 2 outside the vehicle in step S9.

[Embodiments of the invention]
[Aspect 1]
According to the presentation information generating method and presentation information generating device 17 of the present embodiment, there is provided a presentation information generating device including: a driving state acquisition unit 1001 that acquires a driving state of a vehicle; an opening acquisition unit 1002 that acquires an opening degree of an opening/closing mechanism 15 that separates the interior and exterior of the vehicle; an interior airflow estimation unit 1005 that estimates an airflow state in the interior of the vehicle based on at least the driving state of the vehicle acquired by the driving state acquisition unit 1001 and the opening degree of the opening/closing mechanism 15 acquired by the opening acquisition unit 1002; an image generation unit 1008 that generates an image including information representing the airflow state estimated by the interior airflow estimation unit 1005; an image output unit 1009 that outputs the image generated by the image generation unit 1008 to a device 2 outside the vehicle; and an opening/closing command output unit 1010 that acquires an opening/closing command for operating the opening/closing mechanism 15 from the device 2 outside the vehicle and outputs the acquired opening/closing command to an opening/closing mechanism control unit 1011 that operates the opening/closing mechanism 15. This makes it possible to estimate the speed and direction of the airflow flowing into the vehicle cabin from the vehicle's traveling speed and the open/closed state of the opening/closing mechanism 15 for the windows, sunroof, etc., and to generate and output an image that takes into account the effect of the estimated airflow on the occupants. As a result, when an assistant that remotely assists the driver in driving, or an acquaintance of the driver who is virtually riding with the vehicle using an avatar (alter ego) opens or closes a vehicle window, the assistant and acquaintance who are in a location away from the vehicle can intuitively grasp the state of the airflow inside the vehicle cabin.

[Aspect 2]
According to the presentation information generating method and the presentation information generating device 17 of the present embodiment, the present invention further includes an information acquiring unit 1003 that acquires information including at least one of the weather around the vehicle, an image around the vehicle, and map information around the vehicle, and an outside-vehicle airflow estimating unit 1004 that estimates an airflow outside the vehicle based on the information acquired by the information acquiring unit 1003, and the inside-vehicle airflow estimating unit 1005 estimates an airflow state inside the vehicle based on the outside airflow estimated by the outside-vehicle airflow estimating unit 1004 in addition to the running state of the vehicle acquired by the running state acquiring unit 1001 and the opening degree of the opening/closing mechanism acquired by the opening degree acquiring unit 1002. This makes it possible to estimate the state of the airflow inside the vehicle in consideration of the strength and direction of the wind outside the vehicle and the running environment of the road on which the vehicle is running.

[Aspect 3]
According to the presentation information generating method and the presentation information generating device 17 of the present embodiment, the image generating unit 1008 generates the image in which objects in the vehicle cabin move according to the state of the airflow in the vehicle cabin, thereby making it possible to generate an image that takes into consideration the physical effect of the wind flowing into the vehicle cabin on the hair, clothes, and the like of the occupants.

[Aspect 4]
According to the presentation information generating method and the presentation information generating device 17 of the present embodiment, the image generating unit 1008 generates the image that visualizes the airflow in the vehicle cabin, thereby making it possible to generate an image that allows the strength and direction of the wind flowing into the vehicle cabin to be visually understood.

[Aspect 5]
According to the presentation information generating method and presentation information generating device 17 of the present embodiment, a recommended opening calculation unit 1007 is further provided which calculates a recommended opening of the opening/closing mechanism 15 based on the state of airflow estimated by the in-vehicle airflow estimation unit 1005, and the image generation unit 1008 generates the image including information representing the recommended opening calculated by the recommended opening calculation unit 1007. This allows a user in a remote location to operate the opening/closing mechanism 15 within a range that is comfortable for the vehicle occupants.

[Aspect 6]
The presentation information generating method and presentation information generating device 17 of the present embodiment further include a purpose input unit 1006 to which a purpose for operating the opening/closing mechanism 15 is input, and the recommended opening degree calculation unit 1007 calculates the recommended opening degree of the opening/closing mechanism 15 based on the state of airflow estimated by the in-vehicle airflow estimation unit 1005 and the purpose input to the purpose input unit 1006. In this way, an opening degree suitable for the purpose for operating the opening/closing mechanism 15 can be presented to a user at a remote location.

Reference Signs List 1... Presentation information generation system 11... Sensor 111... Vehicle speed sensor 112... Steering angle sensor 12... Camera 121... Vehicle exterior camera 122... Vehicle interior camera 13... Map information 14... Vehicle position detection device 15... Opening/closing mechanism 151... Driving device 152... Opening angle sensor 16... Communication device 17... Presentation information generation device 18... Processor CPU... 181
ROM…182
RAM…183
2: Equipment outside the vehicle 21: Display device 22: Input device 23: Communication device 24: Object input device 3: Server 1000: Presentation information generation unit 1001: Driving state acquisition unit 1002: Opening degree acquisition unit 1003: Information acquisition unit 1004: Outside-vehicle airflow estimation unit 1005: Inside-vehicle airflow estimation unit 1006: Object input unit 1007: Recommended opening degree calculation unit 1008: Image generation unit 1009: Image output unit 1010: Opening/closing command output unit 1011: Opening/closing mechanism control unit

Claims (7)

A running state acquisition unit that acquires a running state of a vehicle;
an opening degree acquisition unit that acquires an opening degree of an opening/closing mechanism that separates an interior and an exterior of the vehicle;
an interior airflow estimating unit that estimates an airflow state in a cabin of the vehicle based on at least the vehicle running state acquired by the running state acquiring unit and the opening degree of the opening/closing mechanism acquired by the opening degree acquiring unit;
an image generating unit that generates an image including information representing an airflow state in a cabin of the vehicle estimated by the interior airflow estimating unit;
an image output unit that outputs the image generated by the image generation unit to a display device that is provided at a remote location and is communicably connected via a server and a communication device ;
an opening/closing command output unit that acquires an opening/closing command to operate the opening/closing mechanism from an input device that is provided at the remote location and is communicatively connected via the server and the communication device, and outputs the acquired opening/closing command to an opening/closing mechanism control unit that operates the opening/closing mechanism. an information acquisition unit that acquires information including at least one of weather around the vehicle, an image of the surroundings of the vehicle, and map information around the vehicle;
and an outside airflow estimation unit that estimates an airflow outside the vehicle based on the information acquired by the information acquisition unit.
2. The presentation information generating device according to claim 1, wherein the in-vehicle airflow estimating unit estimates an airflow state inside the vehicle cabin based on the airflow outside the vehicle estimated by the outside-vehicle airflow estimating unit in addition to the vehicle running state acquired by the running state acquiring unit and the opening degree of the opening/closing mechanism acquired by the opening degree acquiring unit. The presentation information generating device according to claim 1 or 2, wherein the image generating unit generates an image in which an object in the vehicle's interior moves according to the state of airflow in the vehicle's interior. The presentation information generating device according to any one of claims 1 to 3, wherein the image generating unit generates an image that visualizes the airflow inside the vehicle. a recommended opening degree calculation unit that calculates a recommended opening degree of the opening/closing mechanism based on the state of airflow in a cabin of the vehicle estimated by the in- vehicle airflow estimation unit,
5. The presentation information generating device according to claim 1, wherein the image generating unit generates an image including information representing the recommended opening degree calculated by the recommended opening degree calculating unit. A purpose input unit into which a purpose for operating the opening/closing mechanism is input,
6. The presentation information generating device according to claim 5, wherein the recommended opening degree calculation unit calculates the recommended opening degree of the opening/closing mechanism based on the state of airflow in the cabin of the vehicle estimated by the in-vehicle airflow estimation unit and the purpose input to the purpose input unit. Acquire the vehicle's running status,
acquiring an opening degree of an opening/closing mechanism that separates the interior and exterior of the vehicle;
estimating an airflow state in a cabin of the vehicle based on at least a running state of the vehicle and an opening degree of the opening/closing mechanism;
generating an image including information representative of an airflow condition within the vehicle cabin ;
outputting the image to a display device provided at a remote location and communicatively connected via a server and a communication device ;
acquiring an opening/closing command to operate the opening/closing mechanism from an input device that is provided at the remote location and is communicatively connected via the server and the communication device ;
The acquired opening/closing command is output to the opening/closing mechanism.

Images