JP6970377B2 - In-vehicle user interface device - Google Patents

Description

The present invention relates to an in-vehicle user interface device that displays various contents as a stereoscopic image in a space and changes the stereoscopic image according to the movement of a user's hand around the stereoscopic image.

Conventionally, an in-vehicle display device using a display device such as a liquid crystal panel is known (see, for example, Patent Document 1). Such an in-vehicle display device can not only display information about various devices provided in the vehicle such as an air conditioner, but also display information about facilities around the vehicle.

Since the information presented to the user of the vehicle is diverse in this way, various measures have been taken to display it in an easy-to-understand manner for the user. For example, a plurality of pieces of information are displayed three-dimensionally on the screen, and the display position and the like are changed based on the user's operation.

However, the display range of the display device has a limit for displaying a large amount of information, which makes it difficult for the user to see. Further, even if the information is displayed in an easy-to-see position by the user's operation, the operation required for that purpose needs to take a plurality of steps, which is complicated. Further, a plurality of display devices may be mounted on the vehicle instead of one. If various types of information are simply listed on multiple display devices, it is difficult for the user to understand the location of the necessary information, and it is also difficult for the user to understand the operation for obtaining the desired information.

Japanese Unexamined Patent Publication No. 2013-84070

The present invention has been made in view of such circumstances, and an object of the present invention is to provide an in-vehicle user interface device including a plurality of display devices that are easy to use for a vehicle user and can intuitively obtain contents. And.

A first aspect of the present invention that solves the above problems is a storage device that stores predetermined contents and a shared display of a plurality of the contents as a stereoscopic image so that all users seated in the passenger compartment can see the contents. A display device, an individual display device that displays a plurality of the contents as a stereoscopic image so that only each user seated in the passenger compartment can see the content, an motion detection means for detecting the motion of the user's hand, and the stereoscopic image. The display control unit includes a display control unit that moves the selected stereoscopic image according to the operation when the operation of selecting the image and the operation of moving the stereoscopic image are detected, and the display control unit performs the shared display. It is an in-vehicle user interface device characterized by switching between a shared mode using the device and the individual display device and an individual mode using the individual display device to display the content as a stereoscopic image.

In the first aspect, the movement of the user's hand can be detected, and the content can be displayed as a stereoscopic image on the common display device and the individual display device so as to follow this movement. As a display mode for displaying a stereoscopic image on these common display devices and individual display devices, there are an individual mode and a shared mode, which are switched according to the number of users and the purpose of use. As a result, the user can easily obtain desired information by an intuitive operation according to the purpose of use.

The second aspect of the present invention is the in-vehicle user interface device according to the first aspect, and the display control unit displays the stereoscopic image displayed on the individual display device in the shared mode. The in-vehicle user interface device is characterized in that when the movement of a hand moving out of the display area of the device is detected, the stereoscopic image is hidden from the individual display device and displayed on the shared display device.

In the second aspect, content can be shared from one occupant to another by an intuitive operation.

A third aspect of the present invention is the in-vehicle user interface device according to the first or second aspect, wherein the display control unit displays the stereoscopic image displayed on the shared display device in the shared mode. The in-vehicle user interface device is characterized in that when the movement of a hand moving to the display device side is detected, the stereoscopic image is hidden from the shared display device and displayed on the individual display device.

In the third aspect, the stereoscopic image can be moved to one's own hand and the details can be viewed by an intuitive operation.

A fourth aspect of the present invention is the in-vehicle user interface device according to any one of the first to third aspects, wherein the display control unit is the stereoscopic display displayed on the individual display device in the shared mode. It is an in-vehicle user interface device characterized by displaying another stereoscopic image related to the stereoscopic image on the shared display device when the movement of a hand with respect to the image is detected.

In the fourth aspect, one user can operate the content without being disturbed by other occupants and can perform the operation without confusion, and the other user can view the resulting content on the shared display device. ..

A fifth aspect of the present invention is the in-vehicle user interface device according to any one of the first to fourth aspects, wherein the storage device is provided in a server device capable of communicating with a vehicle, and the content is described. Classification information for classifying the content is given, and the display control unit acquires the content to which the classification information specified by the user of the vehicle is given from the server device, and in the individual mode, the content is given to the individual display device. In the shared mode, the vehicle-mounted user interface device is characterized in that the content is displayed on the shared display device.

In the fifth aspect, content can be exchanged with like-minded users in other vehicles.

A sixth aspect of the present invention is the in-vehicle user interface device according to any one of the first to fifth aspects, wherein the storage device is provided in a server device capable of communicating with a vehicle, and the content is a user. The display control unit acquires user information from the server device whose attributes of users other than the user of the vehicle match the attributes of the user of the vehicle, including the user information consisting of the attributes of the above, and in the individual mode, the individual display The vehicle-mounted user interface device is characterized in that the user information is displayed on the device and the user information is displayed on the shared display device in the shared mode.

In the sixth aspect, it is possible to get on another vehicle and exchange contents or get acquaintance with other users who have similar user attributes such as hobbies and lifestyle patterns.

INDUSTRIAL APPLICABILITY According to the present invention, there is provided an in-vehicle user interface device including a plurality of display devices that are easy to use for a vehicle user and can intuitively obtain content.

It is a schematic plan view of an in-vehicle user interface device. It is a perspective view which shows the display device and a motion sensor. It is a perspective view and a plan view which show the individual display device and a motion sensor. It is a perspective view which shows the common display device and the individual display device. It is a block diagram of an in-vehicle user interface device. It is a figure which shows the example of the stereoscopic image which represented the content. It is a perspective view of the stereoscopic image of the content displayed by a common display device. It is a top view which shows the stereoscopic image for setting an in-vehicle device. It is a side view of the in-vehicle user interface device. It is a side view of the in-vehicle user interface device. It is a figure which shows the display mode of the stereoscopic image displayed by the shared display device and the individual display device. It is a figure which shows the display mode of the stereoscopic image displayed by the shared display device and the individual display device. It is a schematic diagram of an in-vehicle user interface device for explaining a circle mode, and a stereoscopic image. It is the schematic of the stereoscopic image displayed on the in-vehicle user interface device for demonstrating the connected mode.

Hereinafter, embodiments for carrying out the present invention will be described. The description of the embodiment is an example, and the present invention is not limited to the following description.

<Embodiment 1>
1 is a schematic plan view of an in-vehicle user interface device, FIG. 2 is a perspective view showing a common display device and a motion sensor, and FIG. 3 is a perspective view and a plan view showing an individual display device and a motion sensor. 4 is a perspective view showing a common display device and an individual display device. NS. The front-rear direction of the vehicle 1 is the X direction, the vehicle width direction is the Y direction, and the height direction is the Z direction. The same applies to the following figures.

As shown in FIG. 1, in the passenger compartment 4 of the vehicle 1, two front seats 2 (2A, 2B) constituting the front seats (driver's seat and passenger seat) and two rear seats constituting the rear seats are provided. Sheets 3 (3A, 3B) are arranged.

The front seat 2 is rotatably provided around a vertical axis (Z axis). That is, the front seat 2 is rotatably provided between a front-facing position facing the front of the vehicle and a rear-facing position facing the rear of the vehicle and facing the rear seat 3.

Further, the front seat 2 and the rear seat 3 are so-called electric seats, and are provided with a slide device (not shown) that slides and moves the seat in the front-rear direction of the vehicle 1 by an electric motor or the like. Further, the front seat 2 is provided with a rotating device (not shown) for rotating the seat by an electric motor or the like. The configurations of the slide device and the rotating device are not particularly limited, and existing configurations may be adopted. Therefore, detailed description of the slide device and the rotating device will be omitted.

A user seated on the front seat 2 (hereinafter referred to as an occupant) can appropriately operate the slide device and the rotating device by operating a predetermined switch, and the front seat 2 can be arranged in a desired manner. Further, the occupant seated on the rear seat 3 can appropriately operate the slide device and slide the rear seat 3 to a desired position in the front-rear direction of the vehicle by operating a predetermined switch.

The vehicle 1 is capable of fully automatic driving without the need for a driver. Therefore, not only the front seat 2B on the passenger seat side but also the front seat 2A on the driver's seat side is configured to rotate between the forward facing position and the facing position by the rotating device.

The vehicle interior 4 is equipped with an in-vehicle user interface device 10 including a shared display device 30, an individual display device 40, and a motion sensor 50.

As shown in FIGS. 2 and 4, the shared display device 30 is a device for displaying a stereoscopic image in space. As such a shared display device 30, a known device for displaying a stereoscopic image in space can be adopted.

For example, a display device that displays an image in the air by spraying fog to make it a screen and projecting an image on the screen can be used.

In addition, a display device that forms a stereoscopic image in the air using a lens or a concave mirror can be used. Further, it is possible to use a display capable of displaying a two-dimensional image and a display device in which a lens array in which minute lenses are arranged in front of the display is arranged and an image is formed in the air by the lens array. In addition, a display capable of displaying a two-dimensional image and a transmissive mirror array imaging element that regards the light incident on a minute mirror as one ray and controls those rays with many mirrors to realize the imaging action. A display device using a child can be used. Furthermore, a volumetric three-dimensional display capable of arranging light spots three-dimensionally by scanning based on the rotation of the screen or the like can be used.
Regardless of the type of display device, the stereoscopic image displayed in the air can be observed from all around.

Such a shared display device 30 is arranged so as to be surrounded by the front seats 2 and the rear seats 3 at substantially the center of the vehicle interior 4. The shared display device 30 is arranged so as to display a stereoscopic image in the space above. The area where the shared display device 30 can display a stereoscopic image is referred to as a shared display area 31. Further, three-dimensional coordinates (X, Y, Z) are defined in the shared display area 31, and it is possible to display a stereoscopic image by designating the three-dimensional coordinates.

In the present embodiment, a rectangular parallelepiped area is a shared display area 31 between the seats of the vehicle interior 4 (between the front seats 2 and the rear seats 3). Therefore, no matter which seat of the front seat 2 and the rear seat 3 is seated, the stereoscopic image displayed in the shared display area 31 can be seen.

As shown in FIGS. 3 and 4, the individual display device 40 is a device that displays a stereoscopic image in space so that it can be visually recognized only by each occupant seated in each seat of the passenger compartment 4. A plurality of individual display devices 40 are arranged around the shared display device 30 and are provided for each seat. In the present embodiment, four individual display devices 40A to 40D are provided corresponding to each sheet. When these are not distinguished, it is referred to as an individual display device 40.

Specifically, the individual display device 40 regards the light incident on the liquid crystal display 42 capable of displaying a two-dimensional image and the minute mirrors as one light ray, and controls the light rays by many mirrors to connect the light rays. It includes an imaging plate 43 having a transmissive mirror array imaging element that realizes an image effect. The image displayed on the liquid crystal display 42 is displayed (imaged) as a stereoscopic image in space by the image forming plate 43.

The space in which the stereoscopic image displayed by the imaging plate 43 is displayed is referred to as an individual display area 41. The imaging plate 43 is arranged so that the individual display area 41 is located in the space between each seat and each individual display device 40. The stereoscopic image displayed by each individual display device 40 can be visually recognized only by the occupants of the seat corresponding to each individual display device 40, and cannot be visually recognized by other occupants. The term "visible only to the occupant" as used in the present invention means a mode in which the stereoscopic image itself cannot be seen by other occupants, or a mode in which the stereoscopic image cannot be recognized as characters or figures.

In the present embodiment, for example, the individual display device 40A displays a stereoscopic image toward the occupant of the front seat 2A. Even if the occupants of the front seat 2B, the rear seat 3A, and the rear seat 3B try to see the stereoscopic image displayed by the individual display device 40A, they are obstructed by the imaging plate 43 of the individual display device 40A and cannot be visually recognized. Characters and figures cannot be clearly recognized and are clearly visible.

As shown in FIG. 4, the occupants of each seat (the occupants of the front seats are not shown) can visually recognize the stereoscopic image I1 displayed by the shared display device 30. On the other hand, the stereoscopic image I2 displayed for the occupants of the rear seats 3A can be visually recognized only by the occupants, and cannot be visually recognized by the occupants of the front seats 2A and 2B (not shown) and the rear seats 3B. The same applies to the stereoscopic image I3 displayed for the occupants of the rear seat 3B, the front seat 2A, and the stereoscopic image displayed for the occupants of the front seat 2B.

The motion sensor 50 is a device for detecting the movement of the occupant's hand. Specifically, the motion sensor 50 is a device that emits infrared rays and captures the reflected light reflected by the detection object to form an image. be. The area where the motion sensor 50 can detect the occupant's hand is referred to as a detection area. The motion sensor 50 of the present embodiment has a first detection area 51 including a shared display area 31 and a second detection area 52 including an individual display area 41 as detection areas. The motion sensor 50 captures the first detection area 51 and the second detection area 52 as an image. It is not necessary for the motion sensor 50 to image the first detection area 51 and the second detection area 52 by one unit, but to image the first detection area 51 and the second detection area 52 by a plurality of units. It is also good.

FIG. 5 is a block diagram of the vehicle-mounted user interface device 10. As shown in the figure, the vehicle-mounted user interface device 10 includes a storage device 11, a control device 20, and a microphone 60.

The storage device 11 stores predetermined contents. The content is various information about the vehicle 1. For example, the name of the in-vehicle device, setting items related to the in-vehicle device, information about the surroundings of the vehicle 1 and facilities on the route on which the vehicle 1 is going to travel, and the like.

In-vehicle devices include navigation systems, radios, audio devices, and air conditioners. In the case of a navigation system, the setting items related to the in-vehicle device include a route and a destination. Similarly, in the case of a radio, it is the volume or radio station, in the case of an air conditioner, it is the operation mode (heating, cooling, ventilation, etc.), temperature, air volume, and in the case of audio equipment, it is the volume, play, stop, fast forward, etc. be.

As described above, the storage device 11 stores various information related to the in-vehicle device and contents related to peripheral facilities and the like.

The content is not limited to that stored in the storage device 11 mounted on the vehicle 1. The content may be stored in a remote storage device. In this case, a server device including a storage device for storing the contents is provided so that the vehicle-mounted user interface device 10 and the server device can communicate wirelessly. Then, when the keyword is transmitted from the vehicle 1 to the server device via wireless communication, the server device searches the storage device for the content corresponding to the keyword and transmits the content to the vehicle 1. In this way, the vehicle 1 may obtain the content from the remote storage device 11.

The control device 20 is an ECU (Electronic Control Unit), and includes a CPU, a ROM for storing and storing a control program, a RAM as an operating area for the control program, an EEPROM for holding various data in a rewritable manner, and peripheral circuits. It is configured to include an interface unit that takes an interface. The control device 20 is connected to each part of the vehicle 1 via an interface part, exchanges information with each part, and controls each part.

Further, the control device 20 includes a detection unit 21, a voice recognition unit 22, and a display control unit 23. Each of these parts is realized by the CPU of the control device 20 executing a control program.

The detection unit 21 analyzes the image acquired from the motion sensor 50 and detects the position and movement of the occupant's hand. The position of the hand is, for example, three-dimensional coordinates with respect to the origin of the shared display area 31. The motion sensor 50 and the detection unit 21 correspond to the motion detection means described in the claims.

Since the detection of the position and movement of the hand based on the analysis of the image is a known technique, detailed description thereof will be omitted, but the detection unit 21 can detect the following movement of the hand.

For example, the detection unit 21 can detect the shape of a hand such as a grasped hand, an open hand, or a pointing hand. Further, it is possible to detect the direction of a hand such as a hand in a horizontal state or a hand in a vertical state. In addition, the distance and position from the motion sensor 50 can also be detected. Then, the detection unit 21 detects the movement of the hand from such a change in the state of the hand. For example, as a hand motion, a flick motion, a slide motion, a point motion, and a pinch motion are determined.

The flick motion is a motion of swinging the fingertip left and right or up and down around the wrist.
The sliding motion is a motion of moving the entire hand in the vertical direction and the horizontal direction.
The point movement is a movement in which a part of a finger, for example, the index finger, is extended and the other finger is bent to move the hand in the vertical direction or the horizontal direction.
The pinch movement is a movement in which two fingertips approach or separate from each other with two fingers extended. A pinch-in operation in which two fingertips are close to each other is also called a pinch-in operation, and a pinch-out operation in which two fingertips are separated from each other is also called a pinch-out operation.

The voice recognition unit 22 analyzes the voice acquired from the microphone 60 and recognizes words and the like of the voice uttered by the occupant. Further, the voice recognition unit 22 analyzes the voice acquired from the microphone 60 and detects the position of the source of the voice, that is, the position of the occupant. Such voice recognition and detection of the position of the occupant can be performed by a known voice analysis technique. The microphone 60 and the voice recognition unit 22 correspond to the occupant position detecting means described in the claims.

The display control unit 23 controls the shared display device 30 and the individual display device 40 to display the content as a stereoscopic image. The display control unit 23 reads the content from the storage device 11, converts the content into a data format that can be displayed by the shared display device 30 and the individual display device 40, and causes the shared display device 30 and the individual display device 40 to display the content.

FIG. 6 is a diagram showing an example of a stereoscopic image showing the content. FIG. 6A is a perspective view of the stereoscopic image A viewed from one side, and FIG. 6B is a perspective view of the stereoscopic image A viewed from the opposite side (the stereoscopic image A of FIG. 6A is taken around the Z axis. FIG. 6 (c) is a perspective view of the stereoscopic image B. The stereoscopic image A is an opaque (the opposite side cannot be seen through) cubic stereoscopic image, and the stereoscopic image B is a translucent (the opposite side can be seen through) spherical stereoscopic image.

Content is displayed in these stereoscopic images A and B. For example, as shown in FIG. 6A, new information about a facility called “○○ Land” and a map around the facility are displayed on each side of the stereoscopic image A. Further, as shown in FIG. 6B, the surrounding weather of the facility and the SHOP information (product information) of the facility are displayed on each surface on the opposite side of the stereoscopic image B.

As shown in FIG. 6 (c), new information about the facility "○○ Land" (a part of the characters wraps around to the back side and can be seen through from the front side) is displayed along the spherical surface of the stereoscopic image B. ing.

As described above, the content is displayed in the stereoscopic image A and the stereoscopic image B, but another content (thumbnail image or the like) for calling the content may be displayed. For example, although the details will be described later, when the occupant touches the surface of the stereoscopic image A displayed as "map", another stereoscopic image on which the map of "○○ land" is displayed is displayed on the shared display device 30. You may.

Further, the stereoscopic image may represent contents for operating the in-vehicle device. For example, as such contents, upward / downward arrows for adjusting the temperature of the air conditioner, plus / minus symbols, and the like may be displayed as a stereoscopic image. As will be described later, when such a stereoscopic image is moved upward by the occupant, the temperature of the air conditioner is controlled to be raised. A stereoscopic image may be used as a user interface for such control.

The position, orientation, and movement of displaying the stereoscopic image illustrated in FIG. 6 will be described. Here, the shared display device 30 will be described, but the same applies to the individual display device 40.
The display control unit 23 reads the content from the storage device 11 and displays it on the shared display device 30. For example, the display control unit 23 causes the shared display device 30 to display a plurality of contents as stereoscopic images A to G.

The display control unit 23 first determines the content to be displayed. For example, the predetermined content is read from the storage device 11. Alternatively, the display control unit 23 uses the voice of the occupant recognized by the microphone 60 and the voice recognition unit 22 as a keyword, and searches the storage device 11 for content related to the keyword.

For example, the display control unit 23, as predetermined contents, from the storage device 11, a navigation system, a radio, a television, an audio device, an air conditioner, vehicle information such as speed and remaining fuel, and contents related to facilities around the vehicle. To read.

FIG. 7 is a perspective view of a stereoscopic image of the content displayed by the common display device.
As shown in FIG. 7A, the display control unit 23 displays the content read from the storage device 11 as individual stereoscopic images A to G. For example, content related to the navigation system is displayed on each surface of the stereoscopic image A, for example, a current position or destination is displayed on one surface, and a peripheral map is displayed on another surface. For other stereoscopic images B to G, various contents are displayed on each surface.

Further, the display control unit 23 determines the coordinates in the shared display area 31 so that the individual stereoscopic images A to G do not overlap, and displays the stereoscopic images A to G at the coordinates. These stereoscopic images A to G may always be displayed at a fixed position, or the displayed position may be changed based on the movement of the occupant.

For example, the display control unit 23 arranges a plurality of stereoscopic images A to G evenly on one ring 32 at predetermined intervals and displays them in the shared display area 31.

Further, it is preferable that the stereoscopic images A to G do not overlap with the line of sight L of the occupant. Such a line of sight L can be determined based on the front seat 2, the rear seat 3, the average occupant's eye position, and the position of the shared display area 31.

The line of sight L of the occupant is virtually formed in the three-dimensional space, and the three-dimensional coordinates of each three-dimensional image are calculated so that two or more stereoscopic images are not arranged on the line of sight L. In the present embodiment, since there are four occupants, four lines of sight L are virtually formed, and the three-dimensional coordinates of each three-dimensional image are set so that two or more stereoscopic images are not arranged in each line of sight L. calculate.
As a result, for the occupant, the stereoscopic images do not overlap each other, so that the visibility of the plurality of stereoscopic images is improved.

Further, the stereoscopic images A to G displayed in the shared display area 31 may be rotated. For example, the display control unit 23 rotates each stereoscopic image A to G around the Z axis. As a result, the occupant can visually recognize each side surface of the stereoscopic images A to G while seated. Further, the stereoscopic images A to G may move along the circumference of the ring 32. Since each stereoscopic image A to G moves closer to the occupant with the passage of time, the visibility of the stereoscopic image is improved. Of course, the mode of rotation and movement of the stereoscopic image is not limited to the above.

Further, the display control unit 23 causes the shared display device 30 to display the stereoscopic image selected by the motion of the occupant among the plurality of stereoscopic images following the motion of the occupant.

The display control unit 23 determines whether or not there is a stereoscopic image within a certain range from the coordinates of the occupant's hand obtained from the detection unit 21. When it is determined from the coordinates of the hand that there is a stereoscopic image within a certain range, it is assumed that the stereoscopic image is selected by the occupant. In the example of FIG. 7A, it is determined that the stereoscopic image A is selected by the occupant. In addition, it may be determined that the stereoscopic image is selected when the point motion is detected within a certain range from the stereoscopic image.

In the state where the stereoscopic image is selected, when a specific motion (for example, an motion in which the hand moves away from the stereoscopic image A at a certain speed or higher) is detected, it is determined that the stereoscopic image is deselected.

Displaying a stereoscopic image following the movement of the occupant means changing the coordinate position, size, or orientation of the stereoscopic image in response to the above-mentioned flicking motion, sliding motion, point motion, and pinch motion, or displaying the stereoscopic image. It means to change the displayed contents.

For example, when the pinch-out operation is detected from the state where the hand pinches the stereoscopic image A as shown in FIG. 7A, the stereoscopic image A is enlarged and displayed as shown in FIG. 7B. In this way, the stereoscopic image A is enlarged in response to the pinch-out operation, which is an operation for enlarging the object. As a result, the request "I want to magnify the stereoscopic image A" can be realized by an intuitive operation.

In addition, although not particularly shown, it is possible to display a stereoscopic image corresponding to each operation.
For example, when the pinch-in operation is detected from the state where the hand pinches the stereoscopic image, the stereoscopic image is reduced and displayed. In this way, the stereoscopic image is reduced in response to the pinch-in operation, which is an operation of reducing the object. As a result, the request "to reduce the stereoscopic image to make it easier to see other stereoscopic images" can be realized by an intuitive operation.

When a slide motion or a flick motion is detected from the state where the hand selects the stereoscopic image, the stereoscopic image is moved according to the position of the hand. In this way, the stereoscopic image is moved in response to the slide motion, which is an motion of moving an object. As a result, the request of "want to move the stereoscopic image" can be realized by an intuitive operation.

Further, when the hand detects a point motion with respect to the stereoscopic image, the content related to the stereoscopic image may be searched and the content may be displayed as another stereoscopic image. For example, when a point operation is detected on the side of the stereoscopic image A showing "new information" shown in FIG. 6A, the content related to the details of the new arrival information is displayed as another stereoscopic image. You may. As a result, the request "I want to know the details of the content displayed on the stereoscopic image" can be realized by intuitive operation.

When displaying a stereoscopic image following the movement of the occupant's hand, a predetermined process may be executed according to the content.

FIG. 8 is a plan view showing a stereoscopic image for setting an in-vehicle device.
In FIG. 8A, for example, the content related to the temperature setting of the air conditioner is displayed as the stereoscopic image H in the shared display area 31. When an upward flick operation is detected, the display control unit 23 moves the stereoscopic image H upward and controls the air conditioner to raise the temperature by, for example, 1 ° C. Similarly, when a downward flick operation is detected, the display control unit 23 moves the stereoscopic image H downward and controls the air conditioner to lower the temperature by, for example, 1 ° C. The display control unit 23 returns the stereoscopic image H to its original position after setting the temperature. In this way, the requirement of "raising or lowering the temperature of the air conditioner" can be realized by intuitive operation.

Further, in FIG. 8B, for example, the content related to the radio channel selection setting is displayed as the stereoscopic image I in the shared display area 31. When a flick operation to the left is detected, the display control unit 23 moves the stereoscopic image I to the left and changes to a broadcasting station using a frequency lower than that of the currently selected broadcasting station. Similarly, when a flick operation to the right is detected, the display control unit 23 moves the stereoscopic image I to the right and changes to a broadcasting station that uses a higher frequency than the currently selected broadcasting station. do. In this way, the request to "select a radio" can be realized by an intuitive operation.

In addition, for stereoscopic images, operation of car navigation system, air volume of air conditioner, switching of operation mode of air conditioner (heating, cooling, ventilation, etc.), volume / selection of TV, volume / playback / stop of audio equipment -The user interface for fast-forwarding may be used to control each device when a specific operation is detected for a stereoscopic image.

As described above, the shared display device 30 and the individual display device 40 for displaying a stereoscopic image function as output devices for displaying the content to the occupants, and the motion sensor 50 and the detection unit 21 are inputs for inputting operations for the content. Functions as a device.

As described above, the mode of displaying the stereoscopic image on each of the shared display device 30 and the individual display device 40 has been described. Further, the in-vehicle user interface device 10 of the present invention has an individual mode and a shared mode as a mode for displaying a stereoscopic image on the shared display device 30 and the individual display device 40.

The display control unit 23 automatically switches between the plurality of modes. For example, switching is performed according to the number of passengers in the vehicle interior. Specifically, the display control unit 23 switches to the individual mode if there is only one occupant, and switches to the shared mode if there are a plurality of occupants.

Further, the switching between the plurality of modes may be manually performed by the occupant. For example, a menu for selecting a plurality of modes may be displayed as a stereoscopic image on the shared display device 30 or the individual display device 40, and each mode may be selected by the operation of the occupant's hand. Of course, a button provided on the instrumental panel or the like may be used to switch between a plurality of modes.

The individual mode is a display mode for displaying a stereoscopic image for each occupant. Specifically, the content that requires the privacy of the occupant is displayed only on the individual display device 40 for the occupant so that it cannot be visually recognized by the individual display device 40 for other occupants. As a means for displaying the content only to a specific occupant, as described above, an individual display device 40 that displays a stereoscopic image so that only each occupant can see the content can be applied. When displaying content that requires privacy, the display control unit 23 automatically switches to the individual mode and displays the content only on the individual display device 40.

Content that requires privacy includes, for example, information handled by the calling application (calling party, call content (text information)), search keywords used when accessing a search engine via a browser, browsing history of web pages, and the like. be.

Whether or not such privacy is required is set in advance for each content or set by the occupant and stored in the storage device 11. When the content designated by the occupant is read from the storage device 11, the display control unit 23 does not display the content on the shared display device 30 and is used for the occupant if privacy is set for the content. Is displayed on the individual display device 40.

FIG. 9 is a side view of the in-vehicle user interface device. The figure shows the occupants of the front seat 2A and the rear seat 3B, the individual display device 40A and the individual display device 40D, and the shared display device 30.

For example, the stereoscopic image B (three-dimensional image B displayed by the individual display device 40D) that requires privacy for the occupant of the rear seat 3B cannot be visually recognized or is difficult to be visually recognized by the occupant of the front seat 2A. What can be visually recognized by the occupant of the front seat 2A is the stereoscopic image A displayed by the individual display device 40A for the occupant. Therefore, even if the content related to the privacy of the occupant of the rear seat 3B is displayed on the individual display device 40D as the stereoscopic image B, the privacy of the occupant can be protected. Of course, the same applies to the occupants of other seats.

Next, the shared mode will be described. The shared mode is an embodiment in which both the shared display device 30 and the individual display device 40 display a stereoscopic image. Specifically, there are a multiplayer mode and a pioneer mode as shared modes.

A multiplayer mode will be described with reference to FIGS. 10 and 11. FIG. 10 is a side view of an in-vehicle user interface device, and FIG. 11 is a diagram showing a display mode of a stereoscopic image displayed by a shared display device and an individual display device.

The multi-person mode is a display mode in which the content is displayed on the shared display device 30 and the individual display device 40 based on the movement of the occupant's hand on the stereoscopic image. The display control unit 23 switches to the multi-person mode when a plurality of occupants are on board in the vehicle interior and the plurality of occupants display various contents in parallel or operate the contents.

As shown in FIGS. 10 and 11A, the display control unit 23 detects the movement of the hand moving the stereoscopic image B displayed on the individual display device 40D to the outside of the individual display area 41 of the individual display device 40D. At that time, the stereoscopic image B is hidden from the individual display device 40D and displayed on the shared display device 30 (shared display area 31).

Here, when the motion of the hand that moves the stereoscopic image B upward to the outer edge of the individual display area 41 is detected, the stereoscopic image B is hidden in the individual display area 41 and displayed in the shared display area 31. That is, when the occupant of the rear seat 3B takes an action of manually selecting and moving the stereoscopic image B displayed on the individual display device 40D upward, the stereoscopic image B is transferred to the shared display device 30. Can be moved. The stereoscopic image B is not limited to the case of moving upward, and when the movement of the hand moving to a specific area (for example, a corner portion) of the individual display area 41 is detected, the individual display area 41 is displayed. The stereoscopic image B may be hidden and displayed in the shared display area 31.

Next, a display mode for moving from the shared display device 30 to the individual display device 40 in the multiplayer mode will be described.

As shown in FIGS. 10 and 11B, when the display control unit 23 detects the movement of the hand that moves the stereoscopic image B displayed on the shared display device 30 toward the individual display device 40, the shared display device 23. The stereoscopic image B is hidden from 30 and displayed on the individual display device 40A.

Here, when the motion of the hand moving the stereoscopic image B to the outer edge of the shared display area 31 in the horizontal direction (direction toward the individual display device 40A for the occupant of the front seat 2A) is detected, the stereoscopic image B is shared. It is hidden in the display area 31 and displayed in the individual display area 41. That is, when the occupant of the front seat 2A takes an action of manually selecting and moving the stereoscopic image B displayed on the shared display device 30 to the front, the stereoscopic image B is displayed on the individual display device 40A. Can be moved. The stereoscopic image B is not limited to the case of moving to the front, and when the movement of the hand to move to a specific area (for example, a corner portion) of the shared display area 31 is detected, the shared display area 31 The stereoscopic image B may be hidden and displayed in the individual display area 41.

In the multi-person mode described above, the occupant can move the stereoscopic image displayed on the individual display device 40 to the shared display device 30, and other occupants can view it. According to such a multi-person mode, each occupant can show and share the stereoscopic image displayed on his / her individual display device 40 to other occupants. Further, according to the multi-person mode, each occupant can move the stereoscopic image displayed on the shared display device 30 to his / her own individual display device 40 for viewing. In this way, in the multiplayer mode, the content can be exchanged intuitively between the occupants as a stereoscopic image, and the content can be easily shared.

Next, the pioneer mode will be described with reference to FIG. FIG. 12 is a diagram showing a display mode of a stereoscopic image displayed by a shared display device and an individual display device.

The pioneer mode is a display mode in which only one occupant can operate the individual display device 40, and the other occupants can perform operations such as viewing or moving the stereoscopic image of the shared display device 30. The display control unit 23 switches to the pioneer mode when a plurality of occupants are on board the vehicle interior and one occupant proactively displays the content and operates the content. Here, a case where the occupant of the rear seat 3B can operate the individual display device 40D will be described.

In the pioneer mode, when the display control unit 23 detects the movement of the hand on the stereoscopic image of the individual display device 40, the display control unit 23 displays another stereoscopic image related to the stereoscopic image on the shared display device. Here, the search screen, which is the content related to the car navigation system, is displayed as the stereoscopic image A, and the search result screen related to the stereoscopic image A is displayed as the stereoscopic image B.

In the pioneer mode, the movement of the hand is detected for the stereoscopic image A displayed on one individual display device 40D. Then, a predetermined process is performed based on the movement of the hand on the stereoscopic image A. For example, when a movement of a hand touching the "departure point" is detected, a stereoscopic image prompting the passenger of the rear seat 3B to input the departure point is displayed, or sound is output from a speaker (not shown). do.

For example, the control device 20 recognizes the voice of the occupant collected by the microphone 60 by using a known voice recognition technique, and acquires the recognized voice as a starting point. Alternatively, a virtual keyboard may be displayed as a stereoscopic image, and an action of touching the keyboard may be detected to input characters. Such character input is similar to character input by a conventional graphical user interface (GUI) using a flat display, except that it is a stereoscopic image. Of course, not limited to the keyboard, a plurality of departure points may be displayed side by side as a stereoscopic image, and the departure point may be selected by selecting one of them.

The control device 20 also acquires the "destination" in the same manner as the "departure point". The display control unit 23 displays the destination (here, “home”) and the departure place (here, “○○ land”) acquired in this way on the individual display device 40D as a stereoscopic image A.
After inputting the "starting point" and "destination", the occupant of the rear seat 3B performs an operation of manually touching the "search" button displayed as the stereoscopic image A. When the display control unit 23 detects the movement of the hand touching the "search" button in the stereoscopic image A, the car navigation system (not shown) is made to perform a route search.

The display control unit 23 displays the search result by the car navigation system as a stereoscopic image B on the shared display device 30. Here, the map and the route from the departure point (◯ to S) to the destination (○ to G) are displayed as a stereoscopic image B. The two-dimensional stereoscopic image B such as a map may be rotated around the Z axis so as to be visible to all occupants.

In the pioneer mode described above, the content requiring operation is displayed as a stereoscopic image on one individual display device 40D. Then, only the movement of the hand with respect to the stereoscopic image displayed on one individual display device 40D is detected. That is, only a specific occupant can operate the stereoscopic image. On the other hand, the stereoscopic image B related to the stereoscopic image A is displayed on the shared display device 30 that can be visually recognized by all the occupants.

According to such a pioneer mode, since the operation of the car navigation system is performed by one occupant in the individual display device 40, the route can be searched without confusion, and all the search results can be shared. can.

Of course, the pioneer mode is not limited to the car navigation system, but can be applied to the operation of any in-vehicle device. For example, the setting related to the air conditioner of the vehicle may be performed by operating the stereoscopic image displayed on the individual display device 40, and the confirmation screen may be displayed on the shared display device 30.

Further, there may be a pioneer mode in which the individual display device 40 searches (collects) the content and the result is displayed on the shared display device 30. For example, the display control unit 23 displays the search interface of an application (for example, a browser) that searches for contents on the individual display device 40 as a stereoscopic image. When the display control unit 23 detects the movement of the occupant's hand with respect to the stereoscopic image, the display control unit 23 causes the application to search and collect the content. The display control unit 23 summarizes the collected contents as, for example, a travel plan, and displays the collected contents on the shared display device 30 as a stereoscopic image.

According to such a pioneer mode, one occupant can collect content (for example, create a travel plan) without being interfered by other occupants by using the individual display device 40, and the content (for example, creating a travel plan). (Travel plan, etc.) can be shared with everyone by the shared display device 30.

As described above, the individual mode and the shared mode (multi-person mode and pioneer mode) have been described as display modes of the stereoscopic image, but the circle mode and the connected mode will be described as examples of other display modes.

FIG. 13 is a schematic diagram of an in-vehicle user interface device for explaining the circle mode and a stereoscopic image. A circle is a group of people who have the same hobbies and tastes in the real world. The circle mode is a mode for displaying contents related to the circle in which the occupant participates. When the occupant selects the circle mode, the display control unit 23 switches to the circle mode.

Here, as an example, it is assumed that two persons belonging to a circle related to automobiles (named as "automobile circle") are on different vehicles 1A and 1B. The vehicle-mounted user interface device 10 is mounted on each of the vehicle 1A and the vehicle 1B.

The server device 70 identifies information about the attributes of a person (hereinafter referred to as a member) belonging to an automobile circle, for example, a name and a nickname, an ID (identification code) and a password for identifying the member, and a circle to which the member belongs. Information (circle name "automobile circle") etc. is stored.

Contents related to various circles are stored in the server device 70 capable of wireless communication with the in-vehicle user interface device 10. The name of the circle is given to the content related to the circle. The circle name given to the content in this way corresponds to the classification information for classifying the content.

In order to access the content such as adding or acquiring the content stored in the server device 70, the server device 70 authenticates the member. As known authentication technology can be applied to such personal authentication, details will be omitted.

When a member is authenticated by the server device 70, the member can acquire or add information about the circle to which the member belongs.

Here, it is assumed that the occupants of vehicle 1A and vehicle 1B are authenticated as members of the automobile circle. After the authentication, the display control unit 23 acquires the content related to the automobile circle to which the authenticated occupant belongs from the server device 70. In the server device 70, the content to which the classification information of the automobile circle is added is searched and transmitted to the display control unit 23.

The display control unit 23 displays the content related to the automobile circle on the individual display device 40 as a stereoscopic image in the individual mode, and displays the content on the shared display device 30 in the shared mode. For example, as shown in FIG. 13, the vehicle 1A is in a shared mode (multiplayer mode or pioneer mode), and in this case, the display control unit 23 displays the content related to the “automobile circle” on the shared display device 30 as a stereoscopic image A. Display as.

Further, the display control unit 23 has a function of adding content from the occupant of the vehicle to the automobile circle. Although not particularly shown, the display control unit 23 displays a button on the shared display device 30 for the occupant to add content to the automobile circle. When the display control unit 23 detects the movement of the hand selecting the button, the display control unit 23 displays a stereoscopic image prompting the occupant to input voice on the shared display device 30. Then, the voice of the occupant is recognized, and the recognition result is used as a character to create content related to the automobile circle. Next, the display control unit 23 transmits the content to the server device 70.

Here, it is assumed that the occupant (member) of vehicle 1A utters "Event will be held on XX days." As a result, the content "Event will be held on XX days" is stored in the storage device 11 of the server device 70 as event information related to the automobile circle.

On the other hand, the vehicle-mounted user interface device 10 in the vehicle 1B acquires the content related to the vehicle circle from the server device 70 as described above. In vehicle 1B, it is assumed that it is an individual mode. In this case, the display control unit 23 displays the content on the individual display device 40 as a stereoscopic image B.

In this way, according to the circle mode, contents can be generated and shared among members belonging to the same automobile circle. Of course, the circle mode can be applied not only to circles related to automobiles but also to any circle. Further, not limited to the circle, if the classification information is given, the contents having the same classification information can be shared between the in-vehicle user interface devices 10.

FIG. 14 is a schematic view of a stereoscopic image displayed on an in-vehicle user interface device for explaining the connected mode.

The connected mode is a display mode for displaying contents that provide an automatic matching function between members having similar hobbies and lifestyle patterns. Here, a person to whom the automatic matching function is provided is called a member. When the member (occupant) selects the connected mode, the display control unit 23 switches to the connected mode.

Although not particularly shown, it is assumed that even in the connected mode, the vehicle can wirelessly communicate with the server device 70 and the contents are stored in the storage device 11 of the server device 70, as in the circle mode.

User information consisting of member attributes is stored as content in the server device 70. The user information is, for example, information representing a member's hobby or life pattern. Such user information is created by the member himself / herself in advance and transmitted to the server device 70. Regarding the creation of specific user information, the shared display device 30 and the individual display device 40 of the in-vehicle user interface device 10 are used to have the members input the user information and send the user information to the server device 70. .. Alternatively, a member may create user information and send it to the server device 70 by using a smartphone, a personal computer, or the like.

Next, the display control unit 23 authenticates whether the occupant of the vehicle is a member of the connected mode. Authentication is performed in the same way as in circle mode. When the occupant of the vehicle is authenticated as a member, the server device 70 searches the storage device 11 for user information regarding other members. Other members are members other than the authenticated member. The storage device 11 searches for user information such that the attributes of other members match or approximate the attributes of the member boarding the vehicle. For example, the server device 70 searches for user information about members whose hobbies match or are similar as attributes. Whether or not the attributes are similar is set in advance on the server device 70 side.

The display control unit 23 acquires user information from the server device 70 that has the same or similar hobbies as the occupants on the vehicle. Then, the display control unit 23 displays the user information about the members having the same hobby as a stereoscopic image on the individual display device 40 in the individual mode, and displays the user information on the shared display device 30 in the shared mode. For example, as shown in FIG. 14, in the individual mode, the display control unit 23 displays the user information about the member of the vehicle and the member whose hobby is close to the individual display device 40 as the stereoscopic image A.

As described above, according to the connected mode, user information regarding, for example, other members having the same hobby among the members who use the vehicle-mounted user interface device 10 is displayed as a stereoscopic image on the vehicle-mounted user interface device 10. By using the connected mode in this way, members with the same hobbies and lifestyle patterns are automatically matched (introduced), so you can increase friends and acquaintances, and in-vehicle with unprecedented excitement and new experiences. It can be given to the occupant of the vehicle equipped with the user interface device 10.

As described above, the in-vehicle user interface device 10 can detect the movement of the occupant's hand and display the content as a stereoscopic image on the shared display device 30 and the individual display device 40 so as to follow this movement. .. As a display mode for displaying a stereoscopic image on the shared display device 30 and the individual display device 40, there are an individual mode and a shared mode, which are switched according to the number of occupants and the purpose of use. As a result, the occupant can easily obtain the desired information by an intuitive operation according to the purpose of use.

Further, the in-vehicle user interface device 10 can move the stereoscopic image displayed on the individual display device 40 to the shared display device 30 by the operation of the hand in the multi-person mode. This makes it possible to share content from one occupant to another by intuitive operation.

Further, the in-vehicle user interface device 10 can move the stereoscopic image displayed on the shared display device 30 to the individual display device 40 by the operation of the hand in the multi-person mode. As a result, the stereoscopic image can be moved to one's own hand and the details can be viewed by intuitive operation.

Further, in the in-vehicle user interface device 10, in the pioneer mode, one occupant can operate the content without being disturbed by the other occupants and can perform the operation without confusion, and the other occupants share the resulting content. be able to.

Further, the in-vehicle user interface device 10 can exchange contents with like-minded members who are in other vehicles in the circle mode.

In addition, the in-vehicle user interface device 10 can get on another vehicle in the connected mode, exchange contents with members having similar hobbies and lifestyle patterns, and obtain acquaintance.

Although the embodiments of the present invention have been described, of course, the present invention is not limited to the above-described embodiments, and the addition, omission, substitution, and configuration of the configuration are added, omitted, and substituted within the range not deviating from the gist of the present invention. Other changes are possible.

1 ... Vehicle, 4 ... Vehicle room, 10 ... In-vehicle user interface device, 11 ... Storage device, 20 ... Control device, 21 ... Detection unit, 22 ... Voice recognition unit, 23 ... Display control unit, 30 ... Shared display device, 40 ... Individual display device, 50 ... Motion sensor, 51 ... First detection area, 52 ... Second detection area, 70 ... Server device

Claims (6)

A storage device that stores predetermined content and
A shared display device that displays a plurality of the contents as a stereoscopic image so that all users seated in the passenger compartment can see the contents.
An individual display device that displays a plurality of the contents as a stereoscopic image so that only each user seated in the passenger compartment can see the contents.
Motion detection means to detect the motion of the user's hand,
It is provided with a display control unit that moves the selected stereoscopic image according to the motion when the motion of selecting the stereoscopic image and the motion of moving the stereoscopic image are detected.
The display control unit is an in-vehicle user interface characterized by switching between a shared mode using the shared display device and the individual display device and an individual mode using the individual display device to display the content as a stereoscopic image. Device. The in-vehicle user interface device according to claim 1.
The display control unit is in the shared mode.
When the movement of the hand that moves the stereoscopic image displayed on the individual display device to the outside of the display area of the individual display device is detected, the stereoscopic image is hidden from the individual display device and the shared display device is displayed. An in-vehicle user interface device characterized by displaying on. In the vehicle-mounted user interface device according to claim 1 or 2.
The display control unit is in the shared mode.
When the movement of the hand moving the stereoscopic image displayed on the shared display device to the individual display device side is detected, the stereoscopic image is hidden from the shared display device and displayed on the individual display device. In-vehicle user interface device featuring. The vehicle-mounted user interface device according to any one of claims 1 to 3.
The display control unit is in the shared mode.
An in-vehicle user interface device, characterized in that when a hand movement with respect to the stereoscopic image displayed on the individual display device is detected, another stereoscopic image related to the stereoscopic image is displayed on the shared display device. The vehicle-mounted user interface device according to any one of claims 1 to 4.
The storage device is provided in a server device capable of communicating with the vehicle.
The content is given classification information for classifying the content.
The display control unit acquires the content to which the classification information specified by the user of the vehicle is added from the server device, displays the content on the individual display device in the individual mode, and shares the content in the shared mode. An in-vehicle user interface device characterized by displaying the content on a display device. The vehicle-mounted user interface device according to any one of claims 1 to 5.
The storage device is provided in a server device capable of communicating with the vehicle.
The content includes user information consisting of user attributes.
The display control unit acquires user information from the server device whose attributes of users other than the user of the vehicle match the attributes of the user of the vehicle, and displays the user information on the individual display device in the individual mode. An in-vehicle user interface device characterized in that the user information is displayed on the shared display device in the shared mode.

Images