JP7630351B2 - CONTENT CONTROL DEVICE, CONTENT CONTROL METHOD, PROGRAM, AND CONTENT PROVIDING SYSTEM - Google Patents

Description

The present invention relates to a content control device, a content control method, a program, and a content provision system.

Conventionally, technology has been developed that provides content that allows users to experience virtual space using a head-mounted display. In such applications, it is often desirable for the head-mounted display to be used in an open space with no surrounding obstacles, taking into consideration the user's movements. However, since the situation around the user is not necessarily constant, the user needs to use the head-mounted display while taking into consideration the surrounding environment when using content. To solve this inconvenience, technology has been devised that provides content using a head-mounted display while restricting the user's range of movement to some extent (see, for example, Patent Document 1).

JP 2019-136572 A

However, with the technology in Patent Document 1, the user does not actually move from a given position, so content that allows the user to experience movement in a virtual space can sometimes lack a sense of realism.

The present invention was made in consideration of these circumstances, and one of its objectives is to provide a content control device, a content control method, a program, and a content provision system that can improve the sense of realism of content that allows users to experience things including movement in a virtual space.

The content control device, content control method, program, and content provision system according to the present invention have the following configuration.

(1): A content control device according to one aspect of the present invention is a control device for a content provision system that includes a vehicle equipped with omnidirectional wheels and a video projection device, and includes a content playback unit that plays content that allows a user to have an experience that includes movement in a virtual space and outputs a video signal obtained by playing the content to the video projection device, and a movement control unit that controls the omnidirectional wheels of the vehicle in synchronization with the video displayed on the video projection device.

(2): In the aspect of (1) above, the movement control unit controls the omnidirectional wheels so that the vehicle travels along a specified circular route in synchronization with the user's straight-line movement in the virtual space while the content is being played back.

(3): In the above aspect (2), the movement control unit controls the omnidirectional wheels so that the vehicle travels along the circular route at a speed equal to or less than a specified speed.

(4): In any of the above aspects (1) to (3), in the image of the virtual space obtained by playing the content, the virtual space is displayed so that areas that are perceived as closer by the user change more in accordance with the user's movement in the virtual space, and areas that are perceived as farther away by the user change less in accordance with the user's movement in the virtual space.

(5): In any of the above aspects (1) to (4), the movement control unit controls the omnidirectional wheels based on the position of an object displayed in the virtual space corresponding to the movement limit of the vehicle, so that the user does not come into contact with the movement limit.

(6): In any of the above aspects (1) to (5), the device serves as a base on which the vehicle is placed, and further includes a drive platform device that cancels the movement of the vehicle caused by the omnidirectional wheels.

(7): In the above aspect (6), a production control unit is further provided that instructs a generating device, which generates an event that is perceived by at least one of the five human senses as a special effect for producing the content, to generate the event according to the driving state of the drive table device.

(8): In one aspect of the present invention, a content control method is provided in which a computer that functions as a control device for a content provision system that includes a vehicle equipped with omnidirectional wheels and a video projection device plays content that allows a user to have an experience that includes movement in a virtual space, outputs a video signal obtained by playing the content to the video projection device, and controls the omnidirectional wheels of the vehicle in synchronization with the video displayed on the video projection device.

(9): A program according to one aspect of the present invention causes a computer functioning as a control device for a content provision system including a vehicle with omnidirectional wheels and a video projection device to play content that allows a user to have an experience that includes movement in a virtual space, output a video signal obtained by playing the content to the video projection device, and control the omnidirectional wheels of the vehicle in synchronization with the video displayed on the video projection device.

(10): A content provision system according to one aspect of the present invention includes a vehicle equipped with omnidirectional wheels, a video projection device, a content playback unit that plays content that allows a user to have an experience that includes movement in a virtual space and outputs a video signal obtained by playing the content to the video projection device, and a movement control unit that controls the omnidirectional wheels of the vehicle in synchronization with the video displayed on the video projection device.

According to (1) to (10), by playing content that allows a user to experience an experience that includes movement in a virtual space, outputting a video signal obtained by playing the content to a video projection device, and controlling an omnidirectional vehicle in synchronization with the video displayed on the video projection device, it is possible to improve the realism of the content that provides an experience that includes movement in a virtual space.

1 is a diagram illustrating an example of a configuration of a content providing system according to a first embodiment. 1A and 1B are diagrams illustrating an example of the configuration of an omnidirectional wheel according to a first embodiment. FIG. 2 is a diagram illustrating an example of a functional configuration of a content providing system according to a first embodiment. 4 is a diagram illustrating an example of a relationship between the moving direction of an omnidirectional vehicle in the first embodiment and the moving direction of a user perceived from a content video; FIG. 5 is a flowchart showing an example of a process flow in which the content control device of the first embodiment controls the movement of an omnidirectional vehicle in accordance with the playback of content. 5 is a flowchart showing an example of the flow of a synchronization control process in the first embodiment. 10A to 10C are diagrams illustrating an example of a situation in which the moving direction of the omnidirectional vehicle is changed at a second control timing in the first embodiment. FIG. 11 is a diagram illustrating an example of a configuration of a content providing system according to a second embodiment. FIG. 11 is a diagram illustrating an example of a functional configuration of a content providing system according to a second embodiment. 13 is a flowchart showing an example of the flow of a synchronization control process in the second embodiment.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, with reference to the drawings, embodiments of a content control device, a content control method, a program, and a content providing system of the present invention will be described.
First Embodiment
1 is a diagram showing an example of the configuration of a content providing system 1A in the first embodiment. The content providing system 1A is a system that provides content that allows a user to experience a visually recognized virtual movement in synchronization with an actual movement. The content providing system 1A includes, for example, an image projection device 10, an omnidirectional vehicle 20, and a content control device 30. The content control device 30 is capable of communicating with both the image projection device 10 and the omnidirectional vehicle 20.

The video projection device 10 is a display device that can give the user the sensation of being in a virtual space by inputting a video signal (hereinafter referred to as a "VR signal") corresponding to VR (Virtual Reality) and displaying an image corresponding to the parallax in front of the user's eyes. The video projection device 10 inputs a VR signal of the target content from the content control device 30 and displays an image based on the input VR signal, thereby allowing the user to have an experience that includes movement in a virtual space.

For example, the image projection device 10 may be a head-mounted display device known as VR goggles. Note that the image projection device 10 is not limited to being worn on the user's head as long as it is installed in a position that allows a moving user to view VR images. For example, the image projection device 10 may be one in which the display support is fixed to a part other than the user's head (such as the shoulder), or one that is fixed to the omnidirectional vehicle 20. Furthermore, the VR images projected by the image projection device 10 may include AR (Augmented Reality) and MR (Mixed Reality).

The method of realizing the image projection device 10 is not limited to a specific method as long as it allows the user to perceive a similar sensation. For example, the projection method of the image projection device 10 may be a retinal projection method, a virtual image projection method, or other method. Also, for example, the display unit of the image projection device 10 may be of an open type or a shielded type.

The omnidirectional vehicle 20 has the role of moving the user in the content provision system 1A to add a sense of movement obtained by actual movement to the virtual movement visually perceived by the content video. The omnidirectional vehicle 20 receives a control signal synchronized with the content video from the content control device 30, and controls the movement of the vehicle based on the received control signal. Specifically, the omnidirectional vehicle 20 includes, for example, a seat unit 21 and omnidirectional wheels 22. The seat unit 21 constitutes the user's seat. The user sits in the seat unit 21 and operates the omnidirectional vehicle 20.

The omnidirectional wheels 22 are wheels that allow the vehicle to immediately move forward in any direction (all 360 degrees) from its current position without making a preparatory movement such as turning. FIG. 2 is a diagram showing an example of the configuration of the omnidirectional wheels 22. The omnidirectional wheels 22 are, for example, equipped with large-diameter wheels 22A as front wheels and turning wheels 22C as rear wheels, and equipped with a plurality of small-diameter wheels 22B on the ground contact portion (radial edge portion) of the large-diameter wheels 22A of the front wheels. The large-diameter wheels 22A are wheels that mainly realize linear movement in the forward and backward directions. The small-diameter wheels 22B are wheels that mainly realize lateral movement on the spot by rotating around the rotation direction (circumferential direction) of the large-diameter wheels 22A as an axis. On the other hand, the turning wheels 22C of the rear wheels are wheels that have a smaller diameter than the large-diameter wheels 22A and mainly realize turning movement by rotating around a rotation axis perpendicular to the rotation axis of the large-diameter wheels 22A. The omnidirectional wheels 22 are equipped with motors (not shown) that can independently control the rotation of the large diameter wheels 22A, the small diameter wheels 22B, and the turning wheels 22C. With this configuration, the omnidirectional wheels 22 can move in various directions, such as straight sideways or diagonally, as well as in forward and backward directions, by utilizing the difference in lateral movement speed between the front and rear wheels, and can also achieve agile movements such as turning and rotating on the spot.

Here, the forward direction of the omnidirectional vehicle 20 is the positive direction of the y axis in FIG. 1 (the direction from the back of the page to the front of the page, hereafter referred to as the +y axis direction), and the backward direction is the negative direction of the y axis (the direction from the front of the page to the back of the page, hereafter referred to as the -y axis direction). For example, as shown in operation example M1 (forward/reverse) in FIG. 2, the omnidirectional wheel 22 moves forward by rotating the large diameter wheel 22A in the direction of arrow A1, and moves backward by rotating it in the direction of arrow A2.

For example, as shown in the operation example M2 (left-right movement) of FIG. 2, the omnidirectional wheel 22 can move leftward on the spot without changing its direction by rotating the small diameter wheel 22B in the direction of the arrow A3. In this case, the turning wheel 22C may be configured to rotate naturally in the direction of the arrow A4 in response to the left-right movement, or may be controlled to rotate in the direction of the arrow A4 in response to the amount of rotation of the small diameter wheel 22B. The omnidirectional wheel 22 can move rightward on the spot without changing its direction by rotating the small diameter wheel 22B in the opposite direction to the arrow A3. The leftward direction here is the leftward direction in FIG. 1, which corresponds to the negative direction of the x-axis (-x-axis direction), and the rightward direction is the rightward direction in FIG. 1, which corresponds to the positive direction of the x-axis (+x-axis direction). The multiple small diameter wheels 22B may be configured so that all the wheels rotate simultaneously, or only the wheels on the ground may rotate.

For example, as shown in operation example M3 (turning on the spot) in Figure 2, the omnidirectional wheel 22 can turn on the spot in the direction of arrow A6 around the ground contact point P1 of the large diameter wheel 22A by rotating the turning wheel 22C in the direction of arrow A5, and can turn on the spot in the direction opposite to arrow A6 by rotating it in the opposite direction to arrow A5.

For example, as shown in operation example M4 (turning) in FIG. 2, the omnidirectional wheel 22 can move forward while turning in the direction of arrow A9 by rotating the large diameter wheel 22A in the direction of arrow A7 and the turning wheel 22C in the direction of arrow A8 (turning). The omnidirectional wheel 22 can move backward while turning in the direction opposite to arrow A9 by rotating the large diameter wheel 22A in the direction opposite to arrow A7 and rotating the turning wheel 22C in the direction of arrow A8. In this example, the omnidirectional wheel 22 can move forward or backward with the turning center on the right side by rotating the turning wheel 22C in the direction opposite to arrow A8.

The method of realizing the omnidirectional wheels 22 is not limited to the method shown in FIG. 2. The omnidirectional wheels 22 may be realized by any existing technology. The omnidirectional vehicle 20 may be equipped with one omnidirectional wheel 22 or multiple omnidirectional wheels 22. Furthermore, the omnidirectional vehicle 20 may be equipped with normal wheels as auxiliary wheels in addition to the omnidirectional wheels 22. The operation of the omnidirectional wheels 22 is controlled by a control unit (not shown) (for example, installed inside the seat unit 21) mounted on the omnidirectional vehicle 20, and the control unit changes the operation (movement direction and speed) of the omnidirectional wheels 22 based on a control signal input from the content control device 30.

The content control device 30 has a function of playing back content and outputting a VR signal of the content being played back to the image projection device 10. The content control device 30 also has a function of outputting a control signal according to the playback status of the content to the omnidirectional vehicle 20. By having the content control device 30 have each of these functions, the content provision system 1A can move the user in synchronization with the virtual movement visually perceived by the content image.

Figure 3 is a diagram showing an example of the functional configuration of the content providing system 1A in the first embodiment. The image projection device 10, the omnidirectional vehicle 20, and the content control device 30 are connected to, for example, a wireless LAN (Local Area Network) and can communicate with each other via the wireless LAN. For convenience in using content, this embodiment assumes that communication between the devices is realized by wireless communication, but this is not essential and communication between the devices may be realized by wired communication. In addition, the image projection device 10, the omnidirectional vehicle 20, and the content control device 30 may be configured to communicate by short-range wireless communication instead of wireless LAN.

Also, if there is no problem with responsiveness, the image projection device 10, the omnidirectional vehicle 20, and the content control device 30 may be configured to communicate via a WAN (Wide Area Network) such as a cellular network, a dedicated line, or the Internet.Also, if there is no problem with responsiveness, the image projection device 10, the omnidirectional vehicle 20, and the content control device 30 may be configured to communicate via a WAN (Wide Area Network) such as a cellular network, a dedicated line, or the Internet.

First, the configuration of the video projection device 10 will be described. The video projection device 10 includes, for example, a communication unit 11, a display unit 12, and a display control unit 13. These components are realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by collaboration between software and hardware. The program may be stored in advance in a storage device such as an HDD (Hard Disk Drive) or a flash memory (a storage device having a non-transient storage medium), or may be stored in a removable storage medium such as a DVD or a CD-ROM (a non-transient storage medium), and may be installed by mounting the storage medium in a drive device.

The communication unit 11 is, for example, a wireless LAN interface that connects to a LAN. The communication unit 11 receives a VR signal from the content control device 30 via the LAN and outputs the received VR signal to the display control unit 13. The communication unit 11 may be replaced with another communication interface depending on the communication method adopted between the video projection device 10, the omnidirectional vehicle 20, and the content control device 30.

The display unit 12 is configured by combining a light source (a small projector), a lens, a half mirror, etc., and is configured so that an image output from the light source is focused on the retina of a user wearing the image projection device 10 via the lens, half mirror, etc. The display unit 12 outputs an image based on a VR signal supplied from the content control device 30 from the light source.

The display control unit 13 controls the display operation of the video projection device 10. Specifically, the display control unit 13 receives a VR signal of the content being played from the content control device 30 via the communication unit 11, and outputs the received VR signal to the display unit 12. In the display unit 12, an image based on the VR signal output from the display control unit 13 is output from a light source. As a result, the image of the content being played is focused on the user's retina.

Next, the configuration of the omnidirectional vehicle 20 will be described. The omnidirectional vehicle 20 includes, for example, omnidirectional wheels 22, a communication unit 23, and a wheel control unit 24. These components are realized by, for example, a hardware processor such as a CPU executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI, ASIC, FPGA, or GPU, or may be realized by a combination of software and hardware. The program may be stored in advance in a storage device such as an HDD or flash memory (a storage device with a non-transient storage medium), or may be stored in a removable storage medium such as a DVD or CD-ROM (a non-transient storage medium), and installed by inserting the storage medium into a drive device.

As described above, the omnidirectional wheels 22 are wheels that can instantly change their direction of movement to any direction, and have a drive mechanism that changes the direction of movement of the wheels, and a drive mechanism that changes the rotational speed and direction of the wheels. Each of these drive mechanisms can be controlled by an electrical signal, and is controlled based on a control signal input from the wheel control unit 24.

The communication unit 23 is, for example, a wireless LAN interface. The communication unit 23 receives a control signal from the content control device 30 and outputs the received control signal to the wheel control unit 24. The communication unit 23 may be replaced with another communication interface depending on the communication method adopted between the image projection device 10, the omnidirectional vehicle 20, and the content control device 30.

The wheel control unit 24 controls the movement of the omnidirectional vehicle 20. Specifically, the wheel control unit 24 controls the operation of the omnidirectional wheels 22 based on a control signal supplied from the content control device 30 according to the playback status of the content. For example, in a situation where a scene in which a user moves forward in a virtual space is being played in a content video, the wheel control unit 24 inputs a control signal from the content control device 30 to move the omnidirectional vehicle 20 forward in accordance with the user's forward movement, and outputs the input control signal to the omnidirectional wheels 22, thereby moving the omnidirectional vehicle 20 forward.

Next, the configuration of the content control device 30 will be described. The content control device 30 includes, for example, a communication unit 31, a storage unit 32, and a content control unit 33A. These components are realized by, for example, a hardware processor such as a CPU executing a program (software). Some or all of these components may be realized by hardware (including circuitry) such as an LSI, ASIC, FPGA, or GPU, or may be realized by a combination of software and hardware. The program may be stored in advance in a storage device such as an HDD or flash memory (a storage device with a non-transient storage medium), or may be stored in a removable storage medium such as a DVD or CD-ROM (a non-transient storage medium), and installed by inserting the storage medium into a drive device.

The communication unit 31 is, for example, a wireless LAN interface that connects to a LAN. The communication unit 31 transmits a VR signal to the image projection device 10 via the LAN, and transmits a control signal to the omnidirectional vehicle 20. The communication unit 31 may be replaced with another communication interface depending on the communication method adopted between the image projection device 10, the omnidirectional vehicle 20, and the content control device 30.

The storage unit 32 is realized by, for example, a HDD, a flash memory, an EEPROM, a ROM, or a RAM. For example, the storage unit 32 stores content data D1 and content control data D2. In addition, the storage unit 32 may store any information necessary for the operation of the content control device 30, such as programs read and executed by the processor, setting information, intermediate data, and various input/output data.

The content data D1 is data for generating the content to be provided to the user. In this embodiment, the content data D1 includes video data that allows the user to visually perceive virtual movement in a virtual space, and is configured to display the content video by performing a playback process. The content control data D2 is data that defines a control signal for the content to be provided to the user according to the playback status.

The content control unit 33A has a function of playing back the specified content and displaying it on the video projection device 10, and also has a function of controlling the movement of the omnidirectional vehicle 20 according to the content playback status. For example, the content control unit 33A includes a content playback unit 331 and a movement control unit 332.

The content playback unit 331 acquires the content data D1 of the specified content from the storage unit 32 and executes a playback process to acquire a video signal of the content, and converts the acquired video signal into a VR signal and transmits it to the video projection device 10. Note that if the content data D1 supports VR display, that is, if the video data included in the content data D1 is configured to directly output a VR signal through a playback process, the content playback unit 331 may omit the process of converting the video signal into a VR signal.

The movement control unit 332 acquires content control data D2 corresponding to the content being played from the storage unit 32, generates a control signal according to the playback status of the content based on the acquired content control data D2, and transmits the generated control signal to the omnidirectional vehicle 20. For example, the content control data D2 defines at least a control timing corresponding to the display timing of a scene in which the user moves in the content video, and the movement control unit 332 generates a control signal that moves the omnidirectional vehicle 20 in accordance with the control timing indicated by the content control data D2 while synchronizing with the content video being played.

Note that content playback may be affected by the load on the content control device 30 during playback, and so the playback position of the content being played does not necessarily match the time elapsed since the start of content playback. For this reason, for example, the movement control unit 332 periodically acquires information indicating the playback position of the content being played from the content playback unit 331 (hereinafter referred to as "playback position information") and monitors the playback position to generate a control signal in synchronization with the content video. For example, the playback position information may be represented by a specific frame in the content video or a count number of a clock signal. This enables the content control device 30 to precisely synchronize the content video with the operation of the omnidirectional vehicle 20, reducing the sense of incongruity caused by a discrepancy between movement in virtual space and actual movement, and providing content with a higher sense of realism.

The content control data D2 may define a movement mode, such as a movement speed, a movement amount, and a movement direction, in association with the control timing. In this case, the movement control unit 332 may be configured to generate a control signal for moving the omnidirectional vehicle 20 in a movement mode defined for the control timing indicated by the content control data D2.

Figure 4 is a diagram illustrating the relationship between the moving direction of omnidirectional vehicle 20 and the moving direction of the user as perceived by the content video. In Figure 4, the video of virtual space VS1 shows a situation in which a scene is being played in the content video in which the user is moving along road R1 from the front side of the page to the back side of the page (in the direction of the arrow in the figure). In this situation, the movement control unit 332 synchronizes with the video of virtual space VS1 and generates a control signal in real space RS1 to cause the omnidirectional vehicle 20 to travel along circuit route RT1 at a speed equal to or less than a specified speed.

The specified speed here is the upper limit of the speed at which the user can be made to perceive (or be fooled into thinking) that the circular movement is moving in a straight line. This takes advantage of the fact that the faster the movement speed is in a circular movement, the greater the centrifugal force, making it easier for the user to perceive the current movement as circular movement through senses other than sight, while the slower the movement speed is, the smaller the centrifugal force, making it easier for the user to be fooled into thinking the current movement is moving in a straight line.

In addition, in circular movement, the larger the diameter of the circular route, the greater the centrifugal force, making it easier for the user to perceive the current movement as circular movement through senses other than sight, while the smaller the diameter of the circular route, the smaller the centrifugal force, making it easier for the user to mistake the current movement for straight-line movement. Therefore, the movement control unit 332 may be configured to generate a control signal that, in addition to satisfying the movement speed condition, causes travel along a circular route with as large a diameter as possible within an allowable range.

In this way, by the movement control unit 332 controlling the movement of the omnidirectional vehicle 20 in synchronization with the content video, it is possible to provide content in which movement in virtual space and actual movement are synchronized, making it possible to provide content with a higher sense of realism. Furthermore, by the movement control unit 332 controlling the omnidirectional vehicle 20 to travel along a circular route at a speed equal to or less than a specified speed, it is possible to limit the range of real space required to use the content to the range of the circular route while preventing the user from feeling uncomfortable. This allows the user to use content with a higher sense of realism in a limited range of space. Therefore, according to the content providing system 1A of this embodiment, it is possible to improve the realism of content that allows the user to experience an experience that includes movement in a virtual space.

To further enhance the realism of the content, the magnitude of the image change in the content video may be varied depending on the area within the image. Specifically, a visual effect may be imparted to the content video such that, in response to the user's movement in the virtual space, the image change is made greater in areas that are perceived as closer by the user and the image change is made smaller in areas that are perceived as farther away by the user. The content playback unit 331 may play content to which such visual effects have been imparted in advance, or may be configured to impart such visual effects to a video signal obtained by playing the content.

Figure 5 is a flowchart showing an example of a process flow in which the content control device 30 of this embodiment controls the movement of the omnidirectional vehicle 20 in accordance with the playback of content. First, in the content control device 30, when the content playback conditions are satisfied, the content playback unit 331 plays the specified content (step S101). Specifically, the content playback unit 331 acquires content data D1 of the specified content from the storage unit 32, and executes a playback process on the acquired content data D1. When the content playback unit 331 starts playing the content, it converts the time-series video signal acquired by the playback process into a VR signal, and outputs the converted time-series VR signal to the video projection device 10 in time series (step S102).

Then, the movement control unit 332 executes a synchronization control process (step S103). The synchronization control process is a process that controls the movement of the omnidirectional vehicle 20 in synchronization with the content video, and is a process that is repeatedly executed at a predetermined cycle during the playback of the content. After executing one cycle of the synchronization control process (step S103), the movement control unit 332 determines whether the playback of the content has ended (step S104). If it is determined that the playback of the content has not ended, the movement control unit 332 returns to the process at step S103 and repeatedly executes the synchronization control process.

On the other hand, if it is determined in step S104 that the playback of the content has ended, the movement control unit 332 stops the movement of the omnidirectional vehicle 20 (step S105) and terminates the output of the VR signal to the video projection device 10 (step S106).

Figure 6 is a flowchart showing an example of the flow of the synchronization control process in this embodiment. First, the movement control unit 332 determines whether or not a first control timing has arrived for the movement control of the omnidirectional vehicle 20 in the content video being played back (step S201). Specifically, the movement control unit 332 refers to the content control data D2 stored in the storage unit 32 and determines whether or not the current playback time of the content video (here, this means the elapsed time from the beginning of the video) is defined as the first control timing. In this case, the movement control unit 332 can determine that the first control timing has arrived if the current playback time is defined as the first control timing, and can determine that the first control timing has not arrived if the current playback time is not defined as the first control timing.

If it is determined that the first control timing has arrived, the movement control unit 332 generates a control signal to control the omnidirectional vehicle 20 to travel along the circular route at a speed equal to or less than the specified speed, and outputs the control signal to the omnidirectional vehicle 20 (step S202). On the other hand, if it is determined in step S201 that the first control timing has not arrived, the movement control unit 332 skips step S202 and proceeds to step S203.

Then, the movement control unit 332 determines whether or not a second control timing has arrived for the movement control of the omnidirectional vehicle 20 in the content image being played back (step S203). Here, like the first control timing, the second control timing is also defined in the content control data D2, and the arrival or absence of the second control timing can be determined based on the content control data D2. Here, the second control timing is the timing at which a scene is played back in which the user reaches a virtual object (e.g., a wall, cliff, fence, etc.) that is set up in response to the movement limit in real space and changes the direction of movement.

Here, if it is determined that the second control timing has arrived, the movement control unit 332 generates a control signal to change the movement direction so as not to exceed the movement limit in real space, and outputs it to the omnidirectional vehicle 20 (step S204). For example, FIG. 7 is a diagram showing an example of a situation in which the movement direction of the omnidirectional vehicle 20 is changed at the second control timing. In FIG. 7, the image of the virtual space VS2 represents a situation in which a scene is being played in which the user is moving on road R2 from the front side of the paper to the back side of the paper in the content image. In addition, a wall WL1 located midway on road R2 is a virtual object displayed in correspondence with a wall WL2 (movement limit) that limits the user's movement range in real space RS2.

For example, the display of such virtual objects can be achieved by running omnidirectional vehicle 20 in a specified driving scenario (route and speed) in sync with the playback of content configured to display virtual objects at a specified timing. Applying this to the example of Figure 7, this method can be said to involve playing content that shows a video in which wall WL1 is reached five minutes after playback begins, while running omnidirectional vehicle 20 in a driving scenario in which wall WL2 is reached five minutes after playback begins. In other words, in this case, the content and the driving scenario are configured in advance to be synchronized.

As another method, when the content is not simply played back by playing a video, but is realized by reproducing a virtual space by simulation, the content playback unit 331 may place a virtual object in the virtual space according to the movement status of the omnidirectional vehicle 20. In this case, the content playback unit 331 needs to continuously grasp the positional relationship between the omnidirectional vehicle 20 and the movement limit. Therefore, in this case, the omnidirectional vehicle 20 may have a function of acquiring position information of the vehicle itself, and may be configured to periodically acquire and provide the position information to the content control device 30.

Regardless of the implementation method, when the movement limit in real space and the virtual object in virtual space are displayed in sync, the movement control unit 332 generates a control signal that is synchronized with the image in the virtual space VS2 and changes the movement direction of the omnidirectional vehicle 20 in real space RS2 so as not to exceed the movement limit, i.e., so as not to come into contact with WL2, which is the movement limit. Here, for example, in the example of FIG. 7, the content being played is pre-configured to display a scene in which the vehicle turns left toward road R3 just before wall WL1, and the movement control unit 332 changes the movement direction of the omnidirectional vehicle 20 in accordance with the playback timing of this scene.

In this way, an object corresponding to the movement limit in the real space is also displayed in the virtual space, and the movement direction of the omnidirectional vehicle 20 is changed in accordance with the playback timing of the scene in the virtual space to avoid that object, allowing the user to have an experience that includes movement in the virtual space with a greater sense of realism.

According to the content providing system 1A of the first embodiment configured as described above, content is played back that allows the user to experience an experience that includes movement in a virtual space, a video signal obtained by playing back the content is displayed on the video projection device 10, and the omnidirectional vehicle 20 is controlled in synchronization with the video displayed on the video projection device 10, thereby making it possible to improve the realism of the content that provides an experience that includes movement in a virtual space.

Second Embodiment
Fig. 8 is a diagram showing a configuration example of a content providing system 1B in the second embodiment. The content providing system 1B is different from the content providing system 1A in the first embodiment in that the content providing system 1B further includes a drive stand device 40 that drives the omnidirectional wheels 22 to cancel the drive so that the omnidirectional vehicle 20 does not move, and further includes a special effect generating device 50 that generates various special effects to improve the realism of the experience including movement in a virtual space. The other configurations of the content providing system 1B are the same as those of the content providing system 1A. Therefore, in Fig. 8, the same reference numerals as those in Fig. 1 are used for the configurations similar to those in the first embodiment, and the description thereof will be omitted here.

The driving platform device 40 is a device used as a base on which the omnidirectional vehicle 20 is placed. The driving platform device 40 is equipped with a driving unit 42 that comes into contact with the omnidirectional wheels 22 of the omnidirectional vehicle 20 and drives the omnidirectional wheels 22 to counteract the drive of the omnidirectional wheels 22. For example, the driving unit 42 may be composed of one or more spheres or caterpillars that rotate due to the drive of the omnidirectional wheels 22, or may be composed of a planar member with a small coefficient of friction. The driving unit 42 may detect the drive of the omnidirectional wheels 22 using a sensor and drive to counteract it, or it may not have an electrical mechanism and drive relatively with small resistance to the drive of the omnidirectional wheels 22.

The special effects generating device 50 is a device that generates special effects such as wind, mist, smell, sound, and vibration. The special effects generating device 50 generates special effects in synchronization with the content video under the control of the content control device 30. For example, when a scene in which wind blows in a virtual space is played in the content video, the special effects generating device 50 inputs a control signal for outputting wind from the content control device 30 at the playback timing. This allows the special effects generating device 50 to generate actual wind in real space in synchronization with the scene in which wind blows in the virtual space.

Figure 9 is a diagram showing an example of the functional configuration of content providing system 1B in the second embodiment. As described above, content providing system 1B differs from content providing system 1A in the first embodiment in that it further includes a drive stand device 40 and a special effect generating device 50. Also, in content providing system 1B, content control device 30 differs from content providing system 1A in the first embodiment in that it includes a content control unit 33B instead of content control unit 33A. Also, content control unit 33B differs from content control unit 33A in the first embodiment in that it further includes a performance control unit 333. The other configuration of content providing system 1B is the same as that of content providing system 1A. Therefore, in Figure 9, the same reference numerals as in Figure 3 are used for the configuration similar to that of the first embodiment, and description thereof will be omitted here.

First, the configuration of the drive table device 40 will be described. The drive table device 40 includes a communication unit 41, a drive unit 42, and a drive sensor 43. The communication unit 41 is, for example, a wireless LAN interface that connects to a LAN. The communication unit 41 communicates with the content control device 30 via the LAN. The communication unit 41 may be replaced with another communication interface depending on the communication method adopted between the drive table device 40 and the content control device 30.

As explained in FIG. 8, the drive unit 42 is a drive mechanism that comes into contact with the omnidirectional wheels 22 of the omnidirectional vehicle 20 and drives the wheels to counteract the drive of the omnidirectional wheels 22. The drive state of the drive unit 42 is detected by the drive sensor 43 and notified to the content control device 30.

The drive sensor 43 is a sensor that detects the drive state of the drive unit 42. The drive sensor 43 may be anything that can at least detect whether the drive unit 42 is in drive or not. For example, the drive sensor 43 may be a rotation sensor that detects the rotation of a rotating part that rotates due to the operation of the drive unit 42, or a sensor that detects the displacement of the drive unit 42. The drive sensor 43 transmits information indicating the detection result (hereinafter referred to as "detection information") to the content control device 30.

Next, the configuration of the special effects generating device 50 will be described. The special effects generating device 50 is a device that generates an event that is perceived by at least one of the five human senses as a special effect that produces the content. The special effects generating device 50 includes, for example, a communication unit 51, a special effects generating unit 52, and a special effects control unit 53. The communication unit 41 is, for example, a wireless LAN interface that connects to a LAN. The communication unit 51 communicates with the content control device 30 via the LAN. The communication unit 51 may be replaced with another communication interface depending on the communication method adopted between the special effects generating device 50 and the content control device 30.

As described above, the special effects generating unit 52 is a device such as a blower, sprayer, fragrance device, speaker, or vibrator that generates special effects such as wind, mist, smell, sound, or vibration. The special effects generating device 50 may include multiple special effects generating units 52 that each generate different special effects, or may include a single special effects generating unit 52. Furthermore, the content providing system 1B may be configured to generate the special effects required for the presentation of the content using a single special effects generating device 50, or may be configured to generate the special effects using multiple special effects generating devices 50. The special effects generating unit 52 can control the presence or absence of special effects output and the intensity of the output using electrical signals, and is controlled based on control signals input from the special effects control unit 53.

The special effects control unit 53 controls the output operation of the special effects by the special effects generation unit 52. Specifically, the special effects control unit 53 controls the operation of the special effects generation unit 52 based on a control signal corresponding to the driving state of the drive base unit 40, which is supplied from the content control device 30. For example, when the drive base unit 40 is being driven, i.e., when the omnidirectional wheels 22 are rotating, the special effects control unit 53 inputs a control signal from the content control device 30 that generates vibrations to provide the user with a more realistic sense of movement, and outputs the input control signal to the special effects generation unit 52, causing the special effects generation unit 52 to generate vibrations, which are then transmitted to the omnidirectional vehicle 20. This allows the user to experience a more realistic sense of movement when moving in a virtual space.

Next, the performance control unit 333 of the content control device 30 will be described. The performance control unit 333 instructs the special effects generating device 50 to generate special effects according to the driving state of the drive table device 40. The performance control unit 333 generates a control signal according to the driving state of the drive table device 40 and outputs it to the special effects generating device 50. For example, in the above vibration example, the performance control unit 333 may generate a control signal that generates a small vibration when the omnidirectional vehicle 20 is moving at a low speed, and generate a control signal that generates a large vibration when the omnidirectional vehicle 20 is moving at a high speed. By the performance control unit 333 outputting such a control signal, the special effects generating device 50 can perform a movement performance for the user according to the driving state of the omnidirectional vehicle 20 in synchronization with the driving state of the omnidirectional vehicle 20.

Figure 10 is a flowchart showing an example of the flow of the synchronization control process in the second embodiment. Here, the synchronization control process in the second embodiment differs from the synchronization control process in the first embodiment in that it further includes steps S301 and S302. Therefore, in Figure 10, the same processes as in the first embodiment are given the same reference numerals as in Figure 6, and the description here is omitted.

For example, after the movement control unit 332 outputs a control signal to the omnidirectional vehicle 20 in step S204, the performance control unit 333 determines whether or not the conditions for generating a special effect are met (step S301). The condition for generating a special effect here is, for example, that the omnidirectional vehicle 20 is in motion. Since the drive of the omnidirectional wheels 22 is canceled by the drive platform device 40, the omnidirectional vehicle 20 does not actually move from above the drive platform device 40. In this case, the performance control unit 333 can determine whether or not the omnidirectional vehicle 20 is in motion based on the detection information received from the drive platform device 40.

If it is determined that the conditions for generating the special effect are met, the performance control unit 333 instructs the special effect generating device 50 to output a special effect according to the driving state of the omnidirectional vehicle 20 (step S302). On the other hand, if it is determined in step S301 that the conditions for generating the special effect are not met, the performance control unit 333 skips step S302 and ends the synchronization control process.

According to the content providing system 1B of the second embodiment configured as described above, content is played back that allows the user to experience an experience that includes movement in a virtual space, a video signal obtained by playing back the content is displayed on the video projection device 10, and the omnidirectional vehicle 20 is controlled in synchronization with the video displayed on the video projection device 10, thereby making it possible to improve the realism of the content that provides an experience that includes movement in a virtual space.

Furthermore, according to the content providing system 1B of the second embodiment, the driving of the omnidirectional vehicle 20, which is controlled in synchronization with the content video, is cancelled by the driving platform device 40, so that the omnidirectional vehicle 20 performs the same operation as when moving, but does not move from above the driving platform device 40. Therefore, content that allows the user to experience experiences that include movement in a virtual space can be provided with a higher sense of realism and in a smaller space.

Furthermore, according to the content providing system 1B of the second embodiment, the special effects generating device 50 generates special effects according to the driving state of the omnidirectional vehicle 20, which is controlled in synchronization with the content video, thereby enabling the content to be produced using physical phenomena in real space. As a result, content that allows the user to experience an experience that includes movement in a virtual space can be provided to the user with a higher sense of realism.

The above-described embodiment can be expressed as follows.
A storage device storing a program;
a hardware processor;
The hardware processor executes the program stored in the storage device,
A computer that functions as a control device of a content providing system including a vehicle having omnidirectional wheels and a video projection device,
Playing content that allows users to experience an experience that includes movement in a virtual space;
A video signal obtained by playing the content is output to the video projection device;
controlling the omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device;
The content control device is configured to:

In each of the above embodiments, some or all of the functional units of the content control device 30 may be distributed and disposed in one or more of the image projection device 10, the omnidirectional vehicle 20, the drive platform device 40, and the special effects generation device 50.

The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made without departing from the spirit of the present invention.

1A, 1B...content providing system, 10...image projection device, 11...communication unit, 12...display unit, 13...display control unit, 20...omnidirectional vehicle, 21...seat unit, 22...omnidirectional wheels, 22A...large diameter wheels, 22B...small diameter wheels, 22C...turning wheels, 23...communication unit, 24...wheel control unit, 30...content control device, 31...communication unit, 32...storage unit, 33A, 33B...content control unit, 331...content playback unit, 332...movement control unit, 333...performance control unit, 34...axis, 40...drive platform device, 41...communication unit, 42...drive unit, 43...drive sensor, 50...special effects generating device, 51...communication unit, 52...special effects generating unit, 53...special effects control unit

Claims (12)

A control device for a content providing system including a vehicle equipped with omnidirectional wheels and a video projection device,
a content playback unit that plays content that allows a user to have an experience including movement in a virtual space, and outputs a video signal obtained by playing the content to the video projection device;
a movement control unit that controls omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device;
Equipped with
the movement control unit controls the omnidirectional wheels so that the vehicle travels along a specified circular route in synchronization with the straight-line movement of the user in the virtual space during the reproduction of the content.
Content control device. the movement control unit controls the omnidirectional wheels so that the vehicle travels along the circular route at a speed equal to or less than a specified speed.
The content control device according to claim 1 . A control device for a content providing system including a vehicle equipped with omnidirectional wheels and a video projection device,
a content playback unit that plays content that allows a user to have an experience including movement in a virtual space, and outputs a video signal obtained by playing the content to the video projection device;
a movement control unit that controls omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device;
a drive platform device that acts as a platform on which the vehicle is placed and counteracts the movement of the vehicle caused by the omnidirectional wheels;
A content control device comprising: A production control unit is further provided that instructs a generating device that generates an event perceived by at least one of the five human senses as a special effect for producing the content to generate the event according to a driving state of the driving table device.
The content control device according to claim 3 . In the image of the virtual space obtained by playing the content, the virtual space is displayed so that an area that is recognized as being closer by the user changes more significantly in accordance with the user's movement in the virtual space, and an area that is recognized as being farther away by the user changes less significantly in accordance with the user's movement in the virtual space.
The content control device according to claim 1 . the movement control unit controls the omnidirectional wheels based on a position of an object displayed in the virtual space corresponding to the movement limit of the vehicle so that the user does not come into contact with the movement limit.
The content control device according to claim 1 . A computer that functions as a control device of a content providing system including a vehicle having omnidirectional wheels and a video projection device,
a content reproduction process for reproducing content that allows a user to have an experience including movement in a virtual space, and outputting a video signal obtained by reproducing the content to the video projection device;
a movement control process for controlling omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device;
A content control method for performing
the movement control process controls the omnidirectional wheels so that the vehicle travels along a specified circular route in synchronization with the user's straight-line movement in the virtual space during playback of the content;
Content control methods. a computer that functions as a control device for a content providing system including a vehicle equipped with omnidirectional wheels, a video projection device, and a drive platform device that serves as a base for the vehicle and cancels the movement of the vehicle caused by the omnidirectional wheels,
a content reproduction process for reproducing content that allows a user to have an experience including movement in a virtual space, and outputting a video signal obtained by reproducing the content to the video projection device;
a movement control process for controlling omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device;
A content control method that performs A computer that functions as a control device of a content providing system including a vehicle equipped with omnidirectional wheels and an image projection device,
a content reproduction process for reproducing content that allows a user to have an experience including movement in a virtual space , and outputting a video signal obtained by reproducing the content to the video projection device;
a movement control process for controlling omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device;
A program for executing
the movement control process controls the omnidirectional wheels so that the vehicle travels along a specified circular route in synchronization with the user's straight-line movement in the virtual space during playback of the content;
program. A computer that functions as a control device of a content providing system including a vehicle equipped with omnidirectional wheels, a video projection device, and a drive platform device that serves as a base for the vehicle and cancels the movement of the vehicle caused by the omnidirectional wheels,
a content reproduction process for reproducing content that allows a user to have an experience including movement in a virtual space, and outputting a video signal obtained by reproducing the content to the video projection device;
a movement control process for controlling omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device;
A program for executing. A vehicle equipped with omnidirectional wheels;
A video projection device;
a content playback unit that plays content that allows a user to have an experience including movement in a virtual space, and outputs a video signal obtained by playing the content to the video projection device;
a movement control unit that controls omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device;
Equipped with
the movement control unit controls the omnidirectional wheels so that the vehicle travels along a specified circular route in synchronization with the straight-line movement of the user in the virtual space during the reproduction of the content.
Content delivery system. A vehicle equipped with omnidirectional wheels;
A video projection device;
a drive platform device that acts as a platform on which the vehicle is placed and counteracts the movement of the vehicle caused by the omnidirectional wheels;
a content playback unit that plays content that allows a user to have an experience including movement in a virtual space, and outputs a video signal obtained by playing the content to the video projection device;
a movement control unit that controls omnidirectional wheels of the vehicle in synchronization with the image displayed on the image projection device;
A content providing system comprising:

Images