JP7240355B2 - Information processing program and information processing method - Google Patents

Description

The present invention relates to an information processing program and an information processing method.

2. Description of the Related Art Conventionally, there has been known a system for distributing moving images including character moving images based on user movements (see, for example, Patent Document 1). In this system, the motion picture processing device acquires the detection results of the face and body movements of the first voice actor, and acquires the detection results of the face and body movements of the second voice actor. Further, based on the obtained detection result, the moving image processing device performs rendering based on the three-dimensional information of the first character and the three-dimensional information of the second character to generate a moving image of the first character and a moving image of the second character. Synthesize the video of

JP 2015-184689 A

In order to increase interest in this type of moving image distribution, real-time communication between the distributing user who distributes the moving image and the viewing user is important. However, the broadcasting user may not notice the message from the viewing user. If there is a marked lack of communication during video distribution, there is a risk that the video will become less interesting.

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and an object of the present invention is to activate communication between a distribution user and a viewing user.

An information processing program for solving the above problems includes a distribution information generation step for generating distribution information for distributing a video by a distribution user to one or more computers, and an information processing device used by a viewing user who watches a video. and a transmitting step of transmitting a driving signal for driving an output device that gives a tactile sensation to the distribution user based on the specific information.

An information processing method for solving the above problems includes a distribution information generation step in which one or more computers generate distribution information for distribution users to distribute moving images, and an information processing device used by viewing users who watch moving images. and a transmission step of transmitting a driving signal for driving an output device that gives a tactile sensation to the distribution user based on the specific information.

An information processing apparatus that solves the above problems includes: a first transmitting unit that transmits distribution information for distributing a moving image to an information processing apparatus used by a viewing user who views the moving image; and the information processing apparatus of the viewing user. A specific information receiving unit that receives specific information from the specified information, an aggregating unit that aggregates the specific information according to the specific information, and information about the aggregated specific information or the aggregated result used by the distribution user who distributes the video and a second transmitter for transmitting to the processing device.

An information processing method for solving the above problems includes a first transmission step in which one or more computers transmit distribution information for distributing a moving image to an information processing device used by a viewing user who views the moving image; a receiving step of receiving specific information from the information processing device of the viewing user; an aggregating step of aggregating the specific information according to the specific information; and a second transmission step of transmitting to the information processing device used by the distribution user.

An information processing program for solving the above problems includes a video display step of receiving distribution information for distributing a video to one or more computers and displaying the video on a display viewed by a viewing user; A specific information generating step of generating specific information based on a user's operation and a specific information transmitting step of transmitting the specific information are executed.

An information processing method for solving the above problems includes a moving image display step of receiving distribution information for distributing a moving image and displaying the moving image on a display viewed by a viewing user; A specific information generating step of generating information and a specific information transmitting step of transmitting the specific information are executed.

ADVANTAGE OF THE INVENTION According to this invention, communication between a distribution user and a viewing user can be activated.

1 is a schematic diagram showing a first embodiment of a moving image data processing system; FIG. FIG. 4 is a schematic diagram showing a state in which a viewing user supports a distribution user in the same embodiment; FIG. 4 is a sequence chart showing the procedure of video distribution in the same embodiment; FIG. The figure which shows an example of the delivery screen in the same embodiment. The figure which shows an example of the game viewing screen in the same embodiment. The figure which shows an example of the game delivery screen in the same embodiment. The figure which shows an example of the game viewing screen in the same embodiment. The figure explaining the positional information in 2nd Embodiment of a moving image data processing system. FIG. 4 is a schematic diagram of drive waveforms of an actuator, in which (a) shows the drive waveform of the actuator acting on the right action site and (b) shows the drive waveform of the actuator acting on the left action site; Schematic diagram of a drive waveform of an actuator. The sequence chart which shows the procedure of moving image delivery in a modification. The schematic diagram of the moving image data processing system in a modification.

(First embodiment)
A first embodiment of the video distribution system will be described below.
As shown in FIG. 1 , the moving image distribution system 11 includes a user device 12 and a server 13 . A moving image application program for viewing and distributing moving images is installed in the user device 12 . By executing the video application program, the user device 12 transmits and receives data to and from other user devices 12 via the server 13 and the network 14, and distributes and displays videos. Hereinafter, a user who distributes a video is referred to as a "distribution user", a user who views a video distributed by the distribution user is referred to as a "viewing user", and simply referred to as a "user" when not distinguishing between them.

The user device 12 is a smart phone (multifunctional phone terminal), a tablet terminal, a personal computer, a console game machine, a wearable computer such as a head-mounted display, and an information processing device other than these devices capable of reproducing moving images.

The user device 12 includes a computer processor 20 , memory 21 , storage 22 (storage medium), and communication interface (I/F) 23 . The computer processor 20 is an arithmetic device that loads an operating system and other programs into the memory 21 from the storage 22 or other storage and executes instructions retrieved from the memory 21 . The computer processor 20 is one or more arithmetic circuits such as a CPU (Central Processing Unit), GPU (Graphic Processing Unit), NPU (Neural network Processing Unit). Communication I/F 23 transmits and receives data to and from server 13 and other user devices 12 via network 14 . The network 14 includes various networks such as a local area network and the Internet. Also, the communication I/F 23 performs short-range wireless communication or wired communication with other external devices. Communication I/F 23 is implemented as hardware, software, or a combination thereof.

The memory 21 is a main storage device (recording medium) directly readable and writable by the computer processor 20, and is composed of a semiconductor memory or the like. The storage 22 is an auxiliary storage device (recording medium), such as a magnetic disk, an optical disk, or a semiconductor memory. The storage 22 can also be used by combining multiple storages. The storage 22 stores a video application program 220, avatar data 221 for drawing an avatar object, and object data 222. FIG.

The moving image application program 220 is updated by update data appropriately obtained from the server 13 . By executing the video application program 220 in accordance with the user's instruction, switching is made between a distribution mode in which the user distributes videos and a viewing mode in which videos distributed by other distribution users are viewed. On the screen displayed by executing the video application program 220, a button for switching between the distribution mode and the viewing mode is displayed on the screen.

Avatar data 221 is three-dimensional model data for drawing an avatar object. The user device 12 acquires the avatar data 221 from the server 13 at a predetermined timing, such as when the video application program 220 is activated. The avatar data 221 includes data for drawing the avatar object body, texture data applied to the avatar object body, and the like. The data for drawing the main body of the avatar object is not particularly limited, but consists of skeletal data (bone) for expressing the motion of the avatar object, polygon data for expressing skin and the like, and the like. The avatar data 221 includes data of multiple avatar object bodies. The texture data includes multiple parts data that can be applied to the avatar object. For example, a plurality of parts data are prepared for each category such as "eyes", "eyebrows", "ears", and "clothes". A user selects one avatar object from a plurality of avatar objects. Part data is also selected and applied to the avatar object body to create a user's own avatar object. A combination of the avatar object main body and parts data selected by the user is recorded in the storage 22 .

The object data 222 is information about an object rendered in the virtual space, other than the avatar object. The object data 222 is acquired from the server 13 at a predetermined timing. Objects corresponding to the object data 222 include gift objects presented by viewing users and objects displayed during game execution. The form of the gift object is not particularly limited, but may be, for example, a wearable object that can be worn by an avatar object, a normal object that is displayed in the virtual space for a certain period of time, or an effect object such as fireworks or letters.

These avatar objects and other objects may be objects that exhibit physical behavior. Specifically, the object may simulate physical behavior such as falling due to gravity, motion due to application of force, and the like. A component (program) for simulating physical behavior is executable associated with the physical behavior object.

The user device 12 also includes a sensor unit 24 , a speaker 25 , a microphone 26 , an operation section 27 and a display 28 . At least one of the sensor unit 24, the speaker 25, the microphone 26, the operation unit 27, and the display 28 may be provided as the same device as the computer processor 20, and is provided in a manner connected to a device including the computer processor 20. may

The sensor unit 24 is one or more sensors that detect face motion, which indicates changes in the user's facial expression, and body motion, which indicates changes in the relative position of the user's body with respect to the sensor unit 24 . Face motion includes movements such as blinking and opening and closing the mouth. For the sensor unit 24, known devices can be used. For example, an infrared camera for detecting infrared rays reflected by an emission unit for emitting infrared rays toward the user, a user's face, etc., and a camera for photographing the user's face. and an image processing unit that performs image processing on data captured by the camera. The sensor unit 24 detects, for example, a change in facial expression and a change in relative position from the initial state when detection is started. Alternatively, the sensor unit 24 may further include sensors other than the above sensors, such as an acceleration sensor and a gyro sensor. Hereinafter, face motion detection data and body motion detection data will be referred to as “motion data”.

The speaker 25 converts the audio data into audio and outputs it. The microphone 26 receives voice uttered by the user and converts it into voice data. The operation unit 27 includes a touch panel integrated with the display 28, operation buttons, a keyboard, a mouse, a controller, etc. provided on the housing of the user device 12 or the like. The display 28 outputs various images according to output instructions from the computer processor 20 . The controller corresponds to the operation part.

The computer processor 20 functions as an application management section 201 and a display control section 202 by executing a video application program 220 stored in the storage 22 . The application management unit 201 manages moving image application programs. The application management unit 201 receives requests from the user input through the operation unit 27 or requests from the server 13, and outputs requests to the display control unit 202 according to the content of those requests. The application management unit 201 also acquires motion data from the sensor unit 24 and outputs it to the display control unit 202, transmits requests from the display control unit 202 to the server 13, and stores various data received from the server 13. 22 is recorded.

Also, the application management unit 201 executes the game based on the operation of the distribution user in the distribution mode. In this embodiment, the video application program 220 includes a game control program, and the game progresses by reading and executing the game control program based on the operation of the distribution user. The application management unit 201 transmits to the server 13 data necessary for displaying the game video on the user device used by the viewing user. Also, the application management unit 201 receives data for displaying a game video from the server 13 when the user device 12 is in the viewing mode. Also, in the viewing mode, the application management unit 201 transmits a support command for the viewing user to the server 13 to support the distribution user. Note that the support command corresponds to "specific information".

The display control unit 202 applies motion data to the avatar data 221 in the distribution mode and viewing mode. In addition, when displaying an avatar object or an object other than an avatar object, the display control unit 202 performs rendering including the object. Rendering here includes drawing processing such as perspective projection and hidden surface removal (rasterization). Rendering may be at least one of these processes. In addition to the above processing, processing such as shading and texture mapping may be included. Also, the display control unit 202 generates an animation using the rendered image. Further, the display control unit 202 synthesizes the animation with GUI (Graphical User Interface) parts such as posted messages sent from the user device 12 of the viewing user or notifications sent from the server 13, operation buttons, etc. (or superimposed) moving image data is output to the display 28 . The display control unit 202 also displays the game moving image on the display 28 based on the data for displaying the game moving image received via the server 13 .

The user device 12 communicates with an output device 42, which is an external device. The output device 42 is a device that gives a tactile sensation to the user. The output device 42 acts on the action site of the user by, for example, vibration, pressure, or the like. The output device 42 receives driving instructions from the user device 12 . User device 12 can only send drive instructions in delivery mode. The drive command output to the output device 42 corresponds to the drive signal (drive information).
The output device 42 is preferably a combination of a device that can change the action site acting on the user's body between the left side and the right side, and a device that gives a tactile sensation, and selectively operates them. For example, a haptic rendering device described in Japanese Patent Application No. 2019-126624 can be used. The haptic rendering device includes a pair of actuators and an action section, and the actuator operates the action section with a predetermined drive waveform. The action part acts on at least two parts of the user's body. For example, the action part is a string-like body (flexible body) that is hung around the user's neck, and each end of the action part is connected to different actuators. The actuator vibrates by winding or loosening the flexible body. By changing at least one parameter value such as the amplitude, phase, frequency, etc. of the drive waveform of the actuator, the action section causes the action on the left action site or the right action site of the user's neck to differ. By making the action on either the left action position or the right action position different in this way, the user can grasp the direction indicated by the output device 42 through a tactile sensation.

Next, the server 13 will be explained. The server 13 is used by one or more service providers who provide services for distributing moving images. The server 13 comprises a computer processor 30, a memory 33, a storage 35 and a communication I/F34. Computer processor 30 is similar in configuration to computer processor 20 of user device 12 . The computer processor 30 may be configured by combining a plurality of arithmetic circuits. Also, the memory 33, the storage 35, and the communication I/F 34 have the same configurations as those of the user device 12. FIG. The server 13 may be composed of a plurality of devices, and the computer processor 30, memory 33, storage 35, and communication I/F 34 may be distributed among these devices.

The computer processor 30 functions as a distribution manager 301 by executing a distribution management program. The distribution management unit 301 stores various data received from the user device 12 in the storage 35 . Furthermore, the distribution management unit 301 acquires data requested by the user device 12 from the storage 35 or the like and transmits the data to the user device 12 . Specifically, the distribution management unit 301 transmits a list of videos being distributed in response to a request from the user device 12 . When the distribution management unit 301 receives the identification information of the requested moving image from the list from the user device 12, the distribution management unit 301 requests various data transmitted from the user device 12 used by the distribution user of the requested moving image. Send to user device 12 .

Further, when the distribution user is distributing a game video, the distribution management unit 301 receives a game execution command for proceeding with the game from the user device 12 in the distribution mode, or receives a game execution command from the user device 12 in the viewing mode. Receive support commands. The distribution management unit 301 transmits the received game execution command to the user device 12 in the viewing mode, and transmits the support command to the user device 12 in the distribution mode.

In addition, the distribution management unit 301 receives a posted message or the like posted by the viewing user for the video being distributed. Furthermore, the distribution management unit 301 transmits the received posted message to the user devices 12 of the distribution users and to the user devices 12 of all viewing users who are viewing the video. The posted message includes, in addition to the content of the message, identification information of the viewing user (user's account name, etc.) and the like. Also, when the viewing user starts viewing the moving image, the delivery management unit 301 transmits a notification message such as "Mr. A has entered the room" to the user device 12 of the delivery user and the user device 12 of the viewing user. The user device 12 displays the received notification message in the posted message display field.

The distribution management unit 301 receives a request to display an object in the moving image being viewed from the user device 12 used by the viewing user viewing the moving image. Objects for which display requests are made are objects displayed in the virtual space, and include gift objects as well as evaluation objects that evaluate moving images favorably from viewing users. The distribution management unit 301 transmits the gift object display request received from the viewing user's user device 12 together with the gift object identification information to the distribution user's user device 12 and the viewing user's user device 12 . The user device 12 displays the notification message regarding the received gift object in the posted message display field.

In addition, the distribution management unit 301 performs object purchase processing according to the user's operation. Purchasing processing includes purchasing an object by paying consideration (medium) such as coins, points, or tickets that can be used within the animation application program. The distribution management unit 301 records the purchased object in the user device 12 or server 13 as being owned by the user. Sales of purchasable objects are distributed, for example, to broadcast users and service providers.

Next, various data stored in the storage 35 of the server 13 will be described. The storage 35 stores user management information 350 , avatar data 351 , object data 352 and game control data 353 .

The user management information 350 is information about users who use the moving image application program. Avatar data 351 is data for drawing an avatar object associated with each user, and is transmitted to user device 12 in response to a request from user device 12 . The object data 352 is data for drawing gift objects and other objects, and is transmitted to the user device 12 in response to requests from the user device 12 .

The game control data 353 is various data including data for progressing the game, data for supporting the game, and the like. The game control data 353 includes game update data, newly added game programs, and the like. The distribution management unit 301 transmits game control data 353 to the user device 12 as necessary. The game control data 353 may also include a game execution history associated with the user.

Next, with reference to FIG. 2, cheering during distribution mode will be described. Transmission and reception of motion data, voice data, etc. for moving the avatar object is omitted here.

A distribution user 101 is wearing an output device 42 . In the example of FIG. 2, the output device 42 is a haptic rendering device having actuators 42L and 42R provided on both sides of the action portion 421, and the actuators 42L and 42R drive the action portion 421 with a predetermined drive waveform. This driving waveform is controlled by the user device 12 used by the distribution user 101 (hereinafter referred to as distribution user device 12A). As a result, a tactile sensation can be given to the left action site 101L and the right action site 101R of the neck or shoulder of the delivery user 101 . The broadcast user 101 operates the broadcast user device 12A to put it into the broadcast mode. Also, the distribution user device 12A starts the game based on the operation of the distribution user 101 and displays the game distribution screen.

Also, the distribution user device 12A transmits the game execution command 110 to the server 13 . Upon receiving the game execution command 110, the server 13 transmits the game execution command 110 to the user device 12 used by the viewing user 102 (hereinafter referred to as viewing user device 12B). The viewing user device 12B executes the video application program 220, progresses the game on its own terminal based on the game execution command 110, and displays the game viewing screen. As a result, a game viewing screen displaying the game played by the distribution user 101 is displayed on the display 28 of the viewing user device 12B.

The viewing user supports the distribution user 101 by operating the viewing user device 12B or a controller or the like connected to the viewing user device 12B while viewing the game viewing screen. Specifically, the viewing user device 12B receives a user operation for supporting the viewing user 102 . One or more cheering commands are associated with the scene of the game moving image, and the viewing user device 12B identifies the cheering command according to the scene of the game moving image and the operation of the viewing user 102 .

For example, in a battle scene between a player character and an enemy character, a user operation for cheering is associated with a cheering command. For example, the user operation for cheering is a touch operation on the touch panel display. In another scene, a cheering command is associated with each of a plurality of user operations for cheering. For example, when a tap operation is performed on the touch panel display, the viewing user device 12B identifies the “support command A” associated with the tap operation, and when a slide operation is performed on the touch panel display, the viewing user device 12B identifies the "cheering command B" associated with the slide operation.

Further, if the viewing user device 12B is equipped with a sensor (inertia sensor) such as an acceleration sensor or a gyro sensor, it detects the movement of the viewing user device 12B and issues a cheering command according to the vibration frequency or speed. You may make it specify. Furthermore, when the viewing user device 12B can communicate with an operation unit having a sensor (inertia sensor) such as an acceleration sensor or a gyro sensor, it detects that the operation unit is shaken, and detects the vibration frequency and speed. You may make it specify the support command according to. Further, when the voice uttered by the viewing user 102 is input to the microphone 26, the viewing user device 12B AD-converts the voice signal to generate voice data, and specifies the cheering command according to the volume. good too. For example, when a cheering command to inform the position of an enemy character is generated, when the volume is loud (when the volume is equal to or greater than a predetermined threshold value), the cheering command indicating "close" is specified, and when the volume is low (when the volume is above a predetermined is less than the threshold of), specify a cheering command indicating "far". Furthermore, the viewing user device 12B may identify the cheering command based on the keyword included in the posted message. Keywords are, for example, "right", "left", "near", "far", and the like. If the posted message includes "right", a cheering command indicating "right" is identified, and if the posted message includes "left", a cheering command indicating "left" is identified. Also, if the posted message includes "near", a cheering command indicating "close" is specified, and if the posted message includes "distant", a cheering command indicating "distant" is specified.

Note that the viewing user device 12B does not transmit a cheering command to the server 13 when detecting an input operation by the viewing user 102 in a game scene that is not associated with a cheering command. Alternatively, when the server 13 identifies the scene of the game being executed by the distribution user device 12A based on the game execution command transmitted from the distribution user device 12A, and receives the cheering command in the game scene that is not associated with the cheering command. In this case, the support command may not be transmitted to the distribution user device 12A.

The viewing user device 12B transmits the identified support command 111 to the server 13 . When the server 13 receives the support command 111, the server 13 transmits the support command 111 or information corresponding to the support command 111 to the distribution user device 12A and all the viewing user devices 12B. The transmission of the cheering command 111 to the viewing user device 12B that transmitted the cheering command 111 may be omitted.

The server 13 may select the support command 111 according to the type of support command 111 . Then, the selected support command 111 may be transmitted to the distribution user device 12A and the viewing user device 12B. For example, if a plurality of viewing users 102 may transmit different cheering commands 111 within a certain period of time, one of the cheering commands is selected and transmitted to the distribution user device 12A and the viewing user device 12B. do.

The process of selecting the support command 111 is not particularly limited, but there are, for example, the following modes.
- Accumulate the number of commands for each cheering command 111, and transmit the cheering command 111 with the larger total number within a certain period to the distribution user device 12A and the viewing user device 12B.
- Accumulate the number of cheering commands 111, and when the total number reaches a certain number, send the cheering commands 111 to the distribution user device 12A and the viewing user device 12B.
- Randomly select one of the received support commands 111 and transmit the selected support command 111 to the distribution user device 12A and the viewing user device 12B.
Giving priority according to the attribute of the user who sent the cheering command 111, and sending the cheering command 111 with the highest priority to the distribution user device 12A and the viewing user device 12B.
- Send the cheering command 111 associated with the highest priority among the priorities associated with the cheering commands 111 to the distribution user device 12A and the viewing user device 12B.

The distribution user device 12A receives the support command 111 or information corresponding to the support command 111, and generates a drive command to the output device 42 according to the received information. Specifically, based on the support command 111, the values of parameters related to drive waveforms such as the amplitude, frequency, and phase of the actuators 42L and 42R are determined. The distribution user device 12A transmits the generated driving command to the output device 42 worn by the distribution user 101. FIG. That is, the cheering transmitted from the viewing user 102 is conveyed to the distribution user 101 via the output device 42 as a tactile sensation. Also, different tactile sensations are given to the distribution user 101 according to the type of the cheering command 111 .

For example, when the support command 111 transmitted from the server 13 is to present directions to the distribution user 101, the distribution user device 12A transmits a driving command with a driving waveform for presenting directions to the output device 42. do. For example, if the support command 111 received from the server 13 is a command indicating "left", the output device 42 makes the amplitude of the drive waveform of the left actuator 42L larger than the amplitude of the drive waveform of the actuator 42R, It is driven so that the action on the action site 101L of the distribution user 101 becomes strong. At this time, the actuator 42R may not vibrate. Alternatively, the output device 42 sets the phase of the drive waveform of the left actuator 42L ahead of the phase of the drive waveform of the right actuator 42R, and drives the left action site 101L to act first. Alternatively, the output device 42 sets the frequency of the drive waveform of the left actuator 42L higher than the frequency of the drive waveform of the actuator 42R so that the action section 421 acts on the action site 101L of the distribution user 101 at a high frequency. do. By providing a difference in frequency in this manner, it is possible to give distribution user 101 a sense of undulation from action site 101L to action site 101R. By making the drive waveform parameter values different between the actuators 42L and 42R in this way, it is possible for the distribution user 101 to recognize that the presented direction is the left direction.

Also, when the cheering command 111 presents the distance to the target position, the distribution user device 12A transmits to the output device 42 a driving command with a driving waveform for presenting the distance. For example, if the support command 111 received from the server 13 is a command indicating "close", the output device 42 increases the amplitude of the driving waveforms of the actuators 42L, 42R, and acts on the action sites 101L, 101R of the distribution user 101. drive to become stronger. In addition, if the support command 111 received from the server 13 is a command indicating “distant”, the output device 42 reduces the amplitude of the driving waveforms of the actuators 42L and 42R, and causes the action sites 101L and 101R of the distribution user 101 to act. is driven to become weaker.
Further, when the support command 111 does not present a direction, the output device 42 operates so as to strengthen the action on the central action site between the action sites 101L and 101R, or You may operate so that the action with respect to 101R may become equal. In addition, the amplitude, frequency, phase, etc. of the drive waveforms of the actuators 42L and 42R are changed according to the number of support commands 111 based on information according to the aggregated results of the server 13 and the type of support commands 111. good too. This allows the distribution user 101 to recognize that the cheering command 111 has been transmitted from the viewing user 102 .

Also, the distribution user device 12A reflects the support command 111 in the game according to the type of the support command 111. FIG. Among the support commands 111 reflected in the game, there are those that operate the output device 42 and are reflected in the game, those that are reflected in the game without operating the output device 42, and those that operate the output device 42. It may contain things that are not reflected in the game.

As one aspect of reflecting the support command 111 in the game, the distribution user device 12A may change the value of the in-game parameter of the player character corresponding to the distribution user 101 based on the support command 111 . These parameters may be those associated with the player character, such as HP, MP, attack power, defense power, quickness, abilities, vitality, experience points, levels, attributes, and the like. Depending on the type of the support command 111, the parameter values of the player character may be changed to be advantageous in the game, or may be changed to be disadvantageous. When the value of the parameter is changed in this way, the distribution user device 12A may operate the output device 42. FIG. An example of a game in which the support command 111 is reflected in this way is, for example, a tower defense game in which an enemy invading one's territory is defeated. In one example of a tower defense game, a cheer command loads a weapon's bullets. Specifically, in the initial state, the weapon is not loaded with bullets, and bullets are loaded according to the number of support commands 111 such as "relord". That is, if there is no support command 111, the mission cannot be cleared. Also, in this game, a support command 111 such as "Charge" may be used to increase the attack power of gunfire, such as by increasing the size of bullets.

As another aspect of reflecting the cheering command 111 in the game, the distribution user device 12A may change the in-game parameters of characters other than the player character corresponding to the distribution user 101 . For example, the value of a parameter associated with an enemy character that fights against the player character may be changed so that the enemy character is at a disadvantage in the game.
Also, the distribution user device 12A may change the points given to the player character at the end of the game to be advantageous or disadvantageous in the game according to the number or content of the cheering commands 111. can be changed to For example, when the number of cheering commands with content to support the player character exceeds a certain number, it is determined that the support action has been performed, and the points given to the player character are reduced. For example, the points are subtracted by a predetermined number, or the points are multiplied by a predetermined factor less than "1". Also, when the number of commands to support the player character exceeds a certain number by interfering with the enemy character fighting against the player character, points given to the player character are increased. For example, points are increased by a predetermined number, or points are multiplied by a predetermined coefficient exceeding "1".

As another aspect of reflecting the cheering command 111 in the game, the distribution user device 12A may associate the distribution user 101 with game media. A game medium may be electronic data used in a game, and this electronic data may be acquired, owned, used, managed, exchanged, combined, enhanced, sold, discarded, or donated by the user in the game. For example, game media include arbitrary media such as cards, items, virtual currency, tickets, characters, spells, and jobs. The mode of use of the game media is not limited to what is specified in this specification. For example, the distribution user device 12A gives the player character a weapon item corresponding to the support command 111 . The distribution user device 12A may operate the output device 42 when the game content is provided.

As another mode of reflecting the support command 111 in the game, the distribution user device 12A changes the action mode of the player character corresponding to the distribution user 101 or the action mode of the enemy character based on the support command 111 ("slow"). You can speed it up or slow it down.

As another mode of reflecting the support command 111 in the game, the distribution user device 12A may change the display mode of the game viewing screen or the game distribution screen based on the support command 111. FIG. Specifically, in response to the support command 111 (“move”), the display range displayed on the game viewing screen is changed in the vertical direction and along the horizontal direction of 360 degrees with respect to the avatar object 121. may This makes it easier for the viewing user 102 to search for an object such as an enemy.
The distribution user device 12A may adjust the game distribution screen so that it is difficult for the distribution user 101 to visually recognize it, or it is easy for the distribution user 101 to visually recognize it. For example, when the predetermined number of cheering commands 111 reaches a predetermined number, the delivery user device 12A places an object (for example, translucent and plate-like) in front of the avatar object 121, makes the object disappear, You can also change the transparency of the object. Alternatively, the distribution user device 12A adjusts the contrast, brightness, etc. of the image displayed on its own display 28 . Also, the viewing user 102 cheering the broadcast user 101 may transmit a cheering command 111 for interfering with the progress of the game of another broadcast user 101 who is the opponent of the broadcast user 101 . The distribution user device 12A, which has received the support command 111 for obstruction, places the above object in front of the avatar object 121 corresponding to the other distribution user 101 who is the opponent, and displays the game distribution screen of the other distribution user 101. It may be in a state where it is difficult to visually recognize. Furthermore, the viewing user device 12B used by the viewing user 102 who supports the distribution user 101 transmits a support command 111 for operating the output device 42 of another distribution user 101 who is the opponent of the distribution user 101. good too. The cheering command 111 at this time is also sent to interfere with the distribution user who is the opponent. The output device 42 of the other broadcast user 101 who is the opponent originally operates the output device 42 so as to support the other broadcast user 101, but when the support command 111 that interferes is received, the original operation mode The output device 42 is operated in a different operation mode. Alternatively, the output device 42 is operated so as to overlap the original operation mode for supporting the distribution user 101 and the operation mode for obstruction. As a result, it becomes difficult for the distribution user 101 to detect the tactile sensation of supporting another distribution user 101 who is an opponent.

(motion)
With reference to FIG. 3, an example of a procedure for distributing game animation will be described. Here, an avatar object serving as a game player character will be described. When the distribution user device 12A starts the distribution mode, it transmits motion data and audio data to the server 13 (step S11). The server 13 transmits the motion data and the audio data to the viewing user device 12B (step S12). The distribution user device 12A and the viewing user device 12B output moving images based on the motion data and the audio data (steps S13 and S14).

The distribution user device 12A starts the game while distributing the moving image (step S15). When the distribution user 101 performs an operation to progress the game, the distribution user device 12A transmits the game execution command 110 to the server 13 together with the motion data and the voice data (step S16).

The server 13 transmits the motion data, the audio data and the game execution command 110 to the viewing user device 12B (step S17). The distribution user device 12A and the viewing user device 12B output the game video (steps S18 and S19). In the game video, the distribution user device 12A and the viewing user device 12B apply motion data to the avatar data 221 to generate an animation of the avatar object, and execute the game based on the game execution command 110. FIG. Also, the voice of the distribution user 101 is output based on the voice data.

The viewing user device 12B receives support based on the operation of the viewing user 102 (step S20), and transmits the support command 111 to the server 13 (step S21). The server 13 also transmits the support command 111 to another viewing user device 12B (not shown).

Upon receiving the support command 111, the distribution user device 12A transmits a driving command to the output device 42 (step S23). Also, the distribution user device 12A reflects the support command 111 in the game as necessary. The output device 42 operates based on the drive command. Since the distribution user 101 speaks or moves according to the tactile sensation given to the output device 42, the voice and motion are reflected in the game video as the voice and the motion of the avatar object.

Next, a screen example of a game moving image displayed on the distribution user device 12A or the viewing user device 12B will be described.
As shown in FIG. 4 , an avatar object 121 is displayed on the video distribution screen 120 . The avatar object 121 changes its facial expression in accordance with the change in facial expression of the distribution user 101 . Also, the avatar object 121 moves based on a change in the relative position of the broadcast user 101 with respect to the broadcast user device 12A.

A video viewing screen (not shown) displayed on the viewing user device 12B displays an evaluation button for giving a good evaluation of the video, a gift button for giving a gift object to the video, and the like. When the viewing user operates the gift button and the server 13 accepts a gift object display request, the gift object 122 is displayed on the video distribution screen 120 and the video viewing screen.

Also, on the video distribution screen 120, a message 123 posted by the viewing user who is watching the video is displayed. Also displayed on the video distribution screen 120 are a distribution button 124 for starting or stopping distribution and a game start button 125 for starting a game. When the game start button 125 is operated, the application management unit 201 of the distribution user device 12A starts the game.

FIG. 5 and FIG. 6 show modes in which the distribution user can perform a predetermined action in the game with the support of the viewing user. FIG. 5 is an example of the game viewing screen 126 displayed on the viewing user device 12B. An avatar object 121 is displayed on the game viewing screen 126 . That is, the game viewing screen 126 is a screen viewed from a viewpoint other than the viewpoint of the avatar object 121 . The game is a shooting game, and the distribution user 101 can shoot by operating the weapon 127 possessed by the avatar object 121 . The motion data of the distribution user 101 is applied to the avatar object 121 . In addition to shooting, the distribution user 101 may perform operations such as movement within the virtual space and changing items such as the weapon 127 . The number of remaining bullets is set for the weapon 127 , and when the number of remaining bullets reaches the maximum value, shooting can be performed based on the operation of the distribution user 101 . When the viewing user 102 touches any one of the game viewing screens 126, the viewing user device 12B receives the touch operation, and the support command 111 ("relord") associated with the scene corresponding to the game viewing screen 126 shown in FIG. to the server 13. The server 13 accumulates the number of support commands 111 . The server 13 transmits the support command 111 or statistical data corresponding to the total number of support commands 111 to the viewing user device 12B. The viewing user device 12B displays the number of remaining bullets as a gauge 128 on the game viewing screen 126 based on the support command 111 or statistical data.

FIG. 6 shows a game delivery screen 130 displayed on the delivery user device 12A. The game distribution screen 130 is rendered from the viewpoint of the avatar object, which is the player character of the game, and displays a virtual space image. The game delivery screen 130 does not display the gauge 128 shown in FIG. On the other hand, when the number of remaining bullets reaches the maximum value, the distribution user device 12A receives the support command 111 indicating that the number of remaining bullets has reached the maximum value from the server 13 . When the distribution user device 12A receives the support command 111, it outputs a driving command to the output device 42 to operate it. Therefore, even if the gauge 128 is not displayed on the game distribution screen 130, the distribution user 101 can grasp that the remaining number of bullets has reached the maximum value through a tactile sensation. Therefore, the distribution user 101 can operate the distribution user device 12A to shoot immediately after the number of remaining bullets reaches the maximum value. In addition, when the tactile sensation is given, the distribution user 101 speaks in response to receiving support, or causes the avatar object 121 to perform an action by moving himself or herself, thereby displaying the video of the distribution user 101. reaction can be reflected.

FIG. 7 shows how viewing user 102 presents directions to broadcasting user 101 . In this aspect, directions are presented to the distribution user 101 by varying the action of the output device 42 on the plurality of action sites 101L and 101R of the distribution user 101 . For example, the game viewing screen 131 displays a bird's-eye view image and a map including a player position 132 that is the position of the avatar object 121 and enemy positions 133 . When the viewing user 102 performs a touch operation on the enemy's position 133 or its vicinity, the viewing user device 12B identifies the position indicated by the touch operation. Also, the viewing user device 12B transmits a cheering command 111 associated with the game scene according to the position of the touch operation. For example, when the left side of the screen is tapped, “enemy pos (left)” is transmitted, and when the right side of the screen is tapped, “enemy pos (right)” is transmitted to the server 13 . Each time the server 13 receives a support command 111, the server 13 transmits the support command 111 to the distribution user device 12A. Alternatively, the server 13 accumulates the number of cheering commands 111 received within a certain period of time for each "enemy pos (left)" and "enemy pos (right)". Then, the support command with the larger accumulated number is transmitted to the distribution user device 12A. In response to the received support command 111 , the distribution user device 12</b>A determines the parameter values of the drive waveform for presenting the direction, generates a drive command, and transmits it to the output device 42 . For example, when the distribution user device 12A receives the support command 111 of "enemy pos (right)", the output device 42 operates so as to increase the action on the left action site 101R. This allows the distribution user 101 to grasp the position of the enemy.

Next, the effects of this embodiment will be described.
(1) Since the output device 42 operates according to the cheering command 111 transmitted from the viewing user device 12B, the cheering of the viewing user 102 can be conveyed to the distribution user as a tactile sensation. This makes it easier for the distribution user 101 to notice the information transmitted by the viewing user 102, and thus can react to the viewing user 102 through speech, actions, and the like. Since the viewing user 102 can immediately view the moving image based on the reaction of the distribution user 101, the viewing user 102 can understand that the moving image is being distributed in real time. As a result, the motivation for cheering can be increased, and communication between the distribution user 101 and the viewing user 102 can be activated. In addition, since cheering does not necessarily have to be displayed on the game distribution screen, it is possible to reduce the amount of information displayed on the game distribution screen. Reducing the amount of information displayed on the game distribution screen in this way makes it easier for the distribution user 101 to proceed with the game.

(2) The distribution user device 12A adjusts the drive waveform of the output device 42 based on the counting of the support commands 111. FIG. Therefore, for example, the distribution user 101 can grasp additional information of the cheering command 111, such as the number of times the cheering command 111 has been sent, through tactile sensation.

(3) Since the direction presented to the distribution user 101 by the viewing user 102 can be conveyed to the distribution user 101 as a tactile sensation, the distribution user 101 can quickly respond to the direction presented by the viewing user 102. . In addition, since the viewing user 102 can immediately view the moving image based on the reaction of the distribution user 101, communication between the distribution user 101 and the viewing user 102 can be made active.

(4) The value of the parameter associated with the distribution user 101 is changed by the cheering command 111 of the viewing user 102 and the output device 42 is operated based on the cheering command 111 . As a result, it is possible to notify the distribution user 101 as a tactile sensation that the parameter value has been changed.

(5) Changing the value of a parameter associated with a character other than the character corresponding to the distribution user 101, such as an enemy character, by the cheering command 111 of the viewing user 102, and operating the output device 42 based on the cheering command 111; made it As a result, it is possible to notify the distribution user 101 as a tactile sensation that the parameter value has been changed.

(6) The game content is associated with the distribution user by the cheering command 111 of the viewing user 102 and the output device 42 is operated based on the cheering command 111 . As a result, it is possible to convey to the distribution user that the game content has been associated as a tactile sensation.

(7) The display mode of the video of the game is changed by the support command 111 of the viewing user 102 and the output device 42 is operated based on the support command 111 . Thereby, it is possible to notify the distribution user as a tactile sensation that the display mode of the screen has been changed.

(Second embodiment)
Next, a second embodiment of the video distribution system will be described. 1st Embodiment demonstrated the aspect which operates the output device 42 only based on the support from a viewing user. This embodiment differs from the first embodiment in that the distribution user device 12A independently operates the output device 42 and operates the output device 42 based on support. In the following, parts similar to those of the first embodiment are denoted by the same reference numerals, and detailed description thereof will be omitted.

As shown in FIG. 8, the distribution user device 12A identifies a target position 141 to be presented to the user during game execution, and generates position information. The position information of the target position 141 includes the relative distance L from the reference position 140 and the relative direction θ. In the example shown in FIG. 8 , the reference position 140 is the position of the avatar object 121 and the target position 141 is the position of the enemy object 142 . The relative direction θ is an angle between a straight line 143 in the front direction of the avatar object 121 and a straight line 144 connecting the reference position 140 and the target position 141 . Note that the reference position 140 may be another position such as the position of a virtual camera placed in the virtual space, and the target position 141 may be the position of an object other than the enemy object 142 or a specific point. .

The application management unit 201 controls the actuators 42L and 42R based on the information about the target position 141 so that the user can grasp the target position 141. FIG. For example, when the target position 141 is on the right side as viewed from the reference position 140, the output device 42 is operated so that the action on the action site 101R on the right side of the distribution user 101 acts earlier than the action site 101L on the left side. . Also, the greater the absolute value of the relative direction θ, the stronger (or weaker) the action on the action sites 101L and 101R, or the higher (or lower) frequency. Also, the shorter the relative distance L, the stronger the action on the action sites 101L and 101R, or the higher the frequency. Furthermore, the magnitude of the absolute value of the relative direction θ is defined as a change in frequency, and the magnitude of the absolute value of the relative distance L is defined as a change in intensity. The parameter of the drive waveform that changes according to the current may be made different.

The distribution user device 12A also operates the output device 42 with support from the viewing user device 12B. At this time, the application management unit 201 makes the operation period of the output device 42 based on the position information and the operation period of the output device 42 based on the support command 111 different.

FIG. 9(a) shows an example of the driving waveform of the actuator 42R, and FIG. 9(b) shows an example of the driving waveform of the actuator 42L. The horizontal axis is time, and the vertical axis corresponds to the magnitude (amplitude) of vibration. During the period from time T1 to T2, the output device 42 operates with drive waveforms 145L and 145R for presenting the target position 141 acquired by the broadcast user device 12A to the broadcast user. The example shown in FIG. 9 shows drive waveforms when the target position 141 is located on the right side of the reference position 140, and the drive waveform 145R for the actuator 42R has a predetermined phase difference from the drive waveform 145L for the actuator 42L. progressing. The amplitude and frequency of the drive waveforms 145L and 145R are constant. Thereby, the user can grasp that the target position 141 is on the right side of the reference position 140 . Further, the amplitude of the drive waveforms 145L and 145R increases as the relative distance L decreases.

Further, the period of time T3-T4 is driving waveforms 146L, 146R based on the cheering command transmitted from the viewing user device 12B. The driving waveforms 146L and 146R have different frequencies from the driving waveforms 145L and 145R during the time T1-T2. Specifically, the frequency f2 of the drive waveforms 146L and 146R during the time T3-T4 is lower than the frequency f1 of the drive waveforms 145L and 145R during the time T1-T2. The drive waveforms 146L and 146R of the actuators 42L and 42R during the time T3 to T4 have the same amplitude and frequency, and the drive waveform 146R of the actuator 42R is out of phase with the drive waveform 146L of the actuator 42L as in the time T1 to T2. It advances by a predetermined phase difference. Therefore, the tactile sensation given from the output device 42 is equal to the left and right during the time T3-T4.

In this manner, by changing the frequency according to the type of information presented to the distribution user 101, different tactile sensations can be imparted to the distribution user at the site of action. This allows the distribution user 101 to grasp different information through tactile sensations. For example, if a tactile sensation is given by a high-frequency drive waveform, the direction of the enemy can be grasped, and if a tactile sensation is given by a low-frequency drive waveform, it is possible to grasp that support has been sent. The types of support are the same as in the first embodiment.

In this way, by presenting different information to the distribution user through the tactile sensation without displaying it on the screen, the information displayed on the screen is not disturbed and the information to be conveyed to the distribution user can be surely grasped.

According to the second embodiment, the following effects are obtained in addition to the effects described in (1) to (7) of the first embodiment.
(8) The output device 42 is operated according to the direction in which the viewing user 102 presents to the distribution user 101 . Thereby, the direction presented by the viewing user 102 can be conveyed to the distribution user 101 as a tactile sensation. As a result, the distribution user 101 can easily notice the information regarding the direction and can quickly respond to the information.

(9) The output device 42 is operated according to the distance presented to the distribution user 101 by the viewing user 102 . Thereby, the distance presented by the viewing user 102 can be conveyed to the distribution user 101 as a tactile sensation. As a result, the distribution user 101 can easily notice the information about the distance and can quickly respond to the information.

(10) The period during which the tactile sensation is imparted based on the support command 111 is made different from the period during which the tactile sensation is imparted based on the positional information. This makes it easier for the distribution user 101 to grasp which information the tactile sensation is based on.

(Third Embodiment)
Next, a third embodiment of the video distribution system will be described. This embodiment differs from the first embodiment in that the distribution user device 12A independently operates the output device 42 and also operates the output device 42 based on support. Also, the timing at which the output device 42 operates based on cheering is different from that in the second embodiment. In the following, parts similar to those of the first and second embodiments are denoted by the same reference numerals, and detailed description thereof will be omitted.

In this embodiment, at least a part of the operation period of the output device 42 independently operated by the distribution user device 12A and the operation period of the output device 42 based on the support command 111 are overlapped. are combined to act on the action sites 101L and 101R. The mode of the game is not particularly limited as long as the operation periods overlap. Send to 13. The server 13 transmits the support command 111 to the distribution user device 12A. In addition, the game is provided with a period during which shooting is possible and a standby period during which shooting is not possible, and the distribution user device 12A operates the output device 42 during the period during which shooting is possible.

The delivery user device 12A synthesizes a drive waveform when receiving the support command 111 of "Charge" during the shooting enabled period. Specifically, the drive waveform for notifying that it is a period in which shooting is possible and the drive waveform based on the support command 111 of "Charge" are combined with the same phase, and the amplitude is increased.

FIG. 10 shows drive waveforms for one of the actuators 42L and 42R. The drive waveform from time T10 to T11 is the drive waveform 147 for presenting to the distribution user 101 that it is a shooting enabled period. A drive waveform 148 from time T11 to time T12 is obtained by synthesizing the drive waveform 147 with the drive waveform based on the support command 111 . As a result, since the amplitude of the drive waveform 148 from time T11 to time T12 increases, the strength acting on the action sites 101L and 101R of the distribution user 101 also increases. Therefore, the distribution user 101 can understand from the viewing user 102 that it is possible to shoot with a large bullet.

According to the third embodiment, the following effects are obtained in addition to the effects described in (1) to (7) of the first embodiment.
(11) In order to operate the output device 42 so as to synthesize the drive waveform based on the support command 111 and the drive waveform based on the position information, the presence or absence of support or the presentation of the position is triggered by the change in the drive waveform. It becomes easier for the distribution user 101 to grasp the presence/absence.

Each of the above embodiments can be implemented with the following modifications. Each of the above-described embodiments and the following modifications can be implemented in combination with each other within a technically consistent range.
- In 1st Embodiment, when the kind of the support command 111 received differs, the support command 111 was selected from those support commands 111. FIG. Alternatively, all cheering commands 111 may be sent with their numbers. The distribution user device 12A increases the strength of the driving waveform of the output device 42 as the number of support commands 111 increases. As a result, the support commands 111 with a large number give a tactile sensation to the delivery user 101, and the support commands 111 with a small number become noise and do not give a tactile sensation. Also, in the viewing user device 12B, only the support command 111 that needs to be displayed is displayed on the display .

- In the second embodiment, the position information about the target position 141 includes the relative distance L and the relative direction θ from the reference position 140, but any one of them may be included.
- In the above-described embodiments, the server 13 aggregates the support commands 111, but instead of this, the distribution user device 12A may aggregate the support commands 111. FIG. In this case, the distribution user device 12A receives all the support commands 111 transmitted from the viewing user device 12B, totalizes the received support commands 111, and operates the output device 42 based on the total result.

- In each of the above-described embodiments, the delivery user device 12A determines the values of the parameters related to the drive waveforms of the output device 42, but the devices that determine the values of the parameters related to the drive waveforms are other than the delivery user device 12A. may be For example, the server 13 may determine values of parameters relating to the drive waveforms of the output device 42 . In this case, the server 13 transmits the parameter value to the distribution user device 12A, and the distribution user device 12A operates the output device 42 based on the received parameter value. Alternatively, the controller of the output device 42 may determine the values of parameters relating to the dynamic waveform.
- In each of the above embodiments, the server 13 may transmit the drive command (drive signal) to the output device 42 without going through the distribution user device 12A.

- In each of the above embodiments, the client rendering method in which moving images are rendered by the distributing user device 12A and the viewing user device 12B has been described, but moving images may be distributed using other moving image distribution methods. FIG. 11 shows a video distribution method in which the distribution user device 12A generates moving images, and shows the processing procedure after the game is started. The broadcast user device 12A executes the game based on the operation of the broadcast user. The distribution user device 12A applies the motion data to the avatar objects 121 and renders each object to generate a moving image (step S30). Then, the distribution user device 12A transmits the generated video data to the server 13 (step S31). The server 13 receives the moving image data and transmits the moving image data to the viewing user device 12B of the viewing user who is viewing the moving image (step S32). The viewing user device 12B outputs a game video based on the transmitted video data (step S19), receives support based on the operation of the viewing user (step S20), and transmits a support command 111 to the server 13 (step S21). ). The server 13 transmits the support command 111 to the distribution user device 12A, and the distribution user device 12A outputs a drive command to the output device 42 based on the support command 111 (step S23).

Alternatively, a server distribution method in which the server 13 generates moving images may be employed. In this distribution method, the distribution user device 12A transmits a game execution command to the server 13 based on the operation of the distribution user. The server 13 generates video data based on the game execution command, and transmits the video data to the distribution user device 12A and the viewing user device 12B. The distribution user device 12A and the viewing user device 12B display moving images based on the received moving image data. The viewing user device 12B receives support based on the operation of the viewing user and transmits a support command 111 to the server 13 . If necessary, the server 13 reflects the support command 111 in the game and transmits the support command 111 to the distribution user device 12A. At this time, the server 13 may transmit a driving request with a predetermined driving waveform to the distribution user device 12A (or the output device 42) instead of the support command 111. FIG.

- In each of the above-described embodiments, the video application program 220 includes a game control program, and the user device 12 reads the game control program to execute the game. Alternatively, the user device 12 may receive web data including data described in markup language from the server 13 and use a web browser to display a game animation based on the web data. Alternatively, a hybrid game may be executed in which a game control program included in the video application program 220 and web data are used to execute the game. In each aspect, the user device 12 or the server 13 may reflect the cheering on the game. It should be noted that in any of these modes, it is possible to distribute game moving images by a client rendering method or a video distribution method in which the distribution user device 12A and the server 13 generate moving images.

- In the above-described embodiment, the user device 12 is assumed to have a moving image application program installed therein for viewing and distributing moving images. Alternatively, the application program for viewing moving images and the application program for distributing moving images may be separate application programs. When performing distribution, a distribution application program is used to distribute moving images. For viewing, the video is viewed using a viewing application program. A gift object display request is made using a viewing application program.

- You may display the image|video containing the image of the real world in a moving image. For example, a moving image may display an augmented reality (AR) space. For example, an avatar object and other objects are superimposed on an image of the real world captured by the camera of the user device 12 and displayed. In this aspect, the image captured by the camera of the distribution user device 12A is used as the background image.

- In the above-described embodiment, a game animation is distributed in which the avatar object 121 to which the movement of the distribution user 101 is applied is the player character. Alternatively, the game animation may include a player character other than the avatar object 121 . Also, it may be a game in which a player character does not appear in the first place, such as a game from a player's point of view (first person's point of view). Even in these modes, the support of the viewing user can be conveyed to the distribution user 101 as a tactile sensation.

- There may be a plurality of distribution users 101 who progress the game. For example, in collaboration distribution in which a plurality of distribution users 101 participate in a moving image, at least one of the distribution users 101 may use the output device 42 . For example, the tactile sensation may be given only to the distribution user 101 corresponding to the avatar object 121 using a specific weapon. Also, the output device 42 worn by a plurality of distribution users 101 may be controlled to impart a tactile sensation to those distribution users 101 . When giving a tactile sensation to a plurality of distribution users 101, the driving waveforms of the output devices 42 may be the same or different. Furthermore, the viewer user 102 may be allowed to designate the distribution user 101 to whom the tactile sensation is applied. In this case, the viewing user device 12B designates the distribution user 101 (avatar object 121) to whom the tactile sensation is to be applied. Also, the period during which the output device 42 of each distribution user 101 operates may be the same or different.

- In each of the above-described embodiments, the output device 42 is illustrated as a haptic rendering device including an action section and an actuator. The output device 42 may be any device as long as it can touch at least a part of the body of the distribution user 101 and give the distribution user 101 a tactile sensation. For example, the output device 42 may have a plurality of vibration-generating actuators attached to different action sites of the delivery user 101 . Also, the output device 42 may be in contact with parts other than the neck and shoulders, such as the head and legs. For example, the output device 42 may be a haptic rendering device that imparts haptics to the front and back of the broadcast user 101 . One example of such a haptic rendering device is a jacket-type device worn on the upper body. This haptic rendering device is provided with an action section positioned in front of the broadcast user 101 and an action section positioned in the back side. According to this, the distribution user 101 can recognize information about the front-rear direction by the operation of the output device 42 . Furthermore, the output device 42 may act on one action site of the distribution user 101 . Even if there is only one action site, the distribution user 101 can recognize the existence of the notification target by giving a tactile sensation to the action site. It is preferable that the output device 42 does not interfere with the operation of the distribution user 101, but it may be one that the distribution user 101 holds.

- Although the distribution user 101 used the output device 42 in the above embodiment, the viewing user 102 may use the output device 42 instead of or in addition to this. For example, by operating the user device 12 of the distribution user 101, the output device 42 worn by the viewing user 102 may be operated.

- In the above-described embodiment, the output device 42 is described as providing a tactile sensation to the user. Alternatively, the user may feel a change in temperature. For example, the temperature may be raised when the cheering commands transmitted from the viewing users reach a certain number.

- Output device 42 may combine a plurality of devices. For example, a device that gives the user a tactile sensation by vibration may be combined with a device that emits light or a device that outputs sound.
- In each of the above embodiments, the user device 12 is provided with input/output devices such as the sensor unit 24, the speaker 25, the microphone 26, the operation unit 27, and the display . Alternatively, these input/output devices may be connected to the user device 12 as external devices. Also, the user device 12 may be connected to at least one of the communication I/F 23 and the storage 22 as an external device.

- In each of the above-described embodiments, the distribution user 101 distributes the video using the distribution user device 12A owned by the distribution user 101. However, the viewing user 102 may view the video distributed by the distribution user 101. If possible, it is not limited to this. For example, the moving image may be displayed on a large display installed at an event venue where many viewing users 102 participate. The viewing user 102 operates an information processing device installed at the event venue and an operation unit (for example, psyllium or a smartphone) capable of communication, and transmits a support command 111 from the operation unit to the information processing device. Alternatively, the information processing device installed at the event venue and receiving the cheers of the viewing users 102 may transmit the cheering command 111 to the information processing device that generates the distribution information. The information processing device to which the voice is input corresponds to the "information processing device used by the viewing user who watches the moving image" and outputs the support command 111 based on the volume, the rhythm of the voice, and the results of voice recognition based on the voice data. Identify. If the sound volume is high, the cheering command 111 that exhibits an advantageous effect in the game may be used. The information processing device transmits the support command 111 to the output device 42 of the distribution user 101 . Also, a plurality of distribution users 101 may participate in the event as game players, and viewers may watch the progress of the game on a large display. In this case, the output device 42 may be prepared for each distribution user 101 . When a plurality of viewing users 102 gather at the venue in this way, the volume based on the cheering of the viewing users 102 may be digitized or graphed and displayed on the display. In the graph at this time, the vertical axis may be the volume and the horizontal axis may be the time axis. In addition, when the viewing users 102 are dispersed in a plurality of venues, numerical values or graphs of the volume of cheering for each venue may be displayed for comparison. The graph at this time may be a bar graph showing the volume of each venue.
・The statistical results of the cheering commands 111 sent from the viewing user device 12B used by the viewing user 102 are displayed on the display 28 of the distribution user device 12A and the viewing user device 12B, or the main display installed at the event site (or a sub display attached thereto). display). The statistical results are the number of cheering commands 111, the frequency of the cheering commands 111, and the like. Also, the types of support commands 111 may be displayed on them. In this way, it is possible to increase the motivation of the viewing user 102 to cheer.

Also, the distribution user 101 may distribute the moving image from a studio that distributes the moving image. FIG. 12 shows a video distribution system installed in a video distribution studio, comprising a camera 161, a microphone 162, a controller 164, a distribution server 166, and the like. The moving image distribution system also includes a tracking system including mounting sensors 165 worn on the hands and feet of the distribution user 101 and a position detection unit 163 for specifying the positions of the mounting sensors 165 . Camera 161 photographs the face of distribution user 101 . The distribution server 166 generates animation by applying the tracking data obtained from the tracking system and the facial expression data obtained from the camera 161 to the avatar object 121 . Also, an animation obtained by rendering the background of the virtual space and the avatar object is distributed to the viewing user device 12B as moving image data together with the sound. Also, for example, the tracking system may be composed of a camera or the like that detects a marker attached to the body of the distribution user.
Next, technical ideas that can be grasped from the above embodiment and another example will be added below.
[1] to one or more computers,
a distribution information generating step for generating distribution information for a distribution user to distribute a moving image;
an identifying step of identifying the specific information based on the sound uttered by the viewing user who watches the moving image;
and a transmitting step of transmitting a drive signal for driving an output device that gives a tactile sensation to the distribution user, based on the specific information.

11 ... Video distribution system,
12 User device 13 Server.

Claims (16)

on one or more computers,
a distribution information generating step for generating distribution information for a distribution user to distribute a moving image;
a receiving step of receiving specific information from an information processing device used by a viewing user who watches a moving image;
and a transmitting step of transmitting a drive signal for driving an output device that gives a tactile sensation to the distribution user, based on the specific information. 2. The information processing program according to claim 1, wherein said transmitting step adjusts a driving waveform of said output device based on a total of said specific information. 3. The information processing program according to claim 1, wherein said transmitting step adjusts a driving waveform of said output device based on the type of said specific information. The output device is for differentiating actions on a plurality of action sites of the distribution user's body,
4. The information processing program according to any one of claims 1 to 3, wherein in said transmitting step, said output device transmits said drive signal for differentiating the action on each of said action sites based on said specific information. 5. The information processing program according to claim 4, wherein said transmitting step presents said direction to said delivery user by differentiating actions on said plurality of action sites based on said specific information presenting the direction of a target position. 2. The transmitting step presents the distance to the distribution user by varying an action on an action site of the distribution user's body according to the distance based on the specific information presenting the distance to the target position. 6. The information processing program according to any one of 1 to 5. The output device is for changing the strength acting on the action site of the distribution user's body,
7. The information processing program according to any one of claims 1 to 6, wherein said transmitting step operates said output device so as to change the strength to said action site based on said specific information. At least one of a direction of a target position with reference to a reference position and a distance between the reference position and the target position is acquired in the computer, and the output device according to position information including at least one of the direction and the distance. to further execute a position presentation step of operating the
The information processing program according to any one of claims 1 to 7, wherein in the position presentation step, an operation period of the output device based on the position information and an operation period of the output device based on the specific information are made different. . 9. The information processing program according to claim 8, wherein in said position presentation step, a driving waveform of said output device based on said position information and a driving waveform of said output device based on said specific information are synthesized. The information for distribution is information about a game that progresses according to the operation of the distribution user,
to the computer;
10. The information processing program according to any one of claims 1 to 9, further causing a reflection step of reflecting the specific information in the game. 11. The information processing program according to claim 10, wherein said reflecting step changes a value of a parameter in said game corresponding to said distribution user. 12. The information processing program according to claim 10, wherein the reflecting step changes values of parameters in the game of characters other than the character corresponding to the distribution user. 13. The information processing program according to any one of claims 10 to 12, wherein the reflecting step associates game media with the distribution user. 10 to 13, wherein the reflecting step changes a display mode of at least one of a moving image of the game displayed on the display viewed by the viewing user and a moving image of the game displayed on the display viewed by the distribution user. The information processing program according to any one of . The moving image is provided with an operable period in which the output device can be operated,
15. The information processing program according to any one of claims 1 to 14, wherein said transmitting step operates said output device only during said operable period. one or more computers
a distribution information generating step for generating distribution information for a distribution user to distribute a moving image;
a receiving step of receiving specific information from an information processing device used by a viewing user who watches a moving image;
and a transmission step of transmitting a driving signal for driving an output device that gives a tactile sensation to the distribution user, based on the specific information.

Images