JP7723982B2 - Video distribution system, control method, and program - Google Patents

Description

The present invention relates to a video distribution system, a control method, and a program.

Patent Document 1 discloses a technology for a video distribution system that streams live video of sports matches and the like. The technology divides the video from the start of streaming to the current point during ongoing streaming distribution into multiple chapters, extracts representative frames for each of the multiple chapters, and creates a digest video that includes the representative frames, thereby distributing the digest video selected by the user from a menu screen that allows the user to select a representative frame.

In recent years, in addition to live streaming of sports matches and other events, live streaming of e-sports tournaments and gameplay on user devices has also become common. Furthermore, while watching these live streams, large numbers of viewers can be seen actively exchanging comments using chat and other methods.

JP 2013-192062 A

In the case of live streaming such as that described above, viewers who start watching partway through the live stream rather than from the beginning (beginning) have a desire to know the content (development) of the live stream from its start until they begin watching. Also, viewers who watch the live stream from the beginning but are forced to miss a period of time and then resume watching later also want to know the content (development) of the period they were unable to watch. Furthermore, in order to share the excitement (excitement) among a large number of viewers, it is desirable to be able to grasp not only the current match situation but also important moments from the start of the match up to the present. Thus, viewers who are unable to watch a portion of the live stream have a desire to be able to easily grasp important moments from that period.

For example, the technology disclosed in Patent Document 1 creates a digest video that includes representative frames of chapters into which video is divided from the start of streaming to the present, but not all of these representative frames are necessarily important scenes. As a result, it is difficult to know which important scenes are when selecting representative frames from the menu screen. Furthermore, for viewers who are unable to watch for a period of time, the options include the already viewed period, making it difficult to know which option to select in order to watch a digest video of the unviewed period.

One of the objectives of some aspects of the present invention is to provide a video distribution system, control method, and program that allows viewers who are unable to view a live broadcast for a period of time to easily grasp important scenes from that period.

Another aspect of the present invention aims to provide a video distribution system, control method, and program that enable the effects described in the embodiments below to be achieved.

In order to solve the above-mentioned problems, one aspect of the present invention is a video distribution system that streams live video of gameplay on a game device to multiple terminals connected to a network, the video distribution system comprising: a live video generation unit that generates the live video based on gameplay video of the game being played on the game device; an acquisition unit that acquires information regarding the play status of the game being played on the game device; a weight information generation unit that generates weight information that associates time information corresponding to the time from the start of the live video with a weighting based on the play status of the game; a storage unit that stores user information that identifies each of multiple users; a digest generation unit that generates a digest video of the live video for a period specified by the time designation information associated with first user information of the user information, based on the weight information and time designation information; and a distribution unit that streams the live video to the multiple terminals and streams the digest video to a first terminal of the multiple terminals identified by the first user information.

Another aspect of the present invention is a control method for a video distribution system that streams live video of gameplay on a game device to multiple terminals connected to a network, the control method including: a live video generation unit generating the live video based on gameplay video of the game being played on the game device; an acquisition unit acquiring information related to the play status of the game being played on the game device; a weight information generation unit generating weight information that associates time information corresponding to the time from the start of the live video with a weighting based on the play status of the game; a digest generation unit generating digest video of the live video for a period specified by the time designation information based on the weight information and time designation information associated with first user information among the user information identifying each of multiple users stored in a storage unit; a distribution unit streaming the live video to the multiple terminals; and a distribution unit streaming the digest video to a first terminal among the multiple terminals identified by the first user information.

Another aspect of the present invention is a program for causing a computer in a video distribution system that streams live video of gameplay on a game device to a plurality of terminals connected to a network to execute the following steps: generating the live video based on gameplay video of the game being played on the game device; acquiring information regarding the play status of the game being played on the game device; generating weight information that associates time information corresponding to the time from the start of the live video with a weighting based on the play status of the game; generating a digest video of the live video for a period specified by the time designation information based on the weight information and time designation information associated with first user information among the user information identifying each of a plurality of users stored in a storage unit; streaming the live video to a plurality of the terminals; and streaming the digest video to a first terminal among the plurality of terminals identified by the first user information.

1 is a schematic block diagram showing an example of the configuration of a video distribution system according to an embodiment. FIG. 2 is a diagram showing an example of a display screen of the viewing terminal according to the embodiment. FIG. 1 is a block diagram showing an example of a schematic configuration of a computer according to an embodiment. FIG. 2 is a block diagram showing an example of the functional configuration of a moving image generation server according to the embodiment. FIG. 10 is a diagram showing an example of setting evaluation points according to the embodiment. FIG. 10 is a diagram showing an example of evaluation point information according to the embodiment. FIG. 2 is a block diagram showing an example of the functional configuration of a video distribution server according to the embodiment. FIG. 10 is a diagram showing a first example of time designation information according to the embodiment. FIG. 10 is a diagram showing a second example of time designation information according to the embodiment. FIG. 10 is a diagram showing a third example of time designation information according to the embodiment. FIG. 4 is a diagram showing an example of unviewed chapters and evaluation points according to the embodiment. FIG. 10 is a diagram showing an example of evaluation point information regarding unviewed time according to the embodiment. 10A and 10B are diagrams showing an example of selecting chapters to be included in a digest video according to the embodiment; 10 is a flowchart showing an example of a video distribution process according to the embodiment. 10A and 10B are diagrams showing modified examples of chapters of unviewed time of live streaming and evaluation points according to the embodiment. FIG. 16 is a diagram showing an example of evaluation point information regarding the unviewed time shown in FIG. 15 . 10A and 10B are diagrams showing a modified example of the selection of chapters to be included in the digest video according to the embodiment. 10A and 10B are diagrams showing modified examples of the display screen of the viewing terminal when a digest video without audio is played back according to the embodiment.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[System configuration and overview]
First, the configuration and overview of the video distribution system according to this embodiment will be described.
1 is a schematic block diagram showing an example of the configuration of a video distribution system according to this embodiment. The video distribution system 1 is a system that performs live distribution (streaming distribution) of e-sports (electronic sports) tournaments, live distribution of games played by users on game consoles, etc. For example, the video distribution system 1 includes a game console 10, a video and audio operation device 20, a video generation server 30, a video distribution server 40, and multiple viewing terminals 50 (50A, 50B, 50C, ...).

The game console 10 and video production server 30, and the video and audio control device 20 and video production server 30 are connected via an HDMI (registered trademark) cable, a broadcast cable, or the like. The video production server 30, video distribution server 40, and multiple viewing terminals 50 are communicatively connected to a network NW.

The network NW is a communications network that may be, for example, the Internet, a mobile phone network, a VPN (Virtual Private Network), a dedicated communication line network, a WAN (Wide Area Network), a LAN (Local Area Network), a PSTN (Public Switched Telephone Network), or a combination of these.

Game console 10 is a game device for playing a live-streamed game, and may be a dedicated game console or a personal computer. A controller 11A operated by player A and a controller 11B operated by player B are connected to game console 10. For example, game console 10 is capable of playing a competitive baseball game. Player A selects team A, and player B selects team B, allowing a baseball game to be played in which teams A and B compete against each other based on the operations of each player.

Note that, while a competitive baseball game will be described here as an example of a game played using the game console 10, this is not limited to this and any type of game can be applied. Furthermore, the number of players playing the game is not limited to two, but may be one or three or more. The number of controllers connected to the game console 10 is also not limited to two, but may vary depending on the number of players.

The audio and video control device 20 is a computer device used to comment on or provide commentary on game play played using the game console 10, or to operate the audio and video. For example, the audio and video control device 20 is connected to a microphone 21, a camera 22, and an operation panel 23. The microphone 21 is a microphone that inputs the voice of the commentator or analyst, as well as the audio of the game venue. The camera 22 is an imaging device that captures images of the commentator or analyst and the game venue. The operation panel 23 is an operation unit that allows an operator to operate the audio and video that are being live-streamed. The operation panel 23 may be configured with mechanical controls, or may be configured with a touch panel that operates on a display screen, etc.

The audiovisual control device 20 may be connected to a microphone 21, camera 22, and operation panel 23, or may have a built-in microphone 21, camera 22, and operation panel 23. Either the commentator or the commentator, or both, may also serve as the operator. Alternatively, only either the commentator or the commentator may serve as the operator, or one person may serve as both the commentator and the commentator. The operator may also be a director, etc.

The game console 10 outputs gameplay video and audio of the game being played on the game console 10, as well as information about the game's play status, to the video production server 30. The video and audio operation device 20 outputs video and audio of the commentator or analyst to the video production server 30.

The video production server 30 acquires gameplay video and audio output from the game console 10, as well as information about the game play status. The video production server 30 also acquires video and audio of the commentator or commentator output from the video and audio operation device 20. The video production server 30 then generates live video of the game by combining the gameplay video and audio with the video and audio of the commentator or commentator, and transmits the generated live video to the video distribution server 40 via the network NW. Hereinafter, "transmission from the video production server 30 to the video distribution server 40 via the network NW" will be simply referred to as "transmission from the video production server 30 to the video distribution server 40."

The video generation server 30 also generates weight information that associates time information (hereinafter referred to as "playback time") corresponding to the time from the start of the live video (start of distribution) with a weighting based on the game play situation. The playback time may be expressed as the elapsed time from the start time, with the start time of the live distribution being set to "0," or the start time of the live distribution and the time after the start time may be expressed in standard time (e.g., Japan Standard Time). The weight information is also expressed, for example, as evaluation point information that indicates an evaluation point weighted based on the game play situation. By assigning a high evaluation point when the game play situation is exciting (e.g., when a hit is made or a point is scored) and a low evaluation point when the game play situation is not exciting, it is possible to identify footage of exciting moments in the live distribution. The video generation server 30 associates the generated evaluation point information (an example of weight information) with the live video and transmits it to the video distribution server 40 via the network NW.

The video distribution server 40 receives and stores the live video transmitted from the video generation server 30, and distributes (live distributes) the received live video to multiple viewing terminals 50 via the network NW by streaming. Hereinafter, "the video distribution server 40 distributing to the viewing terminals 50 via the network NW" will simply be referred to as "the video distribution server 40 distributing to the viewing terminals 50."

The viewing terminal 50 displays live video streamed from the video distribution server 40. Furthermore, if a viewer starts watching the live stream partway through rather than from the beginning (beginning), the viewing terminal 50 can display a digest video of the unwatched time from the start of the live stream until the viewer starts watching.

Figure 2 shows an example of the display screen of the viewing terminal 50 according to this embodiment. The entire screen area G11 of the illustrated display screen G10 displays live video streamed from the video distribution server 40. The display screen G10 also displays a "digest playback button B10" as an operator for playing digest video. When a viewer touches the digest playback button B10 to view digest video during live streaming, a signal (hereinafter referred to as a "distribution request") requesting the distribution of digest video is sent from the viewing terminal 50 to the video distribution server 40. In response to this distribution request, the video distribution server 40 generates digest video for the time the viewer has not yet viewed the video, and streams the digest video (digest distribution) to the viewer's viewing terminal 50.

Specifically, the video distribution server 40 stores user information identifying each of multiple viewers, and by acquiring the viewing start time of each viewer, associates and stores the user information with the viewing start time. This allows the video distribution server 40 to identify the unviewed time of each viewer of the live video being distributed. The viewing start time is information (hereinafter referred to as "time designation information") for specifying the playback time of the digest video requested by the viewer (i.e., the unviewed time) within the playback time of the live video. The time designation information associated with the user information may be any information that can identify the unviewed time, and may be one or more of the viewing start time, viewing end time, unviewed time, and viewing time.

When the video distribution server 40 receives a digest video distribution request from one of multiple viewing terminals 50, it generates a digest video for the unviewed time specified by the time designation information associated with the user information included in the distribution request (i.e., the user information of the requesting viewing terminal 50). The video distribution server 40 then streams the generated digest video to the requesting viewing terminal 50.

For example, as shown in Figure 2, when digest video is distributed from video distribution server 40, viewing terminal 50 displays the digest video in a sub-screen screen area SG10 that is smaller than the screen area G11 in which the live video is displayed. Note that the example of the display screen for the live video and digest video shown in Figure 2 is just one example, and the size and position of the screen area in which each video is displayed are not limited to this example.

In addition, the video distribution server 40 stores the evaluation point information associated with the live video and transmitted from the video generation server 30, and by using the evaluation point information when generating the digest video, it is possible to generate a digest video that prioritizes the most exciting moments in the live broadcast.

The configuration of each part of the video distribution system 1 according to this embodiment will be described in detail below.
[Hardware configuration]
First, a description will be given of the hardware configuration of each unit of the video distribution system 1 according to this embodiment. Fig. 3 is a block diagram showing an example of a schematic configuration of a computer according to this embodiment.
For example, each of the game machine 10, video and audio operation device 20, video generation server 30, video distribution server 40, and viewing terminal 50 shown in Figure 1 has some or all of the components of the computer 100 shown in the figure.

The computer 100 has a hardware configuration including a CPU (Central Processing Unit) 101, RAM (Random Access Memory) 102, ROM (Residual Only Memory) 103, a storage device 104, a communication unit 105, an input unit 106, and an output unit 107.

The CPU 101 is a processor that performs various processes by executing programs stored in the ROM 103 or the storage device 104.

RAM 102 is used as a reading area for programs executed by CPU 101, or as a working area for writing data used in processing by those programs.

ROM 103 is composed of electrically rewritable non-volatile memory such as an EEPROM (Electrically Erasable Programmable Read Only Memory) or flash ROM. For example, ROM 103 stores at least a portion of the system program and programs that execute various processes.

The storage device 104 is configured to include a hard disk drive (HDD), a solid state drive (SSD), etc. For example, the storage device 104 may store at least a portion of the system program, programs that execute various processes, etc. The storage device 104 also stores data required for various processes, data to be acquired, etc.

The communication unit 105 connects to the network NW via a wireless LAN (Local Area Network) or a wired LAN to communicate data with other devices and equipment. The communication unit 105 may also be equipped with an interface such as a short-range wireless communication interface like Bluetooth (registered trademark) or a USB (Universal Serial Bus) to communicate data with peripheral devices.

The input unit 106 includes input devices such as a keyboard, touchpad, touch panel, and microphone. The game console 10 includes an interface as the input unit 106 that connects to the controllers 11A and 11B. The controllers 11A and 11B may be built into the game console 10. The audiovisual control device 20 includes an interface as the input unit 106 that connects to the microphone 21, camera 22, and operation panel 23. The microphone 21, camera 22, and operation panel 23 may be built into the audiovisual control device 20.

The output unit 107 includes a display unit such as a liquid crystal display or an organic EL display, and an output device such as a speaker. Note that the output unit 107 (e.g., a display unit or a speaker) may be connected as an external output device.

Next, the functional configurations of the video generation server 30 and the video distribution server 40 included in the video distribution system 1 will be described.
[Video generation server functional configuration]
First, the functional configuration of the video generation server 30 will be described.
FIG. 4 is a block diagram showing an example of the functional configuration of the moving image generating server 30 according to this embodiment.

The video production server 30 has the following functional components realized by executing a program stored in the video production server 30: a video and audio acquisition unit 31, a live video production unit 32, a play status acquisition unit 33, an evaluation point information generation unit 34, and a transmission unit 35.

The video and audio acquisition unit 31 acquires game play video and audio output from the game console 10. The video and audio acquisition unit 31 also acquires video and audio of the commentator or analyst output from the video and audio operation device 20.

The live video generation unit 32 generates live video of gameplay based on gameplay video of the game being played on the game console 10. For example, the live video generation unit 32 generates live video of the game that combines gameplay video and audio with video and audio of a commentator or analyst.

The play status acquisition unit 33 acquires information about the play status of a game being played on the game machine 10. Information about the game play status includes information about events that occur during the progress of the game. For example, in the case of a baseball game, information about the game play status includes information about events that occur as the baseball game progresses, such as hits, home runs, runs scored, and comebacks.

The evaluation point information generation unit 34 generates evaluation point information based on information about the game play status acquired by the play status acquisition unit 33. Specifically, the evaluation point information generation unit 34 generates evaluation point information that associates the playback time corresponding to the time from the start of the live game broadcast with an evaluation point weighted based on the game play status. For example, in the case of a baseball game, evaluation points are set in advance according to the game play status (hits, home runs, runs, comebacks, etc.). The more exciting and interesting a scene is, the higher the evaluation point value is set.

(Example of evaluation score information)
FIG. 5 is a diagram illustrating an example of how evaluation points are set according to this embodiment. In the illustrated example of how evaluation points are set, evaluation points are set for each event that occurs during the game as a game play situation. For example, a first base hit is scored as "1 point," a second base hit as "2 points," a triple base hit as "2 points," and a solo home run as "3 points." Thus, higher evaluation points are set for doubles and triples than for first base hits, and even higher evaluation points are set for solo home runs. Furthermore, even for home runs, a grand slam is scored as a higher evaluation point than a solo home run. For example, the evaluation point information generator 34 generates evaluation point information that associates the playback time of the live video with the evaluation points shown in FIG. 5 .

The game play status may be any status that corresponds to the progress of the game, and can be set arbitrarily depending on the type of game, etc. For example, in the case of a soccer game, the game play status may include the contents of events that occur as the soccer game progresses, such as kick-offs, shots, goals, player substitutions, free kicks, and penalty kicks.

Figure 6 is a diagram showing an example of evaluation point information according to this embodiment. For example, the evaluation point information divides the playback time of the live video into chapters, and associates the playback time and evaluation point for each chapter in chronological order from the start of the live broadcast. The evaluation point associated with each chapter is the cumulative value of evaluation points based on the gameplay situation (occurring events) within each chapter. For example, as shown in Figure 6 (A), if the chapters are divided in the order of "00:00" (0 minutes 0 seconds) when the live broadcast starts, "00:20" (0 minutes 20 seconds), "01:00" (1 minute 0 seconds), and so on, evaluation point information is generated that associates the playback time and evaluation point for each chapter, as shown in Figure 6 (B).

In the example of rating point information shown, chapter "#00" has a playback time of "00:00:00 - 00:19:99" and a rating point of "0 points." Chapter "#01" has a playback time of "00:20:00 - 00:59:99" and a rating point of "2 points." Chapter "#02" has a playback time of "01:00:00 - 02:59:99" and a rating point of "1 point." Chapter "#03" has a playback time of "03:00:00 - 05:29:99" and a rating point of "8 points." Note that the playback times associated with the rating point information shown in this figure are expressed in decimal seconds; "00:20:00" indicates 0 minutes 20 seconds (0 minutes 20 seconds 00), but the decimal points will be omitted as appropriate in the following explanation.

In this way, the evaluation point information generation unit 34 calculates the evaluation points for each chapter as time passes from the start of the live broadcast, and sequentially generates and updates evaluation point information that associates the playback time and evaluation point for each chapter. Because this evaluation point information is generated based on the game play status, it is common information for all viewers.

Chapters can be set arbitrarily. For example, in the case of a baseball game, a chapter could be set for each ball thrown by the pitcher to the batter, or for each individual batter. A chapter could be set to 15 seconds before or after the occurrence of an event that earns evaluation points. Chapters could also be set at preset intervals (e.g., 30 seconds).

Note that the playback time associated with the rating score in the rating score information is not limited to the playback time for each chapter, and may be associated with the playback time in any format. For example, the playback time of an event that has occurred may be associated with the rating score for that event, without dividing it into chapters.

The transmission unit 35 transmits the live video generated by the live video generation unit 32 to the video distribution server 40 via streaming. The transmission unit 35 also associates the evaluation point information generated by the evaluation point information generation unit 34 with the live video and transmits it to the video distribution server 40.

[Video distribution server functional configuration]
Next, the functional configuration of the video distribution server 40 will be described.
FIG. 7 is a block diagram showing an example of the functional configuration of the video distribution server 40 according to this embodiment.

The video distribution server 40 has the following functional components realized by executing a program stored in the video distribution server 40: a live video acquisition unit 41, a live video storage unit 42, a rating point information acquisition unit 43, a rating point information storage unit 44, a user information acquisition unit 45, a user information storage unit 46, a digest generation unit 47, and a distribution unit 48.

The live video acquisition unit 41 receives live video transmitted from the video generation server 30 and stores it in the live video storage unit 42. The distribution unit 48 distributes the received live video to multiple viewing terminals 50 by streaming.

The evaluation point information acquisition unit 43 receives evaluation point information associated with the live video transmitted from the video generation server 30 and stores it in the evaluation point information storage unit 44.

The user information acquisition unit 45 acquires user information identifying each viewer (user) watching live video on multiple viewing terminals 50 and stores it in the user information storage unit 46. This user information corresponds to, for example, the user information at the time of user registration for an application that plays live video on the viewing terminal 50. When user registration is performed on the viewing terminal 50, the user information acquisition unit 45 acquires the user information from the viewing terminal 50. Note that when user registration is performed on a device other than the viewing terminal 50 (for example, a personal computer), the user information acquisition unit 45 acquires the user information from the device on which the user registration was performed.

Furthermore, the time at which a viewer starts watching the live broadcast on the viewing terminal 50 varies from viewer to viewer. Therefore, when viewing of the live video starts on the viewing terminal 50, the user information acquisition unit 45 acquires the viewing start time from the viewing terminal 50, associates the user information of the viewer of the viewing terminal 50 with the viewing start time, and stores this as time designation information in the user information storage unit 46.

(Example of time specification information)
FIG. 8 is a diagram showing a first example of time designation information according to this embodiment. In the illustrated example of time designation information, user information (account ID), identification information identifying the live video to be viewed (viewed video ID), a viewing start time, and an unviewed time are associated with each other. The viewing start time of a viewer who has been watching the live broadcast from the beginning is, for example, "00:00." The viewing start time of a viewer who has started watching the live broadcast partway through is a time after "00:00," and the time from the live broadcast start time to the viewing start time is set as the unviewed time. In the illustrated example, the viewer's viewing start time is "05:40," so the unviewed time is set as "00:00 to 05:40." The viewing start time and the unviewed time may be stored in standard time (such as Japan Standard Time).

Note that if a viewer starts watching a live broadcast on the viewing terminal 50 but then stops watching midway through the broadcast, the time from when they stop watching until they resume watching will also be considered unwatched time. Therefore, the user information acquisition unit 45 may acquire not only the viewing start time from the viewing terminal 50 but also the viewing end time, and determine the unwatched time based on the viewing start time and viewing end time. Figure 9 shows an example of time designation information that includes the unwatched time from when they stopped watching midway through the broadcast until they resumed watching.

Figure 9 is a diagram showing a second example of time designation information according to this embodiment. In the example of time designation information shown, user information (account ID), identification information identifying the live video to be viewed (video ID to be viewed), viewing start time, viewing end time, and unviewed time are associated with each other, for example. The time from the viewing end time "11:10" to the viewing start time "12:50" is also set as unviewed time.

Note that the time designation information may be managed collectively as unviewed time, including the viewing start time and viewing end time. FIG. 10 is a diagram showing a third example of time designation information according to this embodiment. In the example of time designation information shown in the figure, as an example, user information (account ID), identification information identifying the live video to be viewed (viewed video ID), and unviewed time are associated with each other.

When the digest generation unit 47 receives a digest video distribution request sent from the viewing terminal 50, it generates digest video based on the time designation information and evaluation point information associated with the user information of the viewer of that viewing terminal 50. This digest video is a digest video of the unviewed time specified by the time designation information from the live video being distributed (live video stored in the live video storage unit 42).

For example, the digest generation unit 47 determines, based on the evaluation point information, one or more periods and the playback order of the unviewed live video identified by the time designation information to be played as digest video, and generates a digest list indicating the periods and playback order to be played as digest video.

The length of the digest video generated is generated so that it fits within a predetermined time (for example, 3 minutes). If the digest video is too long, it is undesirable because it takes time to grasp important scenes from the unviewed portion of the video. This predetermined time may be set in advance, or the viewer may be able to select from options such as "1 minute," "3 minutes," or "5 minutes" displayed on the display unit of the viewing terminal 50.

(Generating a digest list)
An example of a method for generating a digest list will be described with reference to Figures 11 to 13. Here, the length of the digest video to be generated is three minutes (or less). Figure 11 is a diagram showing an example of unviewed chapters and evaluation points according to this embodiment. This diagram shows an example of unviewed chapters from the start of the live broadcast at "00:00" to the start of viewing at "05:40" in chronological order, along with the duration (in seconds) and evaluation points for each chapter, assuming that viewing begins 5 minutes and 40 seconds after the start of the live broadcast.

The evaluation scores for unviewed chapters "#00," "#01," "#02," "#03," "#04," and "#05" are "0 points," "2 points," "1 point," "8 points," "4 points," and "5 points," respectively. Note that while viewing began 5 minutes and 40 seconds into chapter "#06," the evaluation score of "6 points," based on the gameplay from the start of chapter "#06" until before viewing began (05:39:99), will be provisionally considered the evaluation score for chapter "#06."

Figure 12 is a diagram showing an example of rating point information for the unviewed time of the live broadcast shown in Figure 11. As explained with reference to Figure 6, the playback time and rating point for each chapter are associated in chronological order from the start of the live broadcast and stored as rating point information. This figure shows only the rating point information for the unviewed time. Note that the time (in seconds) of each chapter is shown to make the length of each chapter easier to understand, but it does not have to be included in the rating point information.

The digest generation unit 47 selects chapters to be included in the digest video in descending order of evaluation score so that the total time (number of seconds) of the chapters falls within 180 seconds (3 minutes).
13 is a diagram showing an example of selecting chapters to be included in a digest video according to the present embodiment. As shown in (A) of FIG. 13, when chapters are arranged in descending order of evaluation score, the total time for chapters "#03" (evaluation score: 8 points), "#06" (evaluation score: 6 points), "#05" (evaluation score: 5 points), and "#04" (evaluation score: 4 points) is 160 seconds. Including the next highest evaluation score, chapter "#01" (evaluation score: 2 points), brings the total time to 200 seconds. Since the total time would exceed 180 seconds if chapter "#01" were included, the digest generation unit 47 selects chapters "#03,""#06,""#05," and "#04" as chapters to be included in the digest video so that the total time does not exceed 180 seconds, resulting in a 160-second digest video.

When the selected chapters are arranged in chronological order from the start of the live broadcast, the order is chapters "#03," "#04," "#05," and "#06," as shown in Figure 13 (B). The digest generation unit 47 generates a digest list in which chapters "#03," "#04," "#05," and "#06" are played in this order.

The digest generation unit 47 may generate a digest list in which chapters are played in descending order of evaluation points, rather than rearranging them in the order of live distribution. This allows the digest video to be created in which the most exciting scenes are given priority in being played first.

The digest generation unit 47 may also add, for example, 20 seconds of video from chapter "#01" so that the length of the digest video is 180 seconds (3 minutes).

The distribution unit 48 streams digest video, which is live video played back in accordance with the digest list generated by the digest generation unit 47, to the viewing terminal 50 that sent the distribution request. For example, if the distribution unit 48 receives a digest video distribution request from one of the viewing terminals 50 while streaming live video to multiple viewing terminals 50, it streams the digest video to the viewing terminal 50 that made the digest video distribution request.

(Digest video from the intermission)
In the above, a configuration has been described in which digest video of unviewed time is distributed from the video distribution server 40 in response to a distribution request from the viewing terminal 50 and can be viewed on the viewing terminal 50. However, digest video may also be distributed during intermissions. Intermissions are the time between matches of a live-streamed game, during which players (e.g., athletes participating in an e-sports match) are replaced, filming sets are switched, and so on. Furthermore, digest video may also be distributed during intermissions when game play is interrupted due to the occurrence of some kind of trouble. Such digest video distributed during intermissions is hereinafter referred to as "intermission digest video."

The intermission digest video is generated from video extracted from gameplay video before the intermission based on evaluation point information, and is distributed, for example, to the viewing terminals 50 of all viewers. Therefore, the intermission digest video will have the same content for all viewers, for example.

However, a digest video of three minutes (or less) length extracted from the unviewed live video may be distributed as an intermission digest video to the viewing terminal 50 of a viewer who started watching partway through a live broadcast (a viewer who is determined to have unviewed time based on the user information). The content of the digest video of the unviewed time is basically the same as the content of the digest video generated in response to a distribution request from the viewing terminal 50 described above, but it may be different.

If the intermission time does not end in three minutes, the intermission digest video will be played repeatedly (looped) on the viewing terminal 50. Viewers who have been watching from the start of the live broadcast (viewers who are determined to have no unviewed time based on their user information) will be distributed the generated intermission digest video regardless of the unviewed time.

For example, when an operator (or commentator, commentator, etc.) operates an "intermission time button" (not shown) on the operation panel 23 of the video and audio control device 20, an intermission signal is output from the video and audio control device 20. This intermission signal is a signal that instructs the distribution of an intermission digest video. The intermission signal output from the video and audio control device 20 is transmitted to the video distribution server 40. The intermission signal may also be transmitted to the video distribution server 40 via the video generation server 30. The video distribution server 40 generates an intermission digest video in response to the intermission signal from the video and audio control device 20 and distributes it via streaming.

[Video distribution processing operation]
Next, the operation of the video distribution process by the video distribution system 1 will be described.
FIG. 14 is a flowchart showing an example of a video distribution process according to this embodiment.

The illustrated flowchart shows the relative states of the operations of the game console 10, audio and video control device 20, video production server 30, video distribution server 40, and viewing terminal 50. The game console 10, audio and video control device 20, video production server 30, video distribution server 40, and viewing terminal 50 are all assumed to be synchronous (for example, one cycle is 1/60 seconds) and to repeatedly (loop) execute processing.

The game console 10 repeatedly (loops) executes steps S100 to S105 while a game (e.g., a match) is in progress. For example, the game console 10 outputs gameplay video and audio of the game being played on the game console 10 to the video production server 30 (step S101). The game console 10 also outputs information related to the game play status to the video production server 30 (step S103). The game console 10 repeatedly executes steps S101 and S103 while a game (e.g., a match) is in progress.

The video and audio control device 20 repeatedly (loops) executes steps S200 to S207. For example, the video and audio control device 20 transmits video from a camera 22 capturing a commentator or analyst and audio input from a microphone 21 to the video generation server 30 (step S201).

The audio-visual control device 20 also determines whether it is an intermission time (step S203). For example, the audio-visual control device 20 detects operation of an intermission time button (not shown) on the operation panel 23, and determines that it is an intermission time if it detects that operation has been performed. If the audio-visual control device 20 determines that it is an intermission time (step S203: YES), it outputs an intermission signal (step S205). On the other hand, if the audio-visual control device 20 determines that it is not an intermission time (step S203: NO), it does not output an intermission signal. The audio-visual control device 20 repeatedly executes the processes of steps S201, S203, and S205.

The intermission signal output from the audiovisual control device 20 is transmitted to the video distribution server 40. Note that the intermission signal may also be transmitted to the video distribution server 40 via the video generation server 30.

The video production server 30 repeatedly (loops) executes the processing of steps S300 to S307. For example, the video production server 30 generates live video of the game by combining the gameplay video and audio output from the game console 10 in step S101 with the commentator or analyst video and audio output from the video and audio control device 20 in step S201 (step S301). The video production server 30 then transmits the generated live video to the video distribution server 40 via streaming (live streaming output) (step S303).

The video generation server 30 also acquires information about the game play status output from the game console 10, generates evaluation score information that associates the playback time of the live game video with an evaluation score based on the game play status, and transmits this information to the video distribution server 40 (step S305). The video generation server 30 repeatedly executes the processes of steps S301, S303, and S305.

The video distribution server 40 repeatedly (loops) executes steps S400 to S420. For example, the video distribution server 40 receives and stores live video (live streaming) transmitted by streaming from the video production server 30 in step S303 (step S401). The video distribution server 40 also receives and stores evaluation point information transmitted from the video production server 30 in step S305 (step S403).

Meanwhile, the viewing terminal 50 repeatedly (loops) executes steps S500 to S513 as the viewer watches the live stream. Note that while only one viewing terminal 50 is shown in this diagram, in actual processing, multiple viewing terminals 50 communicate with the video distribution server 40. For example, when a viewer starts watching live video through live streaming, the viewing terminal 50 sends a live streaming request to the video distribution server 40 (step S501). Note that this live streaming request is sent from the viewing terminal 50 to the video distribution server 40 not only at the start of the live streaming, but also repeatedly while the viewer is watching the live streaming on the viewing terminal 50. In other words, the live streaming request can be considered a signal indicating that the viewer is currently watching a live stream.

When the video distribution server 40 receives a live streaming request from the viewing terminal 50, it updates the user information corresponding to the viewer of the viewing terminal 50 that received the request (step S405). For example, the video distribution server 40 associates the user information with the viewing start time and stores it as time designation information. Note that, as mentioned above, the time designation information may also include the unviewed time, etc.

The video distribution server 40 also determines whether it is an intermission time based on whether it has received an intermission signal output from the video and audio control device 20 (step S407). If it has received an intermission signal, the video distribution server 40 determines that it is an intermission time (step S407: YES) and generates a digest list for the intermission digest video based on the evaluation score information of the gameplay video before the intermission (step S409). The video distribution server 40 then streams the intermission digest video to multiple viewing terminals 50 (step S411). When the viewing terminal 50 receives the intermission digest video streamed from the video distribution server 40, it plays and displays the received intermission digest video (step S503).

On the other hand, if the video distribution server 40 does not acquire an intermission signal, it determines that it is not an intermission time (step S407: NO) and streams the live video to multiple viewing terminals 50 (step S413). When the viewing terminal 50 receives the live video streamed from the video distribution server 40, it plays back and displays the received live video (step S505).

During the live broadcast, the viewing terminal 50 also determines whether a touch operation has been performed on, for example, the digest playback button B10 (see FIG. 2) (step S507). If the viewing terminal 50 determines that a touch operation has been performed on the digest playback button B10 (step S507: YES), it transmits a digest video distribution request to the video distribution server 40 (step S509).

The video distribution server 40 determines whether a digest video distribution request has been received (step S415). If the video distribution server 40 determines that a digest video distribution request has been received (step S415: YES), it identifies the unviewed time by referencing the user information of the viewer of the viewing terminal 50 that sent the digest video distribution request, and generates a digest list of the unviewed time based on the evaluation point information (step S417). The video distribution server 40 then streams the digest video of the unviewed time to the viewing terminal 50 that sent the digest video distribution request in accordance with the generated digest list (step S419). When the viewing terminal 50 receives the digest video streamed from the video distribution server 40, it plays and displays the received digest video (step S511).

The video distribution server 40 repeatedly executes the processes of steps S401, S403, S405, S407, S409, S411, S413, S415, S417, and S419 described above. The viewing terminal 50 repeatedly executes the processes of steps S501, S503, S505, S507, S509, and S511 described above.

In the above process, the digest video (digest list) is generated when a digest video distribution request is sent from the viewing terminal 50 to the video distribution server 40 in step S509, but the digest video (digest list) may be generated before the digest video distribution request is sent. For example, if a viewer starts watching partway through a live broadcast, the unwatched time can be determined in response to the live broadcast request sent from the viewing terminal 50 to the video distribution server 40 in step S501. Therefore, the digest video (digest list) may be generated in advance between the time the live broadcast request is sent and the time the digest video distribution request is sent.

In the above process, an example has been described in which an intermission signal is output from the audiovisual control device 20 in response to operation by a commentator, analyst, or operator. However, an intermission signal may also be output from the game console 10 in response to the progress of the game. For example, the game console 10 may output an intermission signal indicating that it is an intermission time between matches at the end of game play (the end of a match) in response to the progress of the game. Alternatively, the game console 10 may continue to output the intermission signal until the start of the next match, and end output of the intermission signal immediately before the start of the next match. When the video distribution server 40 acquires an intermission signal from the game console 10, it streams an intermission digest video.

For example, the digest generation unit 45 generates a digest list of the intermission digest video when an intermission signal is received from the game console 10. The distribution unit 46 streams the intermission digest video, which is obtained by playing back the live video in accordance with the digest list generated by the digest generation unit 45 in response to the reception of the intermission signal from the game console 10, to multiple viewing terminals 50.

Summary of the embodiment
As described above, the video distribution system 1 according to the present embodiment distributes live video of game play on a game console 10 (an example of a game device) via streaming to multiple viewing terminals 50 (an example of a terminal) connected to a network NW. The video distribution system 1 includes a live video generation unit 32, a play status acquisition unit 33 (an example of an acquisition unit), an evaluation point information generation unit 34 (an example of a weighting information generation unit), a user information storage unit 46 (an example of a storage unit), a digest generation unit 47, and a distribution unit 48. The live video generation unit 32 generates live video based on game play video of the game played on the game console 10. The play status acquisition unit 33 acquires information regarding the play status of the game played on the game console 10. The evaluation point information generation unit 34 generates evaluation point information (an example of weighting information) that associates a playback time (an example of time information) corresponding to the time from the start of the live video with an evaluation point (an example of weighting) based on the play status of the game. The user information storage unit 46 stores user information identifying each of multiple viewers (users). The digest generation unit 47 generates a digest video of the live video for a period (e.g., an unviewed period) specified by the time specification information based on the time specification information and the evaluation point information associated with the first user information of the user information. The distribution unit 48 distributes the live video by streaming to the plurality of viewing terminals 50, and distributes the digest video by streaming to the viewing terminal 50 (an example of a first terminal) specified by the first user information among the plurality of viewing terminals 50.

As a result, during the live distribution of gameplay, the video distribution system 1 generates and distributes a digest video of the live video for a period (e.g., unviewed time) specified by the viewer (user) based on the game play status for each viewer, allowing viewers who were unable to watch a portion of the live distribution to easily grasp the important scenes from that period in a short amount of time. Therefore, even if a viewer was unable to watch a portion of the live distribution, they can easily grasp the important scenes from that period and share the excitement with other viewers.

For example, the digest generation unit 47 determines, based on the evaluation point information, one or more periods of live video footage to be played as digest video and the order in which they will be played, from the period (e.g., unviewed time) specified by the time designation information, and generates a digest list indicating the periods and order in which they will be played as digest video. The distribution unit 48 streams the digest video, which is the live video footage played in accordance with the digest list generated by the digest generation unit 47.

As a result, when generating digest video, the video distribution system 1 determines one or more periods of the live video to be played as digest video and the playback order based on the game play status, allowing viewers to easily grasp important scenes by watching the digest video.

Furthermore, if the distribution unit 48 receives a request (an example of a request) for distribution of a digest video from a viewing terminal 50 identified by the above-mentioned first user information while streaming live video to multiple viewing terminals 50, the distribution unit 48 streams the digest video to that viewing terminal 50.

This allows the video distribution system 1 to allow viewers to watch digest footage at any time during the live distribution of gameplay, allowing viewers who were unable to watch a portion of the live distribution to easily grasp important scenes from that period.

The video distribution system 1 also includes a video and audio operation device 20 (an example of a video and audio operation unit) for operating commentary, commentary, or video and audio related to game play on the game machine 10. When the distribution unit 48 receives a signal (e.g., an intermission signal) from the video and audio operation device 20 in response to operation by a commentator, analyst, or operator instructing the distribution of intermission digest video (an example of digest video), it distributes the intermission digest video via streaming.

This allows the video distribution system 1 to distribute a digest video of what has happened up to that point to all viewers watching the live video at any timing desired by the live video provider. For example, by distributing a digest video of what has happened up to that point during an intermission, the video distribution system 1 can prevent viewers from stopping watching the live broadcast during the intermission.

The distribution unit 48 may also stream intermission digest video (an example of digest video) based on a signal obtained from the game device 10 according to the progress of the game (for example, an intermission signal transmitted from the game device 10 at the end of the game (end of the match)).

This allows the video distribution system 1 to automatically distribute intermission digest videos according to the progress of the game, eliminating the need for commentators, analysts, or operators to operate the system, providing greater convenience.

In addition, information about game play status includes information about events that occur during the game.

This allows the video distribution system 1 to distribute digest video containing important scenes based on events that occur during the game (e.g., hits, home runs, runs scored, comebacks, etc.).

Furthermore, the above rating information is common to multiple viewers (users).

As a result, even if a viewer is unable to watch a portion of a live broadcast, the video distribution system 1 allows them to view a digest video containing scenes prioritized for that period according to the evaluation score information common to multiple viewers. This allows them to understand the important scenes from that period in the same way as other viewers, and share in the excitement with other viewers.

In addition, the time designation information associated with the user information is information corresponding to the unviewed time during which the viewer identified by the user information has not viewed the live video.

As a result, during a live broadcast of gameplay, the video distribution system 1 can distribute digest video of the unviewed portion of the live broadcast to viewers who were unable to view the entire broadcast. This allows viewers to easily grasp important scenes from the unviewed portion in a short amount of time.

The viewing terminal 50 also displays live video streamed from the distribution unit 48 in the screen area G11 of the display unit, and when digest video streamed from the distribution unit 48, displays the digest video in the screen area SG10 of the sub-screen, which is smaller than the screen area G11 in which the live video stream is displayed.

This makes the video distribution system 1 more convenient because viewers can watch digest footage in addition to live footage during live distribution.

Furthermore, according to this embodiment, a control method for a video distribution system 1 that streams live video of game play on a game console 10 (an example of a game device) to a plurality of viewing terminals 50 (an example of a terminal) connected to a network NW includes the steps of: a live video generation unit 32 generating live video based on game play video of the game being played on the game console 10; a play status acquisition unit 33 (an example of an acquisition unit) acquiring information regarding the play status of the game being played on the game console 10; and an evaluation point information generation unit 34 (an example of a weight information generation unit) associating a playback time (an example of time information) corresponding to the time from the start of the live video with an evaluation point (an example of weighting) based on the game play status. the digest generation unit 47 generating a digest video of the live video for a period (e.g., unviewed time) specified by the time designation information based on time designation information and evaluation point information associated with first user information among the user information identifying each of the multiple viewers (users) stored in the user information storage unit 46 (an example of a storage unit); the distribution unit 48 streaming the live video to the multiple viewing terminals 50; and the distribution unit 48 streaming the digest video to the viewing terminal 50 (an example of a first terminal) identified by the first user information among the multiple viewing terminals 50.

As a result, the control method in video distribution system 1 generates and distributes a digest video of the live video for a period (e.g., unviewed time) specified by the viewer (user) during live gameplay distribution for each viewer based on the game play status, allowing viewers who were unable to watch a portion of the live distribution to easily grasp important scenes from that period in a short amount of time. Therefore, even if a viewer was unable to watch a portion of the live distribution, they can easily grasp important scenes from that period and share the excitement with other viewers.

In addition, the program of this embodiment causes a computer in a video distribution system 1, which streams live video of game play on a game console 10 (an example of a game device) to multiple viewing terminals 50 (an example of a terminal) connected to a network NW, to execute the following steps: generating live video based on game play video of the game played on the game console 10; acquiring information regarding the play status of the game played on the game console 10; generating evaluation point information (an example of weighting information) that associates a playback time (an example of time information) corresponding to the time from the start of the live video with an evaluation point (an example of weighting) based on the play status of the game; generating digest video of a period of the live video specified by the time designation information (e.g., unviewed time) based on time designation information and evaluation point information associated with first user information among the user information identifying each of multiple viewers (users) stored in a user information storage unit 46 (an example of a storage unit); streaming the live video to the multiple viewing terminals 50; and streaming the digest video to a viewing terminal 50 (an example of a first terminal) among the multiple viewing terminals 50 that is identified by the first user information.

As a result, during the live broadcast of gameplay, the program generates and broadcasts a digest video of the live footage for a period (e.g., unviewed time) specified by the viewer (user) based on the game play status for each viewer, allowing viewers who were unable to watch a portion of the live broadcast to easily grasp the important scenes from that period in a short amount of time. Therefore, even if a viewer was unable to watch a portion of the live broadcast, they can easily grasp the important scenes from that period and share the excitement with other viewers.

Although embodiments of the present invention have been described in detail above with reference to the drawings, the specific configurations are not limited to the above-described embodiments and include designs that do not deviate from the gist of the present invention. For example, the above-described configurations can be combined in any desired manner.

[Modification]
(1) Generating Evaluation Points Based on Commentary and Analysis In the above embodiment, an example was described in which evaluation point information was generated based on information about the game play situation on the game machine 10. However, evaluation point information may also be generated based on other information. For example, the audiovisual control device 20 may detect the level of excitement based on the volume of the voice of the commentator or commentator input to the microphone 21, and generate evaluation point information by associating the evaluation points based on the level of excitement with the playback time of the live video. Alternatively, the audiovisual control device 20 may detect the level of excitement by converting the voice of the commentator or commentator into text and analyzing the content of the voice, and generate evaluation point information by associating the evaluation points based on the level of excitement with the playback time of the live video. Furthermore, the audiovisual control device 20 may detect the level of excitement based on the volume and content of the voice of the commentator or commentator, and generate evaluation point information by associating the evaluation points based on the level of excitement with the playback time of the live video.

In other words, the video distribution system 1 further includes a video and audio operation device 20 (an example of a video and audio operation unit) for operating commentary, commentary, or video and audio related to game play on the game console 10. The information related to the game play status includes information related to commentary or commentary on the game play status.

This allows the video distribution system 1 to distribute digest video that includes important scenes when the commentary or commentary on the game play situation is exciting.

(2) Generating a Digest List When There Is Unviewed Time During a Live Streaming As described in the above embodiment with reference to Figures 9 and 10, if a viewer starts watching a live streaming broadcast on the viewing terminal 50 and then stops watching during the broadcast, the time from when they stop watching until when they resume watching will also be counted as unviewed time. While an example of generating a digest list from the start of the live streaming to the start of viewing has been described with reference to Figures 11 to 13, here we will describe an example of generating a digest list when there is unviewed time during the live streaming broadcast.

Figure 15 shows a modified example of unviewed chapters and evaluation scores for live streaming according to this embodiment. The example shown shows a case where a viewer starts watching 5 minutes and 40 seconds after the start of the live streaming, and there are two unviewed periods between stopping and resuming viewing of the live streaming, i.e., three unviewed periods. For example, unviewed period 1 is "00:00-05:40," unviewed period 2 is "07:20-08:40," and unviewed period 3 is "11:00-12:50." Examples of chapters for each unviewed period, the length of each chapter (in seconds), and evaluation scores are shown in chronological order.

Please note that the time when you start watching, stop watching, or resume watching may fall in the middle of a chapter. In such cases, the evaluation score up to or from the middle will be provisionally considered as the evaluation score for that chapter.

Figure 16 is a diagram showing an example of rating point information for the unviewed time of the live broadcast shown in Figure 15. As with Figure 12, only the rating point information for the unviewed time is shown, and the time (in seconds) of each chapter is shown to make the length of each chapter easier to understand. The time (in seconds) of each chapter does not need to be included as rating point information.

The rating points for chapters "#00", "#01", "#02", "#03", "#04", "#05", and "#06" in unwatched time 1 are "0 points", "2 points", "1 point", "8 points", "4 points", "5 points", and "4 points", respectively. The rating points for chapters "#11" and "#12" in unwatched time 2 are "6 points" and "1 point", respectively. The rating points for chapters "#20", "#21", and "#22" in unwatched time 3 are "7 points", "2 points", and "1 point", respectively.

The digest generation unit 47 selects chapters to be included in the digest video in descending order of evaluation score so that the total time (number of seconds) of the chapters falls within 180 seconds (3 minutes).
17A and 17B are diagrams illustrating a modified example of the selection of chapters to be included in the digest video according to the present embodiment. As shown in (A) of Fig. 17A, when the chapters are arranged in descending order of evaluation score, the total time for chapters "#03" (evaluation score: 8 points), "#20" (evaluation score: 7 points), "#11" (evaluation score: 6 points), and "#06" (evaluation score: 6 points) is 170 seconds. Including the next highest evaluation score, "#05" (evaluation score: 5 points), brings the total time to 210 seconds. Since the total time exceeds 180 seconds if chapter "#05" is included, the digest generation unit 47 selects chapters "#03,""#20,""#11," and "#06" as chapters to be included in the digest video so that the total time does not exceed 180 seconds, resulting in a 170-second digest video.

When the selected chapters are arranged in chronological order from the start of the live broadcast, the order is chapters "#03," "#06," "#11," and "#20," as shown in Figure 17 (B). The digest generation unit 47 generates a digest list in which chapters "#03," "#06," "#11," and "#20" are played in this order.

The digest generation unit 47 may generate a digest list in which chapters are played in descending order of evaluation points, rather than rearranging them in the order of live distribution. This allows the digest video to be created in which the most exciting scenes are given priority in being played first.

The digest generation unit 47 may also add, for example, 10 seconds of video from chapter "#05" so that the length of the digest video is 180 seconds (3 minutes).

(3) Playback of digest video from the start of viewing of live streaming In the above embodiment, a configuration has been described in which a viewer touches the digest playback button B10 when they want to view a digest video, or a digest video is played during an intermission. However, the present invention is not limited to this. If a viewer starts viewing a live streaming midway through, a digest video of the unviewed portion of the live streaming may be played first, and then the digest video may be switched to playback of the live video once the viewer has caught up with the live streaming.

For example, when the distribution unit 48 receives a request to view live video (e.g., a live distribution request) from the viewing terminal 50 identified by the first user information, it streams a digest video to the viewing terminal 50 before starting distribution of the live video, and then streams the live video after distribution of the digest video.

This allows the video distribution system 1 to automatically switch to live streaming after a viewer who starts watching partway through a live stream has quickly grasped important scenes from the unwatched time before they began watching. Therefore, even if a viewer starts watching partway through a live stream, they can quickly grasp important scenes from before they began watching and then continue watching the live stream, allowing them to share in the excitement with other viewers.

(4) Playback of Digest Video Without Audio and Display of Captions When the viewing terminal 50 plays back digest video in the screen area SG10 of the sub-screen while simultaneously playing back live video, confusion can easily occur if the audio of the live video and the audio of the digest video are mixed. For this reason, the viewing terminal 50 may play back the digest video without audio. In this case, to express the excitement of the digest video, the viewing terminal 50 may analyze the audio spoken by the commentator or analyst in scenes with high evaluation scores, convert the audio into text, and display captions.

Figure 18 shows a modified example of the display screen of the viewing terminal 50 when playing back digest video without audio according to this embodiment. In the illustrated example, similar to the example of Figure 2, the viewing terminal 50 display screen G10 displays live video in screen area G11, and digest video in screen area SG10 of the sub-screen. In addition, the sub-screen screen area SG10 displays the audio spoken by the commentator as captions (in the illustration, "Home run!"). This makes it easier to hear the audio of the live video, and also allows the content of exciting scenes in the digest video to be recognized through the captions.

(5) Other Modifications In the above embodiment, the video creation server 30 generates the evaluation point information, but the video distribution server 40 may generate the evaluation point information. Also, the game console 10 may generate the evaluation point information. In the above embodiment, the video creation server 30 generates the digest video, but the video creation server 30 may generate the digest video.

Furthermore, a program for implementing the functions of the game console 10, audiovisual control device 20, video production server 30, video distribution server 40, or viewing terminal 50 may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be loaded into a computer system and executed to perform some or all of the processing of the game console 10, audiovisual control device 20, video production server 30, video distribution server 40, or viewing terminal 50. Here, "loading a program recorded on a recording medium into a computer system and executing it" includes installing the program into a computer system. The term "computer system" here includes hardware such as an OS and peripheral devices. Furthermore, a "computer system" may include multiple computer devices connected via a network, including communication lines such as the Internet, WAN, LAN, or dedicated line. Furthermore, a "computer-readable recording medium" refers to portable media such as a flexible disk, optical magnetic disk, ROM, or CD-ROM, as well as storage devices such as a hard disk built into a computer system. In this way, the recording medium storing the program may also be a non-transitory recording medium such as a CD-ROM. The term "recording medium" also includes internal or external recording media accessible from a distribution server for distributing the program. The program code stored on the distribution server's recording medium may be different from the program code in a format executable on a terminal device. In other words, the format in which the program is stored on the distribution server is not important as long as it can be downloaded from the distribution server and installed in a format executable on a terminal device. The program may be divided into multiple parts, downloaded at different times, and then combined on a terminal device, or each part may be distributed by a different distribution server. Furthermore, "computer-readable recording medium" also includes a medium that stores a program for a certain period of time, such as volatile memory (RAM) within a computer system that serves as a server or client when a program is transmitted over a network. The program may also be a medium that implements some of the functions described above. Furthermore, the program may be a so-called differential file (differential program) that can implement the functions described above in combination with a program already stored on the computer system.

Furthermore, some or all of the functions of the above-mentioned game console 10, audiovisual control device 20, video generation server 30, video distribution server 40, or viewing terminal 50 may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each of the above-mentioned functions may be individually implemented as a processor, or some or all of them may be integrated into a processor. Furthermore, the integrated circuit implementation method is not limited to LSI, and may be implemented using a dedicated circuit or a general-purpose processor. Furthermore, if an integrated circuit implementation technology that can replace LSI emerges due to advances in semiconductor technology, an integrated circuit based on that technology may be used.

Furthermore, the game console 10 may be provided with some or all of the configuration of the video and audio operation device 20 described above. Furthermore, the game console 10 may be provided with some or all of the configuration of the video and audio operation device 20. Furthermore, the game console 10, the video and audio operation device 20, and the video generation server 30 may all or some of them be integrated into a single computer device, or may be distributed across multiple computer devices.

Furthermore, the video generation server 30 and video distribution server 40 may be configured as separate servers across multiple computer devices, or may be configured as a single virtual server (video generation and distribution server) on the cloud.

[Note]
From the above description, the present invention can be understood, for example, as follows: Note that, to facilitate understanding of the present invention, reference numerals in the accompanying drawings are conveniently placed in parentheses, but this does not mean that the present invention is limited to the illustrated embodiments.

(Supplementary Note 1) A video distribution system (1) according to one aspect of the present invention is a video distribution system that distributes live video of gameplay on a game device (10) via streaming to multiple terminals (50) connected to a network (NW), and includes a live video generation unit (32) that generates the live video based on gameplay video of the game being played on the game device, an acquisition unit (33) that acquires information regarding the play status of the game being played on the game device, and weighting information (e.g., , evaluation point information); a storage unit (46) that stores user information identifying each of a plurality of users (e.g., viewers); a digest generation unit (48) that generates a digest video of the live video for a period (e.g., unviewed time) specified by the time specification information based on the weight information and time specification information associated with first user information of the user information; and a distribution unit (48) that streams the live video to a plurality of terminals and streams the digest video to a first terminal of the plurality of terminals identified by the first user information.

According to the configuration of Supplementary Note 1, during live gameplay streaming, the video distribution system generates and distributes digest video of live video for a period (e.g., unviewed time) specified by the user (viewer) for each user based on the game play status. This allows users who were unable to watch a portion of the live stream to easily and quickly grasp important scenes from that period. Therefore, even if a user was unable to watch a portion of the live stream, they can easily grasp important scenes from that period and share the excitement with other users.

(Supplementary Note 2) Another aspect of the present invention is the video distribution system described in Supplementary Note 1, wherein the digest generation unit determines, based on the weight information, one or more periods of the live video within a period (e.g., an unviewed period) specified by the time designation information to be played back as the digest video, as well as the playback order, and generates a digest list indicating the periods and playback order to be played back as the digest video; and the distribution unit streams the digest video, which is the live video played back in accordance with the digest list generated by the digest generation unit.

According to the configuration of Appendix 2, when generating digest video, the video distribution system determines one or more periods of live video to play as digest video and the order in which they will be played based on the game play status, allowing users to easily grasp important scenes by watching the digest video.

(Supplementary Note 3) Another aspect of the present invention is the video distribution system described in Supplementary Note 1, wherein when the distribution unit receives a request for the digest video from the first terminal while streaming the live video to the multiple terminals, the distribution unit streams the digest video to the first terminal.

According to the configuration of Appendix 3, the video distribution system allows users to view digest footage at any time during live gameplay distribution, allowing users who were unable to view portions of the live distribution to easily grasp important scenes from that period.

(Supplementary Note 4) Another aspect of the present invention is the video distribution system according to Supplementary Note 1,
The game device further includes a video and audio operation unit (20) for performing operations related to commentary, explanation, or video and audio regarding game play on the game device, and when the distribution unit receives a signal (e.g., an intermission signal) from the video and audio operation unit instructing distribution of the digest video in response to operation by a commentator, an analyst, or an operator, the distribution unit distributes the digest video by streaming.

According to the configuration of Appendix 4, the video distribution system can distribute a digest video of what has happened up to that point to all users watching the live video at any timing desired by the live video provider. For example, by distributing a digest video of what has happened up to that point during an intermission, the video distribution system 1 can prevent users from stopping watching the live broadcast during the intermission.

(Supplementary Note 5) Another aspect of the present invention is the video distribution system described in Supplementary Note 1, in which the distribution unit distributes the digest video by streaming based on a signal obtained from the game device according to the progress of the game (e.g., a signal indicating the end of the game (end of the match), an intermission signal, etc.).

With the configuration of Appendix 5, the video distribution system can automatically distribute digest video according to the progress of the game, eliminating the need for commentators, analysts, or operators, making it highly convenient.

(Supplementary Note 6) Another aspect of the present invention is the video distribution system described in Supplementary Note 1, wherein when the distribution unit receives a request to view the live video (e.g., a live distribution request) from the first terminal, the distribution unit streams the digest video to the first terminal before starting distribution of the live video, and streams the live video after distribution of the digest video.

According to the configuration of Appendix 6, the video distribution system allows a user who starts watching a live broadcast partway through to quickly grasp important scenes from the unwatched time before starting to watch, and then automatically switches to live streaming. Therefore, even if a user starts watching a live broadcast partway through, they can quickly grasp important scenes from before they started watching and continue watching the live broadcast, allowing them to share in the excitement with other users.

(Appendix 7) Another aspect of the present invention is the video distribution system described in Appendix 1, wherein the information relating to the game play status includes information relating to events that occur during the progress of the game.

According to the configuration of Appendix 7, the video distribution system can distribute digest video containing important scenes based on events that occur during the game (e.g., hits, home runs, runs scored, comebacks, etc.).

(Appendix 8) Another aspect of the present invention is the video distribution system described in Appendix 1, further comprising a video and audio operation unit for operating commentary, commentary, or video and audio regarding game play on the game device, and the information regarding the game play status includes information regarding commentary or commentary regarding the game play status.

With the configuration of Appendix 8, the video distribution system can distribute digest video that includes important scenes when the commentary or commentary on the game play situation is exciting.

(Supplementary Note 9) Another aspect of the present invention is the video distribution system described in Supplementary Note 1, wherein the weight information is common to multiple users (e.g., viewers).

According to the configuration of Appendix 9, even if a user is unable to watch a live broadcast for a certain period of time, the video distribution system allows the user to view a digest video containing scenes prioritized for that period according to the evaluation score information shared by multiple users. This allows the user to understand the important scenes from that period in the same way as other users and share in the excitement with other users.

(Appendix 10) Also, one aspect of the present invention is a video distribution system as described in Appendix 1, in which the time designation information associated with the user information is information corresponding to an unviewed time during which the user (e.g., viewer) identified by the user information has not viewed the live video.

According to the configuration of Supplementary Note 10, the video distribution system can distribute digest video of the unviewed portion of a live gameplay broadcast to users who were unable to view the live broadcast. This allows users to easily grasp important scenes from the unviewed portion in a short amount of time.

(Supplementary Note 11) Another aspect of the present invention is the video distribution system described in Supplementary Note 1, in which the terminal displays the live video distributed from the distribution unit in a screen area (G11) of the display unit, and, when the digest video is distributed from the distribution unit, displays the digest video in a screen area (SG10) smaller than the screen area (G11) in which the live video is displayed.

The configuration of Appendix 11 provides a convenient video distribution system, allowing users to view digest video in addition to live video during live distribution.

(Appendix 12) Furthermore, a control method in a video distribution system (1) according to one aspect of the present invention is a control method in a video distribution system that streams live video of game play on a game device (10) to multiple terminals (50) connected to a network (NW), the control method including: a step (S301) in which a live video generation unit (32) generates the live video based on game play video of the game being played on the game device; a step (S305) in which an acquisition unit (33) acquires information regarding the play status of the game being played on the game device; and a weight information generation unit (34) associates time information (e.g., playback time) corresponding to the time from the start of the live video with a weight (e.g., evaluation points) based on the play status of the game. The method includes a step (S305) of generating weight information (e.g., evaluation point information) associated with the first user information among the user information identifying each of the multiple users (e.g., viewers) stored in the storage unit (46), a step (S417) of a digest generation unit (48) generating a digest video of the live video for a period (e.g., unviewed time) specified by the time specification information based on the weight information and time specification information associated with the first user information, and a step (S413) of a distribution unit (48) streaming the live video to the multiple terminals, and a step (S419) of the distribution unit (48) streaming the digest video to a first terminal among the multiple terminals identified by the first user information.

According to the configuration of Supplementary Note 12, the control method in the video distribution system generates and distributes a digest video of the live video for a period (e.g., unviewed time) specified by the user (viewer) during live distribution of gameplay for each user based on the game play status, allowing users who were unable to view the live distribution for a period to quickly and easily grasp the important scenes from that period. Therefore, even if a user was unable to view the live distribution for a period, they can easily grasp the important scenes from that period and share the excitement with other users.

(Appendix 13) Furthermore, a program according to one aspect of the present invention includes a program for causing a computer in a video distribution system (1) that streams live video of game play on a game device (10) to a plurality of terminals (50) connected to a network (NW) to: generate the live video based on game play video of the game being played on the game device (S301); acquire information regarding the play status of the game being played on the game device (S305); and acquire weight information (S306) that associates time information (e.g., playback time) corresponding to the time from the start of the live video with a weighting (e.g., evaluation points) based on the play status of the game. The system executes the steps of: generating (S305) a digest video of a period (e.g., unviewed time) of the live video designated by the time designation information based on the weight information and time designation information associated with first user information among the user information identifying each of the multiple users (e.g., viewers) stored in the storage unit (46); distributing (S413) the live video by streaming to the multiple terminals; and distributing (S419) the digest video by streaming to a first terminal among the multiple terminals identified by the first user information.

According to the configuration of Supplementary Note 13, during a live broadcast of gameplay, the program generates and broadcasts a digest video of the live footage for a period (e.g., unviewed time) specified by the user (viewer) based on the game play status for each user. This allows users who were unable to watch a portion of the live broadcast to easily and quickly grasp the important scenes from that period. Therefore, even if a user was unable to watch a portion of the live broadcast, they can easily grasp the important scenes from that period and share the excitement with other users.

REFERENCE SIGNS LIST 1 Video distribution system, 10 Game machine, 20 Video and audio operation device, 30 Video generation server, 31 Video and audio acquisition unit, 32 Live video generation unit, 33 Play status acquisition unit, 34 Evaluation point information generation unit, 35 Transmission unit, 40 Video distribution server, 41 Live video acquisition unit, 42 Live video storage unit, 43 Evaluation point information acquisition unit, 44 Evaluation point information storage unit, 45 User information acquisition unit, 46 User information storage unit, 47 Digest generation unit, 48 Distribution unit, 50 Viewing terminal, 100 Computer, 101 CPU, 102 RAM, 103 ROM, 104 Storage device, 105 Communication unit, 106 Input unit, 107 Output unit

Claims (6)

A video distribution system that streams live video of game play on a game device to multiple terminals connected to a network, comprising:
a live video generation unit that generates the live video based on gameplay video of a game played on the game device;
an audiovisual operation unit for performing commentary, explanation, or operations related to audiovisual content of game play on the game device;
an acquisition unit that acquires information about a commentary or commentary on a game play situation based on the voice of a commentator or analyst input via the audio and video operation unit as information about the game play situation being played on the game device;
a weight information generation unit that detects a degree of excitement based on the voice of the commentator or interpreter, and generates weight information that associates an evaluation score weighted based on the degree of excitement with time information corresponding to a time from the start of the live video;
a storage unit that stores user information that identifies each of a plurality of users;
a digest generation unit that generates a digest video of the live video for a period designated by the time designation information based on time designation information and the weight information associated with first user information of the user information;
a distribution unit that distributes the live video to the plurality of terminals by streaming and distributes the digest video to a first terminal identified by the first user information among the plurality of terminals by streaming;
A video distribution system comprising: A control method for a video distribution system that streams live video of game play on a game device to multiple terminals connected to a network, comprising:
a live video generation unit generating the live video based on a game play video of a game being played on the game device;
an acquisition unit acquiring information relating to a commentary or commentary on the game play status as information relating to the play status of the game played on the game device, based on a voice uttered by a commentator or an analyst inputted into an audio/video operation unit for performing operations relating to commentary, commentary, or audio/video of the game play on the game device;
a weighting information generating unit detecting a degree of excitement based on the voice of the commentator or interpreter, and generating weighting information that associates an evaluation score weighted based on the degree of excitement with time information corresponding to a time from the start of the live video;
a digest generation unit generating a digest video of the live video for a period designated by the time designation information based on the weight information and time designation information associated with first user information among user information identifying each of a plurality of users stored in a storage unit;
a distribution unit streaming the live video to the plurality of terminals;
the distribution unit streaming the digest video to a first terminal identified by the first user information among the plurality of terminals;
A control method comprising: A computer in a video distribution system that streams live video of game play on a game device to multiple terminals connected to a network,
generating the live video based on a gameplay video of a game played on the game device;
acquiring information relating to a commentary or commentary on the game play status as information relating to the game play status of the game being played on the game device, based on a voice uttered by a commentator or an analyst input through an audio/video operation unit for performing operations relating to commentary or commentary on the game play on the game device, or audio /video;
a step of detecting a degree of excitement based on the voice of the commentator or interpreter, and generating weighting information that associates an evaluation score weighted based on the degree of excitement with time information corresponding to a time from the start of the live video;
generating a digest video of the live video for a period designated by the time designation information based on the weight information and time designation information associated with first user information among user information identifying each of a plurality of users stored in a storage unit;
streaming the live video to the plurality of terminals;
distributing the digest video by streaming to a first terminal identified by the first user information among the plurality of terminals;
A program to execute. A video distribution system that streams live video of game play on a game device to multiple terminals connected to a network, comprising:
a live video generation unit that generates the live video based on gameplay video of a game played on the game device;
an acquisition unit that acquires information about a play status of the game being played on the game device from the game device ;
a weight information generation unit that generates weight information that associates time information corresponding to a time from the start of the live video with an evaluation score weighted based on information about the game play situation;
a storage unit that stores user information that identifies each of a plurality of users;
a digest generation unit that generates a digest video of the live video for a period designated by the time designation information based on time designation information and the weight information associated with first user information of the user information;
a distribution unit that distributes the live video to the plurality of terminals by streaming and distributes the digest video to a first terminal identified by the first user information among the plurality of terminals by streaming;
A video distribution system comprising: 1. A control method for a video distribution system that distributes live video of game play on a game device by streaming to multiple terminals connected to a network, comprising:
a live video generation unit generating the live video based on a game play video of a game being played on the game device;
an acquisition unit acquiring information relating to a playing status of the game being played on the game device from the game device ;
a weight information generating unit generating weight information that associates time information corresponding to a time from the start of the live video with an evaluation score weighted based on information related to a play situation of the game;
a digest generation unit generating a digest video of the live video for a period designated by the time designation information based on the weight information and time designation information associated with first user information among user information identifying each of a plurality of users stored in a storage unit;
a distribution unit streaming the live video to the plurality of terminals;
the distribution unit streaming the digest video to a first terminal identified by the first user information among the plurality of terminals;
A control method comprising: A computer in a video distribution system that streams live video of game play on a game device to multiple terminals connected to a network,
generating the live video based on a gameplay video of a game played on the game device;
acquiring, from the game device, information relating to a playing status of the game being played on the game device ;
generating weight information that associates time information corresponding to a time from the start of the live video with evaluation points weighted based on information about the game play situation;
generating a digest video of the live video for a period designated by the time designation information based on the weight information and time designation information associated with first user information among user information identifying each of a plurality of users stored in a storage unit;
streaming the live video to the plurality of terminals;
distributing the digest video by streaming to a first terminal identified by the first user information among the plurality of terminals;
A program to execute.