JP7538271B2 - Content distribution system, computer system, and content distribution method - Google Patents

Description

The present invention relates to a content distribution system that distributes content including at least video provided by a providing user to the user terminal of each viewing user.

Social networking services (SNS) that allow users to send text and images using functions called chat and text functions (see, for example, Patent Document 1), and content distribution services are known.

Using chat and text functions can promote communication between users. For example, in the case of a video distribution service, users can send and post text messages while watching a video, creating a virtual experience that makes it feel as if everyone is watching the video together.

When chat or text functions allow users to send images in addition to text, the sending of those images is sometimes called "image posting." For example, by sending (in this case also called posting) images of characters with dialogue in speech bubbles or images of characters performing actions that express joy, anger, sadness, happiness, etc., it is possible to succinctly express feelings and thoughts that cannot be expressed in words.

The various user experiences provided by these functions for sending text and images can be said to have become an indispensable standard in recent years for social networking services (SNS) and content distribution services.

JP 2017-91393 A

The present invention aims to provide technology that utilizes text and image transmission functions to enrich the user experience.

The first invention for solving the above problem is a content distribution system (e.g., streaming server 1100 in FIG. 1) that distributes content including at least video provided by a providing user to a user terminal of each viewing user (e.g., user terminal 1500 in FIG. 1), in which a viewing screen (e.g., viewing screen W in FIG. 3) is displayed on the user terminal, the viewing screen including a content display unit (e.g., content display unit 32 in FIG. 3) that displays the content, an operation unit (e.g., outgoing operation unit 33 in FIG. 3) that allows the viewing user to perform an outgoing operation for the content being viewed, and an outgoing content display unit (e.g., outgoing content display unit 34 in FIG. 3) that displays the outgoing content of each viewing user, The content distribution system includes an index value determination unit (e.g., the transmission service management unit 230 and the index value determination unit 231 in FIG. 8) that determines an index value that determines the display mode of the content using at least the viewing history and/or transmission history of each viewing user (hereinafter collectively referred to as "user history"), and a transmission content display control unit (e.g., the transmission service management unit 230, the display mode setting unit 233, the transmission content display control unit 235 in FIG. 8) that receives a transmission from the user terminal for the content being viewed and controls the display of the transmission content on the transmission content display unit, and controls the display mode of the transmission content to be changed based on the index value of the viewing user related to the transmission.

According to the first invention, an index value is determined using the user track record of each viewing user who is viewing content, and the determined index value can be used to change the display format of the transmission content that the viewing user has operated to transmit. This makes it possible, for example, to make the transmission content of a viewing user with a high user track record (e.g., experience value in viewing and transmission) stand out from others, thereby increasing their transmission power. Therefore, each viewing user can be encouraged to individually increase their viewing track record and transmission track record, thereby providing a user experience in which multiple viewing users gather together to enjoy the content, giving the viewing users a sense of excitement and excitement.

As a second invention, the content distribution system of the first invention may be configured such that the transmission content display control means changes the degree to which the display format of the transmission content is changed based on whether or not the user terminal is that of a viewing user related to the transmission.

According to the second invention, for example, it is possible to significantly change the display format of the contents of a message sent by a sender on the sender's user terminal, while making the change in the display format of the contents of the message smaller on other user terminals.

As a third invention, the content distribution system of the first invention may be configured such that the user terminal that changes the display format of the transmission content is the user terminal of the viewing user related to the transmission.

According to the third invention, the display format of the contents of a message sent by a sender can be changed only on the sender's user terminal.

As a fourth invention, the content distribution system of any one of the first to third inventions may be configured such that the transmission content display control means controls to change the display form of the transmission content based on the ranking of the index value of the viewing user related to the transmission.

According to the fourth invention, the index values of each viewing user can be ranked, and the display format of the message content can be changed according to the ranking of the sender.

As a fifth invention, the content distribution system may be configured as any one of the first to fourth inventions, in which the index value determination means determines the index value of each viewing user by performing statistical processing of the user performance of each viewing user based on the number of viewing users.

According to the fifth invention, it is possible to perform statistical processing of the user performance of each viewing user based on the number of viewing users, and determine the index value of each viewing user.

As a sixth invention, the content distribution system may be configured as any one of the first to fifth inventions, in which the operation unit is capable of selectively inputting characters and/or images as transmission elements, and the transmission content display control means controls to change at least one of the display size, display color, and display time of the transmitted characters and/or images based on the index value.

According to the sixth aspect of the invention, at least one of the display size, display color, and display time of the characters and/or images selected and input as the content to be transmitted can be changed and displayed.

As a seventh invention, the content distribution system of the sixth invention may be configured such that the transmission content display control means variably sets the display area in the transmission content display unit for displaying the transmission content of each viewing user according to the number of viewing users, and controls the display area to adjust the display area if the display size exceeds the display area as a result of controlling the change in the display size.

According to the seventh invention, the display area for the content transmitted by each viewing user can be variably set according to the number of viewing users, and when the changed display size exceeds the display area, the display area can be adjusted.

Also, as an eighth invention, the content distribution system of the seventh invention may be configured such that the transmission content display control means controls the display of the transmission content after a given display time has elapsed, and adjusts the display area of the new transmission content based on the display status of the transmission content when the new transmission content is displayed.

According to the eighth aspect of the invention, the contents of messages from each viewing user can be displayed for a given display time. Then, when a new message is sent and the message is displayed, the display area of the message can be adjusted based on the display status of other messages.

As a ninth invention, the content distribution system of any of the first to eighth inventions may be configured such that the index value determination means uses at least one of the viewing user's billing amount, billing frequency, number of virtual currency equivalent points consumed, and user level as the user performance.

According to the ninth invention, the index value can be determined using at least one of the viewing user's billing amount, billing frequency, number of virtual currency equivalent points consumed, and user level.

As a tenth invention, the content may be a content distribution system according to any one of the first to ninth inventions, in which the content is live broadcast content.

According to the tenth invention, content can be distributed live.

As an eleventh invention, the content may be a content distribution system according to any one of the first to ninth inventions, in which the content is a live broadcast content of a gameplay video.

According to the eleventh invention, the game screen during gameplay can be live-streamed.

As a twelfth aspect of the invention, the content delivery system of the eleventh aspect of the invention may be configured such that the transmission content display control means further controls to change the display form of the transmission content depending on the game situation related to the gameplay video being viewed.

According to the twelfth aspect of the invention, the display format of the transmitted content can be further changed according to the game situation related to the gameplay video.

As a thirteenth invention, the content distribution system of any of the first to twelfth inventions may be configured to include an avatar display control means (e.g., the avatar display control unit 220 in FIG. 8) for displaying an avatar for each viewing user on the viewing screen, and the transmission content display control means controls the display of the transmission content so that it is associated with the avatar of the viewing user who transmitted the transmission content.

According to the thirteenth invention, the contents of the message can be displayed in association with the avatar of the viewing user.

As a fourteenth invention, a computer system (e.g., the content providing system 1000 in FIG. 1) may be configured that includes a user terminal of each viewing user and a content distribution system according to any one of the first to thirteenth inventions.

The term "computer system" here means a system consisting of a single computer, or a system consisting of multiple computers connected in a communicable manner. According to the fourteenth invention, a computer system that achieves the same effects as the first invention can be realized.

FIG. 1 is a diagram showing an example of the overall configuration of a content providing system. FIG. 2 is a diagram showing an example of the device configuration of a user terminal. FIG. 4 is a diagram showing an example of a screen configuration of a viewing screen. FIG. 13 is a diagram showing an example of a correspondence relational expression between a form determination index value and a display size. 6A to 6C are diagrams illustrating a display size correction process. FIG. 4 is a diagram showing a display example of a call content display unit. FIG. 11 is a diagram showing another display example of the call content display section. FIG. 2 is a block diagram showing an example of the functional configuration of a streaming server. FIG. 4 is a diagram showing an example of a data configuration of user management data. FIG. 4 is a diagram showing an example of the data structure of distribution management data. FIG. 13 is a diagram showing an example of the data configuration of call content display management data. FIG. 2 is a block diagram showing an example of the functional configuration of the viewing terminal. FIG. 4 is a block diagram showing an example of a functional configuration of a providing terminal. 11 is a flowchart showing a processing flow of a streaming server. 15 is a flowchart showing the flow of processing of the streaming server subsequent to FIG. 14 . 6 is a flowchart showing a processing flow of the viewing terminal. 10 is a flowchart showing a processing flow of a providing terminal. FIG. 13 is a diagram showing an example of a chat screen display when the present invention is applied to a chat function of a social networking service.

Below, a preferred embodiment of the present invention will be described with reference to the drawings. Note that the present invention is not limited to the embodiments described below, and the forms to which the present invention can be applied are not limited to the following embodiments. In addition, in the description of the drawings, the same parts are given the same reference numerals.

Figure 1 shows an example of the overall configuration of a content providing system 1000 to which the present invention is applied. The content providing system 1000 is a computer system that provides a streaming distribution service that allows an unspecified number of people to enjoy content simultaneously, and includes a streaming server 1100 and multiple user terminals 1500 (1500a, 1500b, ..., 1500T), which are connected to each other via a communication line 9 so that they can communicate data with each other.

The communication line 9 refers to a communication path that allows data communication. In other words, the communication line 9 includes a dedicated line (dedicated cable) for direct connection, a LAN (Local Area Network) such as Ethernet (registered trademark), a telephone communication network, a cable network, the Internet, and other communication networks, and the communication method can be either wired or wireless.

The streaming server 1100 is a computer system that realizes a content distribution system that streams content including at least video provided from the user terminal 1500 (1500T) of the providing user 2 (2t) to the user terminals 1500 (1500a, 1500b, ...) of each viewing user 2 (2a, 2b, ...).

Specifically, the streaming server 1100 includes a main unit 1101, a keyboard 1106, a touch panel 1108, and a storage 1140. The main unit 1101 includes a control board 1150 on which are mounted various electronic components such as a CPU (Central Processing Unit) 1151, a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), etc., various IC memories 1152 such as a VRAM, a RAM, and a ROM, and a communication device 1153. Note that a part or the whole of the control board 1150 may be realized by an ASIC (Application Specific Integrated Circuit), an FPGA (Field-programmable gate array), or a SoC (System on a Chip).

The streaming server 1100 performs calculations based on a predetermined program and data using the control board 1150,
1) User management functions related to user registration, etc.;
2) Streaming service function for multimedia content;
3) a user transmission service function for distributing text and images transmitted (or posted) from the user terminal 1500;
4) An online shopping function that enables the user to purchase images and other items online that can be sent using the user sending service function;
Of course, it is also possible to configure the device to realize functions other than those described above. For example, it may be possible to realize a social networking service function, a chat function as part of the social networking service function, and the like.

The streaming distribution service function is a function that acquires multimedia content such as video data from the user terminal 1500T of the provider user 2t, who is a user who provides the multimedia content, and distributes the acquired multimedia content to the user terminal 1500 (1500a, 1500b, ...) of the viewing user 2 (2a, 2b, ...), who is a user who has registered as a viewer, in a format that allows viewing in parallel with the downloading of the content file.

The user transmission service function is a function that distributes text and images transmitted from the user terminal 1500 (1500a, 1500b, ...) of the viewing user 2 (2a, 2b, ...) to the user terminal 1500 (1500a, 1500b, ...) of each viewing user 2 (2a, 2b, ...) and the user terminal 1500T of the providing user 2t, and displays the transmitted content at the distribution destination.

The online shopping function is a function for purchasing images to be transmitted, etc., by consuming virtual currency equivalent points (hereinafter simply referred to as "points") owned by the viewing user, and in response to a request from the user terminal 1500, it cooperates with an external electronic payment server operated by an electronic payment company, etc., to carry out the point purchase procedure (billing process). During the billing process, the electronic payment server responds to an inquiry from the streaming server 1100 and performs a process of settling the purchase amount of the points with the user's credit card, prepaid card, etc. Then, the streaming server 1100 grants the user points equivalent to the purchase amount settled by the electronic payment server.

The streaming server 1100 is not limited to the standalone configuration shown in FIG. 1, but may be configured with multiple blade servers each assigned to a different function, connected to each other via an internal bus for data communication. Alternatively, multiple independent servers installed in separate locations may be configured to communicate data via the communication line 9, functioning as a whole as the streaming server 1100.

The user terminal 1500 (1500a, 1500b, ..., 1500T) is a computer system used by the user 2 (2a, 2b, ..., 2t), and by changing the program it executes, it functions as a providing terminal that creates multimedia to be provided for streaming distribution, or a viewing terminal that enables viewing of multimedia content to be streamed. In the example of FIG. 1, the user terminal 1500T corresponds to the providing terminal, and the user terminals 1500a and 1500b correspond to the viewing terminals. Note that the user terminal 1500 in this embodiment is a device known as a smartphone, but it may also be a portable game device, a personal computer, a tablet computer, a wearable computer, etc.

Figure 2 is a diagram showing an example of the device configuration of a smartphone, which is an example of a user terminal 1500. As shown in Figure 2, the user terminal 1500 is equipped with a directional input key 1502, a home key 1504, a touch panel 1506 that functions as an image display device and a contact position input device, a built-in battery 1509, a speaker 1510, a microphone 1512, an image sensor module 1520, a control board 1550, and a memory card reader 1542 that can read and write data to a memory card 1540 that is a computer-readable storage medium. In addition, a power button, a volume control button, etc. (not shown) are provided. In addition, an IC card reader that can contactlessly read and write data to an IC card-type credit card or prepaid card that can be used to pay for game play may be provided.

The control board 1550 is equipped with various microprocessors such as a CPU 1551, a GPU, and a DSP, various IC memories 1552 such as a VRAM, a RAM, and a ROM, a wireless communication module 1553 for wireless communication with a mobile phone base station or a wireless LAN base station connected to the communication line 9, and an interface circuit 1557. The interface circuit 1557 includes a circuit for receiving signals from the direction input key 1502 and the home key 1504, a driver circuit for the touch panel 1506, an output amplifier circuit for outputting a sound signal to the speaker 1510, an audio signal generation circuit for generating a signal of the sound collected by the microphone 1512, a circuit for inputting image data of an image captured by the image sensor module 1520, and a signal input/output circuit for the memory card reader 1542. Each of these elements mounted on the control board 1550 is electrically connected via a bus circuit or the like, and is connected so that data can be read and written and signals can be transmitted and received. Note that a part or all of the control board 1550 may be configured with an ASIC, an FPGA, or a SoC.

In this control board 1550, the IC memory 1552 stores a video providing program for realizing the function as a providing terminal (for example, a providing terminal program that enables the creation and provision of multimedia content), a viewing program for realizing the function as a viewing terminal (for example, a viewing terminal program that enables the viewing of streaming multimedia content and the transmission of text and images), and data required to execute these programs. The CPU 1551 etc. then executes the providing terminal program and the viewing terminal program to perform calculation processing, and controls each part of the user terminal 1500 in response to operational inputs to the touch panel 1506, directional input keys 1502, and home key 1504, thereby enabling the user terminal 1500 to provide/view/etc. multimedia content.

In this embodiment, the user terminal 1500 is configured to download the providing terminal program, the viewing terminal program, and various setting data from the streaming server 1100, but it may also be configured to read them from a storage medium such as a memory card 1540 obtained separately.

Figure 3 is a diagram showing an example of the screen configuration of a viewing screen W for viewing multimedia content. In a user terminal 1500 that is executing a viewing program, the viewing screen W shown in Figure 3 is displayed on a touch panel 1506. The viewing screen W includes, for example, an additional information display section 31 that displays additional information of the distributed multimedia content being viewed, a content display section 32 that displays the multimedia content being viewed, a call operation section 33 for selecting and inputting text and/or images as a call element to perform a call operation, a call content display section 34 that displays the avatar 4 (4a, 4b, ...) of each viewing user 2 (2a, 2b, ...) and the text and image (call content) that have been operated to be called, and a shopping icon 35 for purchasing a call image 8, etc. online.

The additional information displayed on the additional information display unit 31 may include, for example, the title, genre, shooting date and time, shooting location, information about the subject, a situation description, a message from the providing user 2t, and the like. Furthermore, if the multimedia content is a gameplay video, the additional information may include the gameplay content and the game situation (for example, information about the game stage and location being played, equipment information, the name of the enemy character, the progress of the game, the player level, the remaining time and elapsed time until the stage is cleared, the names of rare items that can be obtained, and the like). The additional information may be set by the providing user 2t himself before the multimedia content is provided, or may be set by the operator of the streaming distribution service. Furthermore, in the case of a gameplay video, the additional information may be automatically obtained and set from the play information of the game being played.

The content display unit 32 displays images of multimedia content including at least video (for example, live broadcasts of musical performances or entertainment by the providing user 2t, gameplay played by the providing user 2t, live broadcasts of gameplay or edited videos of recorded gameplay, video works filmed and edited by the providing user 2t, etc.).

The call operation unit 33 includes an input field 331 for inputting text (letters, numbers, symbols) such as a comment or message to be sent, a selection field 333 for selecting an image to be sent from among the sending images 8, and a call execution operation icon 335.

In the selection field 333, the transmission images 8 owned by the viewing user 2a of the user terminal 1500a are displayed side by side. The transmission images 8 are images (also called stamps, etc.) such as illustrations and photographs prepared by the operator of the streaming distribution service and given to the viewing users 2 (2a, 2b, ...) free of charge or for a fee. The viewing users 2 each obtain or purchase a transmission image 8, own it, and use it for transmission. Note that once a transmission image 8 is obtained by purchasing it, it can be used any number of times, but it is also possible to have multiple images of the same type, and consume one from the number owned each time a transmission is made.

Here, the type of the image 8 for transmission can be set appropriately, and it is not limited to a still image, but may be an image with changes such as an animated GIF. Basically, the image 8 for transmission is designed in various ways to be an item of communication between the viewing users 2. Among them are images 8 for transmission designed to show messages evaluating the multimedia content being viewed (e.g., good, bad, interesting, not interesting, amazing, cool, ...), messages of support and encouragement to the providing user 2t (e.g., hang in there, calm down, ...), and predetermined intentions of the sender (e.g., evaluation messages such as good and interesting, I'm cheering you on, hang in there, ...). Also included are images that include words or phrases within the image, such as the image 8A for transmission. The character may be represented with a speech bubble, and designed as if the character is speaking the word or phrase. Of course, the word or phrase may be an onomatopoeia such as a sound effect expression in a manga. For example, you could create an image of a surprised character with the words "Surprise!" or an image of an excited character with the words "Exciting!".

The message content display unit 34 displays the message content, which is text or an image sent by each viewing user 2 currently viewing, in association with the avatar 4 (4a, 4b, ...) of each viewing user 2 (2a, 2b, ...). In this embodiment, the avatars 4 of each viewing user 2 are vertically arranged on both sides of the message content display unit 34, and the message content is displayed for a given display time in a speech bubble 5 (5a, 5b, ...) in the center of the message content display unit 34 inside the two, indicating that the avatar 4 (4a, 4b, ...) of the corresponding viewing user 2 (2a, 2b, ...) is speaking.

When the shopping icon 35 is touched, a sales screen showing a list of transmission images 8 for sale appears as a pop-up, and the desired transmission image 8 can be purchased at the sales price in exchange for spending points. In addition, on the sales screen, cheering items for the providing user 2t can also be purchased. For example, items that activate a cheering effect process according to the type when purchased, and images that are placed on the viewing screen W to create a gorgeous background when purchased, etc. are appropriately prepared as items for sale.

As shown in FIG. 3, the viewing screen W configured as described above is laid out to display the avatars 4 (4a, 4b, ...) of the viewing users 2 (2a, 2b, ...) in front of (below) the content display section 32, providing users with the feeling that they are gathered together to watch multimedia content.

In addition, by displaying the text and images (transmission images 8) sent by each viewing user 2 (2a, 2b, ...) in the speech bubbles 5 (5a, 5b, ...) of the avatar 4, it creates an atmosphere as if everyone is watching multimedia content together, expressing their own thoughts, and talking to their friends. Because the transmission images 8 do not need to be read one by one like text, they can instantly, symbolically, and succinctly convey what the viewing users 2 (2a, 2b, ...) are feeling and thinking. They also have a greater effect on livening up the atmosphere than text.

In this way, the viewing screen W is designed to make it easy for the providing user 2t who provides the multimedia content and the viewing users 2 (2a, 2b, ...) who view it to have the feeling that they are working together to liven up a single live stage or performance.

In this embodiment, the user transmission service function of text and images is used to increase the transmission power of each viewing user 2, thereby providing new added value that further increases the sense of unity and solidarity between viewing users 2.

[principle]
In this embodiment, the display form of the transmission content displayed on the transmission content display unit 34 is changed according to the viewing record and/or transmission record (user record) of the viewing user (sender) related to the transmission. In addition, at that time, the degree of the change is changed between the user terminal 1500 of the sender and the user terminals 1500 of the viewing users (other viewers) other than the sender. Specifically, for the user terminal 1500 of the sender, the display form of the transmission content is changed to largely reflect the user record of the sender, while the degree of change is made smaller for the user terminals 1500 of the other viewers other than the sender.

To this end, the streaming server 1100 accepts a transmission from the user terminal 1500 regarding the multimedia content being viewed, and determines an index value (mode determination index value) that determines the display mode of the transmission content based on the user record of the sender (determination step). Then, based on the mode determination index value, display modes for the sender and other viewers are set (setting step), and the transmission content is displayed in the corresponding display mode on the transmission content display unit 34 on the viewing screen W of each user terminal 1500.

1. Judgment step In the judgment step, an index value calculation process is executed, and a mode determination index value is obtained from the user record of the sender according to, for example, a predetermined function f (V1, V2, ...). The variable V1 of the function f is a variable related to the viewing record of the sender, and includes, for example, the number of points consumed to purchase the image 8 for transmission, etc., consumed by the sender while viewing multimedia content, the amount of charge, or the frequency of charge, viewing time, etc. In addition, the variable V2 of the function f is a variable related to the transmission record of the sender, and includes, for example, the number of transmission operations (number of transmissions) and the frequency (frequency of transmission) performed by the sender while viewing multimedia content. This function f is used to obtain a mode determination index value that is larger as the variables V1 and V2 are larger (the sender's viewing record and transmission record are higher), and is smaller as the variables V1 and V2 are smaller (the sender's viewing record and transmission record are lower).

The function f may be a function whose only variable is the variable V1 relating to the viewing record, or a function whose only variable is the variable V2 relating to the transmission record. It may also be a function that uses one of the values exemplified as the variables V1 and/or V2, or a function that uses a plurality of them. Alternatively, it may be a function whose variable is the user level of the viewing user, which is updated from time to time to reflect the viewing record and/or transmission record of the user. The variables V1 and V2 may be the number of points consumed for the multimedia content being viewed or the number of transmissions, or the total amount or number up to the present time.

2. Setting step In this embodiment, the display size is set as the display mode of the contents of the call made by each viewing user. Specifically, in the setting step, the display size for the sender and the display size for other viewers are provisionally set from the form determination index value calculated in the index value calculation process according to a predetermined correspondence relation between the form determination index value and the display size (provisional display size setting process).

FIG. 4 is a diagram showing an example of a correspondence relation equation between a form determination index value and a display size, in which a correspondence relation equation L11 for provisionally setting a display size for a sender is shown by a solid line, and a correspondence relation equation L13 for provisionally setting a display size for other viewers is shown by a dashed line. Each correspondence relation equation is determined as a straight line in which the correspondence relation equation L11 has a steeper slope than the correspondence relation equation L13, as shown in FIG. 4. For example, when the form determination index value is v _a , the display size for a sender is set to v _b , and the display size for other viewers is provisionally set to v _c , which is smaller than v _b . Note that the correspondence relation equation is not limited to a straight line, and may be set as a curve, a broken line, or the like, as appropriate. Alternatively, a data table that defines the correspondence relationship between a form determination index value and a display size for a sender and a data table that defines the correspondence relationship between a form determination index value and a display size for other viewers may be prepared, and the display size for a sender and the display size for other viewers corresponding to the form determination index value obtained by referring to these tables may be provisionally set.

Now, in this embodiment, the contents of messages are displayed for a given display time as speech bubbles 5 of avatars 4 in the message content display section 34, and when there are few senders, a large display area for each message can be secured. However, as the number of senders increases, the display area that can be secured for each message becomes smaller, and a maximum of the number of display areas required is the number of viewing users.

Therefore, in this embodiment, regardless of whether there is a transmission content to be displayed, the central part of the transmission content display unit 34 is first divided into areas for the number of viewers, and a display area for displaying each transmission content (hereinafter referred to as the "transmission area") is assigned to all viewing users. Then, for transmission content whose provisionally set display size (display size for the sender or display size for other viewers) exceeds the size of the transmission area, the display size is corrected (display size correction process). At that time, if there is free space in the adjacent transmission area, the transmission area is adjusted and the display size is corrected. Note that a transmission area may be assigned only to viewing users who have a transmission content to display, and the display size correction process may be performed. In that case, each time a transmission operation is accepted from the user terminal 1500, the central part of the transmission content display unit 34 may be divided into areas for the number of viewers.

Figure 5 is a diagram explaining the display size correction process, and Figure 5 (a) shows the sections of the transmission area 341 (341a, 341b, ...) that are initially assigned to each viewing user 2 (2a, 2b, ...) in the transmission content display unit 34. Here, assume that a new transmission operation is performed by the viewing user 2a, and the display size for the sender of the provisionally set transmission content exceeds the size of the transmission area 341a. In this case, first, the free space of the neighboring transmission areas 341b, 341d, 341e is determined. For example, if there is no transmission content being displayed for the viewing users 2b, 2d, 2e in each transmission area 341b, 341d, 341e, or if there is, but the display size (in this case, the display size for other viewers) is smaller than the size of the transmission area 341b, 341d, 341e, there is free space in the transmission areas 341b, 341d, 341e. If there is such free space, as shown in FIG. 5(b), the calling area 341a is enlarged and the calling areas 341b, 341d, and 341e are reduced and adjusted, and the allocation of the calling areas 341a, 341b, 341d, and 341e for the viewing users 2a, 2b, 2d, and 2e is changed. Then, if the provisionally set caller display size is larger than the adjusted size of the calling area 341a, the caller display size is reduced to the adjusted size of the calling area 341a and confirmed. If it is equal to or smaller than the adjusted calling area 341a, the caller display size is confirmed as it is. By this process, for example, as shown in FIG. 6, the user terminal 1500a of the viewing user 2a displays the contents of his/her own call, occupying a wider range than the calling areas of the other viewing users 2 (2b, 2c, ...).

On the other hand, if there is a call being displayed for viewing users 2b and 2d in the adjacent call areas 341b and 341d and there is no free space for it, the provisionally set caller display size is reduced to the size of the initially assigned call area 341a and finalized. With this process, even if there are many callers, the call contents are displayed large enough to fit within the assigned call area, as shown in Figure 7, for example.

As described above, in this embodiment, when a viewing user performs a call operation, the display size on the sender's user terminal 1500 reflects the user's record, and the higher the viewing record or call record, the larger the display, and the lower the record, the smaller the display. On the other hand, if the content of messages sent by other viewers is displayed too large, it can become a nuisance, so the degree of change in the content of messages sent by other viewers is kept to a minimum compared to when the user sends the message, and messages from viewing users with high user records are displayed larger and messages from viewing users with low user records are displayed smaller.

Here, viewing users with a high user record, that is, viewing users who purchase and use many transmission images 8 and support items, etc., and transmit many transmissions, can be said to be key players who are actively trying to liven up the atmosphere of the place where everyone is watching the streaming distribution. Therefore, according to this embodiment, the transmission content of such viewing users can be made to stand out, for example by displaying it in a large size, so that the viewing user is given apparent preferential treatment on the viewing screen W and the transmission power of the viewing user can be increased. In addition, preferential treatment can encourage active transmission to other viewing users. Therefore, it is easy to get a sense of a lot of support for the providing user and a sense of excitement in the atmosphere, and it is possible to bring about new added value that further increases the sense of unity and solidarity among viewing users.

[Functional configuration]
1. Streaming Server Fig. 8 is a block diagram showing an example of a functional configuration of a streaming server 1100. As shown in Fig. 8, the streaming server 1100 includes an operation input unit 100s, a server processing unit 200s, an image display unit 390s, a sound output unit 392s, a communication unit 394s, and a server storage unit 500s.

The operation input unit 100s is used to input various operations for system management, maintenance, etc., and can be realized by, for example, a keyboard, mouse, touch panel, etc. In FIG. 1, this corresponds to the keyboard 1106.

The server processing unit 200s can be realized by electronic components such as a microprocessor such as a CPU or GPU, an ASIC, or an IC memory, and controls the input and output of data between each part of the device including the operation input unit 100s and the server storage unit 500s. It performs various calculation processes based on predetermined programs and data, operation input signals from the operation input unit 100s, data received from the user terminal 1500, etc., and generally controls the operation of the streaming server 1100. In Figure 1, this corresponds to the control board 1150 and its CPU 1151.

The server processing unit 200s includes a user management unit 202, an online shopping management unit 204, a delivery service management unit 210, an avatar display control unit 220, an outgoing service management unit 230, a timing unit 280s, an image generation unit 290s, a sound generation unit 292s, and a communication control unit 294s.

The user management unit 202 performs processes related to user registration and manages the data of each registered user linked to a user account. For example, it can perform processes such as granting unique user accounts to registered users, registration information management processes for registering and managing personal information for each user account, ledger management processes for electronic payment media (e.g., virtual currency or points equivalent to virtual currency) consumed in the payment of billing elements (e.g., online shopping, etc.), usage history management processes for managing login and logout history, and creation and editing of avatars 4. Of course, it can also appropriately include management processes for other data linked to user accounts.

The online shopping management unit 204 is responsible for controlling online shopping, and can be realized by appropriately using known online shopping technology. In this embodiment, the viewing user can purchase images for transmission, etc., through online shopping.

The distribution service management unit 210 performs various processes to realize a streaming distribution service for multimedia content. For example, it can execute processes such as managing the distribution schedule of multimedia content, managing viewing users, acquiring data of multimedia content for distribution from the providing terminal, and streaming distribution. Of course, other processes can also be included as appropriate.

The avatar display control unit 220 controls the display of an avatar for each viewing user on the message content display unit 34 of each viewing user's user terminal 1500 (1500a, 1500b, ...), which is the viewing terminal. In this embodiment, this includes the distribution of avatar display management data 626 that sets avatar data for each viewing user, etc.

The outgoing service management unit 230 performs various processes to realize a user outgoing service in parallel with the streaming distribution service. Specifically, it accepts from the viewing terminal that an outgoing operation has been input for the multimedia content being viewed, and controls the display of the outgoing content related to the outgoing operation on the outgoing content display unit 34 of each viewing terminal. In this embodiment, this includes the distribution of outgoing content display management data 630 that sets the outgoing content being displayed on the outgoing content display unit 34, its display size, display time, etc. for each viewing user.

This outgoing service management unit 230 includes an index value determination unit 231, a display format setting unit 233, and an outgoing content display control unit 235, and controls the change of the display format of the display content displayed on the outgoing content display unit 34 at each viewing terminal, using at least the user performance of each viewing user.

The index value determination unit 231 determines the form determination index value from the sender's user performance according to a predetermined function f(V1, V2, ...).

The display mode setting unit 233 sets, for example, the display size as the display mode of the transmission content based on the mode determination index value obtained by the index value determination unit 231.

The call content display control unit 235 controls the call content that each viewing user has operated to make a call to be displayed on the call content display unit 34 at the display size set by the display format setting unit 233 in each viewing terminal. Note that if the streaming server 1100 intends to distribute the image itself displayed on the call content display unit 34, the call content display control unit 235 may generate the image.

The timing unit 280s uses the system clock to measure the current date and time, time limit, etc.

The image generation unit 290s generates images related to system management of the streaming server 1100, and outputs them to the image display unit 390s.

The sound generation unit 292s is realized by executing an IC or software that generates or decodes audio data, and generates or decodes audio data such as operation sounds and background music related to the system management and video distribution of the streaming server 1100. Audio signals related to system management are output to the sound output unit 392s.

The communication control unit 294s performs communication connection and data processing for data communication with an external device (e.g., the user terminal 1500) via the communication unit 394s, and realizes data exchange with the external device.

The image display unit 390s displays various screens for system management and the like based on the image signal input from the image generation unit 290s. For example, this can be realized by an image display device such as a flat panel display, a cathode ray tube (CRT), a projector, or a head-mounted display. In FIG. 1, this corresponds to the touch panel 1108.

The sound output unit 392s emits the sound signal input from the sound generation unit 292s. In FIG. 1, this corresponds to a speaker (not shown) provided in the main device 1101 or the touch panel 1108.

The communication unit 394s connects to the communication line 9 to realize communication. For example, it can be realized by a wireless communication device, a modem, a TA (terminal adapter), a jack for a wired communication cable, a control circuit, etc. In FIG. 1, this corresponds to the communication device 1153.

The server storage unit 500s stores in advance or temporarily stores each time processing is performed programs for operating the streaming server 1100 and implementing the various functions of the streaming server 1100, as well as data used during execution of these programs. For example, this can be implemented by IC memory such as RAM or ROM, a magnetic disk such as a hard disk, or an optical disk such as a CD-ROM or DVD. In FIG. 1, this corresponds to the IC memory 1152.

In addition, the server storage unit 500s stores a server program 503, a distribution viewing terminal program 505, a distribution providing terminal program 507, sales item management data 509, transmission image data 510, user management data 600, distribution management data 620, and a current date and time 800. In addition, other necessary data such as image data for the background image of the viewing screen W and material data for creating and editing avatars are stored as appropriate.

The server program 503 is a program for causing the server processing unit 200s to function as the user management unit 202, the online shopping management unit 204, the delivery service management unit 210, the avatar display control unit 220, and the outgoing service management unit 230. In addition, programs for causing the server processing unit 200s to function as the image generation unit 290s, the sound generation unit 292s, and the communication control unit 294s may also be included as appropriate.

The distribution providing terminal program 507 is original data of an application program downloaded to the user terminal 1500 used as a providing terminal, and executing this enables the user terminal 1500 to function as a providing terminal. Note that the distribution providing terminal program 507 can also be configured to be included in a game program that enables the execution of a game that has a live distribution function implemented.

The distribution viewing terminal program 505 is original data of an application program that is downloaded to the user terminal 1500 to be used as a viewing terminal, and by executing this, the user terminal 1500 can function as a viewing terminal.

Sales item management data 509 is data for defining and managing items (items for sale) sold through online shopping. For example, sales item management data 509 stores data on items that can be purchased, in association with the number of items in stock, the amount charged (corresponding to the amount debited from an electronic payment medium), etc.

The image data for transmission 510 is data that defines an image for transmission. One piece of image data for transmission 510 includes, for example, the type of image for transmission (type of image for transmission), image data, sales price, etc.

User management data 600 is prepared for each registered user and stores various data linked to a user account, which is unique identification information. For example, as shown in FIG. 9, one user management data 600 includes a unique user account 601, a user level 602, payment medium ledger data 603, avatar setting data 604, a list of images for retained calls 605, call log data 606, and user performance data 607.

The payment medium ledger data 603 stores information on the balance of the electronic payment medium (points in this embodiment) linked to the user, such as the purchase date and time and number of points purchased (charged amount), and the consumption date and number of points consumed.

Avatar setting data 604 stores the setting data for the user's avatar 4.

The list of images 605 for transmission held by the user stores a list of images 8 for transmission held by the user.

The call log data 606 is created each time the user makes a call as a viewing user. One call log data 606 stores, for example, the call date and time, the distribution title of the call target, the user account of the providing user who provided the multimedia content of the call target, the call content, etc.

User performance data 607 stores the number of points consumed, the billing amount, the billing frequency, the viewing time, the number of calls, the calling frequency, etc., which are variables V1 and V2 of function f, as user performance. The number of points consumed, the billing amount, and the billing frequency are calculated at any time based on the payment medium ledger data 603, and the number of calls and the calling frequency are calculated at any time based on the calling log data 606.

The distribution management data 620 is prepared for each streaming distribution, and stores various data describing the distribution status. As shown in FIG. 10, for example, one distribution management data 620 includes a distribution title 621, a distribution schedule 622, multimedia content data 623, supplementary information 624, viewing user management data 625, avatar display management data 626, transmission record data 627, and transmission content display management data 630. In addition, for example, background data defining the background of the viewing screen W, etc. are stored.

The viewing user management data 625 stores various data related to the viewing users who have registered as viewers of the multimedia content related to the streaming distribution. For example, it stores access information (e.g., IP address) for connecting to the user terminal 1500 of each viewing user via the communication line 9 in association with the user accounts of all the viewing users who have registered as viewers.

The avatar display management data 626 stores various data describing the display status of each viewing user's avatar in the message content display unit 34. For example, the avatar data, position coordinates, display size, etc. are set in association with the user account of each viewing user.

The call history data 627 is created each time a viewing user makes a call on the viewing terminal. One call history data 627 includes the user account of the viewing user who is the caller, the call timing, and the call content data (the entered text or the selected type of image for calling).

The call content display management data 630 is prepared for each viewing user, and stores various data describing the display status of the call content display unit 34 in each viewing terminal. As shown in FIG. 11, one call content display management data 630 stores a user account 631 of the viewing user, call area data 632 indicating the location and range of the call area assigned to the viewing user, a call display flag (Yes: ON/No: OFF) 633 indicating whether or not a call content is being displayed, call content data 634 set when the corresponding call display flag 633 is ON, a display size for the sender 635 and a display size for other viewers 636 set for the call content, a display start date and time 637 for the call content, and a display time 638. The display time 638 is the time from when the call content is displayed to when it is hidden, and in this embodiment, a fixed value (e.g., 5 seconds) is set.

2. Viewing terminal Fig. 12 is a block diagram showing an example of a functional configuration of a user terminal 1500 (1500a, 1500b, ...) serving as a viewing terminal. As shown in Fig. 12, the user terminal 1500 (1500a, 1500b, ...) serving as a viewing terminal includes an operation input unit 100, an imaging unit 102, a sound collection unit 104, a device processing unit 200, an image display unit 390, a sound output unit 392, a communication unit 394, and a terminal storage unit 500.

The operation input unit 100 allows the user to input various operations, and can be realized by, for example, a button switch, a joystick, a touch pad, a track ball, an acceleration sensor, an angular velocity sensor, etc. In FIG. 2, this corresponds to the directional input keys 1502, the home key 1504, and the touch panel 1506.

The imaging unit 102 receives light from the subject to be photographed, converts it into an electrical signal, generates digital image data, and outputs it to the device processing unit 200. For example, it can be realized by a lens, a mechanical shutter, a shutter driver, a photoelectric conversion element such as a CCD image sensor module or a CMOS image sensor module, a digital signal processor (DSP) that reads the amount of charge from the photoelectric conversion element and generates image data, an IC memory, etc. In FIG. 2, this corresponds to the image sensor module 1520.

The sound collection unit 104 converts the collected sound into an electrical signal and outputs it. In FIG. 2, this corresponds to the microphone 1512.

The device processing unit 200 can be realized by electronic components such as a microprocessor such as a CPU or GPU, an ASIC, or an IC memory, and controls data input/output between each unit of the device including the operation input unit 100 and the device storage unit 500. It performs various calculation processes based on predetermined programs and data, operation input signals from the operation input unit 100, data received from the streaming server 1100, etc., and controls the operation of the user terminal 1500 as a viewing terminal. In FIG. 2, this corresponds to the control board 1550 and its CPU 1551. In this embodiment, the device processing unit 200 of the viewing terminal includes a viewing terminal calculation unit 260, a timer unit 280, a sound generation unit 292, and a communication control unit 294.

The viewing terminal calculation unit 260 includes an operation signal transmission control unit 262 and a viewing screen display control unit 264.

The operation signal transmission control unit 262 performs processing to transmit various data and request information to the streaming server 1100 in response to operation input to the operation input unit 100.

The viewing screen display control unit 264 performs control to display the viewing screen W based on various data received from the streaming server 1100.

The sound generation unit 292 is realized by, for example, a processor such as a DSP or a voice synthesis IC, an audio codec capable of playing audio files, etc., and generates sound signals for sound effects, background music, and various operation sounds related to video distribution, and outputs them to the sound output unit 392.

The communication control unit 294 establishes a communication connection and processes data for data communication with an external device (e.g., the streaming server 1100) via the communication unit 394, and realizes data exchange with the external device.

The image display unit 390 displays various screens such as the viewing screen W based on the image signal input from the viewing screen display control unit 264. For example, this can be realized by an image display device such as a flat panel display, a cathode ray tube (CRT), a projector, or a head-mounted display. In this embodiment, this corresponds to the touch panel 1506 in FIG. 2.

The sound output unit 392 outputs background music and the like based on the sound signal input from the sound generation unit 292. In FIG. 2, this corresponds to the speaker 1510.

The communication unit 394 connects to the communication line 9 to realize communication. For example, it can be realized by a wireless communication device, a modem, a TA, a jack for a wired communication cable, a control circuit, etc. In FIG. 2, this corresponds to the wireless communication module 1553.

The terminal storage unit 500 stores in advance or temporarily stores each time processing is performed programs for operating the user terminal 1500 as a viewing terminal and realizing the functions of the user terminal 1500 as a viewing terminal, and data used during execution of these programs. For example, this can be realized by IC memory such as RAM or ROM, a magnetic disk such as a hard disk, or an optical disk such as a CD-ROM or DVD. In FIG. 2, this corresponds to the IC memory 1552 and the memory card 1540.

The terminal storage unit 500 of the viewing terminal also stores a viewing terminal program 504, a received distribution data group 700, and a current date and time 800. Of course, other programs and data can also be stored as appropriate.

The viewing terminal program 504 is a program that causes the terminal processing unit 200 to function as the viewing terminal calculation unit 260. In this embodiment, it is a copy of the distribution viewing terminal program 505 (see FIG. 8) provided by the streaming server 1100.

The received distribution data group 700 stores various distribution data received from the streaming server 1100 during streaming distribution. In this embodiment, it stores avatar display management data 702, transmission content display management data 704, and retained transmission image list 706. Retained transmission image list 605 (see Figure 8) is copied to retained transmission image list 706 when the user logs in or when the viewer registers.

13 is a block diagram showing an example of the functional configuration of a user terminal 1500 (1500T) serving as a providing terminal. In FIG. 13, the same components as those of the user terminals 1500 (1500a, 1500b, ...) serving as viewing terminals are denoted by the same reference numerals.

In the user terminal 1500 (1500T) serving as the providing terminal, the device processing unit 200 performs various calculation processes based on predetermined programs and data, operation input signals from the operation input unit 100, data received from the streaming server 1100, etc., and controls the operation of the user terminal 1500 as the providing terminal. The device processing unit 200 of the providing terminal includes a providing terminal calculation unit 270, a timing unit 280, a sound generation unit 292, and a communication control unit 294.

The provider terminal calculation unit 270 includes an operation signal transmission control unit 272, a content provision control unit 274, and a provider screen display control unit 276.

The operation signal transmission control unit 272 performs processing to transmit various data and request information to the streaming server 1100 in response to operation input to the operation input unit 100.

The content provision control unit 274 performs processes related to the generation of data for multimedia content to be distributed and control of the provision to the streaming server 1100. In the case of live distribution, it realizes the function of a live streaming encoder, encoding the images captured by the imaging unit 102 one by one and controlling the provision to the streaming server 1100.

The provision screen display control unit 276 controls the display of the provision screen. The provision screen is an operation screen that accepts various operations for live distribution of multimedia content, and also serves as a monitor screen for monitoring the distribution status.

The terminal storage unit 500 stores in advance or temporarily stores each time processing is performed programs for operating the user terminal 1500 as a provision terminal and realizing the functions of the user terminal 1500 as a provision terminal, and data used during execution of these programs. For example, this can be realized by IC memory such as RAM or ROM, magnetic disks such as hard disks, optical disks such as CD-ROM or DVD, etc.

The terminal storage unit 500 of the providing terminal also stores a providing terminal program 506, a received distribution data group 700, provided content data 710, and a current date and time 800. Of course, other programs and data can also be stored as appropriate.

The providing terminal program 506 is a program for causing the device processing unit 200 to function as the providing terminal calculation unit 270. In this embodiment, it is a copy of the distribution providing terminal program 507 (see FIG. 8) provided by the streaming server 1100.

The received distribution data group 700 stores various distribution data received from the streaming server 1100 when providing multimedia content.

The provided content data 710 includes a distribution title at the time of registration 711, a distribution schedule at the time of registration 713, additional information at the time of registration 715, and multimedia content data to be provided 717. The distribution title at the time of registration 711, distribution schedule at the time of registration 713, and additional information at the time of registration 715 each store setting data when the distribution registration procedure is performed as a providing user. The multimedia content data to be provided 717 is original data of the multimedia content to be distributed.

[Process flow]
1. Streaming Server Figures 14 and 15 are flowcharts showing the flow of processing related to live distribution of multimedia content in the streaming server 1100. The processing described here is realized by the server processing unit 200s reading and executing the server program 503. It is assumed that the distribution title, distribution schedule, and additional information of the multimedia content have already been set in accordance with the distribution registration procedure by the providing user. It is also assumed that a separate login procedure has been completed for the viewing terminal of the viewing user.

First, the distribution service management unit 210 performs initial settings for the distribution management data 620 (step S100). Here, the viewing user management data 625, avatar display management data 626, and transmission content display management data 630 are initialized. Note that the distribution title 621, distribution schedule 622, and supplementary information 624 have already been set in conjunction with the distribution registration procedure. Since the multimedia content data 623 is a live distribution, it is not stored until the start of distribution. If it is not a live distribution, data of the multimedia content prepared in advance will be stored.

Then, the distribution service management unit 210 starts distributing various distribution data such as the avatar display management data 626, the transmission content display management data 630, and the held transmission image list 605 based on the viewing user management data 625 (step S102: distribution α). The timing of distribution can be, for example, when the distribution data is added, deleted, or updated, or when a new viewing user is registered, but distribution may also be performed at a predetermined interval.

Then, the distribution service management unit 210 monitors the reception of a viewing request (step S104). When a viewing user selects a distribution title that he or she wishes to view on a user terminal 1500 (1500a, 1500b, ...) functioning as a viewing terminal and performs a specified viewing operation, the viewing request is transmitted to the streaming server 1100 together with information such as the user account.

When this viewing request is received (YES in step S104), the distribution service management unit 210 creates new viewing user management data 625 and registers the user of the viewing terminal as a viewing user (step S106).

Then, the avatar display control unit 220 creates new avatar display management data 626 so that the avatar related to the viewing user is displayed in the message content display unit 34 (step S108).

As described above, since the distribution of the avatar display management data 626 has begun in step S102, the newly created avatar display management data 626 is also distributed to the viewing terminal. The viewing terminal updates the display of each avatar based on this data. As a result, on the viewing screen W, it appears as if a new virtual viewer has appeared in front of the screen.

In addition, since the number of viewers has increased due to viewer registration, the outgoing service management unit 230 creates new outgoing content display management data 630 and reassigns outgoing areas to all viewing users, including the viewing user, to update the outgoing area data 632 (step S110). This newly created outgoing content display management data 630 and the outgoing content display management data 630 with the updated outgoing area data 632 are also distributed to the viewing terminal.

Then, the outgoing service management unit 230 monitors the reception of an outgoing request (step S112). When the viewing user inputs text or selects an image on the viewing terminal to perform an outgoing operation, the text outgoing request is transmitted to the streaming server 1100 together with information such as the user account and the outgoing content.

When this call request is received (YES in step S112), the call service management unit 230 creates call history data 627 for the received new call content, and creates and updates call log data 606 for the requesting viewing user (step S114). The index value determination unit 231 also executes index value determination processing (step S116). The display form setting unit 233 then executes temporary display size setting processing (step S118) and display size correction processing (step S120). Through this processing, the caller display size 635 and other viewer display size 636 are set for the received new call content, and each value of the call content display management data 630 related to the caller is updated. Additionally, the adjacent call area data 632, which has been appropriately adjusted, is updated.

The outgoing service management unit 230 erases each outgoing call content that has exceeded the display time 638. That is, in the outgoing call content display management data 630, the outgoing call display flag 633 relating to the outgoing call content that has exceeded the display time 638 from the display start date and time 637 is turned OFF, and the outgoing call content data 634, the display size for the sender 635, the display size for other viewers 636, the display start date and time 637, and the display time 638 are cleared. Also, if there is an outgoing call area that has expanded or contracted due to the display of the outgoing call content, the outgoing call area data 632 is returned to the initial range assigned in step S110.

The transmission content display management data 630 also starts being distributed in step S102, and the updated transmission content display management data 630 is also distributed to the viewing terminal. Based on this, the viewing terminal displays the new transmission content in an avatar's speech bubble, making it appear as if the avatar has spoken.

The online shopping management unit 204 also monitors the receipt of a purchase request (step S122). The purchase request is sent to the streaming server 1100 when the viewing user performs a predetermined purchase operation (e.g., an operation on the shopping icon 35 in FIG. 3) on the viewing terminal.

When this purchase request is received (YES in step S122), the online shopping management unit 204 executes processes related to online shopping, such as purchasing a transmission image or a support item (step S126). With this purchase, the list of transmission images held 605 in the user management data 600 of the viewing user who made the purchase request is updated, and this is also delivered to the viewing terminal.

In this way, even before the live broadcast, viewers can send text and images to be sent, or purchase images to be sent, allowing viewers to freely discuss their expectations for the live performance before it begins, and to prepare images to be sent in preparation for the start of the live performance.

After that, as shown in FIG. 15, when the scheduled start time of the live distribution arrives (YES in step S126), the distribution service management unit 210 starts the live distribution of the multimedia content (step S128). This process starts the reception of multimedia content data from the providing terminal and streaming distribution to the viewing terminal.

When the distribution of multimedia content has started, the outgoing service management unit 230 monitors the reception of an outgoing request (step S130). Then, when an outgoing request is received (YES in step S130), outgoing call history data 627 is created for the received new outgoing content, and outgoing call log data 606 of the requesting viewing user is created and updated (step S132). The index value determination unit 231 also executes an index value determination process (step S134). Then, the display form setting unit 233 executes a temporary display size setting process (step S136), executes a display size correction process (step S138), and sets the display size for the sender and the display size for other viewers for the received new outgoing content.

The online shopping management unit 204 also monitors whether a purchase request has been received (step S140). If a purchase request has been received (YES in step S140), the online shopping management unit 204 executes processing related to online shopping (step S142).

After that, the process returns to step S130 and repeats the above process until the distribution is completed (NO in step S144). Then, when the distribution is completed (YES in step S144), the process ends.

16 is a flowchart showing the flow of processing related to viewing of multimedia content in the user terminal 1500 (1500a, 1500b, ...) which serves as a viewing terminal. The processing described here is realized by the terminal processing unit 200 reading and executing the viewing terminal program 504.

As shown in FIG. 16, the viewing terminal first executes a login process (step S300). After that, when a predetermined viewing operation (including selection of the multimedia content to be viewed) for viewing the distribution of multimedia content is detected (YES in step S310), the operation signal transmission control unit 262 transmits a viewing request to the streaming server 1100 (step S312: communication A). In response to the viewing request, the streaming server 1100 registers the user of the viewing terminal as a viewing user, and starts distribution of the avatar display management data 626, the transmission content display management data 630, the list of images for held transmissions 605, etc. to the viewing terminal (distribution α). Then, in the viewing terminal, the viewing screen display control unit 264 receives these and stores them in the received distribution data group 700, and starts displaying the viewing screen W (step S314).

Furthermore, when a purchase operation of a sales item such as the image for sending 8 is detected (YES in step S320), the operation signal transmission control unit 262 transmits a purchase request to the streaming server 1100 (step S322: communication B). When the image for sending 8 is purchased, the streaming server 1100 distributes the list of owned images for sending 605 to which the image for sending 8 has been added, and the list of owned images for sending 706 is updated.

When the operation signal transmission control unit 262 detects a text input operation in the call operation unit 33 (YES in step S330), it executes a text input/editing process (step S332) and proceeds to step S336. When the operation signal transmission control unit 262 detects a selection operation of an image for calling in the call operation unit 33 (YES in step S334), it also proceeds to step S336. When the operation signal transmission control unit 262 detects a call operation in step S336 (YES in step S336), it transmits a call request together with the input text or the selected type of image for calling to the streaming server 1100 (step S338: communication C). In response to this call request, the streaming server 1100 sets the display format of the call content (in this embodiment, the display size for the caller and the display size for other viewers), updates the call content display management data 630, and distributes it.

Here, the viewing terminal starts display control of the viewing screen W based on various distribution data in step S314 as described above. Therefore, in step S338, the call contents made by the viewing user on the viewing terminal or another viewing terminal are displayed on the call contents display unit 34 in a display size set according to the user's performance. More specifically, the viewing screen display control unit 264 controls the display of call contents in the call area of the viewing user whose call display flag 633 is ON according to the call contents display management data 630 by applying the caller display size to the call contents related to the viewing user of the viewing terminal and the other viewer display size to the call contents related to other viewing terminals.

After that, the process returns to step S320 and repeats the above process until the distribution is completed (NO in step S340). Then, when the distribution is completed (YES in step S340), the process ends.

17 is a flowchart showing the flow of processing related to the provision of multimedia content in the user terminal 1500 (1500T) which serves as a providing terminal. The processing described here is realized by the terminal processing unit 200 reading and executing the providing terminal program 506. Note that if the multimedia content is to be live broadcast content of game play video, it is assumed that a separate game program is being executed.

As shown in FIG. 17, the viewing terminal first executes a login process (step S500). After that, the provision screen display control unit 276 starts display control of the provision screen (step S502).

Then, the content provision control unit 274 sets the distribution title, distribution schedule, and additional information of the multimedia content to be provided and performs the registration procedure process (step S504). Then, when the scheduled distribution time arrives, the provision of the multimedia content is started (step S506: communication D). In this embodiment, since live distribution is assumed, for example, in the case of live distribution using live action, the content provision control unit 274 sequentially creates multimedia content data by adding audio collected by the audio collection unit 104 to the video captured by the imaging unit 102, and performs live streaming encoding of the data and transmits it to the streaming server 1100. In the case of live distribution of gameplay video, the multimedia content data is sequentially created by adding game audio to video captured from the game screen. In the case of video data for which the multimedia content is prepared in advance, it is uploaded to the streaming server 1100 without waiting for the scheduled distribution time.

Then, when the distribution of the multimedia content is completed (YES in step S508), the process ends.

As described above, according to this embodiment, in a streaming distribution service for multimedia content, a more enjoyable and fulfilling user experience can be provided than with conventional services by utilizing the text and image transmission function, thereby improving the streaming distribution service.

[Modification]
The forms to which the present invention can be applied are not limited to the above-described embodiments, and components can be added, omitted, or modified as appropriate.

For example, in the above embodiment, an example was given of implementing a streaming distribution service in a client-server type computer system, but it may also be implemented in a computer system in which multiple user terminals 1500 are connected in a peer-to-peer manner. In that case, one of the user terminals 1500 is made to function as the streaming server 1100. Alternatively, the functions of the distribution service management unit 210 may be shared among multiple user terminals 1500.

The above embodiment can also be applied to other services that are accessed simultaneously by multiple users and each user can send and receive text or images.

For example, the portion of the viewing screen W in FIG. 3 below the content display section 32 can be a screen that applies the chat function of a social networking service. FIG. 18 shows an example of such a display.

On the left side of the lower chat screen 36, an avatar 4a of the viewing user 2a who is using the user terminal 1500 on which the screen is displayed is displayed, and the contents of messages (text and images) sent by the viewing user 2a are displayed in a speech bubble 5a. On the other hand, on the right side of the chat screen 36, avatars 4c, etc. of other viewing users 2c, etc. are displayed, and speech bubbles 5c, etc. of the contents of messages sent by them are displayed. In this modified example, when displaying the contents of messages sent by each viewing user 2, the display size is changed and controlled according to the user track record of the sender in the same manner as in the above embodiment.

In the above embodiment, the display size for the sender and the display size for other viewers are set, so that the degree of change in display size varies between the sender's user terminal 1500 and the other viewers' user terminals 1500. In contrast, only the display size for the sender may be set. In this way, for each user terminal 1500, the display size can be changed and controlled only for the content transmitted by the viewing user, depending on the user performance of the viewing user who uses the user terminal 1500.

In the above embodiment, the form determination index value is obtained from the user performance of the sender and used to set the display size. In contrast, the user performance of each viewing user may be statistically processed to obtain an index value related to the sender and set the display size. For example, form determination index values for all viewing users are obtained each time a calling operation is accepted from the user terminal 1500, and a standard deviation value related to the sender is calculated as an index value from the form determination index value of each viewing user. The calculated standard deviation value may then be used to set the display size.

In the above embodiment, a form determination index value is calculated for the sender, and a display size is provisionally set according to the form determination index value in accordance with a predetermined correspondence equation. However, the display size may be determined by ranking the form determination index values. For example, each time a call operation is accepted from the user terminal 1500, the form determination index values of all viewing users are calculated, and the rank of the sender is determined by arranging them in descending order. The display size may then be increased as the determined rank increases, and decreased as the rank decreases.

In the above embodiment, the display size of the message content is changed using the sender's user record, but when live streaming gameplay videos as multimedia content, the display form of the message content may be further controlled to change according to the game status related to the gameplay video. For example, the line type, color, shape, background color, etc. of the frame of the speech bubble 5 (5a, 5b, ...) may be changed and controlled according to the game stage, enemy character name, progress, player level, etc. of the gameplay video.

The display form of the transmission content to be changed is not limited to the display size shown as an example, and other display forms such as the display color and display time may be changed, or two or all three of the display size, display color, and display time may be changed. Alternatively, the display form of the target to be changed may be changed by controlling the display size of the transmission content on the sender's user terminal 1500 and changing the display color of the transmission content on the user terminals of other viewers.

1000...Content providing system 1100...Streaming server 100s...Operation input unit 200s...Server processing unit 202...User management unit 204...Online shopping management unit 210...Distribution service management unit 220...Avatar display control unit 230...Transmission service management unit 231...Index value determination unit 233...Display form setting unit 235...Transmission content display control unit 280s...Timekeeping unit 291s...Image generation unit 293s...Sound generation unit 295s...Communication control unit 391s...Image display unit 393s...Sound output unit 395s...Communication unit 500s...Server storage unit 503...Server program 505...Distribution viewing terminal program 507...Distribution provision terminal program 509...Sales item management data 510...Transmission image data 600...User management data 620...Distribution management data 800...Current date and time 1500 (1500a, 1500b, ..., 1500T)... User terminal 100... Operation input unit 102... Imaging unit 104... Sound collection unit 200... Terminal processing unit 262, 272... Operation signal transmission control unit 264... Viewing screen display control unit 274... Content provision control unit 276... Provision screen display control unit 390... Image display unit 392... Sound output unit 394... Communication unit 500... Terminal storage unit 504... Viewing terminal program 506... Provision terminal program 700... Received distribution data group 702... Avatar display management data 704... Transmission content display management data 706... Retained transmission image list 710... Provision content data 711... Distribution title at time of registration 713... Distribution schedule at time of registration 715... Additional information at time of registration 717... Provision multimedia content data 9... Communication line 2 (2a, 2b, ..., 2t)... User W... Viewing screen 31... Additional information display section 32... Content display section 33... Call operation section 34... Call content display section 35... Shopping icon 36... Chat screen 4 (4a, 4b, ...)... Avatar 8... Call image

Claims (7)

A content distribution system that distributes content including at least video provided by a providing user to a user terminal of each viewing user, comprising:
The user terminal is capable of displaying the content, allowing the viewing user to perform a sending operation of a text image post consisting of text and an image for the content being viewed, and displaying the text image post sent by the sending operation of each viewing user,
An index value determination means for determining an index value for determining a display form related to the text image posting, using at least a viewing record and/or a posting record of each viewing user;
a message content display control means for receiving a text image posting from the user terminal to be sent in response to the content being viewed, and controlling the display of the text image posting on the user terminal, the message content display control means controlling the display form of the text image posting to be changed based on the ranking of the index value of the viewing user related to the message;
A content delivery system comprising: A content distribution system that distributes content including at least video provided by a providing user to a user terminal of each viewing user, comprising:
The user terminal is capable of displaying the content, allowing the viewing user to perform a sending operation of a text image post consisting of text and an image for the content being viewed, and displaying the text image post sent by the sending operation of each viewing user,
An index value determination means for determining an index value for determining a display form related to the text image posting, using at least the viewing record and/or posting record of each viewing user (hereinafter collectively referred to as "user record");
a message content display control means for receiving a text image posting from the user terminal to be sent in response to the content being viewed, and controlling the display of the text image posting on the user terminal, the message content display control means controlling the display form of the text image posting to be changed based on the index value of the viewing user related to the message;
Equipped with
the index value determination means determines an index value of each viewing user by performing statistical processing on the user performance of each viewing user based on the number of viewing users;
Content delivery system. A content distribution system that distributes content including at least video provided by a providing user to a user terminal of each viewing user, comprising:
The user terminal is capable of displaying the content, allowing the viewing user to perform a sending operation of a text image post consisting of text and an image for the content being viewed, and displaying the text image post sent by the sending operation of each viewing user,
An index value determination means for determining an index value for determining a display form related to the text image posting, using at least a viewing record and/or a posting record of each viewing user;
a message content display control means for receiving a text image posting from the user terminal to be sent in response to the content being viewed, and controlling the display of the text image posting on the user terminal, the message content display control means controlling the display form of the text image posting to be changed based on the index value of the viewing user related to the message;
Equipped with
The content is a live broadcast content of a gameplay video,
The transmission content display control means further performs control to change a display form related to the text image post in accordance with a game situation related to the game play video being viewed.
Content delivery system. A computer system comprising a user terminal of each viewing user and the content distribution system according to any one of claims 1 to 3 . A content distribution method for distributing content including at least video provided by a providing user to a user terminal of each viewing user, comprising the steps of:
The user terminal is capable of displaying the content, allowing the viewing user to perform a sending operation of a text image post consisting of text and an image for the content being viewed, and displaying the text image post sent by the sending operation of each viewing user,
An index value determination step of determining an index value for determining a display form related to the text image posting using at least a viewing record and/or a transmission record of each viewing user;
a transmission content display control step of receiving a text image posting from the user terminal to be sent in response to the content being viewed, and controlling the display of the text image posting on the user terminal, the transmission content display control step controlling the display form of the text image posting to be changed based on the ranking of the index value of the viewing user related to the transmission;
Content delivery methods including: A content distribution method for distributing content including at least video provided by a providing user to a user terminal of each viewing user, comprising the steps of:
The user terminal is capable of displaying the content, allowing the viewing user to perform a sending operation of a text image post consisting of text and an image for the content being viewed, and displaying the text image post sent by the sending operation of each viewing user,
An index value determination step of determining an index value for determining a display form related to the text image posting using at least the viewing record and/or transmission record of each viewing user (hereinafter collectively referred to as "user record") ;
a transmission content display control step of receiving a text image posting from the user terminal to be sent in response to the content being viewed, and controlling the display of the text image posting on the user terminal, the transmission content display control step controlling the display form of the text image posting to be changed based on the index value of the viewing user related to the transmission;
Including,
The index value determination step is a step of determining an index value of each viewing user by performing statistical processing on the user performance of each viewing user based on the number of viewing users.
Content delivery methods. A content distribution method for distributing content including at least video provided by a providing user to a user terminal of each viewing user, comprising the steps of:
The user terminal is capable of displaying the content, allowing the viewing user to perform a sending operation of a text image post consisting of text and an image for the content being viewed, and displaying the text image post sent by the sending operation of each viewing user,
An index value determination step of determining an index value for determining a display form related to the text image posting using at least a viewing record and/or a transmission record of each viewing user;
a transmission content display control step of receiving a text image posting from the user terminal to be sent in response to the content being viewed, and controlling the display of the text image posting on the user terminal, the transmission content display control step controlling the display form of the text image posting to be changed based on the index value of the viewing user related to the transmission;
Including,
The content is a live broadcast content of a gameplay video,
The message content display control step further includes a step of controlling a change in a display form related to the text image post in accordance with a game situation related to the game play video being viewed.
Content delivery methods.

Images