JP7705095B2 - Information processing device, video distribution method, and video distribution program - Google Patents

Description

The present invention relates to an information processing device, a video distribution method, and a video distribution program.

In recent years, online services such as websites (web pages, web services), online games, and application software (hereinafter referred to as "apps") that are distributed to information processing devices such as mobile terminals via computer networks have become widespread.

One type of online service is a video posting site where users can post videos they have filmed themselves and other users can watch those videos. Users can also post performance videos, such as singing videos, on this video posting site. Online services such as competitions between performance videos of different users are also anticipated.

Patent Document 1 discloses a karaoke machine that allows the audience listening to the singer's singing in a karaoke booth or the like to participate in evaluating the singing. The karaoke machine plays a karaoke song and scores the singing by analyzing the frequency and volume of the singing voice. The audience members who are listening to the singing input their evaluation of the singing using their mobile phones either directly to the karaoke machine or by accessing a compilation center. After the performance of the karaoke song is finished, the karaoke machine calculates a final evaluation by comprehensively evaluating the score obtained from its own scoring function and the evaluation input by the audience, and displays this on the monitor.

JP 2003-233383 A

The karaoke device disclosed in Patent Document 1 allows the audience to evaluate the singing based on their own perception, but when they think the singing is good, they call a specified phone number, which is time-consuming and the system is complicated. Also, for example, when two singers sing at the same time, the audience cannot judge which is better.

The present invention has been made in consideration of the above circumstances, and aims to provide an information processing device, a video distribution method, and a video distribution program that allow other users to easily judge the quality of videos distributed by each of multiple users.

In order to solve the above problems, the information processing device, video distribution method, and video distribution program of the present invention employ the following means.

To solve the above problem, the "information processing device" according to one aspect of the present invention is an information processing device that distributes videos posted by users to a terminal device, and includes a distribution means that distributes a plurality of the videos so that they are simultaneously displayed on the screen of the terminal device, and an evaluation means that receives input of an evaluation of each of the videos distributed to the terminal device from the terminal device.

In order to solve the above problem, the "video distribution method" according to one aspect of the present invention is a video distribution method for distributing videos posted by users to a terminal device, and includes a first step of distributing a plurality of the videos so that they are simultaneously displayed on a screen of the terminal device, and a second step of receiving, from the terminal device, an input of an evaluation of each of the videos distributed to the terminal device.

To solve the above problem, the "video distribution program" of one aspect of the present invention causes a computer included in an information processing device that distributes videos posted by users to a terminal device to function as a distribution means that distributes multiple videos so that they are displayed simultaneously on the screen of the terminal device, and an evaluation means that accepts input of an evaluation of each of the videos distributed to the terminal device from the terminal device.

The above-mentioned "information processing device" may be subject to various technical limitations, as exemplified below. In addition, technical limitations of the same nature may be applied to the processing steps executed by the "video distribution method" or the functions of the "video distribution program."

The distribution means distributes an image showing the evaluation result for each video to the terminal device together with the video.

The evaluation means accepts input of a score as the evaluation and derives a total score input during the distribution of the video.

The evaluation means includes a superimposition means for receiving a request to superimpose a decorative image onto the video and superimposing the received decorative image onto the video.

When the evaluation means receives the superimposition of the decorative image, it receives an input of a score corresponding to the decorative image as the evaluation.

The distribution means distributes an image showing a viewing user who has given the video a relatively higher rating than other viewing users so that the image is displayed on the screen of the terminal device.

The present invention has the advantage that other users can easily judge the quality of videos distributed by each of multiple users.

1 is a configuration diagram of a karaoke system according to the present invention. FIG. 2 is a block diagram showing the electrical configuration of the server according to the present invention. 1 is a block diagram showing an electrical configuration of a mobile terminal according to the present invention; FIG. 13 is a diagram showing a screen display of a mobile terminal when shooting a singing video according to the present invention. FIG. 13 is a diagram showing a screen display of a mobile terminal when viewing a singing video according to the present invention. A figure showing the screen display of a mobile terminal of a viewing user in a singing competition according to the present invention. 2 is a schematic diagram showing divided regions of a musical piece used in a singing battle according to the present invention. FIG. A figure showing another example of the screen display of a mobile terminal of a viewing user in a singing battle according to the present invention. FIG. 13 is a diagram showing a screen display when selecting a coin throwing effect image according to the present invention. FIG. 13 is a diagram showing a singing video on which a coin tip effect image according to the present invention is superimposed. FIG. 2 is a functional block diagram relating to a singing competition function according to the present invention. 4 is a flowchart showing the flow of a singing competition process according to the present invention. 1 is a flowchart showing the flow of a voting process according to the present invention.

Below, an embodiment of an information processing device, a video distribution method, and a video distribution program according to the present invention will be described with reference to the drawings.

In this embodiment, a performer records their own performance as a video using a mobile device and transmits it to a server, thereby uploading it to a video sharing site. The video uploaded to the video sharing site (posted video) can be viewed via a mobile device. Note that in this embodiment, the performance is referred to as singing, the performer is referred to as a singing user, and the video uploaded to the video sharing site is referred to as a singing video. Also, a user who views a singing video uploaded to the video sharing site is referred to as a viewing user.

[1. Karaoke system configuration]
1 is a schematic diagram of a karaoke system 1 according to the present embodiment. The karaoke system 1 includes a communication line 2, a plurality of mobile terminals 3 (mobile terminals 3A1, 3A2, 3B), and a server 4.

Communication line 2 forms a computer network and is, for example, a wide area communication line provided by an electric power company.

The mobile terminal 3 is, for example, an information processing terminal such as a smartphone, tablet terminal, or notebook computer, and is used by users to utilize online services. The mobile terminal 3 includes a touch panel display 3a for displaying images, a speaker 3b for outputting sound, a microphone 3c for inputting sound, a camera 3d for photographing a subject, and an earphone terminal 3e for connecting earphones (not shown). Note that photographing here refers to a state in which the camera 3d is functioning and the subject is displayed on the touch panel display 3a regardless of whether recording is occurring. The touch panel display 3a includes, for example, an LCD (Liquid Crystal Display) and a touch sensor. The LCD displays various images, and the touch sensor accepts various input operations performed using a pointing object such as a finger, a stylus, or a pen. In the following description, the touch panel display 3a is also referred to as a screen 3a.

The server 4 is an information processing device that provides online services to the mobile terminal 3 via the communication line 2. In the example of FIG. 1, the singing user uploads his/her singing video (singing video data) to a video posting site by transmitting the singing video from the mobile terminal 3A to the server 4. The viewing user then accesses the video posting site using the mobile terminal 3B and views the singing video. The singing user can also view the singing video that he/she has uploaded by accessing the video posting site using the mobile terminal 3A. Also, the user of the mobile terminal 3B can become a singing user and upload a singing video to the video posting site.

2. Server Configuration
FIG. 2 is a block diagram showing the electrical configuration of the server 4 according to the present embodiment.

The server 4 according to this embodiment includes a CPU (Central Processing Unit) 20 which is a main control unit that controls the overall operation of the server 4, a ROM in which various programs and various data are stored in advance,
(Read Only Memory) 22, a RAM (Random Access Memory) 24 used as a work area when the CPU 20 executes various programs, and a HDD (Hard Disk Drive) 26 as storage means for storing various programs and various data.

The HDD 26 stores singing video data transmitted from the mobile terminal 3A, i.e., singing video data uploaded to a video posting site, and song data indicating songs that the singing user can sing. Note that the storage means is not limited to the HDD 26, and may be, for example, another storage medium such as a semiconductor memory such as a flash memory.

The server 4 further includes an operation input unit 28, which is composed of a keyboard, a mouse, etc. and accepts input of various operations, a monitor 30, such as a liquid crystal display device, which displays various images, and an external interface 32, which is connected to other information processing devices, such as a mobile terminal 3, via the communication line 2 and transmits and receives various data to and from the other information processing devices.

The CPU 20, ROM 22, RAM 24, HDD 26, operation input unit 28, monitor 30, and external interface 32 are electrically connected to each other via a system bus 34. Therefore, the CPU 20 can access the ROM 22, RAM 24, and HDD 26, grasp the operation state of the operation input unit 28, display images on the monitor 30, and send and receive various data to and from other information processing devices, etc. via the external interface 32.

[3. Electrical configuration of the mobile terminal]
FIG. 3 is a functional block diagram showing the electrical configuration of the mobile terminal 3. As shown in FIG.

In addition to the components shown in FIG. 1, the mobile terminal 3 includes a main control unit 40, a main memory unit 42, an auxiliary memory unit 44, a communication unit 46, and an operation button 48.

The main control unit 40 is, for example, a CPU, a microprocessor, a DSP (Digital Signal Processor), etc., and controls the overall operation of the mobile terminal 3.

The main memory unit 42 is composed of, for example, RAM or DRAM (Dynamic Random Access Memory), and is used as a work area when the main control unit 40 executes processes based on various programs.

The auxiliary storage unit 44 is, for example, a non-volatile memory such as a flash memory, and stores various data such as images, and programs used in the processing of the main control unit 40. The programs stored in the auxiliary storage unit 44 are, for example, an OS (Operating System) for implementing basic functions of the mobile terminal 3, drivers for controlling various hardware, and programs for implementing e-mail, web browsing, and various other functions. In addition, the auxiliary storage unit 44 prestores an application for shooting and posting singing videos and viewing video posting sites (hereinafter referred to as a "video posting and viewing application").

The communication unit 46 is, for example, a network interface controller (NIC), and has a function of connecting to the communication line 2. Note that the communication unit 46 may have a function of connecting to a wireless LAN (Local Area Network), a function of connecting to a wireless WAN (Wide Area Network), and a function of enabling short-range wireless communication such as Bluetooth (registered trademark), infrared communication, etc., instead of or together with the NIC.

The operation buttons 48 are provided on the side of the mobile terminal 3 and include a power button for starting and stopping the mobile terminal 3 and a volume adjustment button for the sound output by the speaker 3b.

The main control unit 40, main memory unit 42, auxiliary memory unit 44, communication unit 46, operation buttons 48, touch panel display 3a, speaker 3b, microphone 3c, camera 3d, and earphone terminal 3e are electrically connected to each other via a system bus 49. Therefore, the main control unit 40 can access the main memory unit 42 and auxiliary memory unit 44, display images on the touch panel display 3a, grasp the operation state of the touch panel display 3a and the operation buttons 48 by the user, input sound to the microphone 3c, output sound from the speaker 3b or an earphone connected to the earphone terminal 3e, control the camera 3d, and access various communication networks and other information processing devices via the communication unit 46.

[4. Filming of singing videos by singing users]
A case where a singing user shoots a singing video using the mobile terminal 3A will be described.

When a singing user shoots a singing video, the singing user launches a video posting and viewing app on the mobile terminal 3A. When the video posting and viewing app launches, the mobile terminal 3A accesses the server 4 that stores multiple pieces of music data. The singing user then arbitrarily selects a piece of music to sing from the video posting and viewing app, and downloads the music data from the server 4 to the mobile terminal 3A. The singing user then plays the music at a timing of their choice using the video posting and viewing app, and sings. The video posting and viewing app starts playing the music, and starts shooting the video with the camera 3d. In other words, the singing video is a video shot by the mobile terminal 3A while the music is being played from the mobile terminal 3A.

Note that song data is also associated with lyric data, and when song data is downloaded from server 4 to mobile terminal 3A, the associated lyric data is also downloaded to mobile terminal 3A. Note that in the following explanation, song data is assumed to include lyric data.

Figure 4 shows an example of the display state (hereinafter referred to as "screen display") on the screen 3a of the mobile terminal 3A when shooting a singing video.

As shown in FIG. 4, the screen 3a is divided into a lyrics display area 50A and a captured image display area 50B. The lyrics display area 50A includes a lyrics image 52 that shows the lyrics of the song being sung by the user, a pitch image 54 that shows the pitch of the song, and a progress bar 56 that shows the progress of the capture.

The lyric image 52 and the pitch image 54 are updated according to the progress of the song. In the present embodiment, as an example, the lyric image 52 and the pitch image 54 are updated every few phrases and displayed in the lyrics display area 50A. Note that the update timing of the lyric image 52 and the pitch image 54 may be the same or different.

As an example, the lyrics image 52 displays lyrics in multiple rows (two rows in the example of FIG. 4), and the color of the lyrics in the upper row changes from the left end to the right end as the song progresses so that the singing user can understand the lyrics that should currently be sung. When the color change of the lyrics in the upper row reaches the right end, the lyrics in the lower row rises and are displayed in the upper row, and new lyrics are displayed in the lower row, and the color of the lyrics in the upper row changes again from the left end to the right end as the song progresses.

As an example, the pitch image 54 is displayed with multiple pitch bars 54A in a staircase pattern in the left-right direction according to the strength of the pitch. Then, in order to enable the singing user to grasp the pitch of the lyrics that should currently be sung, the color of the pitch bars 54A changes from the left end to the right end as the song progresses, and the pointer 54B moves from the left end to the right end. When the color of the pitch bars 54A changes and the pointer 54B reaches the right end, the pitch image 54 indicating the next pitch is updated and displayed.

As an example, the length of the progress bar 56 from the left end to the right end indicates the length of the entire song. When playback of the song begins, a pointer 56A indicating the playback position of the song moves from the left end to the right end, and when the pointer 56A reaches the right end, the song ends. Note that the portion of the progress bar 56 that the pointer 56A has passed through is displayed thicker than its position before the progress.

Recording of a singing video starts a predetermined time (e.g., 10 seconds) after the singing user selects a song and clicks a recording start button (not shown) displayed on screen 3a. The start and end of video recording may coincide with the start and end of the song, but this is not limited thereto. Video recording may start a predetermined time (e.g., 5 seconds) before the start of the song, or end a predetermined time (e.g., 5 seconds) after the song ends.

The singing user connects earphones to the earphone terminal 3e, listens to the played music using the earphones, and sings along with the music. The mobile terminal 3A captures an image of the singing user with the camera 3d, and records the singing of the singing user with the microphone 3c. In other words, the microphone 3c does not capture the sound of the played music. The mobile terminal 3A then records the singing user's singing voice captured by the microphone 3c, and uses this as singing data.

The singing data may be data that has been obtained by extracting the frequency band of the human voice through a filtering process. This filtering process removes noise caused by the singing user's surrounding environment from the singing data, making the recorded singing voice of the singing user clearer.

The video posting and viewing app then combines the music data and singing data with the recording data to generate singing video data that can be sent to server 4. As an example, the user can select one of the following two types of timing for sending the singing video data to server 4, i.e., the timing for uploading the data to the video posting site.

One is live streaming, in which the singing user uploads singing video data to a video sharing site in real time while singing. In live streaming, viewing users watch the singing user sing in real time. The other is non-live streaming, in which the singing user uploads singing video data to a video sharing site at a timing of their choice after finishing singing the song.

When performing live streaming, the singing user sets up the live streaming before recording the singing video, and uploads the singing video data to the video posting site when video recording starts. Note that in the case of live streaming, the singing video data may be uploaded to the video posting site without being stored in the mobile terminal 3A.

When live streaming is performed, the singing user can set either a first live streaming setting that allows viewing users to view the singing video during live streaming, or a second live streaming setting that allows viewing users to view the singing video even after the live streaming. That is, with the first live streaming setting, the singing video data is deleted from the server 4 when the live streaming ends, and the viewing user cannot view the live-streamed singing video after the live streaming ends. On the other hand, with the second live streaming setting, the server 4 continues to store the singing video data even after the live streaming ends, so the viewing user can view the singing video as a non-live stream even after the live streaming ends.

When non-live streaming is performed, the singing video data is temporarily stored in the mobile terminal 3A, and the singing user operates the video posting and viewing app to upload the singing video to the video posting site at any time.

[5. Viewing of singing videos by viewers]
A case where a viewing user views a singing video using the mobile terminal 3B will be described.

When the viewing user wishes to view a singing video, the viewing user launches a video posting and viewing application on the mobile terminal 3B. When the video posting and viewing application is launched, the mobile terminal 3B accesses a server 4 that stores multiple singing video data, i.e., a video posting site. The viewing user then selects the singing video that he or she wishes to view via the video posting and viewing application and displays it on the screen 3a. Note that one example of the method by which the server 4 distributes the singing video to the mobile terminal 3B is streaming distribution.

Figure 5 shows an example of the screen display of mobile terminal 3B when watching a singing video, showing the screen display when live streaming is taking place.

The screen 3a displays a singing video and also has a singing user display area 50C, a lyrics display area 50D, and a comment input display area 50E. The singing user display area 50C, the lyrics display area 50D, and the comment input display area 50E may be displayed superimposed on the singing video.

The singing user display area 50C displays the username of the singing user who posted the singing video, whether it is a live broadcast, and the name of the song being sung.

The lyrics of the singing video are displayed in the lyrics display area 50D. As an example, the lyrics displayed are multiple phrases at a time, and the color of the lyrics changes from the left end to the right end as the music progresses. As an example, the lyrics display area 50D may display lyrics in multiple rows. In this case, when the color change of the lyrics in the upper row reaches the right end, the lyrics in the lower row rises and is displayed in the upper row, and new lyrics are displayed in the lower row, and the color of the lyrics in the upper row changes again from the left end to the right end as the music progresses.

In the comment input display area 50E, a comment input field is displayed, and comments from viewing users who are watching the singing video are displayed together with their user names. As an example, each time a comment is input from a viewing user, that comment is added and displayed at the top of the comment input display area 50E, and comments that were previously displayed are moved down. If there are more comments than can be displayed in the comment input display area 50E, a scroll bar (not shown) is displayed on the right side of the comment display area, and comments that were not previously displayed on the screen 3a can be displayed by the viewing user operating the scroll bar.

In addition, operation icons 58A to 58D are displayed on screen 3a to allow the viewing user to perform various operations.

Operation icon 58A is an icon that is clicked by the viewing user when the viewing user empathizes with the singing video that the viewing user is viewing, and the total number of clicks on operation icon 58A for that singing video is displayed above operation icon 58A.

Operation icon 58B is an icon that is clicked when a viewing user challenges a singing user who is live streaming the singing video displayed on screen 3a to a battle (hereinafter referred to as a "singing battle"). A singing battle involves simultaneously displaying multiple singing videos (first singing video, second singing video) by different singing users on screen 3a of the viewing user's mobile terminal 3B, and the singing videos take turns singing the same song. In other words, the viewing user who clicks operation icon 58B becomes a singing user who will engage in a singing battle.

Operation icon 58C is an icon that is clicked by the viewing user to configure various settings for the video posting and viewing app.

Operation icon 58D is an icon that is clicked by the viewing user when a decorative image is to be superimposed on the singing video displayed on screen 3a. Note that the decorative images in this embodiment have a price determined according to their type, and can be purchased by the viewing user for a fee. Then, the viewing user superimposes a decorative image on the singing video that he or she is viewing by clicking operation icon 58D. The singing user of the singing video on which the decorative image is superimposed receives money according to the superimposed decorative image from the operator of the video posting site. In other words, the superimposition (display instruction) of a decorative image on a singing video by the viewing user corresponds to a so-called tipping to the singing user.

[6. Overview of the competitive singing function]
The video posting and viewing application according to the present embodiment has a battle function in which multiple users, who are performers, compete with each other to see who has the best performance video. The battle function according to the present embodiment is a kind of so-called karaoke battle, and is a singing battle function in which multiple singing videos (first singing video 60A, second singing video 60B) by different singing users are simultaneously displayed on the screen 3a of the mobile terminal 3B of the viewing user, as illustrated in FIG. 6. The singing battle function is executed by the server 4.

Figure 6 shows the screen display of the viewing user's mobile terminal 3B in a singing battle. The "VS" display shown in Figure 6 is displayed when the singing battle begins, and is stopped a predetermined time after the singing battle begins (e.g., 3 seconds). The screen display of the singing user's mobile terminal 3A may be the same as that shown in Figure 6, for example, or the other singing users who will be competing in the singing battle may be displayed in reduced size (see Figure 8 described below) compared to the screen display shown in Figure 4.

For a singing competition to take place, a singing user (hereinafter referred to as the "first singing user") makes a request (hereinafter referred to as the "match request") to another singing user (hereinafter referred to as the "second singing user") to simultaneously distribute a singing video, and the second singing user must accept the match request.

More specifically, the first singing user starts a video posting and viewing application on his/her mobile terminal 3A1 and sends a battle request to the second singing user who is live streaming a singing video using the video posting and viewing application. The battle request is sent by the first singing user clicking the operation icon 58B. The first singing user selects the song to be sung in the battle singing. Information indicating the selected song (hereinafter referred to as the "battle song") (title and singer name) is sent to the second singing user together with the battle request.

The match request sent from the mobile terminal 3A1 is sent to the mobile terminal 3A2 of the second singing user via the server 4. An image corresponding to the received match request is displayed on the screen 3a of the mobile terminal 3A2, and if the second singing user accepts the match request, he or she clicks on a predetermined image displayed on the screen 3a.

When the second singing user accepts the battle request from the first singing user, the server 4 starts the singing battle by distributing the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. This allows the viewing user to watch the singing battle (real-time battle) between the first singing user and the second singing user in real time. In the following description, the first singing video 60A and the second singing video 60B distributed in the singing battle are collectively referred to as singing battle videos.

In this way, the singing competition function accepts a singing video competition request from a first singing user to a second singing user, and if the second singing user accepts the competition request, delivers the first singing video 60A and the second singing video 60B so that they are displayed simultaneously on the screen 3a of the mobile terminal 3B. Therefore, the singing competition function enables singing users to compete with each other by using their own singing videos, and enables a viewing user to simultaneously watch multiple competing singing videos.

It is also possible that the second singing user accepts the battle request but does not accept the battle song. For such a case, the battle singing function may have a function to transmit information indicating the change in the battle song and the battle song selected by the second singing user from the second singing user's mobile terminal 3A2 to the first singing user's mobile terminal 3A1, and to request the first singing user's approval.

[6-1. Alternating singing in singing contests]
In the singing battle function according to this embodiment, a first singing user and a second singing user alternately sing the same piece of music (hereinafter referred to as "alternate singing").

Alternating singing may take the form of, for example, a first singing user finishing singing a song in its entirety, and then a second singing user singing the same song in its entirety; however, the singing battle function according to this embodiment virtually divides a song into multiple regions as shown in FIG. 7, and sets the order of singing users who will sing for each divided region 68 (hereinafter referred to as "alternating performance setting"). As a result, the first singing user and the second singing user will sing the same song in turn according to the alternating performance setting, so that the viewing user can clearly recognize the difference in singing ability between the first singing user and the second singing user, and can enjoy the singing battle even more. In the following description, the order of singing users who will sing will be referred to as the alternating singing order.

As an example, the singing competition function highlights the portion of the lyrics that the singing user is singing, thereby allowing the singing user to recognize the divided area 68 that he or she is singing. The highlighting is achieved by changing the color or thickness of the lyrics, etc.

In the example of FIG. 7, divided areas 68 are set so that the first singing user and the second singing user sing alternately, and divided areas 68 are also set so that the first singing user and the second singing user sing together. The divided areas 68 are set in advance based on, for example, phrases, choruses, or measures of a song, and the time length of each divided area 68 does not necessarily have to be the same.

The alternating singing order is determined when a singing battle is decided. For example, it is set so that the first singing user who requested the battle sings first, and the second singing user sings afterwards. Note that the divided area 68 in which the first singing user and the second singing user sing together may be set in advance for each song.

The alternating singing order set based on the divided areas may also change dynamically. For example, a singing user with a relatively higher total score obtained by a voting function described below may sing a larger number of divided areas 68. More specifically, the total scores of each singing user (singing video) are compared at each predetermined timing of the song, and the singing user with the relatively higher total score sings the subsequent divided areas 68 in succession. In this case, the maximum number of divided areas 68 that can be sung in succession is predetermined.

As a result, singing users with a relatively high total score will have more divided areas 68 to sing in, while singing users with a relatively low total score will have fewer divided areas 68 to sing in. Therefore, singing users with a relatively high total score can better showcase their singing ability to viewing users and attract them more.

0
[6-2. Screen display and audio output during alternating singing]
As described above, Fig. 6 shows a display screen of the mobile terminal 3B of the viewing user in the singing competition, in which the first singing video 60A and the second singing video 60B are both displayed in the same image size. For the singing video in which singing is being performed, a display that allows the viewing user to recognize it ("NOW PLAYING" in Fig. 6) is performed.

Here, a singing video or its audio when singing is not currently being performed is not of interest to the viewing user and may distract the viewing user who is watching singing that is currently being performed.

The singing competition function according to this embodiment distributes singing videos to mobile terminal 3B so that the sound of the singing video in which singing is being performed is output, and the sound of the singing video in which singing is not being performed is not output. Furthermore, server 4 distributes singing videos to mobile terminal 3B so that singing videos in which singing is being performed are displayed larger on screen 3a of mobile terminal 3B than singing videos in which singing is not being performed. This allows the viewing user to watch the singing competition videos without being distracted by singing videos in which singing is not being performed.

Figure 8 is an example of the screen display of the mobile device 3B during a singing battle. In the example of Figure 8, the first singing video 60A is currently being sung and the second singing video 60B is not currently being sung, so the first singing video 60A is displayed enlarged (full screen display) while the second singing video 60B is displayed reduced (window display). The image size and display position on the screen 3a when the singing videos are displayed reduced may be determined in advance, or the viewing user may be able to change the image size and screen position to any desired value.

The singing battle function according to this embodiment distributes singing videos to the mobile terminal 3B so that the first singing video 60A and the second singing video 60B are output as audio or the first singing video 60A and the second singing video 60B are displayed on the screen based on the alternating singing order described above.

That is, in the divided area 68 where the first singing user sings, the sound of the first singing video 60A is output and the first singing video 60A is displayed enlarged, while the sound of the second singing video 60B is not output and the second singing video 60B is displayed reduced. Also, in the divided area 68 where the second singing user sings, the sound of the second singing video 60B is output and the second singing video 60B is displayed enlarged, while the sound of the first singing video 60A is not output and the first singing video 60A is displayed reduced. Also, in the divided area 68 where the first singing user and the second singing user sing together, the first singing video 60A and the second singing video 60B are displayed on the screen at the same image size as shown in FIG. 6, and the sound of both is output.

In this way, the singing competition function according to this embodiment controls the audio output and screen display of the singing competition video based on the alternating performance settings described above, so that even when singing videos are displayed simultaneously, it is easy to control the output of the singing competition video on the viewing user's mobile terminal 3B.

[6-3. Voting function]
The video posting and viewing application has a voting function that accepts input of evaluations (hereinafter referred to as "votes") for each singing video in the singing competition from the viewing user's mobile terminal 3B.

As shown in Figures 6 and 8, a vote is entered by the viewer clicking on the operation icon 58A provided for each singing video. That is, if the viewing user sympathizes with a singing video, the viewing user clicks on the operation icon 58A as an indication of their intention to give a positive evaluation of the singing video. Then, an image 66 showing the evaluation result for each singing video that was received (hereinafter referred to as the "voting result image") is delivered so as to be displayed on the screen 3a of the mobile terminal 3B together with the singing video.

In this way, the voting function according to this embodiment allows the viewing user to rate the competitive singing videos by clicking on operation icon 58A, for example, so that when a singing competition takes place, the viewing user can easily determine the quality of the singing. Note that the viewing user can also rate one singing video and the other singing video.

The voting function accepts input of points as votes, and derives the total points input during the distribution of the singing videos (hereinafter referred to as "total evaluation points") as the evaluation result. The total evaluation points is the sum of the points input by multiple viewing users. The voting function then determines the winner of the singing competition based on the total evaluation points input by the time the singing competition ends. In other words, the singing user whose singing video has a relatively high total evaluation point is determined to be the winner. In this way, according to the voting function of this embodiment, multiple viewing users can vote cooperatively for the singing user (singing video) they support, and therefore the singing user they support can be determined to be the winner, allowing the viewing users to empathize more with the singing user.

In the voting function according to this embodiment, one point is entered each time the operation icon 58A is clicked once. The numbers (21 and 185) in the voting result image 66 shown in Figures 6 and 8 are the total evaluation points for each singing user (singing video), and the bar image that extends to the left and right of the screen 3a and has different hatching (colors) on the left and right indicates the relative total evaluation points for each singing video.

In addition, an upper limit is set for the number of times each viewing user can click on operation icon 58A (hereinafter referred to as "click upper limit"), and the click upper limit in this embodiment is one time. Then, when the click upper limit is reached, operation icon 58D is displayed on screen 3a in place of operation icon 58A, as shown in FIG. 8.

By clicking the operation icon 58D, the viewing user can superimpose a decorative image (hereinafter referred to as a "throwing effect image") on the singing video corresponding to the clicked operation icon 58D. In this way, the voting function has a throwing effect function that receives a request from the mobile terminal 3B to superimpose a throwing effect image on the singing video and superimposes the received throwing effect image on the singing video. In the following description, the viewing user's instruction (selection) to display the throwing effect image via the mobile terminal 3B is referred to as a throwing input, as described above.

In other words, since a viewing user decorates a singing video that he or she sympathizes with by superimposing the tip effect image 69 on the singing video, the tip effect function can liven up the viewers and the singing video itself during distribution of the singing video. Note that the tip effect function is a function executed by the server 4 in response to a display instruction from the viewing user via the video posting and viewing app.

Figure 9 shows the screen display of mobile terminal 3B to which the viewing user transitions when he or she clicks on operation icon 58D, and displays a number of different tip effect images 69 that the viewing user can select from. Points are set for each tip effect image 69, and the design differs according to the points. The viewing user selects one of the multiple tip effect images 69 displayed on the screen that can be obtained with the points they possess. Note that different designs refer to, for example, different shapes, colors, or orientations.

As an example, a charge is set for each point, and the viewing user purchases points, and the number of selectable tip effect images 69 increases or decreases depending on the number of points owned. When a tip effect image 69 is selected by the viewing user, the number of points owned by the viewing user decreases according to the number of points of the selected tip effect image 69. Note that points can be obtained not only by charging, but also by increasing the number of points by using other online services, etc.

The coin tip effect image 69 illustrated in FIG. 9 is four types of spotlight images that mimic spotlights and have different directions, and four types of combined spotlight images that combine multiple spotlight images and have different colors. By using an image that mimics a spotlight as the coin tip effect image 69, the viewing user can get the feeling that they are participating in a concert or the like. Note that the coin tip effect image 69 is not limited to the example in FIG. 9, and may be other images.

Figure 10 shows an example of a singing video on which a combined spotlight image is selected by a viewing user as a coin tip effect image 69 and the coin tip effect image 69 is superimposed (hereinafter referred to as an "effect superimposed singing video"). The effect superimposed singing video is viewable not only by the viewing user who selected the coin tip effect image 69, but also by other viewing users who are watching the singing competition.

The tip effect function according to this embodiment can be applied to a singing video in which singing is being performed, and after a tip input is made, the tip effect image 69 is superimposed on the singing video with almost no time delay. That is, in the example of FIG. 10, the viewing user can superimpose the tip effect image 69 on the first singing video 60A, but cannot superimpose the tip effect image 69 on the second singing video 60B in which the singing user is not singing. More specifically, even if the viewing user clicks on the operation icon 58D corresponding to a singing video in which the singing user is not singing, the tip effect function does not accept the click.

When the voting function accepts the superimposition of the tip effect image 69, it accepts input of a score corresponding to the tip effect image 69 as an evaluation. In this embodiment, as an example, points corresponding to the tip effect image are input as the evaluation score. In other words, each time a tip is input, points corresponding to the tip effect image 69 selected by the viewing user are added to the above-mentioned total evaluation score.

In this way, the voting function according to this embodiment can encourage viewing users to input a tip by accepting the input of a score as an evaluation in response to the superimposition of the tip effect image 69. Note that there is no upper limit to the number of times each viewing user can input a tip. In other words, a viewing user can increase the total evaluation score of a singing video that he or she sympathizes with by repeatedly clicking the operation icon 58D.

Furthermore, an image (icon image 64) showing a viewing user who has given a relatively higher rating (vote) to the singing video than other viewing users, i.e., a viewing user who has input a large number of points (hereinafter referred to as a "highly rated user"), is displayed on the screen 3a of the mobile terminal 3B. This allows the viewing user to make the other viewing users aware of the singing user that they are supporting. Also, the viewing user can make the singing user aware that they are supporting him/her.

In the voting function according to this embodiment, the top three users with the most points entered are determined as highly rated users, and icon images 64 of the highly rated users are displayed on screen 3a for each singing video, but the number of highly rated users whose icon images 64 are displayed is not limited to this.

In addition, in the voting function according to this embodiment, a score is input as an evaluation when the operation icon 58A is clicked and when a coin is deposited, but this is not limited to the above. For example, a score may be input as an evaluation when a coin is deposited 3, or a score may be input as an evaluation when the operation icon 58A is clicked.

[6-4. Other functions]
The server 4 may store information for each singing user (hereinafter referred to as "singing user information") in the HDD 26. The singing user information includes the number of fans the singing user has, the singing user's past match results and winning rate, and favorite songs. The singing battle function may accept a battle request from a first singing user who has a similar number of fans to a second singing user. It is considered that the number of fans a singing user has also differs depending on the singing ability of the singing user. In this way, by making the similar number of fans a condition for accepting a singing battle, it is possible to prevent singing battles between singing users with significantly different singing abilities.

More specifically, when a first singing user makes a challenge request to a second singing user, the competitive singing function compares the number of fans of the first singing user with the number of fans of the second singing user, and if the difference in the number of fans is within a predetermined reference value (e.g., within ±20%), accepts the challenge request from the first singing user to the second singing user. The number of fans increases when a viewing user registers that he or she is a fan of the singing user via the video posting and viewing app. There is no limit to the number of singing users that a viewing user can register as fans.

The singing battle function may accept a battle request even if the number of fans is similar as long as other conditions are met, or may accept a battle request even if the number of fans is not similar as long as the second singing user agrees. On the other hand, the singing battle function may only accept battle requests from users with similar numbers of fans. Here, "only" means, for example, that a battle request from users with an insufficient number of fans will not be accepted even if other conditions are met.

The singing competition function may also provide the singing user who wins the singing competition with compensation according to the total evaluation points that the singing user has acquired through votes for the singing user. The compensation may be money, or points that can be used in video posting and viewing apps (video posting sites) or other online services. The singing user who wins the singing competition may also receive compensation according to the combined total evaluation points of not only his or her own but also his or her opponent's (so-called "take all").

[7. Functional block of singing competition function]
11 is a functional block diagram of the singing battle function according to this embodiment. The CPU 20 of the server 4 includes a battle request receiving unit 70, a battle acceptance determining unit 71, a battle setting unit 72, a video evaluating unit 73, a coin tip effect superimposing unit 74, and a video distributing unit 75. The processes executed by each function of the server 4 are realized by a program stored in the HDD 26.

The match request receiving unit 70 receives a match request from a first singing user to a second singing user. The match request receiving unit 70 may also receive a match request from a first singing user to a second singing user who has a similar number of fans.

The match acceptance determination unit 71 determines whether the second singing user has accepted the match request from the first singing user.

The battle setting unit 72 performs various settings such as setting the song and the singing order for the singing battle. The battle setting unit 72 divides the song into multiple regions in chronological order, and sets the order of singing users who will sing in each region (alternate singing order). The battle setting unit 72 may also dynamically change the alternating singing order that is set based on the divided regions 68.

The video evaluation unit 73 receives input of an evaluation (score) for each singing video distributed to the mobile terminal 3B, and superimposition of a tip effect image 69 on the singing video (tipping input) from the mobile terminal 3B. The video evaluation unit 73 then derives the total evaluation score input during the distribution of the singing video, and determines the outcome of the singing competition.

When a tip input is received, the tip effect superimposition unit 74 superimposes a tip effect image 69 corresponding to the received tip input onto the singing video.

The video distribution unit 75 distributes the singing video to the mobile terminal 3B. Furthermore, when the second singing user accepts the battle request from the first singing user, the video distribution unit 75 distributes the first singing video 60A by the first singing user and the second singing video 60B by the second singing user so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. Furthermore, the video distribution unit 75 distributes the battle singing videos to the mobile terminal 3B so that the sound of the singing video in which singing is being performed is output, the sound of the singing video in which singing is not being performed is not output, and the singing video in which singing is being performed is displayed larger on the screen 3a than the singing video in which singing is not being performed.

[8. Flowchart of singing competition process]
12 is a flowchart showing the flow of the singing competition process according to this embodiment, which is executed by the CPU 20 of the server 4. A program for executing the singing competition process according to this embodiment is stored in a predetermined area of the HDD 26 in advance.

First, in step S100, the match request receiving unit 70 determines whether or not a match request has been made by the first singing user to the second singing user, and if the determination is positive, i.e., if a match request has been received from the first singing user, the process proceeds to step S102. On the other hand, if the determination is negative, the process goes into a waiting state until a match request is received.

In step S102, the match acceptance determination unit 71 determines whether the second singing user has accepted the match request, and if the judgment is affirmative, the process proceeds to step S104, and if the judgment is negative, the process returns to step S100.

In step S104, the battle setting unit 72 performs various settings for the singing battle.

In the next step S106, the video distribution unit 75 starts distributing the competition singing video.

In the next step S108, the video distribution unit 75 determines whether the song in the singing competition has ended, and if the determination is positive, the process proceeds to step S110. On the other hand, if the determination is negative, the video distribution unit 75 continues distributing the singing competition video until the song ends.

In the next step S110, the video distribution unit 75 ends the distribution of the singing competition video and returns to step S100.

As described above, the server 4 (competitive singing function) according to this embodiment accepts a singing video competition request from a first singing user to a second singing user, and if the second singing user accepts the competition request, distributes the first singing video 60A and the second singing video 60B so that they are simultaneously displayed on the screen 3a of the mobile terminal 3B. Therefore, the server 4 (competitive singing function) according to this embodiment enables singing users to compete with each other in their own singing through their respective singing videos, and enables a viewing user to simultaneously watch multiple competing singing videos.

9. Flowchart of voting process
13 is a flowchart showing the flow of the voting process according to this embodiment, which is executed by the CPU 20 of the server 4. A program for executing the voting process according to this embodiment is stored in a predetermined area of the HDD 26 in advance.

First, in step S200, the video evaluation unit 73 determines whether or not the singing competition has started, and if the determination is positive, the process proceeds to step S202. On the other hand, if the determination is negative, the process waits until the singing competition starts.

In step S202, the video evaluation unit 73 determines whether the operation icon 58A has been clicked by the viewing user, and if the determination is positive, the process proceeds to step S204, and if the determination is negative, the process proceeds to step S206.

In step S204, the video evaluation unit 73 derives the total evaluation score, and the video distribution unit 75 updates the display of the total evaluation score.

In step S206, the video evaluation unit 73 determines whether the operation icon 58D has been clicked by the viewing user, and if the determination is positive, the process proceeds to step S208, and if the determination is negative, the process proceeds to step S210.

In step S208, the coin tip effect superimposition unit 74 superimposes the coin tip effect image 69 selected by the viewing user on the target singing video, the video evaluation unit 73 derives a total evaluation score by adding points corresponding to the superimposed coin tip effect image 69, and the video distribution unit 75 updates the display of the total evaluation score.

In the next step S210, the video evaluation unit 73 determines whether there has been a change in the users who have given the singing video high ratings, and if the determination is positive, the process proceeds to step S212, and if the determination is negative, the process proceeds to step S214.

In step S212, the video distribution unit 75 updates the display of the icon images 64 of highly rated users.

In step S214, the video distribution unit 75 determines whether the song in the singing competition has ended, and if the determination is positive, the process proceeds to step S216, and if the determination is negative, the process returns to step S202.

In step S216, the video evaluation unit 73 determines whether the contestant wins or loses based on the total evaluation score for each singing video, and the video distribution unit 75 distributes an image showing the result.

In the next step S218, the video distribution unit 75 ends the distribution of the competition singing video and ends this voting process.

As described above, the server 4 (voting function) according to this embodiment receives evaluations from the mobile terminal 3B for each singing video distributed to the mobile terminal 3B. Therefore, the server 4 (voting function) according to this embodiment enables viewing users to easily determine the merits and demerits of performance videos distributed by each of multiple singing users.

10. Other embodiments
The present invention has been described above using the above-mentioned embodiments, but the technical scope of the present invention is not limited to the scope described in the above-mentioned embodiments. Various modifications or improvements can be made to the above-mentioned embodiments without departing from the gist of the invention, and the forms in which such modifications or improvements are made are also included in the technical scope of the present invention. In addition, the above-mentioned embodiments may be combined as appropriate.

For example, in the above embodiment, a singing battle is described in which two singing users perform the singing battle, but the present invention is not limited to this. For example, a singing battle may be performed by three or more singing users. In this case, a singing user may simultaneously request a battle with two or more other singing users, or a singing user who receives a battle request may further request a battle with other singing users.

In the above embodiment, the voting result image 66 is described as being a form in which the total evaluation score for each singing video is displayed as a bar image, but the present invention is not limited to this. For example, instead of a bar image, the total evaluation score for each singing video may be relatively displayed as a pie chart.

In the above embodiment, the winner of the singing competition is determined by the votes of the viewing users, but the present invention is not limited to this. For example, the singing competition function may have an automatic scoring function, and the winner may be determined by the results of the automatic scoring function.

In the above embodiment, the first singing video 60A and the second singing video 60B are output as audio and displayed on the screen based on the alternating performance setting, but the present invention is not limited to this. For example, the server 4 may perform image analysis (face recognition processing) on the singing videos sent from the mobile terminal 3A to determine which singing video has a wider mouth opening, and based on this determination result, output the audio and display the first singing video 60A and the second singing video 60B. In other words, the singing video with a relatively wider mouth opening is determined to be the singing video in which the singing user is currently singing.

In the above embodiment, a real-time battle is described as a form of competitive singing, but the present invention is not limited to this. For example, a first singing user may request a battle with a singing video of another singing user that has already been recorded, enabling a battle between a live singing video and a recorded singing video, or a battle between recorded singing videos.

In the above embodiment, the performance is singing and the video uploaded to the video sharing site is a singing video, but the present invention is not limited to this. For example, the performance may be something other than singing, such as dancing and the video uploaded to the video sharing site is a dance video.

The process flow described in the above embodiment is also an example, and unnecessary steps may be deleted, new steps may be added, or the process order may be changed without departing from the spirit of the present invention.

3B Mobile terminal (terminal device)
3a Screen 4 Server (information processing device)
26 HDD (storage means)
66 Voting result image (image showing evaluation result)
69. Tipping effect image (decorative image)
73 Video evaluation unit (evaluation means)
74 coin throwing effect superimposition unit (superimposition means)
75 Video distribution unit (distribution means)

Claims (5)

An information processing device including a processor,
The processor,
Distributing a distribution video including a first video by a first user and a second video by a second user to a terminal device;
accepting an input of a predetermined number of points for at least one of the first video and the second video from the terminal device during the distribution of the video;
displaying information indicating at least one user who has input a predetermined number of points to a target video among the first video and the second video together with the target video;
When there is a second user who has input a higher number of points for the target video than the first user, information indicating the second user is preferentially displayed together with the target video over information indicating the first user ;
In a first period, the first moving image is output in a first aspect and the second moving image is output in a second aspect, and in a second period, the first moving image is output in the second aspect and the second moving image is output in the first aspect.
Information processing device. when an input of a predetermined number of points is received from the terminal device during the first period, the first video is identified as the target video, and when an input of a predetermined number of points is received from the terminal device during the second period, the second video is identified as the target video.
The information processing device according to claim 1 . A processor distributes a distribution video including a first video by a first user and a second video by a second user to a terminal device;
a processor receives an input of a predetermined number of points for at least one of the first video and the second video from the terminal device during the distribution of the distribution video;
a processor displays information indicating at least one user who has input a predetermined number of points to a target video among the first video and the second video together with the target video;
a processor, when there is a second user who has input a higher number of points for the target video than a first user, displays information indicating the second user together with the target video in a preferential manner over information indicating the first user;
a processor causes the first moving image to be output in a first manner and the second moving image to be output in a second manner during a first period, and causes the first moving image to be output in the second manner and the second moving image to be output in the first manner during a second period;
Information processing methods. Displaying a distribution video including a first video by a first user and a second video by a second user on a display ;
Accepting an input of a predetermined number of points for at least one of the first video and the second video while the video being distributed is being displayed ;
displaying information indicating at least one user who has input a predetermined number of points to a target video among the first video and the second video together with the target video;
When there is a second user who has input a higher number of points for the target video than the first user, information indicating the second user is preferentially displayed together with the target video over information indicating the first user ;
In a first period, the first moving image is output in a first aspect and the second moving image is output in a second aspect, and in a second period, the first moving image is output in the second aspect and the second moving image is output in the first aspect.
A program that causes a processor to execute a process. A server and a terminal device are provided,
The server,
Distributing a distribution video including a first video by a first user and a second video by a second user to the terminal device;
accepting an input of a predetermined number of points for at least one of the first video and the second video from the terminal device during the distribution of the video;
displaying information indicating at least one user who has input a predetermined number of points to a target video among the first video and the second video together with the target video;
When there is a second user who has input a higher number of points for the target video than the first user, information indicating the second user is preferentially displayed together with the target video over information indicating the first user ;
In a first period, the first moving image is output in a first aspect and the second moving image is output in a second aspect, and in a second period, the first moving image is output in the second aspect and the second moving image is output in the first aspect.
system.

Images