JP6401492B2 - Online karaoke system server - Google Patents

Description

  The present invention relates to a server for an online karaoke system, and more specifically, generates a background video that combines a singing voice of a singer, a singer character, a spectator character, and a video imitating the inside of a facility where the singing is performed. The present invention relates to a server for a communication karaoke system that can change the background video corresponding to the number of spectator characters.

  In order to increase the fun of karaoke singing and to enhance the atmosphere of the venue, a service is known that displays an animation in which a character imitating a singer appears as a background image displayed during karaoke singing (patent) Reference 1, Patent Document 2, and Patent Document 3). The technique described in Patent Document 1 is that a singer character sings in the background according to the genre of the song to be sung, such as the street for rock and the seaside for enka, and the number of audience characters according to the grading process during singing. It is about animation technology that gathers and sees.

  According to this technology, when displaying the evaluation of a song, instead of displaying the score, if the singing is judged to be good, the crowd gathers well, and if the song is poor, the gathering worsens Since the display is controlled, it is possible to perform singing evaluation that is human-like and not mechanical singing evaluation.

  According to the technique described in Patent Document 2, the “number of members of the virtual fan club” is accumulated according to the number of attendees at the time of singing, and the singer character sings at the venue or hall according to the number of members. It is about animation technology.

  According to this technology, if the number of members is small, the singing is performed on the street in front of the station. However, if the number of members is large, the singing can be performed on the dome stadium. Thereby, the interest of karaoke increases and it is possible to encourage the singers and attendees to come back to the store.

  The technique described in Patent Document 3 stores a plurality of audience videos with different numbers of audiences as background videos, determines the degree of popularity of music based on the number of music performances in a predetermined period, and determines the audience size. It is like that. In this case, if the number of performances is large, it is determined that the music is popular, and a spectator video scene with a large number of spectators is selected. Thus, since the audience video scenes with different audience numbers according to the number of performances become the background video, it is possible to display the background video with enhanced realism.

  Moreover, when reproducing the posted singing image | video, the technique of reproducing | regenerating while changing a singing image | video is known rather than reproducing | regenerating in the aspect as contributed (refer patent document 4). The technique described in Patent Document 4 provides a video effect related to both videos in a co-star video that synchronizes and reproduces a plurality of posted song videos. As described above, when a plurality of song videos are synchronously reproduced, the video effects that are related to each other are provided, so that the sense of unity of the song videos can be enhanced.

Japanese Patent Laid-Open No. 08-166780 JP 2002-41067 A JP 2004-333577 A JP 2012-209856 A

  As described above, various techniques for publishing a singing video have been disclosed, but those who enjoy singing at karaoke do not want to reveal their faces, but they are confident in singing. There are many people who want to sing a song without revealing an actual face image. However, at present, when it is common to perform moving image playback, it is not easy to promote viewing by a third party even if only the singing voice is disclosed.

  Therefore, in a combination of conventional techniques, it is considered that a new song video is synthesized and posted on a public site using the background video in which the singer character or spectator character appears and the singing voice of the actual singer. It is done.

  In such a technology, the background video is provided for the purpose of enjoying the karaoke singing at the same time as the karaoke singing, and the work posted as a new synthetic singing video can be viewed on a personal computer or mobile terminal. However, since the same content is always played back, there is a concern that it is not interesting and viewers are easily bored.

  The present invention has been proposed in view of the above-described circumstances, and uses a singer character when releasing a singing video, and can change a background video including a spectator character according to the number of times the singing video is viewed. An object is to provide a server for a communication karaoke system.

  The server of the communication karaoke system of the present invention has been proposed in view of the above-described circumstances, and has the following features. That is, the server of the communication karaoke system of the present invention is characterized in that it includes first storage means, acquisition means, editing means, and distribution means.

  The first storage means is a video simulating the singing voice sung by the singer in accordance with the karaoke performance, the singer character imitating at least the singer and the audience character imitating the audience, and the inside of the facility where the singing is performed. It is means for storing a plurality of synthesized singing moving images composed of background videos corresponding to the number of spectator characters.

The acquisition means is means for acquiring character data of the audience character. The editing means is a means for editing the synthetic singing video every time a reproduction request is received for an arbitrary synthetic singing video from among the plurality of synthetic singing videos stored in the first storage unit. The distribution means is means for distributing the composite singing moving image edited by the editing means together with performance data of karaoke performance sung by the singer . Then, the editing means adds a spectator character based on the character data acquired by the acquisition means to the synthetic song video.

  Further, in addition to the above-described configuration, it is possible to include a second storage unit that stores a plurality of different character data. In such a configuration, the acquisition unit functions to acquire one of a plurality of different character data stored in the second storage unit.

  Further, in addition to the above-described configuration, it is possible to provide receiving means for receiving character data when receiving a reproduction request. In such a configuration, the acquisition unit acquires the character data received by the reception unit.

  Further, in addition to the above-described configuration, it is possible to include a third storage unit that stores data of a plurality of background videos respectively corresponding to the number of spectator characters. In such a configuration, the editing means, when the background video does not correspond to the number of spectator characters, of the spectator character among the plurality of background videos stored in the third storage means instead of the background video. A background video corresponding to the number is selected to generate a synthetic singing video.

  Moreover, in addition to the structure mentioned above, it is possible to provide the effect provision means which provides the sound effect corresponding to a background image | video to a song voice.

  In the server of the communication karaoke system having such a configuration, a publicly-synthesized singing movie is edited each time it is reproduced, and a spectator character is added. Further, when the number of times of reproduction exceeds a predetermined value, that is, when the seats are full, the video is edited so as to be sequentially changed to a video of a venue with a larger capacity.

  In the server of the online karaoke system of the present invention, when the popularity of the posted synthetic singing video increases, the number of playbacks increases, and various variations of the synthetic singing video can be enjoyed. In addition, a sense of unity is cultivated between contributors and viewers, and an unprecedented way to enjoy a singing video can be provided.

  In addition, for the viewer, the video changes even if the favorite synthetic singing movie is reproduced repeatedly, so that the enjoyment of viewing can be increased and the user is not bored with watching the synthetic singing movie. On the other hand, for the singer, it can be expected that the increase in the number of playbacks is visually realized as an increase in the number of spectators, so that the singing motivation can be enhanced.

The block diagram which shows schematic structure of the server of the communication karaoke system which concerns on embodiment of this invention. Explanatory drawing which shows the relationship between the number of audience characters and a background image | video. Explanatory drawing which shows the production | generation procedure of a synthetic song animation. The schematic diagram which shows the change of a synthetic song animation.

  With reference to drawings, embodiment of the server of the communication karaoke system of this invention is described. 1 to 4 illustrate a server of a communication karaoke system according to an embodiment of the present invention. FIG. 1 is a block diagram showing a schematic configuration of the server, and FIG. 2 shows a relationship between the number of spectator characters and a background video. FIG. 3 is an explanatory diagram showing a procedure for generating a synthetic singing video, and FIG. 4 is a schematic diagram showing changes in the synthetic singing video.

<Outline of online karaoke system server>
As shown in FIG. 1, the server 10 of the online karaoke system according to the embodiment of the present invention includes a first storage unit 18, an acquisition unit 13, an editing unit 14, and a distribution unit 15 as functional units serving as a basic configuration. Yes. Further, the server 10 may include a second storage unit 20, a receiving unit 16, a third storage unit 21, and an effect applying unit 17 in addition to these functional units. In addition, not all the functional means described above are realized by one server 10, but the functional means described above may be divided and realized by a plurality of servers. In this case, one unit is realized by virtualization technology. A server can be operated as a plurality of servers.

  In the following description, a program is stored in a RAM or the like and executed by hardware such as a CPU, so that not only software that exhibits its function but also a logic circuit that can exhibit an equivalent function. It is a concept that includes.

  The server 10 is a device capable of comprehensively managing a plurality of karaoke performance devices 30 and transmitting / receiving data to / from the portable information terminal 70 and the personal computer 80. In addition, data communication can be performed with the user's personal computer 80 and the portable information terminal 70 via the data communication line 50 such as a general telephone line and a wireless communication line and the communication base station 40. Further, the server 10 is connected to a plurality of karaoke performance devices 30 via the data communication line 50 and the router 60.

  As shown in FIG. 1, the server 10 includes central control means 11 including a CPU and communication control means 12 as main devices for functioning as the server 10. Furthermore, as described above, as means for realizing the communication karaoke system according to the present invention, the first storage means 18, the acquisition means 13, the editing means 14, the distribution means 15, the second storage means 20, the reception means 16, A third storage unit 21 and an effect applying unit 17 are provided. In addition, a plurality of karaoke performance data is stored in a storage device (not shown) of the server 10, and the distribution unit 15 distributes the synthesized singing moving image 19 edited by the editing unit 14 together with the karaoke performance data. To do. The karaoke performance data is also distributed to the karaoke performance device 30.

<First storage means>
The 1st memory | storage means 18 consists of mass storage apparatuses, such as HDD, the singing voice 19a which the singer sang according to the karaoke performance, the singer character 19b imitating at least a singer, and the audience character 19c imitating the audience And a plurality of synthesized singing videos 19 composed of background images 19d corresponding to the number of audience characters 19c, which are images simulating the inside of a facility where singing is performed.

  That is, the first storage means 18 of the present embodiment stores a plurality of synthesized song videos 19 created for the purpose of disclosure, and each synthesized song movie 19 includes a singer character 19b and a spectator character 19c. A background image 19d composed of an image representing a facility corresponding to the number of audience characters 19c is stored. The relationship between the number of playback times of the synthetic singing moving image 19 and the number of spectator characters 19c and the relationship between the number of spectator characters 19c and the background image 19d will be described in detail later.

<Acquisition means>
The acquisition unit 13 is a unit for acquiring the character data 20 of the audience character 19c imitating the audience. That is, when creating the synthetic singing movie 19, the character data 20 of the spectator character 19 c is acquired by the function of the acquisition means 13. Moreover, you may comprise the acquisition means 13 so that the character data 20 of the singer character 19b imitating a singer may be acquired. The character data 20 of the singer character 19b and the audience character 19c will be described in detail later.

<Editing means>
The editing unit 14 is a unit for editing the synthetic singing video 19 every time a reproduction request is received for an arbitrary synthetic singing video 19 from the plurality of synthetic singing videos 19 stored in the first storage unit 18. is there. That is, when the editing means 14 of this embodiment receives a reproduction request for an arbitrary synthetic singing moving image 19, the singing voice, the singer character 19b, the audience character 19c, and the background video 19d are used each time to synthesize the singing song. Edit the video 19.

<Distribution means>
The distribution unit 15 is a unit for distributing the composite singing moving image 19 edited by the editing unit 14 together with performance data (karaoke performance data) of karaoke performance sung by the singer . That is, when the distribution means 15 accepts a playback request for an arbitrary synthetic song video 19, it adds karaoke performance data to the synthetic song video 19 and sends it to the personal computer 80 or the like that has sent the playback request. And karaoke performance data. When the distribution unit 15 is provided, the editing unit 14 adds a spectator character 19 c based on the character data 20 a acquired by the acquisition unit 13 to the synthetic singing moving image 19.

  Specifically, when the synthetic singing video 19 is distributed by the distribution means 15, the number of reproductions of the synthetic singing video 19 increases by one. And every time the edit means 14 receives the reproduction | regeneration request | requirement of the synthetic song animation 19, the audience character 19c increases, the synthetic song animation 19 is edited, and the new synthetic song animation 19 corresponding to the number of the audience characters 19c concerned is produced. Will be generated.

<Second storage means>
The 2nd memory | storage means 20 consists of mass storage apparatuses, such as HDD, and memorize | stores several different character data 20a. In such a configuration, the acquisition unit 13 functions to acquire one of a plurality of different character data 20 a stored in the second storage unit 20. That is, the 2nd memory | storage means 20 memorize | stores several different character data 20a about the spectator character 19c at least. Moreover, the 2nd memory | storage means 20 may memorize | store at least 1 or more singer character 19b. When there are a plurality of singer characters 19b stored in the second storage means 20, the singer characters 19b are different from each other.

  And the acquisition means 13 acquires one from several different character data 20a. In order to acquire one of a plurality of different character data 20a, it is necessary to select the character data 20a. However, the server 10 may perform the selection automatically, or an instruction from the user. You may perform based on an input.

<Receiving means>
The receiving means 16 is means for receiving character data when receiving a reproduction request. In the case of such a configuration, the acquisition unit 13 acquires the character data received by the reception unit 16. Specifically, when a user requests to view the synthetic song video 19 using the personal computer 80 or the like and a playback request signal is transmitted from the personal computer 80 or the like, the receiving means 16 receives the playback request. Simultaneously, arbitrary character data is received from the personal computer 80 or the like.

  That is, in the case of the configuration provided with the receiving means 16, the acquiring means 13 does not acquire the character data 20a stored in the second storage means 20, but the character from the personal computer 80 or the like that has transmitted the reproduction request signal. Data 20a is acquired.

<Third storage means>
The third storage unit 21 includes a large-capacity storage device such as an HDD, and stores a plurality of background video data 21a corresponding to the number of spectator characters 19c. In such a configuration, when the background video 19d does not correspond to the number of spectator characters 19c, the editing unit 14 replaces the background video 19d with a plurality of background video data 21a stored in the third storage unit 21. The background image 19d corresponding to the number of the audience characters 19c is selected from among the images, and the synthesized singing movie 19 is generated.

  Specifically, the third storage means 21 stores a plurality of background videos 19d corresponding to facilities of different scales as the background video data 21a, and the number of spectator characters 19c increases, and the background video 19d until then. If the facility cannot be accommodated in the facility of the scale used as the facility, the facility of a scale that can accommodate all the audience characters 19c is selected as the background image 19d, and the synthesized singing movie 19 is generated.

<Effect imparting means>
The effect imparting means 17 includes a program for imparting an acoustic effect corresponding to the background video 19d to the singing voice 19a. That is, the effect imparting means 17 imparts an acoustic effect corresponding to a facility of a scale used as the background video 19d to the singing voice 19a. For example, when the background image 19d is a small snack, the singing sound 19a has almost no acoustic effect. When the background image 19d is a large hall, the singing sound 19a is added with an acoustic effect suitable for the large hall. To do. Details of the acoustic effect will be described later.

<Procedure for generating a synthetic song video>
Next, with reference to FIGS. 2-4, the procedure which produces | generates the synthetic | combination song animation 19 in embodiment of this invention is demonstrated concretely. In addition, in the following description, although the name of the synthetic song animation 19 and the number of the audience characters 19c are shown concretely, these are illustrations, and in the production | generation of the actual synthetic song animation 19, it is a synthetic song animation public site. Various settings can be made according to the scale and the like.

  As shown in FIG. 3, when a viewer accesses a synthetic song video public site using a personal computer 80 or a portable information terminal 70 (for example, a smartphone) (S 1), the server 10 sends a plurality of posted synthetic songs. A thumbnail of the video 19 is displayed (S2). When the viewer designates the synthetic singing video 19 and receives a reproduction instruction signal from the personal computer 80 or the like (S3), the number of spectator characters 19c is increased (S4).

  Subsequently, it is confirmed whether or not the number of spectator characters 19c corresponds to the background video 19d (S5). Here, if the number of spectator characters 19c corresponds to the background video 19d, a synthesized singing video 19 using the same background video 19d as the previous time is generated (S6). On the other hand, if the number of spectator characters 19c does not correspond to the background video 19d, a synthesized singing moving image 19 using the new background video 19d corresponding to the number of spectator characters 19c is generated (S7).

  For example, suppose that the viewer designates a synthetic song video A that he / she wants to play and instructs playback. As shown in FIG. 4 (a), in the previous video playback, the synthesized singing video A is sung by a singer character 19b at a predetermined seat in a general karaoke room (background video 1) and around the singer. This is a video in which nine spectator characters 19c are sitting.

  Each time the synthetic singing movie A is reproduced, the number of spectator characters 19c increases. Therefore, at the time of moving image reproduction this time, the number of spectator characters 19c, which was nine, increases by one to ten. Here, the number of spectator characters 19c corresponding to the existing background image 1 is 9 or less, and the current number of spectator characters 19c is no longer corresponding to 10 people. A background image 19d corresponding to 10 characters 19c is selected. Then, the composite singing moving image 19 is generated with reference to the correspondence table between the number of spectator characters 19c and the background video 19d. The correspondence table between the number of spectator characters 19c and the background video 19d is configured by associating the identification number of the background video 19d, the number of spectator characters 19c, and the content of the background video 19d, for example, as shown in FIG. It is a data table.

  As a result of editing the synthetic singing video 19, a synthetic singing video A using the new background video 19 d is generated in the current reproduction. Specifically, as shown in FIG. 4B, the synthesized singing video A is sung by the singer character 19b on the stage of the live house (background video 2), and ten spectator characters 19c are seated in the audience seats. It becomes a picture. Note that the audience character 19c to be added can be composed of the audience character 19c appropriately selected by the server 10 in accordance with the viewer's personal information (birth date, sex, etc.) managed in advance in the database.

<Other embodiments>
Also, when the viewer accesses the synthetic singing video public site and designates the synthetic singing video 19 to be played back, does the server 10 transmit the character data of the original spectator character 19c such as a face photograph or illustration to the viewer? You may be made to inquire whether or not. In such a configuration, when the viewer desires to transmit the character data of the original spectator character 19c, the character data is received and the synthesized singing moving image 19 is generated as the spectator character 19c.

  In addition, when the number of spectator characters 19c reaches the capacity of a famous facility that actually exists, the synthesized singing moving image 19 constituted by the background video 19d that images the facility may be reproduced a predetermined number of times. The synthetic singing video 19 becomes a so-called rare video, and it is possible for both the singer and the viewer to enhance the pleasure of viewing and watching the synthetic singing video 19.

  When the synthesized singing movie 19 is generated, the server 10 synchronizes the edited synthesized singing movie 19 with the karaoke performance of the synthesized singing movie 19 and streams it to the viewer's personal computer 80 or the like. Further, when the server 10 performs streaming delivery of the synthetic singing video 19 in synchronization with the karaoke performance of the synthetic singing video 19, the server 10 gives an acoustic effect (reverb) that matches the background video 19d to the singing voice 19a. May be. That is, in the correspondence table (see FIG. 2) between the number of spectator characters 19c and the background video 19d, as the effect data for the background videos 1 to 9, the type of reverb (for example, “room”, “hall”, “theater”, etc. A parameter indicating the size of the space), a reverb send level (for example, a numerical value of 0 to 100), and the like may be associated with each other. By adopting such a configuration, the sense of unity between the singing voice 19a and the background video 19d is increased, and the enjoyment of viewing and watching the synthetic singing video 19 can be further enhanced.

  The correspondence table between the number of spectator characters 19c and the background video 19d may be prepared for each genre of music or for each original singer. Furthermore, the rare video may use a background video 19d that is an image of a facility that exists in the area (local) according to the attribute information and location information of the viewer.

  Note that the number of spectator characters 19c to be added may be one per reproduction or a predetermined number of two or more. Further, the singer character 19b (for example, a costume) may be upgraded in accordance with the number of audience characters 19c.

  In addition, when the synthesized singing video 19 and motion data obtained by extracting the singer's singing motion are linked and stored, and synthesized with the background image 19d accompanied by the stage, the singer's motion data is included in the motion data. Based on this, the movement of the singer character 19b may be controlled. For example, since the background video 1 is sung by singing, the motion data is hardly reflected, but in the background video 9, various controls such as exaggerating the motion data to move around a wide stage are possible.

  In the above-described embodiment, the number of spectator characters 19c is increased each time a reproduction request for the synthetic singing video 19 is received. However, the number of reproductions of the synthetic singing video 19 is managed, and the number of reproductions within a predetermined period. May be used to select the number of spectator characters 19c and the background video 19d corresponding to the number. In the case of such a configuration, the scale of the facility that becomes the background video 19d is changed in accordance with the number of reproductions within a predetermined period. Specifically, as the number of reproductions within a predetermined period increases, the facility that becomes the background image 19d becomes gorgeous. On the other hand, as the number of reproductions within a predetermined period decreases, the facility that becomes the background image 19d becomes smaller. Thereby, since the background image | video 19d can be changed according to the popular movement of the synthetic | combination song animation 19, it can give a variation in how to enjoy a song animation.

  The devices and means constituting the system of the present invention and its peripheral devices are not limited to those described above, and only the necessary devices and means are configured according to the purpose of use, or other devices and means are appropriately added. Can be. Further, each unit may be configured as a unit in which a plurality of functions are integrated, instead of being configured separately.

DESCRIPTION OF SYMBOLS 10 Server 11 Central control means 12 Communication control means 13 Acquisition means 14 Editing means 15 Distribution means 16 Receiving means 17 Effect giving means 18 First storage means 19 Synthetic song animation 19a Singing voice 19b Singer character 19c Audience character 19d Background image 20 Second 2 storage means 20a character data 21 3rd storage means 21a background video data 30 karaoke performance device 40 communication base station 50 data communication line 60 router 70 portable information terminal 80 personal computer

Claims (5)

A server for an online karaoke system,
A singing voice sung by a singer in accordance with a karaoke performance, a singer character simulating at least a singer and a spectator character simulating a spectator, and an image simulating the inside of a facility where singing is performed, First storage means for storing a plurality of synthesized singing videos composed of background images corresponding to the number;
Obtaining means for obtaining character data of the audience character;
An editing means for editing the synthetic singing video every time a reproduction request is received for an arbitrary synthetic singing video from the plurality of synthetic singing videos stored in the first storage unit;
A distribution unit that distributes the synthetic singing video edited by the editing unit together with the performance data of the karaoke performance ,
The editing means adds a spectator character based on the character data acquired by the acquisition means to the synthetic song video.
The server of the communication karaoke system characterized by this. A second storage means for storing a plurality of different character data;
The acquisition means acquires one of a plurality of different character data stored in the second storage means.
The server of the communication karaoke system according to claim 1. A receiving means for receiving the character data when receiving the reproduction request;
The obtaining means obtains the character data received by the receiving means;
The server of the communication karaoke system according to claim 1. A third storage means for storing a plurality of background video data respectively corresponding to the number of audience characters;
If the background video does not correspond to the number of spectator characters, the editing means corresponds to the number of spectator characters among the plurality of background videos stored in the third storage means instead of the background video. Select a background video and generate the synthetic song video.
The server of the communication karaoke system of any one of Claims 1-3 characterized by the above-mentioned.   The server of the communication karaoke system of any one of Claims 1-4 provided with the effect provision means to provide the acoustic effect corresponding to the said background image | video to the said song sound.

Images