JP6427439B2 - Karaoke device - Google Patents

Description

  The present invention relates to a karaoke apparatus.

  DESCRIPTION OF RELATED ART In the communication karaoke system, the karaoke apparatus provided with the scoring function of a karaoke song is prevailing. Scoring of karaoke singing is performed by digitizing karaoke singing of a singer and comparing with numerical value of reference data. The scoring result is displayed for each song section during the music performance, or displayed as a total score after the music performance, using a monitor that displays the lyrics and the background image.

  Furthermore, techniques for presenting not only a score evaluation but also an evaluation comment are known. For example, Patent Document 1 discloses a karaoke apparatus capable of evaluating singing in real time during music performance and reproducing the evaluation result by voice. The evaluation comment can be reproduced with voices of various voices stored in advance in the hard disk, such as a singer's voice, a voice of an animation character, or an Osaka dialect (specification paragraph [Patent Document 1] [0093]).

Unexamined-Japanese-Patent No. 2000-122674

  By the way, when reproducing the message (evaluation comment) according to song evaluation as an audio | voice, it is desirable for a singer to be able to grasp the content of the said message. For this purpose, it is necessary to reproduce the message so as not to overlap the singer's singing as much as possible.

  Patent Document 1 describes that the evaluation comment is reproduced at a timing according to the comment reproduction instruction data included in the karaoke performance data. That is, execution of song evaluation is instructed for each section divided by each comment reproduction instruction data, and voice output of a song evaluation result is instructed. The comment reproduction instruction data is arranged, for example, at a position at which each phrase in the music or each chorus is switched (specification paragraph of Patent Document 1 [0027]).

  However, in this case, a plurality of comment reproduction instruction data must be set in advance for each of a large number of karaoke performance data, which is cumbersome. Further, the setting of the comment reproduction instruction data is not performed in consideration of the length of the interval (non-singing section).

  In addition, Patent Document 1 also describes that the user performs the song evaluation and instructs the reproduction of the evaluation comment each time the user performs a predetermined operation using a remote control or the like (the specification paragraph of Patent Document 1 [0086]). .

  However, in this case, the singer can not concentrate on singing because it is necessary to execute the evaluation and the instruction to reproduce the evaluation comment during the singing. In addition, since the singer usually does not know the length of the interval, it is difficult to give instructions for reproducing the evaluation comment, etc. in consideration of the overlap with the singing.

  Furthermore, Patent Document 1 describes a configuration for automatically reducing the volume of karaoke performance when an evaluation comment is reproduced (specification paragraph of Patent Document 1 [0095]). In this case, even if a karaoke song is performed at a large volume, the user does not miss the evaluation comment.

  However, lowering the volume of a karaoke performance or singing voice by giving priority to listening to the evaluation comment is a fall at the end of the term, and there is a problem that the interest of the karaoke singing is cut off.

  An object of the present invention is to provide a karaoke apparatus which enables a singer to easily grasp the contents of a message when voice output of a message according to a song evaluation.

  In order to solve the above problems, a karaoke apparatus according to claim 1 is a karaoke apparatus for outputting a message according to a scoring result of a singing voice signal obtained by singing a song, and for each of a plurality of scoring results And a message storage unit that stores a plurality of messages having different playback times in association with each other, a scoring unit that calculates the scoring result for each song section, and a song that calculates the scoring result for a song having a plurality of song sections An interval detection unit that detects an interval length that is an interval from the end of a section to the start of the next singing section, and a message corresponding to the scoring result calculated from among the messages stored in the message storage unit And selecting a message having a reproduction time equal to or less than the length of the detected interval as a predetermined message. It has a chromatography di selecting unit, and a message output unit for performing audio output of the predetermined message during said detected interval.

  According to such a karaoke apparatus, the singer can easily grasp the contents of the message when the message corresponding to the song evaluation is output by voice.

  Further, in order to solve the above problem, a karaoke apparatus according to claim 2 is the karaoke apparatus according to claim 1, wherein the message selection unit is a message of playback time equal to or less than the detected interval length. If there are a plurality of messages, the message with the longest playback time is selected as the predetermined message.

  In this case, the singer can easily grasp the contents of the entire message.

  Further, in order to solve the above problem, a karaoke apparatus according to claim 3 is the karaoke apparatus according to claim 1, wherein the message selection unit is a message of a reproduction time equal to or less than the detected interval length. When there are a plurality of messages, one message is randomly selected from the plurality of messages as the predetermined message.

  In this case, the singer can easily grasp the contents of the entire message.

  Further, in order to solve the above-mentioned problems, a karaoke apparatus according to claim 4 is the karaoke apparatus according to any one of claims 1 to 3, wherein the message output unit reproduces the predetermined message. When the time is shorter than the length of the detected interval, the voice output of the predetermined message is performed from a time point delayed by a predetermined time from the start of the interval.

  In this case, the singer can more easily understand the content of the entire message.

  Also, in order to solve the above problem, a karaoke apparatus according to claim 5 is the karaoke apparatus according to any one of claims 1 to 4, wherein the message selection unit is configured to detect the detected interval. If there is no message with a playback time equal to or less than the length, a message with the shortest playback time is selected from the messages corresponding to the calculated scoring results as the predetermined message.

  In this case, the singer can roughly grasp the content of the message.

  ADVANTAGE OF THE INVENTION According to this invention, when voice-outputting the message according to song evaluation, the singer can grasp | ascertain the content of the said message easily.

It is a figure which shows the outline of the karaoke apparatus which concerns on embodiment. It is a figure showing the example of hardware constitutions of the karaoke main part concerning an embodiment. It is a figure which shows the example of the table data memorize | stored in the memory | storage part which concerns on embodiment. It is a figure which shows the example of the table data memorize | stored in the memory | storage part which concerns on embodiment. It is a figure which shows the example of the audio | voice data memorize | stored in the memory | storage part which concerns on embodiment. It is a figure which shows the example of the audio | voice data memorize | stored in the memory | storage part which concerns on embodiment. It is a figure which shows the software structural example of the karaoke main body which concerns on embodiment. It is a figure which shows the example of the timing which starts the audio | voice output of the message which concerns on embodiment. It is a figure which shows the example of the timing which starts the audio | voice output of the message which concerns on embodiment. It is a flow chart which shows processing of a karaoke device concerning an embodiment. It is a figure which shows the score of the music referred in embodiment.

  The karaoke apparatus 1 which concerns on embodiment is demonstrated with reference to FIGS. 1-10.

== Karaoke device ==
(Hardware configuration)
The karaoke apparatus 1 is an apparatus for performing karaoke performance and singing by the singer. As shown in FIG. 1, the karaoke apparatus 1 includes a karaoke body 10, a speaker 20, a display device 30 (display unit), a microphone 40, and a remote control device 50. The karaoke apparatus 1 is communicably connected to a server (not shown) via a communication line.

  The speaker 20 is configured to emit sound based on the sound emission signal from the karaoke body 10. The display device 30 is configured to display an image or an image on a screen based on a signal from the karaoke body 10. The microphone 40 is configured to convert the voice of the singer into an analog voice signal and input the voice signal to the karaoke body 10. The remote control device 50 is a device for performing various operations on the karaoke body 10. The singer can use the remote control device 50 to activate the karaoke apparatus 1, reserve music, and the like.

  The karaoke body 10 performs various controls related to karaoke singing, such as performance control of selected karaoke music, display control of lyrics and background images, and processing of an audio signal input through the microphone 40. FIG. 2 is a diagram showing an example of the hardware configuration of the karaoke body 10. As shown in FIG. The karaoke body 10 includes a control unit 11, a communication unit 12, a storage unit 13, an acoustic processing unit 14, a display processing unit 15, and an operation unit 16. Each configuration is connected to the bus B via an interface (not shown).

  The control unit 11 includes a CPU 11a and a memory 11b. The CPU 11a realizes various control functions by executing an operation program stored in the memory 11b. The memory 11 b is a storage device that stores a program to be executed by the CPU 11 a and temporarily stores various information when the program is executed.

  The communication unit 12 provides an interface for connecting the karaoke body 10 to a communication line via a router (not shown).

  The storage unit 13 is a large-capacity storage device for storing various data, and is, for example, a hard disk drive. In the present embodiment, the storage unit 13 includes a music data storage unit 13a, a message storage unit 13b, a video data storage unit 13c, and an audio data storage unit 13d.

  The music data storage unit 13a stores a plurality of music data. The music data is data for performing a karaoke performance by the karaoke apparatus 1. When the karaoke apparatus 1 plays music based on music data, the singer can sing karaoke. Each song has a "song section" which is a section in which the lyrics for the singer to sing is set, and a "non-song section (interval)" which is a section in which the lyrics are not set. Exists. The non-singing section corresponds to the interval from the end of a certain singing section to the start of the next singing section.

  The music data includes MIDI data, lyrics data, reference data and the like. The MIDI data is automatic performance data (Karaoke performance data) for automatically playing the sound source of the electronic musical instrument, and is constituted by time-series note information. The note information is constituted by various commands for controlling, for example, timing of sound generation and muffling, pressure of a key, pitch of sound, reproduction pitch and the like. The lyric data is character string data for displaying the lyric telop in the karaoke music on the display device 30. The lyric data is preset for each music. The reference data is data used as a reference when scoring a karaoke song by the user, and is constituted by time-series pitch information representing vocal pitches. The reference data is set for each singing section.

  The music data used in the karaoke apparatus 1 according to the present embodiment may not be stored in the music data storage unit 13a, but may be data acquired directly from a server (not shown).

  The message storage unit 13 b stores a plurality of messages having different reproduction times in association with each of the plurality of scoring results. FIGS. 3 and 4 show examples of table data in which a plurality of scoring results are associated with a plurality of messages having different reproduction times.

  The table data of FIG. 3 is a matrix of the scoring result and the length of the interval. In the table data of FIG. 3, the length of the interval for each graded result and the message (message ID) corresponding to the message of the reproduction time that can be reproduced during the interval are stored one by one. The value described under the message ID in FIG. 3 indicates the reproduction time of the message.

  On the other hand, as in the table data of FIG. 4, the reproduction time may be simply associated with each message. In this case, as in the table data of FIG. 3, it is not necessary to store messages corresponding to the lengths of the individual intervals. That is, since a plurality of messages can be stored regardless of the length of the interval, the degree of freedom of the messages can be enhanced.

  The video data storage unit 13 c is an area for storing video data such as a background image and a character displayed on the display device 30 at the time of karaoke performance.

  The voice data storage unit 13 d stores voice data representing the contents of the message stored in the message storage unit 13 b in voice. For example, the voice data storage unit 13 d stores the message ID and voice data of the message in association with each other. The message stored in the message storage unit 13b and the voice data stored in the voice data storage unit 13d can be associated by giving the same message ID. Moreover, the message of this embodiment is wording adapted to the image of each character so as not to be uncomfortable even when used in the “character scoring mode” described later.

  5 and 6 show an example of audio data stored in the audio data storage unit 13d.

  The voice data in FIG. 5 is data corresponding to a plurality of messages whose words used in each message are similar (or some of the words are common) but different in length. When such voice data is used, even if the length of the interval is different, it is possible to emit a message of the same purport according to the scoring result.

  Also, the voice data in FIG. 6 is data corresponding to a plurality of messages that are similar in message purport (praise, encouragement, etc.) but have different words and lengths. When such voice data is used, for example, even with the same scoring result, a message expressed in different words is emitted depending on the difference in the length of the interval, so that the singer is not bored.

  The sound processing unit 14 controls the performance of the karaoke music and processes the audio signal input through the microphone 40 based on the control of the control unit 11. The sound processing unit 14 includes, for example, a MIDI sound source, a mixer, and an amplifier (all not shown). The MIDI sound source generates a tone signal based on music data. A mixer mixes the said music signal and the audio | voice signal output from the microphone 40 by an appropriate ratio, and outputs it to an amplifier. The amplifier amplifies the mixing signal from the mixer and outputs it to the speaker 20 as a sound emission signal. As a result, from the speaker 20, the karaoke performance sound based on the sound emission signal and the singing voice from the microphone 40 are emitted. In addition, the sound processing unit 14 according to the present embodiment emits a predetermined message based on the control of the sound output control unit 400 (described later).

  The display processing unit 15 performs processing regarding various displays on the display device 30 based on the control of the control unit 11. For example, the display processing unit 15 controls the display device 30 to display a video in which the lyric telop is superimposed on the background video during the karaoke performance.

  The operation unit 16 includes a panel switch and a remote control reception circuit, and outputs operation signals such as a reservation signal and a cancellation signal to the control unit 11 according to the operation of the panel switch of the karaoke apparatus 1 or the remote control device 50 by the singer. Do. Control unit 11 detects an operation signal from operation unit 16 and executes a corresponding process.

(Software configuration)
FIG. 7 is a view showing an example of the software configuration of the karaoke body 10. As shown in FIG. The karaoke body 10 includes a scoring unit 100, an interval detection unit 200, a message selection unit 300, and an audio output control unit 400.

  The scoring unit 100, the interval detection unit 200, the message selection unit 300, and the voice output control unit 400 are realized by the CPU 11a of the control unit 11 executing an operation program stored in the memory 11b.

  The scoring unit 100 calculates a scoring result for each of the singing segments, for the music having a plurality of singing segments. A well-known method can be used for calculation of a scoring result. For example, when the singer performs singing in a certain singing section, the scoring unit 100 acquires a singing voice signal based on the singing. Then, the scoring unit 100 reads out the reference data corresponding to the song section from the music data storage unit 13a, and compares the acquired singing voice signal with the reference data to calculate a scoring result based on the pitch. The scoring result is calculated, for example, as score information in the range of 0 to 100 points. In addition, the scoring unit 100 may calculate not only the scoring result based on the pitch but also the comprehensive evaluation combining the volume and timing (rhythm) of the singing, and the evaluation result of the singing technique as the scoring result.

  The interval detection unit 200 detects the length of the interval which is the interval from the end of the singing section for which the scoring result is calculated to the start of the next singing section. For example, the interval detection unit 200 detects the length of the interval based on the music data stored in the music data storage unit 13a. In addition, the information regarding the length of an interval may be recorded beforehand as music data. In this case, the interval detection unit 200 detects the length of the interval by reading out the information from the music data storage unit 13a.

  The message selection unit 300 is a message corresponding to the scoring result calculated by the scoring unit 100 among the messages stored in the message storage unit 13 b, and the reproduction time is the length of the interval detected by the interval detection unit 200. Select a message which is less than or equal to the predetermined message.

  For example, it is assumed that the scoring result of a certain song section is 95 points, and the length of the interval from the song section to the next song section is 1,100 msec. In this case, the message selection unit 300 refers to the table data of FIG. 3 and selects, as the predetermined message, the message M012 corresponding to the interval length of 1,100 msec among the messages M011 to M015 corresponding to the scoring result of 95 points. Do. In addition, when referring to the table data in FIG. 4, the message selection unit 300 determines, among the messages M011 to M015 corresponding to the scoring result 95, the message M011 of the reproduction time falling within an interval length of 1,100 msec as a predetermined message. Choose as.

  When there are a plurality of messages with playback times equal to or less than the detected interval length, the message selecting unit 300 may select a message with the longest playback time as the predetermined message.

  For example, it is assumed that the scoring result of a certain song section is 85 points, and the length of the interval from the song section to the next song section is 1,800 msec. In this case, according to the table data of FIG. 3, among the messages M031 to M035 corresponding to the scoring result of 85, three messages of the message M031 to M033 exist in the message of the playback time falling within the interval of 1,800 msec. . In this case, the message selection unit 300 selects the message M033 with the longest playback time among the messages M031 to M033 as a predetermined message.

  Alternatively, when there are a plurality of messages with playback times equal to or less than the detected interval length, the message selection unit 300 may randomly select one message from a plurality of messages as a predetermined message.

  For example, it is assumed that the scoring result of a certain song section is 85 points, and the length of the interval from the song section to the next song section is 1,800 msec. In this case, according to the table data of FIG. 3, among the messages M031 to M035 corresponding to the scoring result of 85, three messages of the message M031 to M033 exist in the message of the playback time falling within the interval of 1,800 msec. . In this case, the message selection unit 300 randomly selects one of the messages M031 to M033 as the predetermined message.

  Furthermore, if there is no message with a playback time equal to or less than the detected interval length, the message selection unit 300 selects a message with the shortest playback time from among the messages corresponding to the calculated scoring results as a predetermined message. You may

  For example, it is assumed that the scoring result of a certain song section is 85 points, and the length of the interval from the song section to the next song section is 400 msec. In this case, according to the table data of FIG. 3, among the messages M031 to M035 corresponding to the scoring result of 85, there is no message of reproduction time that fits within the interval of 400 msec. In this case, the message selection unit 300 selects the message M031 having the shortest reproduction time among the messages M031 to M035 as a predetermined message.

  In addition, when there is no message of reproduction time less than the length of the detected interval, it is possible that the message selection unit 300 does not select a predetermined message. In this case, it is possible to give priority to singing without outputting a voice message.

  The voice output control unit 400 controls the sound processing unit 14 to perform voice output of a predetermined message during the detected interval. Specifically, the audio output control unit 400 reads out audio data corresponding to a predetermined message from the audio data storage unit 13 d and transmits the audio data to the sound processing unit 14. The sound processing unit 14 causes the speaker 20 to emit a message corresponding to the sound data based on the control of the sound output control unit 400. That is, the “voice output control unit 400”, the “sound processing unit 14”, and the “speaker 20” constitute a “message output unit” that performs voice output of a predetermined message during the detected interval. When voice output is performed, it is also possible to use text data instead of using voice data recorded in advance. In this case, the voice data storage unit 13d stores text data and a message ID in association with each other. Then, the sound processing unit 14 performs speech synthesis based on text data corresponding to a predetermined message, and emits predetermined message content.

== About the determination of timing ==
Next, a specific example of the timing of audio output by the audio output control unit 400 will be described with reference to FIGS. 8A and 8B. FIGS. 8A and 8B are diagrams schematically showing the relationship between the singing section and interval of music and the timing at which voice output of a message is started (hereinafter sometimes referred to simply as “timing”).

  As in the present embodiment, when the reproduction time of the predetermined message is shorter than the length of the detected interval, the audio output control unit 400 sets the start timing of the audio output of the selected message to the start time of the interval. (See FIG. 8A). By setting the timing in this manner, it is possible to emit all the messages during the interval. Thus, the singer can easily grasp the content of the entire message.

  Alternatively, the audio output control unit 400 may set the start timing of the audio output of the selected message to a point in time delayed by a predetermined time from the start of the interval (see FIG. 8B).

  For example, it is assumed that the detected interval length is 1,400 msec and the selected message length is 1,000 msec. In this case, the voice output control unit 400 performs voice output at a point 200 msec later than the interval start time. By performing voice output in this manner, predetermined intervals (200 msec in the example of FIG. 8B) are generated between each of the preceding singing section and the next singing section and the message. That is, since the interval between the singing section and the sound emission period of the message is wide, it becomes easy to hear the message content. Thus, the singer can more easily understand the content of the entire message.

== About the operation of the karaoke apparatus 1 ==
Next, a specific example of the operation of the karaoke apparatus 1 according to the present embodiment will be described with reference to FIGS. 9 and 10. FIG. 9 is a flowchart showing an operation example of the karaoke apparatus 1. FIG. 10 is a musical score showing a part of a nursery rhyme song "Fuji no yama" (song the lyrics: Sugatani small wave).

  The singer selects the music of "Mt. Fuji" via the remote control device 50 and sings (selection of music / singing. Step 10).

  The scoring unit 100 is the first singing section, when the singing of the song of the 8 measures of "Outside the head of the head" is finished. 85 points are calculated as a scoring result of the singing section (calculation of a scoring result. Step 11). In addition, the scoring result may be obtained when 80% to 90% of singing is completed in a certain singing section, for example, in the case of this embodiment, 87.5% of the singing section, that is, 7 You may calculate the scoring result at the time of the end of the song of "miroroshi" of a bar. In the present invention, “calculating the scoring result for each singing section” also includes the case where the scoring result is obtained based on part of the singing in a certain singing section.

  The interval detection unit 200 refers to the reference data of the song “Fuji no yama” selected in step 10, and after the first song section (“te” in the eighth measure) is finished singing, the next song section (“ Detect the interval length 750 msec until the start of the pinching operation (... Detection of interval. Step 12). As shown in the score of FIG. 10, the interval of the present music is one beat (four minutes rest), and the BPM is 80. Therefore, the interval is 60/80 = 0.75 sec.

  The message selection unit 300 refers to the table data (see FIG. 3) stored in the message storage unit 13b, and is a message corresponding to the scoring result of 85 points, which is a message M031 reproducible with an interval length of 750 msec. Select (Select message. Step 13).

  The voice output control unit 400 reads voice data corresponding to the message M031 selected in step 13 from the voice data storage unit 13d (reading of voice data: step 14).

  The sound processing unit 14 outputs the sound data corresponding to the message M031 read in step 14 through the speaker 20 based on the control of the sound output control unit 400 (sound emission of message: step 15). Specifically, the sound processing unit 14 emits a message M031 (corresponding voice data) having a reproduction time of 400 msec during an interval of 750 msec.

  As described above, according to the karaoke apparatus 1 according to the present embodiment, it is possible to voice-output all the messages corresponding to the song evaluation during the non-singing section (interval) in which the singing voice is not emitted. Therefore, the singer can easily grasp the contents of the message without being influenced by his / her singing voice.

  In addition, it is also possible to use "character scoring mode", when a singer sings. The character scoring mode is a mode that the karaoke apparatus 1 has. When the character scoring mode is selected, the display processing unit 15 (control unit 11) causes the display device 30 to display the character together with the background image and the lyrics at the time of singing, and changes the display mode of the character in accordance with the progression of the music. By installing such a mode, the karaoke apparatus 1 can give the singer a higher preference.

  In such a mode, the display processing unit 15 (control unit 11) can also perform control to change the display mode of the character in accordance with the timing of voice output of the message. For example, when the content of the message is "praise", the display processing unit 15 displays an animation that the character is pleased with. Further, by changing the expression of the character in accordance with the sound emission of the message, it is possible to give a visual effect as if the message is emitted as the speech of the character. In such a case, the singer can visually grasp the outline of the message.

  The above embodiments are presented as examples and do not limit the scope of the invention. In addition, the above configurations can be implemented in combination as appropriate, and various omissions, replacements, and changes can be made without departing from the scope of the invention. Those embodiments and the variations thereof are included in the invention described in the claims and the equivalents thereof as well as included in the scope and the gist of the invention.

DESCRIPTION OF SYMBOLS 1 karaoke apparatus 10 karaoke main body 11 control part 13 memory | storage part 13a music data memory | storage part 13b message memory | storage part 14 acoustic processing part 20 speaker 100 scoring part 200 interval detection part 300 message selection part 400 audio output control part

Claims (5)

A karaoke apparatus for outputting a message according to a scoring result of a singing voice signal obtained by singing a song, as voice.
A message storage unit that stores a plurality of messages having different reproduction times in association with each of a plurality of scoring results;
A scoring unit that calculates the scoring result for each song section for music having a plurality of song sections;
An interval detection unit that detects an interval length which is an interval from the end of the singing section for which the scoring result is calculated to the start of the next singing section;
Among the messages stored in the message storage unit, a message corresponding to the calculated scoring result, wherein a message having a reproduction time equal to or less than the detected interval is selected as a predetermined message. A selection unit,
A message output unit that performs voice output of the predetermined message during the detected interval;
Karaoke apparatus characterized by having.   The message selection unit according to claim 1, characterized in that, when there are a plurality of messages of reproduction time equal to or less than the detected interval length, the message selection unit selects a message with the longest reproduction time as the predetermined message. Karaoke device.   The message selection unit is characterized by randomly selecting one message from the plurality of messages as the predetermined message, when there are a plurality of messages with playback times equal to or less than the detected interval length. The karaoke apparatus of claim 1.   The message output unit is characterized in that, when the reproduction time of the predetermined message is shorter than the length of the detected interval, the message output unit performs the audio output of the predetermined message from a time point delayed for a predetermined time from the start of the interval. The karaoke apparatus according to any one of claims 1 to 3, in which   The message selection unit selects a message having the shortest reproduction time from among the messages corresponding to the calculated scoring results as the predetermined message, when there is no message of the reproduction time equal to or less than the detected interval length. The karaoke apparatus according to any one of claims 1 to 4, wherein:

Images