JP4318188B2 - Telop display device - Google Patents

Description

  The present invention relates to a telop display device that generates a telop and displays it on a display unit.

Conventionally, some karaoke systems include a telop display device that changes the color of a telop according to the progress of music in order to display the timing of utterance to a singer (for example, Patent Document 1).
However, since the conventional telop display device displays the timing to be uttered on the telop, the singer continues to sing without noticing even if the actual utterance time is shifted or the telop is misread. There was a problem that there was a case.
Japanese Patent Laid-Open No. 9-307812

  It is an object of the present invention to display whether or not the timing of voice input is correct, and when a voice is input with a shifted timing, a telop is displayed so that the singer can easily correct this shift. It is an object to provide a telop display device that can be used.

The present invention solves the above problems by the following means. In addition, in order to make an understanding easy, although the code | symbol corresponding to the Example of this invention is attached | subjected and demonstrated, it is not limited to this.
According to the first aspect of the present invention, the subtitle display unit (61A to 61C) for displaying the subtitle (62) and the utterance timing of the display character of the subtitle (62) are associated with the display character of the subtitle (62) and guided. A guide display section (621) to be displayed, a voice input section (20) for voice input, and an input result display for displaying the result of the voice input timing corresponding to the display characters of the subtitle (62) Section (622) , the caption display sections (61A to 61C) divide and display the caption (62), and the guide display section (621) is a part of the divided and displayed caption (62). The telop display device is characterized in that the input result display unit (622) is a part different from the guide display unit (621) of the subtitle (62).

According to a second aspect of the present invention, in the telop display device according to the first aspect, the character information of the display character of the subtitle (62) is stored, and the sound character conversion unit (43) for converting the sound input into character information. When the character type of the character information converted by the character information storage unit (32) and the phonetic character conversion unit (43) matches the character type of the character information of the character information storage unit (32), A telop display device comprising: a control unit (40) for displaying the result of the input timing on the input result display unit (622).
A third aspect of the present invention is the telop display device according to the second aspect, further comprising an utterance timing storage unit that stores the utterance timing of the display character of the subtitle (62), and the control unit (40) includes the input In the telop display device, the result of the input timing is displayed on the input result display unit (622) when the timing result matches the utterance timing of the utterance timing storage unit. is there.
According to a fourth aspect of the present invention, in the telop display device according to any one of the first to third aspects, the guide display unit (621) and the input result display unit (622) include the utterance timing and The telop display device is characterized in that a color changes according to a result of the input timing.

According to the present invention, the following effects can be obtained.
(1) Since the present invention displays the correct utterance timing and the input timing result corresponding to the display characters of the subtitles, the difference between the two can be displayed easily, so that the speaker is correct Whether or not the voice is uttered at the timing can be easily confirmed, and even when the timing is shifted, the shift can be easily corrected.

(2) Since the present invention determines whether the character type of the character information input by voice and the character type of the character information in the character information storage unit match, the input timing is determined only when they match. Results can be displayed. Thereby, the speaker can read the subtitles and check the location.

(3) Since the present invention determines whether the input timing of the voice input and the utterance timing of the utterance timing storage unit match, the result of the input timing can be displayed only when the two match. it can. Thereby, the speaker can confirm the part uttered at different timings even after speaking.

(4) According to the present invention, subtitles are divided and a guide display unit and an input result display unit are provided, so that the results of subtitles, utterance timings, and input timings can be displayed for easy comparison.

(5) In the present invention, since the guide display unit and the input result display unit change in color according to the utterance timing and the input timing result, the utterance timing and the input timing result are displayed with improved visibility. be able to.

  The present invention can display whether or not the timing of voice input is correct, and also displays a telop so that the singer can easily correct this shift even when the voice is input at a different timing. The purpose is to provide a telop display device that can divide subtitles of the lyrics of the music into upper and lower parts and display them on the monitor, and according to the progress of the music, the color of the guide display section that is the upper part of the subtitle characters is blue This is realized by changing the color of the input result display section, which is the lower part of the subtitle character, to red according to the timing of voice input.

Hereinafter, with reference to the drawings and the like, examples of the telop display device of the present invention will be described in more detail.
FIG. 1 is a block diagram of the karaoke system 1 (telop display device) according to the present embodiment, and FIG. 2 is a diagram illustrating an example of a display image on the monitor 60.
As shown in FIG. 1, the karaoke system 1 includes an operation unit 10, a microphone 20 (voice input unit), a storage unit 30, a control unit 40, a drive circuit 50, a monitor 60 (display unit), and a speaker. 70.

The operation unit 10 is for operation by the singer 2 or the like to operate the karaoke system 1. For example, a numeric keypad for inputting a music number stored in the storage unit 30, a start button for starting performance Etc.
The microphone 20 is, for example, a condenser microphone for the singer 2 to input sound.

The storage unit 30 is a storage device for storing information necessary for the karaoke system 1, and is, for example, a hard disk. The storage unit 30 includes a caption video storage unit 31, a character information storage unit 32, a background moving image information storage unit 33, and a music information storage unit 34.
The caption video storage unit 31 is a storage unit for storing video information of the caption 62 (see FIG. 2) displayed on the monitor 60. The video information of the subtitle 62 includes the upper part of the character of the subtitle 62 (a guide display section to be described later) according to the correct utterance timing (that is, the timing of the lyrics to be uttered according to the elapsed time since the music started). 621) changes from white to blue.

The character information storage unit 32 is a storage unit for storing character information of display characters of the caption 62. That is, the subtitle video storage unit 31 stores the subtitle 62 as video information, whereas the character information storage unit 32 stores the subtitle 62 as character information. The character information stored in the character information storage unit 32 is obtained by classifying the character type, and is, for example, text data, waveform data when the subtitle 62 is uttered, or the like.
The background moving image information storage unit 33 is a storage unit for storing background moving image information to be displayed on the monitor 60, and in this embodiment, stores moving image information such as the bird 63 and the person 64 shown in FIG. .
The music information storage unit 34 is a storage unit for storing karaoke performance music information (for example, MIDI data).

The control unit 40 is a control unit for comprehensively controlling the karaoke system 1, and includes, for example, a CPU (Central Processing Unit). The control unit 40 includes a display unit control unit 41, a voice control unit 42, a phonetic character conversion unit 43, a determination unit 44, and a telop generation unit 45, which are connected to each other via a bus line 46 and necessary. Information is communicated accordingly.
The display control unit 41 is a control unit for comprehensively controlling the display on the monitor 60. The display control unit 41 reads out the moving image information in the background moving image information storage unit 33 in accordance with the elapsed time of the music, combines the moving image information with the video information (described later) of the telop, and outputs it to the drive circuit 50.

  The voice control unit 42 is a control unit for comprehensively controlling voice input / output of the karaoke system 1. The voice control unit 42 reads the performance music information in the music information storage unit 34 according to the elapsed time of the music, and performs necessary processing such as echo for voice input to the microphone 20. The voice control unit 42 synthesizes the read performance music information and the processed voice input, and outputs the synthesized voice information to the drive circuit 50.

The voice character conversion unit 43 is a control unit for converting voice input to the microphone 20 into character information. For example, the voice character conversion unit 43 recognizes the character type of the voice input voice from the voice input waveform and converts it into character information.
The determination unit 44 reads the character information from the character information storage unit 32 and determines whether the character type of the character information matches the character type of the character information converted by the phonetic character conversion unit 43. It is a control part. In other words, the determination unit 44 determines whether the singer 2 has uttered literally as displayed on the subtitle 62. The determination unit 44 transmits the determination result to the telop generation unit 45.
When the character information in the character information storage unit 32 is waveform data, the determination unit 44 quickly compares the waveform data with the waveform of the voice input to the microphone 20 to quickly perform the determination described above. It can be carried out.

  The telop generation unit 45 is a control unit for generating telop video information. The telop generation unit 45 reads the video information in the subtitle video storage unit 31 and changes the subtitle 62 of the monitor 60 with the passage of time of the music. When the determination result that the character types match is received from the determination unit 44, the telop generation unit 45 displays the input result of the subtitle 62 in order to display the result of the input timing to the microphone 20. The video information of the caption 62 is processed so that the color of the unit 622 (see FIG. 2) changes from white to red. The telop generation unit 45 transmits the video information of the telop generated by processing in this way to the display unit control unit 41.

The drive circuit 50 includes a display unit drive circuit 51 and an audio drive circuit 52.
The display unit drive circuit 51 performs processing necessary for the video information output from the control unit 40 (for example, conversion from digital information to analog information (D / A conversion), etc.) and outputs the processed information to the monitor 60. It is an electric circuit.
The audio drive circuit 52 is an electric circuit for performing processing (for example, D / A conversion, amplification of an electric signal, etc.) necessary for the audio information output from the control unit 40 and outputting it to the speaker 70.

As shown in FIG. 2, the monitor 60 displays a caption 62 on the caption display unit 61, and a display device for displaying a background moving image (bird 63, person 64, etc.) or the like in a range other than the caption display unit 61. For example, an LCD (Liquid Crystal Display) or the like.
In the scene shown in FIG. 2, three lines of subtitle display sections 61 </ b> A to 61 </ b> C are displayed on the monitor 60, and subtitles 62 of “Yamani”, “Higa”, and “Shizumu” are displayed, respectively. In the subtitle display unit 61, the subtitle 62 is divided and displayed vertically, and the upper part of the subtitle 62 that is divided and displayed (a part of the subtitle 62 that is divided and displayed) is the guide display unit 621, and the lower part (divided display) The input result display unit 622 is a portion of the subtitles 62 that is different from the guide display unit 621. Note that the position of the caption display unit 61 on the monitor 60 may be changed according to the background video, the size of the caption, and the like.

  On the guide display unit 621, the video information of the subtitle video storage unit 31 is displayed without being processed. Therefore, the guide display unit 621 changes the color from white to blue according to the correct utterance timing according to the progress of the music, and the utterance timing that the singer 2 should utter corresponds to the display characters of the subtitle 62. Is displayed as a guide. For example, FIG. 2 is a scene in which the guide display unit 621 that is the upper part of “shi” of the subtitle display unit 61C changes to blue, and the utterance timing at which the singer 2 should utter “shi” is A guide is displayed corresponding to the display character “shi”.

  The input result display unit 622 displays the result of the input timing of the voice input input to the microphone 20 corresponding to the display characters of the caption 62. That is, when the singer 2 utters a character displayed on the subtitle 62, the color of the input result display unit 622 corresponding to the character changes from white to red. For example, FIG. 2 is a scene in which the guide display unit 622 which is the lower part of “hi” in the subtitle display unit 61C changes to red, and the result of the input timing when the singer 2 voice-inputs “hi” is It is displayed corresponding to the display character “HI” of the subtitle 62.

  The speaker 70 is a member for actually outputting the sound input to the microphone 20 and the performance information of the music information storage unit 34 according to the output of the sound drive circuit 52.

Next, the operation of the karaoke system 1 will be described.
FIG. 3 is a flowchart of the telop display process of the karaoke system 1 of the present embodiment.
First, in step S1, the control unit 40 starts a series of processes in response to the operation of the operation unit 10 by the singer 2 or the like.

In step S2, according to the elapsed time of the music, the display unit control unit 41 reads the moving image information in the background moving image information storage unit 33, and the telop generation unit 45 reads the video information of the subtitle 62 in the subtitle video storage unit 31. . The display unit control unit 41 synthesizes the background moving image information and the video information of the subtitle 62 and outputs the combined information to the display unit drive circuit 51 to display the video on the monitor 60.
In step S3, the video information of the subtitle video storage unit 31 is displayed on the guide display unit 621 according to the elapsed time, and the characters on the guide display unit 621 change from white to blue according to the correct utterance timing.

When voice is input to the microphone 20 by the singer 2 in step S4, the voice character conversion unit 43 converts the voice input to the microphone 20 into character information in step S5.
In step S <b> 6, the determination unit 44 determines whether the character type of the converted character information matches the character type of the character information stored in the character information storage unit 32, and transmits the determination result to the telop generation unit 45. When it is determined that the two match (step S6: YES), the telop generation unit 45 proceeds to step S7. On the other hand, when they do not match (step S6: NO), the operation from step S3 is repeated.

  In step S <b> 7, the telop generation unit 45 processes the video information of the subtitle 62 so as to generate the video information of the telop so that the color of the input result display unit 622 changes from white to red according to the result of the input timing. . The telop generation unit 45 transmits the telop video information to the display unit control unit 41, and the display unit control unit 41 synthesizes the telop video information and the background moving image information. The combined information is output to the monitor 60 via the display unit driving circuit 51.

The karaoke system 1 generates the video information of the telop by the above processing, and the correct utterance timing and the input timing result of the voice input are associated with the display characters of the subtitle 62 on the monitor 60 as shown in FIG. indicate. This display is performed almost simultaneously with the voice input from the singer 2 to the microphone 20, and the singer 2 can confirm whether or not the utterance timing is correct. For example, in the state of FIG. 2, the “HI” guide display unit 621 changes to blue, whereas the “HI” input result display unit 622 changes to red, and the correct utterance timing is displayed. It is obvious that the input timing of the singer 2 is delayed.
Further, the singer 2 can easily correct the timing shift by visually recognizing these displays. That is, when the display of the input result display unit 622 is delayed from the guide display unit 621, the singing timing may be corrected so as to be advanced. Can be modified to slow down.

  Furthermore, since the determination part 44 has identified the character classification of the input audio | voice, the singer 2 can confirm whether the uttered lyric is correct. In the state of FIG. 2, since the singer 2 misreads the place where “Yamani” should be uttered and uttered “Yamahe” (see FIG. 1), the input result display section 622 of “Ni” is displayed. It remains white. Thus, the singer 2 can confirm that the song has been sung with the wrong lyrics. For example, when singing next time, the singer 2 may sing carefully.

  In step S8, if the control unit 40 determines that there is a remaining time for the music (step S8: YES), the control unit 40 repeats the processing from step S3, and if it determines that there is no remaining time (step S8: NO), the process proceeds to step S9, and the series of processes is terminated.

  As described above, the karaoke system 1 according to the present embodiment divides and displays the subtitles 62, provides the guide display unit 621 and the input result display unit 622, and according to the results of the utterance timing and the input timing of the voice input, The color of these display parts is changed. Thereby, the karaoke system 1 can display the result of subtitles 62, utterance timing, and input timing in an easy-to-understand manner for the singer 2 (speaker), and the singer 2 sings at a shifted timing. This deviation can be easily corrected even in the case of being.

(Modification)
The present invention is not limited to the embodiments described above, and various modifications and changes are possible, and these are also within the equivalent scope of the present invention.
(1) In the present embodiment, the determination unit or the like of the control unit shows an example in which the color of the input result display unit is changed to red only when the singer utters according to the display characters of the subtitles, but is not limited thereto. . For example, the determination unit or the like may determine whether the input timing result of the voice input is correct, and may change the color of the input result display unit to red when the timing is correct. In this case, a storage unit (speech timing storage unit) for storing the utterance timing of the display characters of the caption is newly provided, and the determination unit or the like may compare the input timing with the stored utterance timing. Thereby, since the karaoke system can display the result of the input timing only when the input timing is correct, the singer can confirm the part that could not be uttered according to the utterance timing even after speaking. .

(2) In the present embodiment, the example in which the guide display unit and the input result display unit are provided by dividing the subtitles is shown, but the present invention is not limited to this. For example, the guide display unit and the input result display unit are indicators (for example, symbols such as arrows) displayed above and below the caption, respectively, and these indicators move according to the utterance timing and the input result. It may be a thing. In this case, since it is not necessary to change the color of the caption, the control unit can easily perform image processing.

It is a block diagram of the Example of the karaoke system to which this invention is applied. It is a figure which shows an example of the display image of the monitor of a present Example. It is a flowchart of the telop display process of the karaoke system of a present Example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Karaoke system 2 Singer 20 Microphone 30 Storage part 31 Subtitle video storage part 32 Character information storage part 34 Music information storage part 40 Control part 41 Display part control part 42 Voice control part 43 Voice character conversion part 44 Judgment part 45 Telop generation part 60 Monitor 61 Subtitle Display Unit 62 Subtitle 70 Speaker 621 Guide Display Unit 622 Input Result Display Unit

Claims (4)

A subtitle display section for displaying subtitles;
A guide display unit that guides the utterance timing of the display characters of the subtitles in correspondence with the display characters of the subtitles;
A voice input unit for voice input;
An input result display unit for displaying the input timing result of the voice input in correspondence with the display characters of the subtitles ;
The subtitle display unit divides and displays the subtitle,
The guide display unit is a part of the subtitles displayed in a divided manner,
The input result display portion is a portion different from the guide display portion of the caption;
A telop display device characterized by the above. The telop display device according to claim 1,
A voice character conversion unit that converts the voice input into character information;
A character information storage unit for storing character information of display characters of the subtitle;
When the character type of the character information converted by the phonetic character conversion unit matches the character type of the character information of the character information storage unit, the result of the input timing is displayed on the input result display unit. A control unit,
A telop display device characterized by the above. The telop display device according to claim 2,
An utterance timing storage unit for storing the utterance timing of the display character of the subtitle;
The control unit displays the input timing result on the input result display unit when the input timing result and the utterance timing of the utterance timing storage unit match.
A telop display device characterized by the above. In the telop display device according to any one of claims 1 to 3 ,
The guide display unit and the input result display unit change in color according to the utterance timing and the result of the input timing,
A telop display device characterized by the above.

Images