JP3397980B2 - 3D image display karaoke device - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a stereoscopic video display karaoke device, and more particularly, to a stereoscopic video display karaoke device which changes the degree of stereoscopic display based on an input video signal to display a stereoscopic video. .

[0002]

2. Description of the Related Art Conventionally, there is no well-known stereoscopic image display karaoke device of this type. For example, in a conventional karaoke device, the pitch of the singer, the rhythm or volume, and the pitch of the performance song input from a microphone. , Rhythm or volume is compared, and after the performance, the singer's singing ability is comprehensively evaluated, and the singer's singing ability is displayed on a scoring display device different from the TV monitor displaying lyrics, background images, etc. There are some that display a score.

[0003]

Therefore, a singer using a conventional karaoke device not only cannot recognize a pitch deviation that is a factor for evaluating his / her singing ability during singing, but also scores a pitch deviation. Even if it can be displayed on the display device for music, the singer is gazing at the lyrics displayed on the TV monitor, so that there is a problem that the deviation of the pitch cannot be recognized.

The present invention has been made in order to solve the above problems, and a stereoscopic image display karaoke apparatus and a stereoscopic image thereof in which a singer can easily recognize a pitch deviation during singing by himself. It is an object of the present invention to provide a stereoscopic image creation device for creating a stereoscopic image.

[0005]

A stereoscopic video display karaoke apparatus of the present invention according to claim 1 is a stereoscopic video display karaoke apparatus provided with a pitch difference detection means and a video signal creation means in order to achieve the above object. Therefore, the pitch difference detection means detects the pitch difference between the pitch of the input musical composition and the pitch of the audio signal from the microphone, and the video signal creation means generates the parallax according to the pitch difference in the character image of the lyrics. It is characterized in that a stereoscopic character image is created and output to a stereoscopic image display means.

A stereoscopic image display karaoke device according to a second aspect of the present invention is the stereoscopic image display karaoke device according to the first aspect, wherein the video signal creating means produces a stereoscopic character image according to a difference in pitch difference sign. The character image is provided with a parallax so that the character image is projected, or retracted.

A stereoscopic image display karaoke apparatus according to a fourth aspect of the present invention is the stereoscopic image display karaoke apparatus according to any one of the first to third aspects, wherein the pitch of the musical piece and the pitch of the audio signal are A deviation direction detecting means for detecting a deviation direction of the pitch difference, and the video signal creating means creates a video signal based on the deviation direction of the pitch difference detected by the deviation direction detecting means. .

[0008]

Embodiments of the present invention will be described in detail below with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a stereoscopic image display karaoke device according to the present invention, and shows a basic configuration when applied to a communication karaoke device. Further, the stereoscopic video display karaoke device 1 is shown within a broken line in the figure.

Reference numeral 7 denotes a CPU unit, which controls the entire stereoscopic image display karaoke apparatus 1, and is an RO for storing a control program in addition to the microprocessor.
M7a, a RAM 7b having a plurality of flag areas necessary for control, which temporarily stores data and the like, and a frame memory (not shown) which stores image data, and the like,
It controls various I / O devices, manages memory, and processes data.

Reference numeral 15 denotes an operation unit, which is composed of various keys for setting various states of the stereoscopic image display karaoke apparatus 1, switches, and a remote controller (not shown). Reference numeral 5 is a modem, which converts music data transmitted from the host computer via an analog communication line such as a telephone line into a digital signal. This music data is data of a performance music, and is MIDI (Musical Instrument).
MIDI data encoded based on the t Digital Interface standard, and character image data of lyrics of a musical piece composed of character information, color change information, genre information, and the like.

Reference numeral 6 denotes a main storage device which stores the music data taken in by the modem 5 under the control of the CPU section 7. This music data is not only taken in at the request of the user of the stereoscopic video display karaoke device 1, but also
The karaoke device 1 is automatically captured at night when the stereoscopic image display karaoke device 1 is rarely used. A MIDI sound source unit 8 is supplied with MIDI data obtained by the CPU unit 7 by retrieving music data stored in the main storage device 6, and outputs this MIDI data as accompaniment music by the function of the electronic musical instrument. To do.

Reference numeral 9 is a superimposing section, which is a CP.
The U unit 7 supplies character information, color change information, and the like in the character image data obtained by searching the music data stored in the main storage device 6. Also, the superimposing section 9
Generates background image data for karaoke based on the image data supplied from the external image reproducing device 2, and synthesizes the background image data with the character image data of the lyrics of the song to be played to obtain the image. It is output to the display device 3 and the stereoscopic image display device 16. However, in this case, the video display device 3 is a normal two-dimensional video display device such as a television, and the character image and the background image are not stereoscopically displayed, and only the stereoscopic image display device 16 stereoscopically displays the character image and the background image. Is displayed.

The external video reproducing device 2 is a widely used VTR, a video CD player or an LD player, and recently, an MPEG (Moving Picture).
An element group player or the like, which reproduces and outputs video data recorded on a recording medium such as a video tape or various discs. 10 is a mixer /
The amplifier part synthesizes and amplifies the accompaniment music signal output from the MIDI sound source 8 and the signal of the singing voice of the singer captured by the microphone 4 and outputs the synthesized signal to the speaker 11 to generate the accompaniment music and the singing voice of the singer. Play as audible sound.

Reference numeral 12 denotes a pitch comparison unit, which compares the accompaniment music signal from the MIDI sound source 8 with the singing voice signal from the microphone 4 and converts the pitch deviation of the signal into numerical data. , To the CPU section 7. For example, in the present embodiment, when the pitch deviation of these signals is large, a large value is output to the CPU section 7, but there is no problem even if the configuration is reversed.

Numeral 13 is a stereoscopic eyeglass, which is worn by the singer so that the singer wears glasses when singing, so that the singer can stereoscopically see the character image and background image displayed on the stereoscopic image display device 16. it can. Reference numeral 14 denotes a stereoscopic glasses interface unit (hereinafter referred to as “stereoscopic glasses I / F unit”), which outputs a signal for driving the liquid crystal shutter of the stereoscopic glasses 13 to the stereoscopic glasses 13.

Next, the operation of the stereoscopic image display karaoke apparatus according to the present invention having the above-described structure will be described separately for the basic performance operation and the stereoscopic display operation. 1) Basic performance operation: When the operator selects the music by inputting the music number of the music to be performed by operating the remote controller included in the operation unit 15, for example, the CPU unit 7 determines the main music number based on the music number. The music data corresponding to the music number is searched from the music data stored in the storage device 6, and the MI required for the performance is searched.
Character information, color change information, genre information and the like in the DI data and the lyrics data of the song to be played are obtained.

Then, the CPU section 7 uses the imported MID
By controlling the MIDI sound source unit 8 based on the I data, a performance signal necessary for playing the music is reproduced, and the performance signal is output to the mixer / amplifier unit 10. The mixer / amplifier unit 10 synthesizes the performance signal and the voice signal of the singer input from the microphone 4 and outputs the synthesized signal to the speaker 11, thereby reproducing the performance song and the singing voice as audible sounds.

Further, the CPU section 7 controls the external video reproducing apparatus 2 based on the genre information in the music data so as to output the background video corresponding to the genre of the music to the superimposing section 9 and the character information. When the character image is output to the superimposing unit 9 based on the color change information and the color change information, the superimposing unit 9 combines the background image and the character image and outputs them to the image display device 3 and the stereoscopic image display device 16. .

2) Stereoscopic display operation: The basic principle that an image is stereoscopically viewed by the stereoscopic glasses 13 and the stereoscopic image display device 16 which are the components of this embodiment is that the left eye is provided with a parallax according to the degree of stereoscopic viewing. The video for the right eye and the video for the right eye are switched at high speed and alternately, and each video is displayed on the left eye or the right eye, but the principle is well known at present and the description thereof is omitted.

When the karaoke performance starts, the CPU 7 displays the character image of the lyrics to be sung next by the singer on the stereoscopic image display device 16 through the stereoscopic glasses 13, but of course, before the singer starts singing, the character image is displayed. Is not displayed three-dimensionally. In this state, the CPU 7 changes the color of the character image being displayed at the timing of the beginning of singing just before the introduction of the karaoke performance ends.

When the singer starts singing along with the performance, the singing voice of the singer is converted into a voice signal by the microphone 4 and input to the pitch comparing section 12 together with the accompaniment music signal from the MIDI sound source 8. The pitch comparison unit 12 compares the accompaniment music signal and the audio signal, and instantaneously determines how much the audio signal is deviated based on the accompaniment music signal from the MIDI sound source 8, and the result is a numerical value. The data is converted and output to the CPU unit 7. For example, if the converted numerical data is “+5”, it indicates that the audio signal is shifted by 5 points in the direction higher than the accompaniment music signal. If the numerical data is "-10", it means that the audio signal is shifted by 10 points in the lower direction. That is, the numerical data indicates the direction of deviation by its sign and the magnitude of deviation by its absolute value.

Upon receiving the numerical value data from the pitch comparing section 12, the CPU section 7 changes the stereoscopic degree and the popping-out direction according to the numerical value data, and converts the character image data of the lyrics into the frame memories for the left and right eyes. Write in. For example, if the sign of the numerical data is “plus”, the character image is written in the frame memory with parallax in the pop-out direction and conversely, if it is “minus”, in the retracted direction.

Next, the CPU section 7 sends the character image data of the lyrics written in the frame memory for the right eye to the NTSC.
When the data of the character image of the lyrics written in the frame memory for the left eye is output to the superimposing unit 9 in synchronization with the even field of the NTSC signal while being synchronized with the odd field of the signal, the superimposing unit 9
Displays a stereoscopically visible image on the stereoscopic image display device 16 by synthesizing the background image and the character image and outputting them to the image display device 3 and the stereoscopic image display device 16.

Then, the stereoscopic glasses I / F unit 14 creates liquid crystal shutter drive signals for the right and left eyes of the stereoscopic glasses 13 in synchronism with the vertical synchronizing signal of the NTSC signal, and the stereoscopic glasses are alternately switched at high speed. By outputting to 13 the character image of the lyrics is stereoscopically displayed on the singer. Figure 2
FIG. 1 is a block diagram showing a configuration of a stereoscopic video display karaoke device according to the present invention.
It is shown within a broken line in the figure.

The difference between FIG. 1 and FIG. 2 is that the image display device 3, the stereoscopic glasses 13 and the stereoscopic glasses I / F unit 1 in FIG.
4 is different from that shown in FIG. 2, and only the difference will be described. Reference numeral 16 is a stereoscopic image display device for stereoscopically displaying an image without using glasses. Since the principle of stereoscopic display is well known such as a lenticular system, detailed description thereof will be omitted.

When the operator selects the song by inputting the song number of the song to be played, the CPU section 7 selects the song number from the song data stored in the main storage device 6 based on the song number. Search for the corresponding song data and MI required for performance
Character information, color change information, genre information, etc. in the lyrics data of the song to be played are obtained from the DI data, and the external video reproduction device 2 is controlled based on the genre information in the song data to respond to the genre of the song. The background image is output to the superimposing unit 9, and the character image is output to the superimposing unit 9 based on the character information and the color change information.

In this case, since the superimposing section 9 synthesizes the background image and the character image and outputs the synthesized image to the stereoscopic image display device 16, the singer and the spectator can observe the stereoscopic image display device 16 by
You can see the background image and the character image displayed in. When the karaoke performance starts, the CPU 7 displays a character image of lyrics to be sung next time on the stereoscopic image display device 16, but before the singer starts singing, the character image is not stereoscopically displayed. When the singer starts singing along with the performance in the state, the pitch comparison unit 12 compares the accompaniment music signal and the voice signal, and immediately determines how much the voice signal is deviated, and the result is a numerical value. The data is converted and output to the CPU unit 7.

Next, the CPU section 7 outputs the data of the three-dimensional character image of the lyrics with parallax to the three-dimensional image display device 16 according to the numerical data, so that the character image of the lyrics is three-dimensionally displayed to the singer and the audience. To be displayed.

[0029]

As described above, according to the stereoscopic image display karaoke apparatus of the present invention, the singer can see the stereoscopic character image of the lyrics corresponding to the deviation of his / her pitch while singing. You can correctly recognize your singing state.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a stereoscopic image display karaoke device according to the present invention.

FIG. 2 is a block diagram showing a configuration of a stereoscopic image display karaoke device according to the present invention.

[Explanation of symbols]

1 3D image display karaoke device 2 External video playback device 3 Video display device 6 main memory 7 CPU 7a ROM 7b RAM 8 MIDI sound source 9 Superimpose department 10 Mixer / Amplifier 12 pitch comparison section 13 stereoscopic glasses 14 3D glasses I / F section 15 Operation part 16 stereoscopic image display device

Claims (2)

(57) [Claims] 1. A stereoscopic image display karaoke apparatus comprising a pitch difference detecting means and a video signal creating means, wherein the pitch difference detecting means is a pitch difference between a pitch of a musical composition inputted and a pitch of an audio signal from a microphone. The stereoscopic video display karaoke device detects the video signal and creates a stereoscopic video image by adding parallax to the character video image of the lyrics according to the pitch difference and outputting the stereoscopic video image to the stereoscopic image display device. 2. The stereoscopic video display karaoke apparatus according to claim 1, wherein the video signal creating means provides a parallax to the stereoscopic video so that the stereoscopic video is in a pop-out direction or a retracted direction according to a difference in pitch difference sign. .