JP3261983B2 - Karaoke equipment - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a karaoke apparatus having a built-in sound source for generating a musical tone based on encoded music data, and particularly to a data encoding method for audio data included in music data. Karaoke apparatus.

[0002]

2. Description of the Related Art The simplest karaoke apparatus reproduces music by reproducing a tape in which the music is recorded as an analog signal. However, with the development of electronic technology, the tape has been replaced with a CD (Compact Disk). And LD
Instead of (Laser Disk), the signal to be recorded is changed from an analog signal to a digital signal, and the data to be recorded therein is not only music data but also various information such as video data and lyrics data. Was. Recently, a communication type karaoke apparatus which takes in music data via a communication line (general telephone line or ISDN line) instead of a CD or LD and plays it using a sound source and a sequencer has rapidly spread. I've been. This communication type karaoke apparatus has a non-storage type in which music data to be reproduced is fetched and reproduced through a communication line each time, and a karaoke apparatus in which fetched music data is stored in a built-in storage device (such as a hard disk). There is a storage type that reads out and reproduces when necessary. At present, in terms of communication costs,
Storage type karaoke devices have become mainstream. In such a communication type karaoke apparatus, the latest data compression method and communication method are used in order to minimize the communication time (communication cost) and storage capacity as much as possible and to reduce the amount of music data per music. Has been introduced. For example, if communication is performed by using digital data recorded on a CD or LD as music data as it is, a communication-type karaoke apparatus cannot be established in terms of communication time and communication cost.
Therefore, the communication type karaoke apparatus transmits data related to performance and data related to lyrics in the music data to MIDI.
(Musical Instrument Digita
l Interface) data (hereinafter referred to as “MIDI data”).
A voice data that cannot be encoded into data
DPCM (Adaptive Differentia)
(1) Pulse Code Modulation) Coding was performed by reducing the data amount of music data per music by encoding the data using a data compression technique.

[0003]

SUMMARY OF THE INVENTION However, ADPCM
Even though the data is compressed, the data amount is relatively large as compared with the MIDI data. Therefore, the data occupies most (about two-thirds) in the storage device of the storage type karaoke apparatus, and This is one of the factors that limit the number of music data that can be stored in the device. This is also a factor that limits shortening of communication time (communication cost) when communicating music data. Therefore, by compressing the audio data by a vector quantization technology having a higher compression ratio than the ADPCM data compression technology, communicating the music data, and storing the data in the karaoke apparatus, the communication time can be greatly reduced. The storage capacity of music data can be reduced. However, since the decoding method of the compressed data is different between the audio data compressed by the ADPCM data compression technique and the audio data compressed by the vector quantization technique, the conventional karaoke apparatus mixes both audio data. Could not handle.
SUMMARY OF THE INVENTION It is an object of the present invention to provide a karaoke apparatus capable of storing audio data compressed by different data compression methods in a mixed manner, reading out the decoded data as appropriate, decoding the data, and performing a karaoke performance.

[0004]

A karaoke apparatus according to the present invention includes storage means for storing a plurality of distributed music data, reads out accompaniment data of the selected music data based on a music selection operation, and plays an accompaniment music tone. And a karaoke apparatus that reads out audio data attached to the selected music data and generates a sound based on the read audio data. In the karaoke apparatus, the audio data includes index information for selecting a spectrum pattern of the audio waveform and the audio waveform. A first representing the audio data with auxiliary information for controlling the spectrum envelope;
And a second data compression method different from the first data compression method, wherein the audio data attached to the selected music data is the first or the second music data. Discriminating means for discriminating which of the second data compression methods the audio data conforms to, table storage means for respectively storing a spectrum pattern of an audio waveform corresponding to each index information; If it is determined that the audio data complies with the first compression method, the spectrum pattern is read from the table storage unit in accordance with the index information in the audio data, and the read spectrum pattern and the auxiliary information First decoding means for decoding a speech waveform according to the spectral envelope based on A second decoding unit that decodes an audio waveform based on the second data compression method when the determination unit determines that the audio data attached to the music data conforms to the second compression method; with the door, the capture via the communication network data of the spectral pattern stored in association with each <br/> index information
It can be recorded in a table storage means . As an example, the second data compression method is an ADPCM data compression method.

[0005] A conventional karaoke apparatus uses audio data (ADP) compressed by ADPCM data compression technology.
Karaoke performance processing is performed based on the CM audio data). Therefore, if the audio data is compressed and transmitted by the vector quantization technology capable of compressing the data at a higher compression rate than the ADPCM data compression technology, even if the audio data is transmitted only by a karaoke device capable of decoding the audio data, The audio data cannot be reproduced. This vector quantization technique is capable of compressing audio data at a compression rate about three times that of the ADPCM data compression technique, and converts the audio data into index information for specifying an audio spectrum pattern and auxiliary information relating to a spectrum envelope. Compress.
Therefore, in the present invention, the karaoke apparatus determines which data compression method is used for the audio data, and decodes the audio data based on the determined data compression method. That is, in the karaoke apparatus according to the present invention, the vector quantized audio data
Both audio data can be reproduced. Therefore, by transmitting the audio data compressed by the vector quantization technique, the communication time can be significantly reduced as compared with the case of transmitting the conventional ADPCM audio data. In addition, the karaoke apparatus can store the received vector quantized audio data in a storage medium such as a hard disk apparatus as it is, so that the storage capacity of music data can be reduced.

[0006]

An embodiment of the present invention will be described below in detail with reference to the accompanying drawings. FIG. 1 is a schematic block diagram showing the overall configuration of a karaoke apparatus 70 according to an embodiment of the present invention. In this embodiment, a karaoke apparatus 70 is connected to a host computer 90 via a communication interface 6 and a communication network 80, receives music data distributed from the host computer 90, and stores the music data in a built-in hard disk. Will be described. In this embodiment,
The host computer 90 converts the digital audio data into digital audio data 1 to n (hereinafter, referred to as “vector quantized audio data”) compressed by the vector quantization technique, or digital audio data (hereinafter, referred to as “ADPCM data compression technique”). , "ADPCM audio data") to 1-n are added to the header portion and the MIDI data portion to form music data as shown in FIG. 2 (A), which is transmitted via the communication network 80 according to a predetermined communication method. This is transmitted to the karaoke device 70. The karaoke device 70
The case where the received vector quantized audio data or ADPCM audio data is stored in the hard disk device 5 will be described. In addition, about this vector quantization technology,
This will be described later with reference to FIG.

The karaoke apparatus 70 includes a microprocessor unit (CPU) 1 and a program memory (RO).
M) 2 and various processes are executed under the control of a microcomputer system including a working memory (RAM) 3. The CPU 1 is a karaoke device 7
0 controls the overall operation. A program memory (R) is supplied to the CPU 1 via a data and address bus 21.
OM) 2, working memory (RAM) 3, panel interface 4, hard disk drive (HDD) 5, communication interface 6, data discriminating circuit 22, codebook 81, sound source circuit 10, effect means 14, image creating circuit 16, and background image The reproduction circuit 18 is connected. In addition, other auxiliary devices such as a MIDI interface circuit and a background video reproducing device including an LD (CD) changer are connected, but the description is omitted here.

The program memory 2 stores a system-related program of the CPU 1, a program for loading a system-related program stored in the hard disk device 5, various parameters and data, and the like. (ROM). The working memory 3 temporarily stores a system program loaded from the hard disk device 5 and various data generated when the CPU 1 executes the program.
M) predetermined address areas are respectively allocated and used as registers and flags. The panel interface 4 converts command signals from various controls and a remote control device (not shown) provided on a panel (not shown) of the karaoke apparatus 70 into signals that can be processed by the CPU 1, and converts them into data and addresses. Output to the bus 21.

The hard disk device 5 stores a system program and music data of the karaoke device 70 and has a storage capacity of several hundred M to several G, for example. In this embodiment, the audio data included in the music data stored in the hard disk device 5 is compressed by a vector quantization technique or an ADPCM data compression technique. It is needless to say that the music data stored in the hard disk device 5 is not only taken in through the communication network 80 but may be read and recorded from a floppy disk driver or a CD-ROM driver (not shown). No. Also,
The hard disk device 3 can easily add an operation program or upgrade the version via a communication line, a CD-ROM driver, or the like. The communication interface 6 reproduces the music data transmitted via the communication network 80 into the original music data in accordance with the communication system, and outputs the original music data to the hard disk device 5 or the karaoke performance history stored in the hard disk device 5. To the host computer 90 according to the communication method. The data discriminating circuit 22 stores the music data reproduced by the communication interface 6 or the hard disk drive 5.
The data of the audio data portion included in the music data read out from the device is fetched in accordance with the progress of the music, and the data of the audio data portion is vector quantized audio data, or A
It is determined whether the data is the DPCM audio data, that is, which data compression method is used for the data in the audio data part, and the vector-quantized audio data is transmitted to the vector-quantized data decoding means 71 in accordance with the result of the determination. ,
ADPCM data decoding means 1 for ADPCM audio data
1 respectively. Since the type name of the audio data portion, that is, data indicating which data compression method is used, is recorded in the header portion of the music data, the data determination circuit 22 determines the type of the audio data portion. According to the name, a decision is made as to which decoding means the data of the audio data part is to be supplied to. The vector-quantized data decoding means 71, in accordance with the instruction of the audio track in the music data, reads the vector-quantized audio data reproduced by the communication interface 6 or the index included in the vector-quantized audio data read from the hard disk device 5. Converting the information into a spectral pattern based on the codebook 81 , decoding the original digital audio data based on the converted spectral pattern and the auxiliary information,
It is output to the mixer circuit 12. Codebook 81
Is a conversion table for converting index information into a spectrum pattern of audio data. Code book
81 may be configured by a dedicated memory, or may be stored in an appropriate location of the hard disk device 5. The data of the code book 81 is stored in the communication network 8
0, or may be read from a floppy disk driver or a CD-ROM driver (not shown) and recorded. The ADPCM data decoding means 11 outputs the ADPCM audio data reproduced by the communication interface 6 or the hard disk drive 5.
, And converts and expands the ADPCM audio data read out from the digital audio data, and decodes the original digital audio data, and outputs it to the mixer circuit 12. Note that AD
The PCM digital decoding means 11 may generate an audio signal pitch-shifted according to the pitch information.

The tone generator circuit 10 is capable of simultaneously generating musical tone signals on a plurality of channels.
1 to input data conforming to the MIDI standard on the musical tone track given, generate a musical tone signal based on this data, and output it to the mixer circuit 12. The tone generator circuit 10 can simultaneously generate tone signals on a plurality of channels by using a single circuit in a time-division manner to form a plurality of tone channels, or a single tone channel can be constituted by a single circuit. It may be of the type as described below. The sound source circuit 10
May be used as the tone signal generation system. For example, a memory reading method (waveform memory method) for sequentially reading out tone waveform sample value data stored in a waveform memory in accordance with address data that changes according to the pitch of a musical tone to be generated, or a phase angle parameter An FM method for executing a predetermined frequency modulation operation as data to obtain tone waveform sample value data, or an AM method for executing a predetermined amplitude modulation operation using the address data as phase angle parameter data to obtain tone waveform sample value data, or the like. May be appropriately adopted. In addition to these methods, a physical model method that synthesizes a musical sound waveform by an algorithm that simulates the sounding principle of a natural musical instrument, a harmonic synthesis method that synthesizes a musical sound waveform by adding a plurality of harmonics to a fundamental wave, A formant synthesis method of synthesizing a musical tone waveform using a formant waveform having a specific spectral distribution, an analog synthesizer method using VCO, VCF, and VCA may be employed. In addition, the tone generator circuit is not limited to the one that uses dedicated hardware, and the tone generator circuit may be configured using a DSP and a microprogram. Alternatively, the tone generator circuit may be configured using a CPU and software programs. It may be.

The mixer circuit 12 converts the tone signal generated by the tone generator 10, the audio signal decoded by the vector quantization data decoding means 71 or the ADPCM data decoding means 11, and the audio signal from the microphone 13. Mixing and output to the effect means 14. The effect means 14 includes a tone signal from the mixer circuit 12,
The sound signal is given an effect such as reverberation or reverb and output to the sound output device 15. The effect means 14 controls the type and degree of the effect according to the control data of the effect control track in the music data. The sound output device 15 emits a tone signal and a sound signal from the effect means 14 via a sound system including an amplifier and a speaker.

The video creating circuit 16 is provided with a character code created based on the MIDI data recorded on the lyrics track, character data relating to the display location, display time data relating to the display time of the lyrics, and the display color of the lyrics. Is generated on the monitor screen on the basis of the wipe sequence data for sequentially changing the song according to the progress of the music. The background video reproduction circuit 18 selectively reproduces a predetermined background video corresponding to the genre of the music to be played from the CD-ROM 17 and outputs it to the video mixer circuit 19. The video mixer circuit 19 superimposes the lyrics video from the video creating circuit 16 on the background video from the background video reproducing circuit 18 in a superimposed manner, and outputs the superimposed lyrics video to the video output circuit 20. The video output circuit 20 displays a composite image of the background video and the lyrics video mixed by the video mixer circuit 19 on a monitor screen.

FIG. 2 is a diagram showing an example of the configuration of one piece of music data received and stored by the karaoke apparatus 70 of FIG. 1 via a communication network. The music data includes a header section 31, a MIDI data section 32, and an audio data section 33 as shown in FIG. The header section 31 is composed of various data related to the music data, and specifically includes data such as a music title, a genre name to which the music belongs, a type name of audio data, a release date, and a performance time. The type name of the audio data is data indicating whether the data in the audio data part is vector quantized audio data or ADPCM audio data. In addition, the header section 31 may record additional information such as a communication date, a date accessed, and a number of times. The MIDI data section 32 includes a musical sound track, a lyrics track, an audio track, and an effect control track. In the music track, performance data such as a melody part, an accompaniment part, and a rhythm part according to the music are recorded. The performance data is data conforming to the MIDI standard, and includes duration time data Δt indicating a time interval between events, status data indicating the type of the event (such as a sounding start command and a sounding stop command), It is composed of pitch designation data for designating a pitch at which sound is started or stopped, and volume designation data for designating a sound volume at the time of sound production. The volume designation data is given when the status data is a sound generation start command. In the lyrics track, data relating to lyrics to be displayed on a monitor screen (not shown) is recorded in a MIDI system exclusive message format. In other words, the MIDI data recorded on the lyrics track includes the character code corresponding to the lyrics to be displayed and the character data relating to the display location, the display time data relating to the display time of the lyrics, and the display color of the lyrics according to the progress of the music. And wipe sequence data for sequentially changing them. In the audio track, data relating to the generation of audio data recorded in the audio data section is recorded in a MIDI system exclusive message format as shown in FIG. That is, MIDI recorded on this audio track
The data includes data relating to the generation timing of audio data, event data specifying audio data to be generated at that timing, and data specifying the volume and pitch of the audio data. The effect control track includes
MIDI data relating to control of the effect means 14 is stored. Lyric track and effect control track are also in Fig. 2.
The data is transmitted as data conforming to the MIDI standard as shown in FIG.

FIG. 2C is a diagram showing an example of a data configuration of the audio data unit 33 quantized by the vector quantization technique. Data 1 to n of the audio data section 33
Consists of auxiliary information 37 to 39 relating to the spectral envelope of audio data relating to the back chorus, sample audio, duet audio, etc., generated in accordance with the music, and index information 34 to 36 for specifying the spectral pattern of the audio data. . One frame of data is constituted by the auxiliary information and the index information, and start data S is recorded at the head of the frame, and end data E is recorded at the end of the frame. In the figure, data for three frames is shown, but the data of the audio data section 33 is actually composed of a large number of frames. FIG. 3 is a diagram showing the contents of the code book 81 . For example, when the index information is “1”, the spectrum pattern 1 is read as the spectrum of the frame, and when the index information is “2”, the spectrum pattern 2 is read as the spectrum of the frame.

FIG. 4 is a diagram schematically illustrating an operation of compressing audio data into vector-quantized audio data. When audio data exists as shown in FIG. 4A, a part of the audio data is cut out in an area shown by a rectangle 40 in FIG. 4B. The waveform data cut out as shown in FIG. 4B is processed by an orthogonal transform (MDCT) unit 41 such as a discrete cosine transform or a discrete Fourier transform, as shown in FIG.
Is converted into a signal in the frequency domain, that is, a spectrum signal. The cut-out data is converted by the linear prediction distribution (LPC) unit 42 into spectral envelope information as shown in FIG. The quantization unit 43 is configured as shown in FIG.
Is quantized using the spectrum envelope information and its audio power information as auxiliary information. The signal (spectral signal) in the frequency domain of FIG.
It is converted into a normalized spectral pattern as in (E). Here, a case where a normalized spectrum pattern is obtained by dividing the frequency domain signal of FIG. 4C by the spectrum envelope information of FIG. 4D will be described. You may. The normalized spectral pattern is input to the quantization unit 45.
As a result, it is quantized into index information corresponding to the closest spectral pattern among the spectral patterns stored in the code book 81 of FIG. The auxiliary information and index information quantized by the quantization unit 43 and the quantization unit 45 in this way are configured as shown in FIG. 2C, and the vector quantization representing the data 1 to n of the audio data unit is performed. It is added to the music data as audio data.

The karaoke apparatus 70 receives music data including vector quantized audio data or ADPCM audio data as data of an audio data section via the communication network 80 and the communication interface 6 and stores the music data in the hard disk device 5. In performing the music, the format of the audio data attached to the music data is output to the discriminating circuit, and if the data captured by the data discriminating circuit 22 is vector-quantized audio data, the vector-quantized data decoding means 71 In accordance with the performance of the music, the read audio data is decoded into the original digital audio signal, and ADP is performed.
In the case of CM audio data, the ADPCM decoding means 11
To decrypt. FIG. 5 is a diagram for explaining an outline of the operation when the vector quantized data decoding means 71 decodes the original digital audio data based on the vector quantized audio data. Note that FIG. 5B corresponds to FIG.
4C corresponds to FIG. 4C, FIG. 5D corresponds to FIG. 4D, and FIG. 5E corresponds to FIG. In the vector quantized data decoding means 71, the normalized spectrum reproducing unit 51 converts the codebook 81 of FIG. 3 to the spectrum pattern of FIG. 5E based on the index information 34 to 36 as shown in FIG. Is read. The spectrum envelope reproducing unit 52 reproduces the spectrum envelope information as shown in FIG. 5D based on the auxiliary information 37 to 39.
The spectrum reproducing unit 53 includes a normalized spectrum reproducing unit 51.
5 is multiplied by the spectrum envelope information from the spectrum envelope reproducing unit,
A spectrum signal as shown in (C) is reproduced. The inverse orthogonal transform unit 54 decodes a part of the original digital audio data as shown in FIG. 5D by performing an inverse orthogonal transform process on the spectrum signal from the spectrum reproducing unit 53. The decoded digital audio data is output to the mixer circuit 71.

In the above-described embodiment, a case has been described in which audio data is transmitted after being compressed by the vector quantization technique. However, other background images are transmitted after being compressed by the vector quantization technique. You may do so. Further, in the above-described embodiment, the case where the type name of the audio data is stored in the header portion has been described. However, the type name of the data may be stored in the event data portion of the audio track, or the music may be stored. It may be stored in an index table for searching.

[0018]

According to the karaoke apparatus of the present invention, AD
Since the music data can be compressed by a data compression method having a higher compression rate than the PCM method and transmitted through a communication line, the communication time can be greatly reduced and a different data compression method can be used. There is an effect that a karaoke performance can be performed by storing compressed audio data in a mixed state, reading out and decoding the data appropriately, and performing decoding.

[Brief description of the drawings]

FIG. 1 is a schematic block diagram showing an overall configuration of an embodiment of a karaoke apparatus according to the present invention.

FIG. 2 is a diagram showing a configuration example of music data distributed to a karaoke device.

FIG. 3 is a view showing an example of the contents of the code book of FIG. 1;

FIG. 4 is a diagram schematically illustrating an operation when audio data is quantized into index information and auxiliary information by a vector quantization technique.

FIG. 5 is a view for explaining an outline of an operation when decoding original digital audio data based on vector quantized audio data compressed by a vector quantization technique;

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... CPU, 2 ... ROM, 3 ... RAM, 4 ... Panel interface, 5 ... Hard disk drive, 6 ... Communication interface, 71 ... Vector quantization data decoding means, 81 ... Code book, 10 ... Sound source circuit, 11 ... AD
PCM data decoding means, 12 mixer circuit, 13 microphone, 14 effect means, 15 sound output means, 1
6 ... Video creation circuit, 17 ... CD-ROM, 18 ... Background video reproduction circuit, 19 ... Video mixer circuit, 20 ... Video output means, 21 ... Data and address bus, 22 ... Data discrimination circuit

Claims (2)

(57) [Claims] 1. A storage means for storing a plurality of distributed music data, wherein, based on a music selection operation, accompaniment data of the selected music data is read out to generate an accompaniment music sound, and the music data is added to the selected music data. In a karaoke apparatus for reading out attached audio data and producing an audio based on the audio data, the audio data includes index information for selecting a spectrum pattern of an audio waveform and auxiliary information for controlling a spectrum envelope of the audio waveform. And a second data compression method different from the first data compression method, wherein the audio data attached to the selected music data is Determining means for determining whether the audio data complies with the first or second data compression method; A table storing means for respectively storing the spectral patterns of the audio waveforms to be processed, and when the audio data attached to the music data is determined by the determination means to be in accordance with the first compression method, A first decoding unit that reads the spectrum pattern from the table storage unit in accordance with the index information, and decodes an audio waveform in accordance with the read spectrum pattern and the spectrum envelope based on the auxiliary information; A second decoding unit that decodes an audio waveform based on the second data compression method when the audio data attached to the music data is determined to comply with the second compression method. , the communication network data of spectral patterns stored in association with each index information It said table storing hand fetches via
A karaoke apparatus characterized by being able to record on a stage . 2. The karaoke apparatus according to claim 1, wherein said second data compression method is an ADPCM data compression method.