JP5494083B2 - Karaoke equipment - Google Patents

Description

  The present invention relates to a technique for performing effect processing for each part of a karaoke song.

  With the widespread use of karaoke equipment and the improvement of users' singing techniques, there is an increasing need to sing parts other than the main melody part (harmonic melody part). However, since the harmony melody part is often more difficult to melody than the main melody part, a technique for assisting a user who sings the harmony melody part has been proposed (see Patent Document 1). According to this technology, it is determined which singing voice signal for singing the harmony melody part is output from which microphone among a plurality of microphones, and the singing voice signal determined as the singing voice signal for singing the harmony melody part is Pitch correction and chorus effects are added. As a result, according to the technique, the singing of the harmony melody part can be heard more accurately and more like a back chorus.

Japanese Patent Laid-Open No. 10-161672

However, when the above technique is used, there is a possibility that the singing of the main melody part is buried when the consonant pronunciation of the singer of the harmony melody part is strong or when the volume of the voice is high. In particular, according to the technique described above, since the chorus effect is added, the singing sound of the harmony melody part is increased in thickness and spread, and the possibility that the singing of the main melody part is buried more increases.
This invention is made | formed in view of such a situation, and it aims at preventing the song of a main melody part being buried in the song of a harmony melody part.

  In order to solve the above-described problems, the present invention provides first and second sound output by a storage means for storing main melody data of karaoke music and first and second sound collection means for outputting the collected sound as an audio signal. The second sound signal is compared with the main melody data stored in the storage means to determine the degree of coincidence, and based on the determination result of the determination means, the first and second sound signals Among them, the voice signal having the high degree of coincidence is identified as the voice signal of the main melody and the voice signal identified as the voice signal of the main melody by the identification means for identifying the other voice signal as the voice signal of the harmony melody For the signal, a first correction unit that performs processing for adding a harmonic component of the audio signal to a frequency band equal to or higher than a first threshold, and an audio signal that is identified as a harmony melody audio signal by the identification unit. A second correcting means for performing a process of reducing the volume in a frequency band equal to or higher than a second threshold; a main melody audio signal processed by the first correcting means; and the second correcting means. There is provided a karaoke apparatus comprising output means for amplifying and outputting a sound signal of a harmony melody that has been processed.

  In a preferred aspect, the karaoke apparatus further includes a discriminating unit that discriminates a characteristic of the audio signal that is discriminated from the main melodic audio signal by the discriminating unit, and the processing of the first correcting unit and the second correcting unit. At least one of the processes may be performed based on the characteristics determined by the determination unit.

  Moreover, in another preferable aspect, the karaoke apparatus further includes a determination unit that determines a characteristic of the audio signal that is identified as the audio signal of the harmony melody by the identification unit, and the processing of the first correction unit; At least one of the processes of the second correcting unit may be performed based on the characteristics determined by the determining unit.

  According to the present invention, by performing effect processing separately on the singing voice signal of the main melody part and the singing voice signal of the harmony melody part, the song of the main melody part can be prevented from being buried in the song of the harmony melody part.

It is a figure which shows the hardware constitutions of the karaoke system which concerns on one Embodiment of this invention. It is a figure which shows the structure of the music data which concern on one Embodiment of this invention. It is a functional lineblock diagram concerning one embodiment of the present invention. It is a functional block diagram concerning one modification of the present invention.

<Embodiment>
FIG. 1 is a diagram showing a hardware configuration of a karaoke system according to an embodiment of the present invention. In the figure, the karaoke apparatus 1 is connected to two microphones 2A and 2B, a speaker 3, and a display 4. The microphones 2A and 2B collect the singer's singing voice and output it to an A / D converter 11A or 11B described later as an analog signal. The speaker 3 acquires a stereo signal from a mixer 14 described later, and outputs sound based on the signal. The display 4 is a display device such as a liquid crystal display, and displays image images and lyrics telops under the control of a VDP (Video Display Processor) 17 described later.

  As shown in FIG. 1, the karaoke apparatus 1 includes A / D converters 11A and 11B, effectors 12A and 12B, D / A converters 13A and 13B, a mixer 14, a control unit 15, a storage unit 16, a VDP 17, and an operation unit 18. And a sound source 19. The A / D converters 11A and 11B acquire an analog signal of singing voice from the microphone 2A or 2B described above, convert the signal into a digital signal, and output the digital signal to the effector 12A or 12B. The A / D converters 11A and 11B also output the digital signal to the control unit 15. The effectors 12A and 12B are DSPs (Digital Signal Processors), which perform an effect process described later on the digital signal acquired from the A / D converter 11A or 11B, and output it to the D / A converter 13A or 13B. The D / A converters 13A and 13B acquire a digital signal from the effector 12A or 12B, convert the signal into an analog signal, and output the analog signal to the mixer 14. The mixer 14 mixes and amplifies the analog signal acquired from the effectors 12A and 12B and the musical sound signal acquired from the sound source 19, and outputs the mixed signal to the speaker 3 as a stereo signal.

  The control unit 15 includes a CPU, a ROM, a RAM, and the like. The CPU controls each unit of the karaoke apparatus 1 by loading a program stored in the ROM into the RAM and executing the program. The storage unit 16 is a storage device such as an HDD (Hard Disk Drive) and stores a plurality of song data of karaoke songs. Each piece of music data is, for example, data in MIDI format, and includes a header, a musical tone track, a main melody track, a harmony melody track, a lyrics track, an image image track, and the like as shown in FIG. In the header, song attribute data such as the song title, genre, and performance time are written. In each track, musical tone data, main melody data, harmony melody data, lyrics data, image image data, and the like are written. Parameters for identifying each track are also stored in the ROM, and the CPU can identify data written in each track by referring to the parameters. For example, it is possible to identify which data is data representing the main melody. The VDP 17 acquires lyric data and image image data read from the storage unit 16 by the control unit 15 and causes the display 4 to display lyric telops and image images. The operation unit 18 has a plurality of buttons and outputs an operation signal corresponding to the pressed button to the control unit 15. The sound source 19 is, for example, a MIDI sound source, acquires musical tone data read from the storage unit 16 by the control unit 15, converts the data into a musical tone signal, and outputs it to the mixer 14.

FIG. 3 is a configuration diagram of functions realized when the CPU of the control unit 15 executes a program stored in the ROM. The function group in the drawing is a function related to the determination of effect processing.
The difference calculation units 151A and 151B acquire the singing voice signal output from the A / D converter 11A or 11B, acquire the main melody data read from the storage unit 16, and calculate the difference between the two data. Here, the difference is a quantification of a difference in pitch and volume between both data, a difference in utterance (pronunciation) timing, and the like. Data representing this difference (difference data) is output from the difference calculation units 151A and 151B to the scoring units 152A and 152B, respectively.
The scoring units 152A and 152B accumulate the difference data output from the difference calculation unit 151A or 151B, and score how much the singing voice signal matches the main melody data at a predetermined timing. Then, the scoring result is output to the comparison unit 153 as point value data. The timing for scoring is, for example, the timing at which the performance of a karaoke song has started and the singing of one phrase has ended, or the timing at which the A melody has ended.

The comparison unit 153 acquires the point value data respectively output from the scoring units 152A and 152B, and compares both data to determine which singing voice signal approximates the main melody data. Then, data indicating the determination result (determination result data) is output to the effect process determination unit 154.
The effect process determination unit 154 determines the effect process to be executed by the effectors 12A and 12B based on the determination result data output from the comparison unit 153. Specifically, for example, based on the determination result data, the singing voice signal output by the A / D converter 11A is closer to the main melody data than the singing voice signal output by the A / D converter 11B. In the case shown, data for instructing the execution of the enhancer process is output to the effector 12A, and the data for instructing the execution of the de-esser process is output to the effector 12B. Output. Conversely, if it is shown that the singing voice signal output by the A / D converter 11B is closer to the main melody data than the singing voice signal output by the A / D converter 11A, the effector 12A In response to this, data instructing execution of the de-esser process is output, and data instructing execution of the enhancer process is output to the effector 12B.

Here, the enhancer process is a process in which the original sound is distorted in a frequency band equal to or higher than a predetermined threshold (distortion process is performed), and only the overtone component is extracted and added to the original sound (harmonic enhancer process). Alternatively, it is a process of adding an original sound whose phase is shifted in a frequency band equal to or higher than a predetermined threshold, extracting a harmonic component obtained by the comb filter effect, and adding it to the original sound (phase enhancer process). It is mainly used in the high sound range, and the outline of the sound can be made clear even if any enhancer processing is applied.
Parameters (effect parameters) that define the contents of enhancer processing include threshold frequency, threshold level, mix balance, and the like. The threshold frequency is a value that specifies a frequency band to which a harmonic component is added, and a harmonic component is added in a frequency band that is equal to or higher than the value specified as the threshold frequency. The threshold frequency is set within a range of 1 to 10 kHz, for example. The level is a value that specifies the degree to which a harmonic component is added. The mix balance is a value that specifies the ratio of mixing the original sound and the overtone component. These values can be set in advance by operating the operation unit 18 or a remote controller (not shown). In the above example, when the effect process determining unit 154 instructs the effector 12A or 12B to execute the enhancer process, the effect process determining unit 154 also outputs a preset effect parameter.

On the other hand, the de-esser process is a process for suppressing the volume in a frequency band equal to or higher than a predetermined threshold. It is mainly used in the frequency band of sibilance, and the effect that the consonant pronunciation can be made inconspicuous is obtained.
Parameters that define the contents of the de-esser processing include a threshold (Threshold), a ratio (Ratio), and a cutoff frequency (Cutoff Frequency). The threshold is a value that specifies the level of the volume to be suppressed, and a volume that is equal to or higher than the value specified as the threshold is suppressed. The threshold is set within a range of 2 to 10 kHz, for example. The ratio is a value that specifies the degree to which the volume is suppressed. The cutoff frequency is a value that designates a frequency band in which the volume is suppressed, and the volume is suppressed in a frequency band that is equal to or higher than the value specified as the cutoff frequency. These values can also be set in advance in the same manner as enhancer processing parameters. In the above example, when the effect processing determining unit 154 instructs the effector 12A or 12B to execute the de-esser processing, the effect processing determining unit 154 also outputs preset effect parameters.

  The effectors 12A and 12B that have acquired the data instructing execution of the effect process and the parameters of the process execute the effect process instructed to execute based on the acquired parameters. Specifically, for example, when the effector 12A is instructed to execute the enhancer process, the effector 12A generates the original sound in the frequency band equal to or higher than the specified threshold for the singing voice signal output from the A / D converter 11A. Is used to extract only the overtone component and add it to the original sound. When the effector 12B is instructed to execute the de-esser process, the singing voice signal output from the A / D converter 11B is subjected to a process for suppressing the volume in a frequency band equal to or higher than a specified threshold.

  According to the embodiment described above, the singing voice for singing the main melody part is determined by the comparison unit 153, and the enhancer process is performed on the signal representing the singing voice. On the other hand, a de-esser process is performed with respect to the singing voice (that is, the singing voice that sings the harmony melody part) determined not to be the singing voice that sings the main melody part. As a result, the outline of the sound is clear for the singing voice that sings the main melody part, and the pronunciation of the consonant becomes inconspicuous for the singing voice that sings the harmony melody part. Therefore, the situation where the song of the main melody part is buried in the song of the harmony melody part can be prevented.

<Modification>
(1) In the above embodiment, the effector 12A or 12B may perform a low path filter process instead of the de-esser process. Here, the low-pass filter process is a process for removing a component having a frequency equal to or higher than a predetermined threshold. According to the low-pass filter process, the frequency component in the high sound range is removed, so that the consonant pronunciation is not noticeable in the singing voice of the harmony melody part, and the singing of the main melody part can be prevented. Note that parameters that define the content of the low-pass filter process include a cut-off frequency and a resonance. The cutoff frequency is a value that designates a frequency band from which the component is removed, and the component is removed in a frequency band that is equal to or higher than the value designated as the cutoff frequency. The resonance is a value that specifies the degree of emphasizing the harmonics around the cutoff frequency. These values can also be set in advance in the same manner as enhancer processing parameters.

(2) In the above embodiment, only one set of effect parameters is set for each effect process. However, a plurality of sets of effect parameters may be set and used in accordance with the song attributes. For example, the storage unit 16 of the karaoke apparatus 1 stores a set of effect parameters for each genre of music for each effect process, and the effect process determination unit 154 refers to the header of the data of the music to be played, and May be specified, the effect parameter set corresponding to the genre may be read from the storage unit 16, and the effect parameter set may be output when the effect processing is instructed to the effector 12A or 12B. According to this modification, in solving the problem of preventing the singing of the main melody part from being buried, an element called a song attribute can also be considered.

(3) In the above embodiment, only one set of effect parameters is set for each effect process as described above. However, a plurality of sets of effect parameters are set, and the characteristics of the input singing voice signal You may use properly according to. Specifically, the storage unit 16 of the karaoke apparatus 1 stores a set of effect parameters for each characteristic of the singing voice for each effect process, and determines the characteristics of the input singing voice signal. A set of effect parameters to be output to the effector 12A or 12B may be determined based on the characteristics. This will be specifically described below.
FIG. 4 is a configuration diagram of functions realized by the CPU of the control unit 15 executing a program stored in the ROM according to the present modification. In the functional configuration diagram according to this modification, analysis units 155A and 155B are added as compared to the functional configuration diagram according to the above-described embodiment.

  In the figure, analysis units 155A and 155B acquire the singing voice signal output from the A / D converter 11A or 11B, and analyze the characteristics of the signal. For example, the analysis units 155A and 155B determine whether or not the fundamental frequency of the singing voice signal to be acquired is 180 Hz or more. In general, the frequency of male voice is about 80 to 120 Hz and the frequency of female voice is about 240 to 500 Hz. Therefore, it is determined whether or not the basic frequency of the singing voice signal is 180 Hz or higher. This is because it is possible to determine whether the voice represented by the signal is male or female. The analysis units 155A and 155B output data indicating the analysis result (analysis result data) to the effect processing determination unit 154, and the effect processing determination unit 154 sets the effect parameter set corresponding to the characteristic represented by the analysis result data. When reading out from the storage unit 16 and instructing the effect processing to the effector 12A or 12B, the effect parameter set is output. In this case, the effect processing determination unit 154 identifies a set of effect parameters to be output to the effector 12A based on the analysis result data output from the analysis unit 155A, and the effector determination unit 154 determines the effector based on the analysis result data output from the analysis unit 155B. A set of effect parameters to be output to 12B is specified. According to this modification, in solving the problem of preventing the singing of the main melody part from being buried, an element of the characteristics of the singing voice can be taken into consideration.

In the above description of the present modification, the effector whose effect parameter set is specified based on the analysis result data output from the analysis unit may be only one of the effectors 12A and 12B. . For example, in the above description of this modification, the effect parameter set output to the effector 12A is specified based on the analysis result data output from the analysis unit 155A, and the effect parameter set output to the effector 12B. A predetermined set may be used. Here, the predetermined set is a preset effect parameter set stored in the storage unit 16.
Further, in the above description of the present modification, a set of effect parameters to be output to the effector 12B is specified based on the analysis result data output from the analysis unit 155A, and based on the analysis result data output from the analysis unit 155B. The effect parameter set to be output to the effector 12A may be specified. In this case, the effect parameter set will be determined based on the characteristics of the other party's singing voice.For example, when you are singing the main melody part and you are a woman, It is possible to make adjustments such as setting the level higher. In this case, the effector whose effect parameter set is specified based on the analysis result data output from the analysis unit may be only one of the effectors 12A and 12B.

(4) In the above embodiment, two microphones are provided, but three or more microphones may be provided. In this case, each microphone to be added is provided with an A / D converter, an effector, and a D / A converter as well as the microphones 2A and 2B, and functions of a difference calculation unit and a scoring unit. The effect processing determination unit 154 instructs the effector that processes the signal closest to the main melody data among the input singing voice signals to execute the enhancer process, and the de-esser processing for the effectors that process other singing voice signals. Process the execution of.

DESCRIPTION OF SYMBOLS 1 ... Karaoke apparatus, 2A, 2B ... Microphone, 3 ... Speaker, 4 ... Display, 11A, 11B ... A / D converter, 12A, 12B ... Effector, 13A, 13B ... D / A converter, 14 ... Mixer, 15 ... Control , 16 storage unit, 17 VDP, 18 operation unit, 19 sound source, 151 A, 151 B difference calculation unit, 152 A, 152 B scoring unit, 153 comparison unit, 154 effect determination unit, 155 A, 155 B ... analysis department

Claims (3)

Storage means for storing main melody data of karaoke songs;
The first and second sound signals output by the first and second sound collecting means for outputting the collected sound as sound signals are compared with the main melody data stored in the storage means, and the degree of coincidence Determining means for determining
Based on the determination result of the determination means, of the first and second sound signals, the sound signal having a high degree of coincidence is identified as the sound signal of the main melody, and the other sound signal is determined as the sound signal of the harmony melody. An identification means for identifying;
First correcting means for performing processing for adding a harmonic component of the sound signal to a frequency band equal to or higher than a first threshold for the sound signal identified as the main melody sound signal by the identifying means;
Second correcting means for performing a process of reducing the sound volume in a frequency band equal to or higher than a second threshold for the sound signal identified as the sound signal of the harmony melody by the identifying means;
Output means for amplifying and outputting the sound signal of the main melody processed by the first correction means and the sound signal of the harmony melody processed by the second correction means. Karaoke device. A discriminating unit for discriminating characteristics of the audio signal identified from the main melodic audio signal by the discriminating unit;
2. The karaoke according to claim 1, wherein at least one of the processing of the first correction unit and the processing of the second correction unit is performed based on the characteristic determined by the determination unit. apparatus. A discriminating unit for discriminating characteristics of the audio signal identified from the audio signal of the harmony melody by the discriminating unit;
2. The karaoke according to claim 1, wherein at least one of the processing of the first correction unit and the processing of the second correction unit is performed based on the characteristic determined by the determination unit. apparatus.

Images