JP4862772B2 - Karaoke device with scoring function - Google Patents

Description

  The present invention relates to a karaoke apparatus having a scoring function capable of scoring with high accuracy.

Conventionally, a karaoke apparatus having a scoring function is widely known. Analyzes the voice of a singer during a karaoke performance input from a microphone, etc., evaluates the feature value obtained by the analysis by a predetermined method, quantifies it, and notifies the singer of the numerical value as a scoring result is there. In addition, information (pitch pitch information) that uses a pitch frequency obtained by extracting the pitch of a singing voice as a feature amount is generally used as a feature amount used for scoring processing. In the following Patent Document 1, a score for each male and female part is disclosed for a duet song. Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for determining the gender of input speech using the difference in frequency characteristics of male and female speech.
Japanese Patent Laid-Open No. 11-282478 JP 2001-56699 A

  By the way, when analyzing (scoring) the input singing voice during karaoke performance, it is desirable to remove acoustic signals other than the input singing voice in order to obtain a highly accurate scoring result. However, not only the singing voice of the singer but also a part of the music sound during the karaoke performance outputted from the musical sound reproducing device is inputted to the microphone of the singer.

  For this reason, conventionally, attempts have been made to remove the music sound by filtering using a frequency band filter or the like, but in this case, in order to remove only the music sound without removing the singer's input singing voice. When performing this filtering process, it is necessary to take care to perform a filtering process that does not affect the input singing voice.

  At this time, the frequency band of the singing voice is different between the male voice and female voice (in general, the voice of a male voice is lower than that of a female voice of a female voice). Applying the same filter processing is not preferable from the viewpoint of obtaining a highly accurate analysis result.

  Regarding this point, the frequency distribution of each of the drum sound, female, and male voice will be described with reference to the drawings. In the figures described below, the horizontal axis is the logarithmic frequency, and the vertical axis is the decibel. 1 to 3 show examples of frequency distribution of drum sounds. The drum sound is a percussive sound. In FIG. 1, there is a first peak near 70 Hz. In FIG. 2, there is a first peak near 60 Hz. In FIG. 3, there is a peak near 80 Hz. According to these figures, it can be seen that the drum sound generally has a first peak in a band of 100 Hz or less.

  4 to 6 show examples of female voice frequency distribution. In FIG. 4, there is a first peak near 300 Hz. In FIG. 5, there is a first peak near 400 Hz. In FIG. 6, there is a first peak near 500 Hz.

  7 and 8 show examples of male voice frequency distribution. In FIG. 7, there is a first peak near 80 Hz. In FIG. 8, there is a first peak between 100 and 200 Hz.

  According to these figures, it can be seen that there is a large difference between the female voice frequency band and the male voice frequency band. Further, it can be seen that the first peak of the low-pitched male voice is close to the first peak of the drum sound.

  As shown in these figures, when a filter (for example, a low cut filter) is set in accordance with the male voice, and the female voice is filtered using the filter as it is, the pitch of the female voice cannot be removed. It will adversely affect the acquisition of information. Further, when a filter is set in accordance with a female voice and the filter is applied to the male voice as it is, the male voice itself is also subjected to the filter processing, which adversely affects the acquisition of the pitch pitch information of the male voice.

  Further, when the filter is switched between male voice / female voice, it is necessary to determine whether the input voice is male voice or female voice. Although it is possible to make the singer select a gender when performing karaoke, such a selection operation places a burden on the singer. In addition, when the apparatus automatically determines male / female voice, it is necessary to perform highly accurate determination, for example, as used in a security system. In general, when a highly accurate voice recognition technology is executed by a karaoke scoring device using a one-chip CPU or the like, the recognition processing takes time, so it is difficult to adopt it for a karaoke device used for entertainment. is there.

  Therefore, the present invention eliminates the above-mentioned problems, accurately and easily discriminates male / female voices during music performance without imposing any burden on the singer, and performs appropriate filter processing for each male / female voice. The purpose of this is to realize a karaoke scoring device that can perform scoring with high accuracy.

  In order to achieve the above object, the invention according to claim 1 is a karaoke singing scoring device comprising a singer voice input means, a music reproducing means, a control means, a storage means, and a scoring means. Related data in which a frequency and a frequency band filter are associated with each other and music data including singer pitch information, instrument sound information, and music performance progress information are stored, and the control means includes the music data During the performance of the music based on the instrument sound information and the music performance progress information, it is determined whether the set predetermined instrument sound is not pronounced, and in the period when the instrument sound is not pronounced The pitch frequency of the singer is specified from the input voice input to the singer voice input means, and the frequency band filter is specified based on the specified pitch frequency and the related data. , The input speech is filtered by the specified frequency band filter, scoring means may be scoring the input speech after being the filtering process using the singer interval information.

  According to a second aspect of the present invention, in the karaoke apparatus having the scoring function of the first aspect, the karaoke apparatus further includes a storage unit, and the pitch pitch information of the input voice acquired during the non-sounding period is stored in the storage unit When the pitch pitch information for a predetermined time is stored and stored, the pitch frequency of the singer is specified by an averaging process.

  According to a third aspect of the present invention, in the karaoke apparatus having the scoring function of the first or second aspect, the music data is attached with information enabling the predetermined musical instrument sound to be specified, and the control means includes: The predetermined musical instrument sound is set based on the information.

  According to a fourth aspect of the present invention, in the karaoke apparatus having the scoring function of the first or second aspect, the predetermined musical instrument sound is predetermined.

According to a fifth aspect of the present invention, in the karaoke apparatus having the scoring function according to any one of the first to fourth aspects, the music is played based on music data including MIDI data, and the control means is configured to perform the predetermined instrument sound. It is determined that a predetermined time after the command for generating the sound is output is a period during which the predetermined musical instrument sound is being generated.

  According to a sixth aspect of the present invention, in the karaoke apparatus having the scoring function of the fourth aspect, the control means does not accumulate a pitch for a predetermined time in the temporary memory within a predetermined time after the performance of the music starts. In this case, the user is notified of predetermined information.

  According to the first aspect of the invention, the pitch frequency of the singer is specified based on the input voice that is input during a period when the predetermined instrument sound is not being generated, and the filter is set and set based on the result. Since scoring is performed on the basis of the filtered sound using the filter, it is possible to realize highly accurate scoring processing by setting a musical instrument that adversely affects pitch pitch information extraction as a predetermined musical instrument sound. it can.

  According to the invention which concerns on Claim 2, since the pitch frequency of a singer is specified using the pitch information for predetermined time, the precision of the specified pitch frequency can be improved.

  According to the invention of claim 3, since the music data is further provided with information that enables the predetermined musical instrument sound to be specified, the musical instrument sound that adversely affects the acquisition of pitch pitch information is provided for each musical piece. Since it becomes possible to specify, the suitable area for acquisition of pitch pitch information can be determined.

  According to the fourth aspect of the present invention, since the predetermined musical instrument sound is determined in advance, it is possible to perform highly accurate scoring using existing music data.

According to the invention of claim 5, further, since it is determined that the period in which the predetermined musical instrument sounds for a period of time after the instruction for sounding the said predetermined musical instrument sound is output is sound, the predetermined It is possible to determine a period during which the predetermined instrument sound is not generated by a simple process using the timing at which a command for generating the instrument sound is output.

  According to the sixth aspect of the present invention, when the pitch for a predetermined time cannot be accumulated within a predetermined time after the performance of the music is started, the fact is notified. It is possible to notify the singer of the early stage during the performance.

[First Embodiment]
A karaoke apparatus according to a first embodiment of the present invention will be described in detail with reference to the drawings.

  FIG. 9 is a block diagram showing the internal configuration of the control device and its peripheral devices in the karaoke device.

  The control device 10 is connected to a host computer (not shown) via a communication line, and receives music data via the communication I / F 15 via the communication line. The received karaoke song data is stored in the storage device 12.

  Here, the music data may include karaoke music title data, video data corresponding to the karaoke music, and the like in addition to the music playback data.

The controller 11 controls the entire control device 10. Various programs are executed.
The storage device 12 stores music data and the like. The storage device 12 is configured by a dynamic storage medium (HDD or the like). Moreover, you may comprise with a static storage medium as needed.

  The operation panel 13 is used for an operator to input various information such as a music selection number. Various kinds of information may be input via the remote controller 13a.

  The RAM 14 is a temporary storage memory in which information necessary for various controls is stored. The RAM 14 functions as a shared memory in the multithread process. The usage method as the shared memory in the present invention will be described later.

  The communication I / F 15 performs communication with a host computer (not shown) via a communication line. Here, the communication line may be wired or wireless.

  The scoring circuit 16 scores the voice input from the microphone 17. Moreover, in this embodiment, the audio | voice used as the object of scoring is given the filter process mentioned later. In FIG. 9, the number of microphones is two, but any number of microphones may be used. In FIG. 9, the controller 11 and the scoring circuit 16 are illustrated as separate configurations, but the controller 11 may perform filter processing and scoring processing. Further, another circuit may perform the filtering process.

  The sound source 18 is connected to the amplifier 19. The music data is converted into an audio signal via the sound source 18, amplified by the amplifier 19, and then output by the speaker 20. In the present embodiment, the sound source 18 is a MIDI sound source. The amplifier 19 also amplifies the sound input from the microphone 17.

  The video control circuit 21 is connected to the monitor 22. The video data acquired from the storage device 12 or the communication line and the lyric information included in the music data are displayed on the monitor 22 via the video control circuit 21 as background video and lyrics at the time of karaoke playback of the music. If the video data is encoded, the video control circuit 21 may perform the decoding process.

  The above-described internal configuration mainly describes what is necessary for the description of the present invention, and it goes without saying that various circuits and elements are included in addition to the above-described configuration.

  In addition, the external appearance of the karaoke apparatus in this embodiment is not limited at all in the present invention. Moreover, in this invention, you may provide the one part element shown as an internal structure of the karaoke apparatus mentioned above outside. The functions of some components can be realized by a server connected to a network.

  The music data used in this embodiment has instrument sound information, music performance progress information, singer pitch information, and the like. As typical examples, MIDI data can be cited, but the present invention is not limited to MIDI data, and may be other data as long as the present invention can be implemented. In MIDI data, a musical instrument sound is designated by a channel number, and on / off of the sound generation of the musical instrument sound is controlled by, for example, a note on / note off signal. Moreover, the note number of a vocal track can be used for the singer pitch information.

  FIG. 10 is a diagram illustrating an internal configuration of the shared memory. As shown in this figure, the shared memory includes an area for storing a time when a note-on signal is output in a predetermined instrument sound (instrument track) and an area for storing a note number of a vocal track. FIG. 10 shows the contents of the shared memory when a drum sound source is designated as a predetermined instrument sound.

  Next, the flow of processing of the karaoke apparatus in the present embodiment will be described with reference to the drawings. FIG. 11 is a flowchart of the scoring process of the karaoke apparatus in the present embodiment, and FIG. 12 is a flowchart of the performance process of the karaoke apparatus in the present embodiment. Here, the scoring process and the performance process are processed as multi-threads. That is, both processes are processed in parallel. Since multi-thread processing is publicly known, description thereof is omitted.

  Both processes can exchange information between the two processes by accessing the shared memory during execution.

[Scoring process]
First, the scoring process will be described with reference to FIG. When music playback starts, the scoring process begins to run.
In S1, the acquisition pitch holding area is initialized. The acquisition pitch holding area is formed in the RAM 14.

  In S2, the low cut filter is turned off. In the present embodiment, an example in which a low cut filter is used as a filter will be described. However, it goes without saying that the present invention can be realized even if a bandpass filter or the like is used. Further, the filter may be configured with a digital filter or an analog filter.

  In S3, it is determined whether or not the pitch pitch information becomes FULL within the acquired pitch holding area. The amount of pitch information stored in the acquired pitch holding area can be set as appropriate, and is an amount that can accurately calculate the pitch frequency of the input voice. If it is determined that the pitch information pitch information is not FULL (S3: NO), the process proceeds to S4.

  In S4, it is determined whether or not the music performance has ended. If it is determined that the performance has ended (S4: YES), the process proceeds to S11. If it is determined that the performance has not ended (S4: NO), the process proceeds to S5.

  In S5, it is determined whether or not a predetermined time has elapsed since the start of the performance. If it is determined that the predetermined time has elapsed (S5: YES), the process proceeds to S11. This certain time can be set as appropriate. The determination that a certain time has elapsed means that it has been determined that a predetermined amount of pitch pitch information has not been acquired within a predetermined time.

  In S11, the performance of the music is finished, and a message that the scoring is not possible is displayed on the monitor 22. Moreover, you may abbreviate | omit the process in S5 and S11 as needed.

In S5, when the predetermined time has not elapsed since the start of the performance (S5: NO), the process proceeds to S6.
In S6, it is determined whether or not pitch pitch information has been acquired. When it is determined that pitch pitch information cannot be acquired (S6: NO), the process returns to S3. If it is determined that pitch pitch information has been acquired (S6: YES), the process proceeds to S7. It should be noted that various known techniques can be employed as a method for acquiring pitch pitch information.

  In S7, it is determined whether or not the input volume at the acquisition timing of the pitch pitch information acquired in S6 is greater than or equal to a predetermined value. If the input volume is not higher than the predetermined level (S7: NO), it is determined that no sound has been input by the microphone 17 at the timing, and the process returns to S3. If the input volume is equal to or higher than the predetermined level (S7: YES), the process proceeds to S8.

  In S8, the current time is acquired. This current time represents the time when the pitch pitch information acquired in S6 is acquired. Thereafter, the process proceeds to S9, and a time difference between the time acquired in S8 and the time stored in the shared memory is calculated. When the time acquired in S8 has not elapsed for a predetermined time or more based on the time stored in the shared memory (S9: YES), the process returns to S3. If the predetermined time or more has elapsed (S9: NO), the process proceeds to S10. The time written in the shared memory is the time when a note-on signal of a predetermined musical instrument sound (in this embodiment, a drum sound source) written in a performance process described later is output.

  The process in S9 will be specifically described. In S9, it is determined that the drum sound is included in the sound input to the microphone 17 for a predetermined time after the drum sound source is sounded, and the pitch information acquired within the predetermined time is used for pitch calculation. Is not used. After a normal sound source is sounded by a note-on signal, the sound continues until a note-off signal is received. However, the drum or percussion sound source sounds at the same time as the note-on signal is received, and is muted when the end of the timbre is reached regardless of the presence or absence of the note-off signal. Therefore, when a drum sound source is specified as the predetermined instrument sound, the time from when the note-on signal is output until the sound is muted is managed as the predetermined time, and the note-on signal is output. Then, the predetermined time can be determined as the section where the sound is being generated. That is, it is not necessary to determine whether or not a note-off signal has been output.

  In S10, the pitch pitch information acquired in S6 is written in the acquired pitch holding area. Then, the process returns to S3.

If it is determined in S3 that the acquired pitch holding area is FULL (S3: YES), the process proceeds to S12.
In S12, an average value of all data in the acquired pitch holding area is calculated, and the average pitch information is acquired as the pitch frequency of the input voice. Then, it progresses to S13.

In S13, it is determined whether or not the calculated pitch frequency is equal to or less than a predetermined pitch. When the pitch frequency is equal to or lower than the predetermined pitch (S13: YES), it is determined that the voice input to the microphone 17 is a male voice, and the process proceeds to S14.
In S14, the low cut filter is set for male voice.

If the pitch frequency is not equal to or less than the predetermined pitch amount (S13: NO), it is determined that the voice input to the microphone 17 is a female voice, and the process proceeds to S15.
In S15, the low cut filter is set for female voice.

  In the processes of S13 to S15, the pitch information of the voice input to the microphone 17 is classified into two pitch frequencies (male voice / female voice), and a filter is set for each pitch frequency. It is possible to classify into three or more and set a filter for each frequency. Further, the relationship between the frequency and the set filter may be stored in advance as a data table, or may be processed on a program (that is, IF / THEN processing). Further, when it is determined that the voice is male, the filter process may not be performed.

  In S16, the scoring value is initialized. In this embodiment, since processing is performed by the deduction method, for example, 1000 points can be set as the initial value, but it is needless to say that a scoring method or other known scoring value setting methods can be applied as appropriate. . In this case, it goes without saying that the initial value is not 1000 points but a different value. Needless to say, when a scoring method other than the deduction method is employed, the processing of S22 described below is different.

  In S17, it is determined whether or not the music performance has ended. When the performance of the music is finished (S17: YES), the process proceeds to S18 and the scoring result is displayed on the monitor 22. In addition, you may comprise so that a scoring result (intermediate result) may be displayed suitably also during the performance of a music. If the performance of the music has not ended (S17: NO), the process proceeds to S19.

  In S19, it is determined whether or not pitch pitch information has been acquired. If the pitch information cannot be acquired (S19: NO), the process returns to S17. If it is determined that pitch pitch information has been acquired (S19: YES), the process proceeds to S20.

  In S20, it is determined whether or not the input volume at the acquisition timing of the pitch pitch information acquired in S19 is greater than or equal to a predetermined value. If the input volume is not higher than the predetermined level (S20: NO), it is determined that no sound is input from the microphone 17 at this timing, and the process returns to S17. If the input volume is equal to or higher than the predetermined level (S20: YES), the process proceeds to S21.

  In S21, the difference between the pitch pitch information acquired in S19 and the note number of the vocal track in the MIDI data stored in the shared memory is calculated. In this embodiment, the note number of the vocal track in the MIDI data is used as a scoring standard. The vocal track in MIDI data is also used as a guide melody when singing. The writing to the shared memory will be described in detail in the performance process. Then, it progresses to S22.

  In S22, the absolute value of the difference obtained in S21 is subtracted from the current scoring value. Here, if the pitch information input from the microphone is the same as the pitch information indicated by the note number stored in the shared memory, the pitch information of the audio signal input from the microphone 17 is correct. It will not be subtracted.

  In the scoring method in S21 and S22, the scoring value is also affected when the singing voice is shifted in the time direction with respect to the guide melody. Therefore, by storing a note number (pitch information) of a guide melody (vocal track) for a predetermined time in a shared memory and performing a scoring process using pitch pitch information and DP matching in the input voice, It is possible to reduce the influence of the deviation in the time direction on the scoring value.

[Performance process]
Next, the performance process will be described with reference to FIG. When the reproduction of the music starts, the performance process is started. In the performance process, a drum track and a vocal track are processed among a plurality of tracks included in MIDI data as music data. Therefore, it is necessary to specify a drum track and a vocal track from a plurality of tracks included in the music data.

  In S31, it is determined whether or not the acquired track data is a drum track. In this embodiment, the drum track is a predetermined instrument sound that affects the acquisition of pitch pitch information. If the track is not a drum track (S31: NO), the process proceeds to S35 without performing the process on the track because the other track is the target of the process.

If it is a drum track (S31: YES), the process proceeds to S32.
In S32, it is determined whether or not note-on information exists in the data acquired in S31. If the note-on instruction information is not included (S32: NO), it is determined that it is not the sound generation start timing of the drum sound source, and the process proceeds to S35.
If note-on instruction information is included (S32: YES), it is determined that the sound generation start timing of the drum sound source is reached, and the process proceeds to S33.

  In S33, the current time is acquired. This current time means the sounding start time of the drum sound source. As the current time, the time from system startup can be used, but other time information may be used. Thereafter, the process proceeds to S34.

  In S34, the current time acquired in S33 is set in the time setting shared memory. The contents of the time setting shared memory are updated each time the current time is acquired in S33.

  In S35, it is determined whether or not the acquired track data is a vocal track. If the track is not a vocal track (S35: NO), the process proceeds to S40 without processing the track because the other track is the target of processing.

  If it is a vocal track (S35: YES), it is determined whether or not note-on instruction information exists in the data acquired in S35. If the note-on instruction information is not included (S36: NO), it is determined that it is not the vocal utterance start timing, and the process proceeds to S38. If note-on information is included (S36: YES), it is determined that it is the vocal utterance start timing, and the process proceeds to S37.

  In S37, the note number is set in the note number shared memory. This content is used as a scoring standard in the scoring process.

In S38, it is determined whether or not note-off instruction information exists in the data acquired in S35. When the note-off instruction information is not included (S38: NO), the process proceeds to S40. If note-off instruction information is included (S38: YES), the process proceeds to S39.
In S39, the note number shared memory is cleared. As a result, information is stored in the note number shared memory only during the vocal utterance period.

  In S40, the MIDI data is sent to the sound source. As a result, the performance is controlled based on the musical sound data.

  In the above processing, the MIDI data is sent to the sound source after the processing for the drum track and the vocal track. However, the MIDI data is first sent to the sound source and then the processing for the drum track and the vocal track is performed. Also good.

  Note that the flowcharts described as the scoring process and the performance process are merely examples, and the process may be realized by another flowchart as long as the process can obtain a result equivalent to the above process.

Next, how the pitch pitch information is acquired during the above-described scoring process and performance process will be described with reference to the drawings.
FIG. 13 shows the relationship between the note-on and note-off timing of the drum track, the time from system activation, and the acquired pitch information. The horizontal axis is the time axis.

  In FIG. 13, 20 ms is set as the pitch ignorance time from the start of the sound generation of the drum sound source, and is set as the fixed time in S5 of FIG. Since the drum sound source is turned on at the time of system time 80010 (the unit ms is omitted; the same applies hereinafter), pitch pitch information acquired from 80010 to 80030 is discarded. Therefore, the pitch information 1 is discarded without being stored in the acquired pitch holding area.

  The pitch information 2 and 3 is acquired after 80030 and is written in the acquired pitch holding area because it is before the start of sound generation of the next drum sound source. Similarly, the pitch information 4 and 8 are discarded, and the pitch information 5 to 7 and 9 to 11 are written in the acquired pitch holding area. In FIG. 13, the drum track note-off instruction information is not used as described above. When pitch information for a predetermined time is accumulated in the acquired pitch holding area, the pitch frequency is calculated.

  As described above, in the present embodiment, after the performance is started, the male / female voice is determined based on pitch pitch information acquired in a period in which the drum sound source is not played, and a filter corresponding to the determined gender is set. Since the input speech is filtered using the set filter and the filtered speech is used as a scoring target, scoring with high accuracy can be performed. Further, when a predetermined amount of pitch pitch information cannot be acquired within a predetermined time when the music performance starts, it can be notified at an early stage of the performance.

  In the above processing, the information of the vocal track in the memory is changed as needed using the shared memory. However, the processing can be performed without using the shared memory. That is, in the scoring process, the note number of the vocal track included in the music data may be directly accessed.

[Second Embodiment]
In the first embodiment, male / female voice is determined, and the voice input to the microphone 17 is not subject to scoring until the filter is determined. However, the voice signal of this period is stored in a buffer or the like. In addition, after the filter is determined, these input voices can be filtered and reflected in the scoring results.

  FIG. 14 shows a flowchart of processing (hereinafter referred to as “temporary storage process”) that is performed after the input voice of the above period is stored in the buffer and the filter is determined.

  The temporary storage process is processed in parallel with the scoring process and the performance process. The temporary storage process is started when the music starts.

  In S51, it is determined whether or not the music performance has been completed. When the performance of the music is finished (S51: YES), the temporary storage process is finished. When the performance of the music has not ended (S51: NO), the process proceeds to S52.

  In S52, it is determined whether or not a filter is set in the scoring process. When the filter is set (S54: YES), the process proceeds to S54. If no filter is set (S54: NO), the process proceeds to S53.

  In S53, the audio signal input to the microphone 17 is written into the buffer. By repeating the processing of S51 to S53, the input voice until the filter is set in the scoring process is written to the buffer.

In S54, the input audio signals stored in the buffer are sequentially read out. Thereafter, the process proceeds to S55.
In S55, the read input audio signal is filtered using the filter set in the scoring process. Thereafter, the process proceeds to S56.

In S56, a scoring process is performed on the filtered audio signal. Since the scoring process itself is the same as that performed in the scoring process, description thereof is omitted.
In addition, you may perform the process of S54-S56 mutually in parallel. That is, the next input sound may be read from the buffer while the sound read from the buffer is being filtered.

  In S57, the scoring value calculated in this process is reflected in the scoring result in the scoring process. In addition, the timing to reflect can be set suitably.

  In the above-described embodiment, the voice input to the microphone 17 before the filter is set can be reflected in the scoring result. Note that the above flowchart is merely an example, and the process may be realized by another flowchart as long as it can obtain a result equivalent to the above process.

[In the setting of the specified instrument sound]
In the first and second embodiments described above, the drum sound source is a predetermined musical instrument sound. As a method for setting a predetermined instrument sound, as shown in FIG. 15, information for indicating a predetermined instrument sound may be included in the music data. By adopting such a configuration, at the time of music data creation, the music data creator side can specify in advance the instrument sound that adversely affects the pitch pitch information acquisition for each music, so the karaoke using the music data The scoring system for males can discriminate male / female voice accurately and easily according to the type of musical instrument sound and the time flow during the performance of music without imposing any burden on the singer. Appropriate filtering can be performed for each female voice, so highly accurate scoring is possible for each song. Note that the data structure of the music data shown in FIG. 15 is merely an example.

  For example, by referring to the exclusion track designation information included in the music data in FIG. 15, it is possible to specify the track of the instrument sound (instrument sound to be set) that adversely affects the pitch pitch information acquisition.

  Here, the excluded track specifies which musical instrument sound has an adverse effect on the pitch pitch information acquisition. If a drum track is designated as the excluded track, the same processing as that shown in FIG. 12 (S31, S32) can be performed. Also, for example, the track No. If 10 is set, the track No. The pitch information acquired within the pitch ignorance time (for example, 20 mS) from the 10 note-on timing is discarded. In this case, the track No. The musical instrument sound designated as 10 is specified as the musical instrument sound that adversely affects the pitch pitch information acquisition (the musical instrument sound to be set).

  Further, by using a program change command in MIDI, an arbitrary instrument sound track can be designated as the predetermined instrument sound track. If the drum sound source is the above-mentioned predetermined instrument sound, and a program change command for switching to the drum sound source is inserted in the MIDI data of any instrument sound track, after the program change command is executed, The track of any instrument sound will function as a drum track. Thus, the predetermined instrument sound can be specified by the MIDI command without directly specifying the predetermined instrument sound by the exclusion track designation information.

  Further, a predetermined instrument sound may be determined in advance in the karaoke apparatus. In this case, the present invention can be realized without processing any existing music data. In this case, although it is assumed that the pitch pitch information cannot be acquired correctly depending on the music, the pitch process for the predetermined time can be acquired within a predetermined time after the performance of the music starts in the scoring process described above. Since the fact that there has been no notification is given, the user can grasp that scoring was not performed correctly during the performance.

The present invention is not limited to the above-described embodiment, and various improvements and modifications can be made without departing from the scope of the present invention. The present invention can also be realized as a scoring method in a karaoke apparatus for executing the above-described processing. Furthermore, the present invention can be realized as a program for causing a computer to execute the scoring method in the karaoke apparatus and a recording medium on which the program is recorded.

It is the figure which showed an example of the frequency distribution of a drum sound source. It is the figure which showed an example of the frequency distribution of a drum sound source. It is the figure which showed an example of the frequency distribution of a drum sound source. It is the figure which showed an example of the frequency distribution of a female voice. It is the figure which showed an example of the frequency distribution of a female voice. It is the figure which showed an example of the frequency distribution of a female voice. It is the figure which showed an example of the male voice frequency distribution. It is the figure which showed an example of the male voice frequency distribution. It is the figure which showed the internal structure of the control apparatus of the karaoke apparatus which has a scoring function based on embodiment of this invention, and its peripheral element. It is the figure which showed the internal structure of the shared memory of the apparatus for karaoke which concerns on embodiment of this invention. It is a flowchart of the process for scoring which concerns on embodiment of this invention. It is a flowchart of the process for performance which concerns on embodiment of this invention. FIG. 4 is a timing chart showing the sound generation timing of a drum sound source, the time from system activation, and acquired pitch pitch information in the present invention. It is a flowchart of the process for temporary storage which concerns on 2nd Embodiment of this invention. It is the figure which showed an example of the structure of the music data in this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Control apparatus 11 Controller 12 Storage device 13 Operation panel 13a Remote control 14 RAM
15 Communication I / F
16 Scoring Circuit 17 Microphone 18 Sound Source 19 Amplifier 20 Speaker 21 Video Control Circuit 22 Monitor

Claims (6)

In a karaoke apparatus having a scoring function comprising a singer voice input means, a music playback means, a control means, a storage means, and a scoring means,
In the storage means,
The related data in which the pitch frequency and the frequency band filter are associated, and song data including singer pitch information, instrument sound information, and music performance progress information are stored,
During the performance of the music based on the music data, the control means,
Based on the instrument sound information and the music performance progress information, it is determined whether or not the set predetermined instrument sound is being pronounced,
The pitch frequency of the singer is identified from the input voice input to the singer voice input means during a period when the instrument sound is not pronounced,
Based on the identified pitch frequency and the related data, identify the frequency band filter,
Filter the input speech with the specified frequency band filter,
The scoring means scores the input voice after the filtering process using the singer pitch information.
A karaoke apparatus having a scoring function. It further has storage means,
The pitch information of the input voice acquired during the period where the pronunciation is not performed is stored in the storage means,
When pitch information for a predetermined time is accumulated, the pitch frequency of the singer is specified by averaging.
A karaoke apparatus having a scoring function according to claim 1. The music data is attached with information that makes it possible to specify the predetermined instrument sound,
The control means sets the predetermined instrument sound based on the information;
A karaoke apparatus having a scoring function according to claim 1 or 2. The predetermined musical instrument sound is predetermined;
A karaoke apparatus having a scoring function according to claim 1 or 2. The above music is played based on music data including MIDI data,
The control means determines a period instruction for sounding the said predetermined musical instrument sound a certain time from the output, the predetermined musical instrument sound is pronounced,
The karaoke apparatus which has a scoring function in any one of Claims 1-4 characterized by the above-mentioned. The control means notifies the user of predetermined information when a pitch for a predetermined time is not accumulated in the temporary memory within a predetermined time after the performance of the music starts.
A karaoke apparatus having a scoring function according to claim 4.

Images