JPH0310053B2 - - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION The present invention relates to a musical note display device, which generates rhythm sounds and/or displays marker point reductions according to the cycle set at a speed, and inputs at the correct tempo based on the rhythm sounds or marker point reduction. It is an object of the present invention to provide a musical note display device which can accurately display musical notes corresponding to each input.

The applicant previously filed Japanese Patent Application No. 57-232457 (Japanese Unexamined Patent Publication No.
59-124384) and Japanese Patent Application No. 59-3670 (Japanese Unexamined Patent Publication No. 59-128576) "Musical note display device" converts the input audio signal into a digital signal, analyzes the frequency of this, and determines the pitch. Determine the pitch of the sound and display it on the CRT
proposed a device that displays music notation in real time.
This method performs an FFT operation on audio signal data converted to a digital signal, then calculates the result into a power spectrum to obtain a spectrum value, then calculates the maximum value of this spectrum value, and calculates the maximum value of this spectrum value. Find the frequency value of the spectrum that has the lowest weekly wave number among the spectra that have a frequency lower than the spectrum frequency that represents the maximum spectrum and that has a smaller spectrum within a predetermined range than the maximum spectrum, and use it as the pitch of the input audio signal. It is determined that
On the other hand, when there is no spectrum that satisfies the above conditions, the frequency value indicating the maximum spectrum is determined to be the pitch of the input audio signal, and this determination result is processed by a video display processor (hereinafter referred to as
Video RAM (hereinafter referred to as VDP)
(VRAM) and display it on a CRT.

However, this method only displays the pitch of the input audio signal, but cannot display the length of the sound. Therefore, it would be easier to see and more convenient if both the pitch and length of the input audio signal were analyzed and displayed as actual notes on the musical staff in real time.

The present invention satisfies the above requirements, and one embodiment thereof will be described below with reference to the drawings.

FIG. 1 shows a block system diagram of an embodiment of a musical note display device according to the present invention. In the same figure, terminal 1
The incoming input audio signal is supplied to a graphic equalizer 2, where it is varied to have a frequency characteristic that is easy to analyze, and then passed through an anti-aliasing filter 3.
The signals are supplied together to the AD converter 4 after removing unnecessary high frequency components so as not to cause aliasing noise. Initial settings (system initialization) are performed in the control device 5 (step A in Fig. 2).
22), each operation of the steps shown in A of the figure is executed while no interrupt occurs.

In the initial settings, for example, a standard speed of ♪ = 60 is set, and the periodic data corresponding to this speed is
It is preset in the cycle/wait area of RAM7. The periodic data in this area is configured to be able to be rewritten as appropriate as described later. On the other hand, in this embodiment, if you do not want to display the current value of the note at the standard speed, you can change the display to the desired current value. 15 and a non-locking cycle indicator switch 16 for setting a desired market price.

For example, if you want to display the market price as it is at standard speed, do not operate switches 15 and 16, but just step
Go to step 24 via step 23. When an interrupt occurs every sampling period of the AD converter 4 (step 53 in FIG. 2B), the operation shown in FIG. 2A is interrupted, and the AD conversion start flag is set in steps 24 and 54. When this is determined, AD conversion is performed in the AD converter 4 according to the conversion command and the command from the digital signal output unit 6 (step 55). If this is not completed (step 56), the process returns; on the other hand, if this is completed ( Step 56) The AD conversion end flag is set, the AD conversion start flag is reset (Step 57), the digital signal is stored in the RAM 7, and the wait operation is initialized (Step 58).

When the AD conversion is completed, it is determined in step 54 that the AD start flag is not set.
In step 59, wait for the transition to the next AD conversion process for a time corresponding to the standard cycle/wait data (corresponding to ♪ = 60 in this case) initialized above in RAM 7 ("wait" in Figure 2 C). ). When this time has elapsed (step 60), the conversion command unit 6 and the RAM
A synchronizing pulse is generated by the synchronizing pulse generator 19 in response to the signal from the synchronizing pulse generator 19 (step 61), and after being made into an appropriate pulse by the monomulti 20 ("synchronizing pulse" in FIG. 2C), it is supplied to the earphone 21. While being sounded as a rhythm sound, it is also supplied to the analysis number detection and pattern data detection section 10 as a marker point reduction control signal.

On the other hand, when the AD conversion is completed (step 25 in Figure 2 A), the signal output section 6
A signal is supplied to the arithmetic and pitch analysis section 8, and the FFT operation is performed in the arithmetic and pitch analysis section 8 (step 26) ("FFT operation" in Fig. 2C).
The calculation result is stored in RAM 7, and then power spectrum calculation is performed (step 27).
(“Power spectrum calculation, etc.” in FIG. 2C) The calculation result is stored in the RAM 7. The maximum spectral value is then determined, and then a spectral value that exists in a frequency region lower than the frequency of the spectrum exhibiting the maximum spectral value and is smaller within a predetermined range than the spectral size of the maximum spectral value is determined. The frequency value of the spectrum that shows the lowest frequency value among the spectra that it has is determined,
This is determined to be the pitch (fundamental tone) of the input audio signal, and if there is no spectrum that meets the above conditions, the frequency value of the spectrum indicating the maximum spectrum value is the pitch of the input audio signal. (fundamental tone) and is stored in the RAM 7.

The time required for the operations in steps 26 to 28 above is
It is preset to a time corresponding to the display of an eighth note shown in FIG. A, and in steps 26 to 28, the pitch of the input audio signal at time t1 shown in FIG. ₄ is analyzed.

Suppose now that the G and A notes of the eighth note shown in FIG. 5 are repeatedly input using a musical instrument such as a piano, which attenuates over time. At time _t1 , when the pitch analysis in steps 26 to 28 is performed, the analysis number detection and pattern data detection section 1
A pattern data command signal is extracted from 0 and supplied to the pattern data determining section 11, where pattern data is created based on the pitch analyzed by the analyzing section 8 (step 29).

Here, the relationship between the count number and the note length, which will be described later, is as shown in FIGS. 3A to 3I, from an eighth note to a whole note, which correspond to count numbers 0 to 8, respectively.
In this case, since the count number is zero and the pitch is G, pattern data corresponding to the G note of an eighth note is extracted and sent to the VRAM1 via the VDP12.
3 and written into a predetermined table.

As shown in FIG. 6, the memory map of the V-RAM 13 includes a sprite generator table SGT and a pattern generator table PGT that store multiple types of patterns, and a display screen (32 columns x 24 rows) on the CRT 14 shown in FIG. ) pattern name table PNT, which has a capacity corresponding to each section of
It is composed of a sprite attribute table SAT that stores information about the vertical position and horizontal position of the display surface, a color table CT that stores color information, and an unused table. VDP1
In 2, the pattern name table of VRAM13
In accordance with the data written in the PNT and the sprite attribute table SAT, a pattern to be displayed on the display screen of the CRT 14 is selected and the movement mode of the pattern is specified, and a composite video signal is created.
Pattern a (eighth note G note) is supplied to the CRT 14 and displayed on the display screen here (step
30). Note that the staff score, clef, etc. are displayed in advance using data stored in the RAM 7 in advance.

As shown in the time chart in Figure 2C, when AD conversion is completed (step 25) and weighting is performed (step 59), FFT calculation, power spectrum calculation, and pitch analysis are performed (step 59).
26 to 28), a synchronizing pulse is generated upon completion of the wait (step 61), and at the same time, the next AD conversion is performed (step 55). In this case, when a synchronization pulse is generated, initial settings for AD conversion are performed (step 62), an AD conversion start flag is set, an AD conversion end flag is reset (step 63), and the process returns to perform AD conversion. (Step 55).

In step 31, the following AD conversion is performed, and at the same time as this AD conversion is completed, FFT calculation of the weight and the sound at time _t2 is performed (step 32,
33), the synchronization pulse is generated again at the same time as the wait ends. A pitch analysis of the A sound at time _t2 is performed in steps 33 to 35, and then the continuous sound detector 9 determines whether or not it is a continuous sound (step 36).
Here, the results of the previous pitch analysis (time t ₁ ) and the results of the current pitch analysis (time t ₂ ) are compared, and it is determined whether the pitches of both are the same or not, and the levels of both. It is determined whether or not the difference is within a preset level difference range, and it is also determined whether or not the current pitch is equal to or higher than the threshold level L (FIG. 4).

In this case, the continuous sound detector 9 detects it as a discontinuous sound, and in steps 37 and 38, the eighth note A note at time _t2 is displayed (pattern b), and the process returns to step 31 again to display the A note at time _t3 . Conversion, weight, and pitch analysis are performed.

Next, when a quarter note C note is input as shown in pattern C in Fig. 5, as in the above case,
AD conversion is performed, and at the same time as this completion, wait and FFT calculations are performed, and simultaneously with the completion of the wait, a synchronization pulse is generated and the next AD conversion is performed. At step 30, the C note is displayed in the form of an eighth note (Fig. 3A), at step 36 it is determined whether it is a continuous note, at step 40 the count number is set to 1, and at steps 41 and 42 it is displayed in the form of a count number of 1. (Figure 3B) The C note is redisplayed in the form of a quarter note. Next, when the next note after the C note of this quarter note is input,
Similar to the above case, AD conversion of this sound is performed, and at the same time as this ends, weight and FFT calculations are performed, and a synchronization pulse is generated at the same time as the end of the wait. When the discontinuous sound is determined in step 36, the pitch of the next input sound is determined in steps 37 and 38.
is displayed as an eighth note. Thereafter, the count is cleared in step 39, and the process returns to step 31, where AD conversion and weight pitch analysis of the next note are performed.

In this way, in steps 30 and 38, the pitch of the note to be displayed is displayed in the form of an eighth note, and in step 42, the stem etc. of the note passing in the middle is displayed, and the note is rewritten. The final pattern of power notes is displayed. As shown in Figures A to I,
Patterns for half notes and dotted half notes are also displayed according to the corresponding count number, and at that time,
As shown in FIG. 8, the notes on the way to the note of the note to be displayed are displayed.

In this way, AD conversion is performed with a cycle based on the initially set cycle and weight data,
Moreover, a synchronization pulse is extracted at that period.
At the same time that a rhythm sound is generated from the earphone 21 due to the generation of a synchronization pulse, pattern data is created by the pattern data determining section 11 and sent to the CRT 1.
Marker d is displayed in dots at the upper left position above 4.
In the case of the standard speed symbol (♪ = 60), there is one quarter note per second (that is, two eighth notes), so the pronunciation of the rhythm note and the point reduction display of marker d are 2 per second. It is carried out once in a while.

If the performer performs based on the periodic rhythm sound generation or marker point decrement display, the performer can easily grasp the tempo and input a constant tempo into the apparatus.

In addition, in this example, when AD conversion is completed,
Since the FFT calculation is performed, the pitch analysis of the input audio signal can be performed immediately, and the time relationship between the end of AD conversion and the start of the FFT calculation is not specified. can be displayed.

Next, redisplay the standard speed symbol (♪ = 60),
The operation of changing the current price of the displayed note will be explained.

When playing music (especially slow tempo music) that would normally have note values as shown in Figure 9 A when displayed at standard speed (♪ = 60), the note values may be too large and difficult to read if displayed as is. In such cases, it is necessary to reduce the market value of the displayed notes while keeping the tempo of the music being played the same. 1st
In the figure, when the mode setting switch 15 is operated, the automatic setting mode is entered (step 23 in Figure 2 A), and then the desired speed (for example, speed symbol (♪ = 30)) is selected.
Operate the cycle instruction switch 16 twice at an interval corresponding to . The signal H level is detected by the first operation of the switch 16 (step 43), the period counter 17 is set (step 44), and counting up is started (step 45). switch 16
The signal H level is detected by the second operation (step 46), and as a result, the cycle calculation and cycle data setting section 18 switches the switch 16 at step 47.
The operation interval, that is, the cycle, is calculated, and in step 48, new cycle/wait data corresponding to ♪=30 is set, and this data is written to the cycle/wait area of the RAM7.

Based on this newly set period/weight data, speed symbol pattern data is created in step 49, and "60" on the CRT 14 is created in step 50.
will be redisplayed, for example, as "30". Speed symbol (♪
=30) is finished, the mode is determined in step 51, and if a new mode is specified, step 51 is executed.
Return to step 43, and if the mode remains the same, proceed to step 52.
AD conversion is set at , and the input signal is AD converted and weighted by the operation explained in FIG. 2B. In this case, in step 59
Waits for the transition to the next AD conversion for a time (longer than the time when ♪=60) based on the period/wait data corresponding to ♪=30 written in RAM7.

A synchronization pulse is generated by the end of the wait,
Thereafter, the rhythm sound and the marker d are decremented at a period according to the period and weight data corresponding to ♪=. At the same time, an FFT operation is performed upon completion of the AD conversion, and thereafter, an FFT operation is performed at a period corresponding to the period corresponding to ♪=30 and the weight data.

In this case as well, rhythm sounds are generated or marker points are decremented at intervals according to the variably set speed symbol, so if the performer plays based on this, he or she can perform at the correct tempo even for the variably set speed. It is possible. In an actual performance, when a C note (equivalent to 2 seconds) as shown in Figure 9A is input, this pitch is displayed as an eighth note in step 30 as explained above.
In the step shown in FIG. 2B following step 31, the system waits for a period of time based on the cycle/wait data corresponding to ♪=30 written in the RAM 7 above, and when this time has elapsed, the process returns to step 33.
~35, this C note is pitch analyzed again, and step 36
Continuous sound is determined at step 40, and the count number is 1 at step 40.
4 as shown in FIG. 9B in steps 41 and 42.
The diacritic C note is displayed. Other actual performances of half notes such as E, G, and E (Figure 9A)
is also displayed as a quarter note as shown in Figure B.
In other words, if you do not change the current price, the pitch will be analyzed four times for 8th notes for 2 seconds and displayed as the note value shown in Figure A, but now the pitch will be analyzed twice for 2 seconds for 8th notes. By changing the pitch analysis cycle to a large value, note values can be displayed small.

Contrary to the above example, music with note values that are too small when displayed at standard speed (especially fast-tempo music)
Now, the operation interval of the cycle instruction switch 16 is made small, and the value of the cycle/weight data is made smaller than that of the standard speed, for example, about ♪=240. In this way, when an actual performance at standard speed is played at 32nd notes (8 notes per second) and cannot be displayed, the pitch will be analyzed 8 times at 8th notes per second. By changing the period of pitch analysis to a smaller value, the note value can be displayed larger.

As described above, the musical note display device according to the present invention detects the number of times the frequency of the shortest note to be displayed is analyzed by the frequency analysis means, and calculates the frequency of the notes analyzed before and after by the frequency analysis means. Differences in height and level are detected to determine whether or not the sounds before and after the sound are continuous, and if it is determined that the sounds are continuous, the frequency is set in advance according to the number of times of analysis. If a discontinuous sound is determined, the note at the current price set corresponding to the number of analyzes is displayed, and the number of analyzes is cleared, and the standard speed symbol set in advance is displayed. This is set variably for the speed corresponding to the input speed, and the cycle of the frequency analysis is varied according to the set speed, and the synchronization signal is generated at a timing according to this variable cycle. The pitch and length of a note can be displayed as notes on a staff notation on the display screen in real time, and unlike devices that print the notes of the input sound later on paper, etc., the score of the music being played is displayed immediately. This makes it possible to clarify the relationship between the music being played and the score, which is useful for music education.In addition, it is especially useful for music with slow tempos, where each note is displayed longer than the desired time value if the standard speed symbol is used. On the other hand, if you are playing music with a fast tempo and cannot display each note with the standard speed symbol, you can slow down the tempo and display each note as a small value. Therefore, it is possible to display the music in a desired musical score form in real time, and even music played at the same tempo can be correctly displayed at an easy-to-read current value by varying the frequency analysis period. Furthermore, since rhythm sounds are generated and/or marker points are decremented according to the set period, the performer can maintain a constant tempo and perform at the correct timing by listening to and/or watching these while playing. It has features such as being able to input notes without any inconvenience such as timing deviations causing omission of display of musical notes, and correctly displaying musical notes corresponding to each input.

[Brief explanation of the drawing]

FIG. 1 is a block system diagram of an embodiment of the device of the present invention, FIGS. 2A and B are flowcharts for explaining the operation of the device of the present invention, FIG. 3C is a timing chart for explaining the operation of the device of the present invention, and FIG. 3A ~I is a diagram showing the relationship between note length and count number, Figure 4 is a diagram showing the relationship between sound level and note, Figure 5 is a diagram of the CRT display screen, and Figure 6 is V-RAM. Memory map of 7th
The figure is an explanatory diagram of the divisions of the CRT display screen, Figure 8 is a diagram to explain the notes on the way from the eighth note to the displayed note, and Figures 9A and B are note values based on standard speed symbols. It is a diagram comparing the sound value and the note value based on the variable set speed symbol. 1...Audio signal input terminal, 4...AD converter,
5...Control device, 6...Conversion command and digital signal output section, 7...RAM, 8...Calculation and pitch analysis section, 9...Continuous sound detection section, 10...Analysis circuit detection and pattern data detection Section, 11...Pattern data determination section, 12...Video display
Processor, 13... V RAM, 14...
CRT, 15...Mode setting switch, 16...
Period instruction switch, 17...Period counter, 18
. . . Period calculation and period data setting section, 19 . . . Synchronous pulse generator, 21 . . . Earphone.

Claims (1)

[Claims] 1. AD that converts an input audio signal into a digital signal
a conversion means; a frequency analysis means for determining the pitch by time-series frequency analysis of the signal from the AD conversion means at intervals of time according to the length of the shortest note among the notes to be displayed; Frequency analysis frequency detection means detects the number of frequency analyzes by the analysis means, and the frequency analysis means detects the difference in pitch and level of the sounds analyzed before and after, and the sounds before and after are continuous sounds. a continuous sound determining means for determining whether or not a continuous sound is present, and when the continuous sound determining means determines whether a continuous sound is present, a musical note whose market price is set in advance from the number of times of frequency analysis by the frequency analyzing means corresponding to the number of times of analysis; displaying means for displaying a note with a current price set corresponding to the number of times of analysis when the continuous sound determining means determines that the sound is a discontinuous sound, and for clearing the number of times of analysis; a frequency analysis period variable means for variably setting a speed corresponding to a standard speed symbol, and varying the frequency analysis period according to the set speed; 1. A musical note display device comprising: synchronization signal generating means for generating a synchronization signal at a timing according to a frequency analysis cycle determined by the frequency analysis cycle. 2. The display means converts into predetermined pattern information based on each output from the frequency analysis means, the frequency analysis number detection means, and the continuous sound judgment means, and converts the pattern information into a composite image using a video display processor. The musical note display device according to claim 1, characterized in that the musical note display device is a means for converting the signal into a signal and displaying it on a CRT. 3. The frequency analysis period variable means detects the interval between two consecutive operations of the external operation switch, detects the period, measures the period, and stores the data as frequency analysis period data in the frequency analysis means. The musical note display device according to claim 1 or 2, characterized in that the musical note display device is a means for writing into a memory. 4. Claims characterized in that the synchronization signal generated by the synchronization signal generation means is supplied to a sound generation means and/or a display means to generate rhythm sounds and/or to subtract marker points. The musical note display device according to item 1, item 2, or item 3. 5. The musical note display device according to claim 4, wherein the marker point reduction is performed on the CRT.