JP6039974B2 - Music score recognition apparatus and program - Google Patents

Description

  The present invention relates to a score recognition apparatus and a program.

  Reading means for collectively reading image data including a plurality of score symbols, a recognition means for analyzing and recognizing the read symbols, and a symbol code when the score symbols included in the image data can be recognized by the recognition means, Based on the recording means for recording the unrecognizable code including the coordinate information of the recognition target image data, the length information in the vertical direction and the horizontal direction corresponding to the image data, and the recorded symbol code and unrecognizable code Reconstructing means for reconstructing the score image, and displaying the symbol code based on the corresponding symbol font, and the unrecognizable code is indicated by the coordinate information in the unrecognizable code and the length information in the vertical and horizontal directions. An image is displayed based on image data, and the symbol font and image data have different colors, or the symbol font and image data are different. Music recognition apparatus is known having a display control means for blinking or Re (for example, see Patent Document 1).

JP-A-10-334179

  The score recognition apparatus can convert a score printed on paper into a bitmap file by a scanner, and recognize the score based on the bitmap file. Here, one sheet of paper is converted into one bitmap file. Accordingly, when one song is composed of a plurality of scores, the scores are converted into a plurality of bitmap files. The user needs to select a plurality of bitmap files constituting one song, specify the order of the plurality of bitmap files, and recognize the score. This task is complicated and cumbersome.

  An object of the present invention is to provide a score recognition apparatus and a program that can easily recognize a score.

The score recognition apparatus of the present invention includes a file designation means for designating a score file including page information, a preview means for displaying the score of the designated file together with page information, and a score recognition target of the designated file. A page designating unit for designating the page, a first recognition unit for recognizing the score of the designated page to generate score information, and a file designated by the file designating unit, in page units. And a second recognizing unit for recognizing whether there is musical score information, wherein the preview unit displays information indicating whether there is musical score information in units of pages .

The program of the present invention includes a file designating step for designating a score file including page information, a preview step for displaying the score of the designated file together with page information, and a score recognition target of the designated file. A page designation step for designating a page of the first page, a first recognition step for recognizing the score of the designated page to generate score information, and a file designated in the file designation step, in page units. A program for causing a computer to execute a second recognition step for recognizing whether or not there is musical score information , wherein in the preview step, information indicating whether or not there is musical score information is displayed in units of pages. It is characterized by .

  Since a score file includes page information, a score of a plurality of pages can be composed of one file. Since it is only necessary to specify one file, the score can be easily recognized. Also, by designating pages, unnecessary pages can be excluded from recognition targets, so that only necessary pages can be recognized and the recognition time can be shortened.

FIG. 1 is a diagram illustrating a hardware configuration example of a computer for realizing a score recognition apparatus. FIG. 2 is a flowchart illustrating a processing example of the score recognition apparatus. FIG. 3 is a flowchart showing details of the processing example of step S203 of FIG. FIG. 4 is a diagram illustrating a display example of a file window. FIG. 5 is a diagram showing a preview display. FIG. 6 is a diagram showing a preview display. FIG. 7 is a diagram illustrating a display example of a recognition target page. FIG. 8 is a diagram illustrating a display example of a recognized score. FIG. 9 is a diagram illustrating a configuration example of the score recognition apparatus.

  FIG. 9 is a diagram illustrating a configuration example of a score recognition apparatus 900 according to the embodiment of the present invention. The score recognition apparatus 900 includes a file designation unit 901, a second recognition unit 902, a preview unit 903, a page designation unit 904, a first recognition unit 905, and a score display unit 906.

  FIG. 1 is a diagram illustrating a hardware configuration example of a computer for realizing the score recognition apparatus 900. A central processing unit (CPU) 102, a ROM 103, a RAM 104, a network interface 105, an input device 106, an output device 107, and an external storage device 108 are connected to the bus 101. The CPU 102 performs data processing or calculation and controls various components connected via the bus 101. The ROM 103 stores a control procedure (computer program) of the CPU 102 in advance, and the CPU 102 starts when the computer program executes the computer program. A computer program is stored in the external storage device 108, and the computer program is copied to the RAM 104 and executed by the CPU 102. The RAM 104 is used as a work memory for data input / output, transmission / reception, and temporary storage for control of each component. The external storage device 108 is, for example, a hard disk storage device or a CD-ROM, and the stored content does not disappear even when the power is turned off. The CPU 102 executes the computer program in the RAM 104 to perform the processing of the score recognition apparatus 900 shown in FIGS. The network interface 105 is an interface for connecting to a network such as the Internet. The input device 106 is, for example, a keyboard, a mouse, a scanner, and the like, and can perform various designations or inputs. The output device 107 is a display device, a speaker, a printer, or the like.

  This embodiment can be realized by a computer executing a program. Further, a computer-readable recording medium in which the above program is recorded and a computer program product such as the above program can also be applied as an embodiment of the present invention. As the recording medium, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

  FIG. 2 is a flowchart showing a processing example of the score recognition apparatus 900. When the CPU 102 executes the program, the process of the flowchart of FIG. 2 is performed. In step S <b> 201, the CPU 101 displays the screen of FIG. 4 on the output device (display device) 107. FIG. 4 is a diagram showing the file window 401. In the file window 401, a score file including page information is displayed. The score file including page information is, for example, a PDF (Portable Document Format) file, but is not limited thereto. Hereinafter, a PDF file will be described as an example. The PDF file allows a user to create a score and save it as a PDF file, create a PDF file based on a paper score using a scanner, or create a PDF file by file conversion. The PDF file is stored in the external storage device 108.

  For example, when the user clicks the scan button 402 in FIG. 4 with the mouse of the input device 106, the scanner of the input device 106 scans a paper score to generate electronic data. The CPU 102 reads the electronic data and saves the PDF file of the score in the external storage device 108.

  The CPU 102 displays the PDF file stored in the external storage device 108 on the file window 401. When the user clicks a desired PDF file in the file window 401 using the mouse of the input device 106, the file designating unit 901 designates a PDF file of a score including page information to be recognized. Further, the CPU 102 sets the page number N to 1.

  The bitmap file does not include page information, and the multi-page score is composed of multiple bitmap files, so the user specifies multiple bitmap files and specifies the order of the multiple bitmap files. Need to be recognized. On the other hand, since a PDF file includes page information, a score of a plurality of pages can be composed of one file. Since the user only needs to specify one file, the score can be easily recognized.

  Next, in step S202, the CPU 102 reads the Nth page data from the PDF file specified above. For example, when N = 1, the data for the first page is read.

  Next, in step S203, the second recognition unit 902 determines whether or not the Nth page is a recognition target. Specifically, the second recognizing unit 902 determines that the musical score information is on the Nth page, and determines that it is not the target of recognition when there is no musical score information on the Nth page. Details of step S203 will be described later with reference to FIG. If it is a recognition target, the process proceeds to step S204. If it is not a recognition target, the process proceeds to step S205.

  In step S <b> 205, the preview unit 903 displays the N-th page data 501 with a “×” mark 510 on the output device (display device) 107 as shown in FIG. 5. N is, for example, “1”. In the example of FIG. 5, the page number 502 indicates that the first page of all two pages is displayed as a preview. The first page data 501 consists only of the character information of “Sample score”, and since there is no score information, it is determined that it is not a recognition target, and the first page data 501 is displayed with an “x” mark 510. For example, it is determined that a page with only character information on the cover of a musical score, a page with only character information on a song title, or a page with only a descriptive text is not recognized. The “x” mark 510 may be displayed in other ways, and may be information indicating whether there is musical score information. Thereafter, the process proceeds to step S206.

  In step S206, the CPU 102 determines whether there is an instruction to change the preview page. When the user clicks the previous page button 503 or the next page button 504 with the mouse or inputs the page number 502 using the keyboard of the input device 106, the CPU 102 determines that there is an instruction to change the preview page. The user can instruct preview display of the previous page by clicking the previous page button 503 with the mouse, and can instruct preview display of the next page by clicking the next page button 504 with the mouse. However, when the first page data 501 of FIG. 5 is displayed, the previous page does not exist, and the previous page button 503 cannot be clicked with the mouse. If there is an instruction to change the preview page, the process proceeds to step S207. If there is no instruction to change the preview page, the process proceeds to step S208.

  In step S207, the CPU 102 sets the page number N in response to the change instruction. When the previous page button 503 is clicked, the page number N is decremented, and when the next page button 504 is clicked, the page number N is incremented. When the page number 502 is input, the page number 502 is set as the page number N. For example, when the next page button 504 is clicked on the screen of FIG. 5, the page number N is changed from “1” to “2”. Thereafter, the process returns to step S202.

  In step S202, the CPU 102 reads data for the second page. Next, in step S203, when the data on the second page is a recognition target, the process proceeds to step S204.

  In step S204, the preview unit 903 displays the Nth page data 601 on the output device (display device) 107 as shown in FIG. N is, for example, “2”. In the example of FIG. 6, the page number 502 indicates that the second page of all two pages is displayed as a preview. The second page data 601 is determined to be a recognition target because there is musical score information including a staff and note symbols, and the second page data 601 is displayed without the “x” mark. Thereafter, the process proceeds to step S206.

  In step S206, the CPU 102 determines whether there is an instruction to change the preview page. When the user clicks previous page button 503 with the mouse, CPU 102 determines that there is an instruction to change the preview page, proceeds to step S207, and changes page number N from “2” to “1”. Thereafter, the process returns to step S202, and the first page data 501 is displayed with the “x” mark 510 as shown in FIG. If it is determined in step S206 that there is no preview page change instruction, the process advances to step S208.

  In step S <b> 208, the CPU 102 checks whether there is a designation instruction for the recognition page range 505. The user can input the start page 506 and the end page 507 of the recognition page range 505 with the input device (keyboard) 106 on the screen of FIG. The default value of the start page 506 is the first page number of the PDF file, and the default value of the end page 507 is the last page number of the PDF file. The user can specify the recognized page range 505 while referring to the preview displays in FIGS. For example, when a plurality of musical scores are included in one PDF file, a desired musical score page range can be set as the recognition page range 505. Even if only one musical score is included in one PDF file, if the page range to be recognized is a part of the song, the desired page range is set as the recognized page range 505. Can be set. The score recognition device can generate score information by recognizing a score and save it in a file.

  If there is no input column for the recognized page range 505, all pages of the PDF file are to be recognized, and musical score information of unnecessary pages is generated, and the recognition time becomes unnecessarily long. Further, since musical score information of unnecessary pages is generated, a troublesome work for deleting the musical score information of unnecessary pages must be performed. In this embodiment, since the recognition page range 505 can be set, unnecessary pages can be excluded from recognition targets, only necessary pages can be recognized, and the recognition time can be shortened. Moreover, the troublesome work for deleting the musical score information of unnecessary pages becomes unnecessary.

  When the user sets the recognized page range 505 and then clicks an “OK” button 508 with the mouse, the page designating unit 904 designates the recognized page range 505 as a page to be recognized. In step S208, the CPU 102 recognizes the recognized page range. It is determined that there is a designation instruction 505, and the process proceeds to step S209. If the “OK” button 508 is not clicked in step S208, the CPU 102 determines that there is no designation instruction for the recognition page range 505, returns to step S206, and repeats the above processing.

  In step S209, the CPU 102 deletes a page that is not a recognition target in the recognition page range 505 (a page with an “x” mark 510 in FIG. 5), and adds the recognition target page 701 to the recognition list as shown in FIG. indicate. For example, in FIG. 5 or FIG. 6, when “1” page is designated as the start page 506 and “2” page is designated as the end page 507, the first page with the “x” mark 510 in FIG. Since the data 501 is not a recognition target and the second page data 601 in FIG. 6 is a recognition target, the first page data 501 is deleted and only the second page data 601 is displayed as the recognition target page 701. If there is no page with the “x” mark 510, the page in the recognized page range 505 becomes the recognition target page 701 as it is.

  Next, in step S210, the CPU 102 prepares for recognition such as a paragraph setting of a score in accordance with a user instruction. In FIG. 7, the score 702 of the recognition target page 701 is displayed. The score 702 is the first score of the recognition target page 701 (second page data 601 in FIG. 6). By operating the scroll bar with a mouse, the recognition target page 701 (second page data 601 in FIG. 6) is displayed. ) Can be displayed. The musical score 702 includes staff notations 703 and 704. In the case of FIG. 7, the CPU 102 sets the staff 703 as the first part, and sets the staff 704 as the second part. The CPU 102 can set the staff notations 703 and 704 to the same part or the different parts according to the user's instruction in the paragraph setting window 705. It can also be set to a staff of separate paragraphs.

  Next, in step S211, when the user clicks the recognition execution button 403 in FIG. 7 with a mouse, the CPU 102 detects this and proceeds to step S212.

  In step S212, the first recognition unit 905 recognizes the score of the recognition target page 701 and generates score information.

  Next, in step S213, the score display means 906 displays the score 801 on the output device (display device) 107 based on the generated score information, as shown in FIG.

  As described above, the file designation unit 901 designates a score file including page information in step S201. In step S203, the second recognizing unit 902 recognizes whether or not there is musical score information for each page based on the file designated by the file designating unit 901. In steps S204 and S205, the preview unit 903 displays the score of the designated file together with page information. In step S204 and S205, the preview unit 903 displays information indicating whether there is musical score information in units of pages. In step S208, the page designating unit 904 designates the page for which the score of the designated file is to be recognized. In step S212, the first recognition unit 905 recognizes the score of the designated page and generates score information. Specifically, the first recognizing unit 905 excludes pages recognized as having no musical score information by the second recognizing unit 902 from the pages designated by the page designating unit 904 in steps S209 and S212. And recognize. In step S213, the score display unit 906 displays a score based on the score information generated by the first recognition unit 905.

  FIG. 3 is a flowchart showing details of the processing example of step S203 of FIG. First, in step S301, the CPU 102 performs a staff detection process from the Nth page data. Next, in step S302, the CPU 102 determines whether or not a staff has been detected. If a staff is detected, the process proceeds to step S303, and if a staff is not detected, the process proceeds to step S306.

  In step S303, the CPU 102 performs note head detection processing from the Nth page data. Next, in step S304, the CPU 102 determines whether or not the note head has been detected. If the note head can be detected, the process proceeds to step S305. If the note head cannot be detected, the process proceeds to step S306.

  In step S305, the CPU 102 determines that the Nth page is a recognition target page, and proceeds to step S204 in FIG. In step S306, the CPU 102 determines that the Nth page is not a recognition target page, and proceeds to step S205 in FIG.

  2 is not limited to the process of FIG. 3, and may be a process for recognizing whether there is musical score information. In the above description, a case where the score recognition apparatus 900 is configured by a computer executing a program has been described as an example, but the present invention is not limited to this. All or part of the score recognition apparatus 900 may be configured by hardware.

  As described above, in this embodiment, a score file includes page information, and thus a multi-page score can be composed of one file. Since it is only necessary to specify one file, the score can be easily recognized. Also, by designating pages, unnecessary pages can be excluded from recognition targets, so that only necessary pages can be recognized and the recognition time can be shortened.

  The above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

101 bus 102 CPU
103 ROM
104 RAM
105 Network Interface 106 Input Device 107 Output Device 108 External Storage Device 900 Music Score Recognition Device 901 File Designation Unit 902 Second Recognition Unit 903 Preview Unit 904 Page Designation Unit 905 First Recognition Unit 906 Musical Score Display Unit

Claims (5)

A file specification means for specifying a score file including page information;
Preview means for displaying the score of the designated file together with page information;
Page designation means for designating a recognition target page of the score of the designated file;
First recognition means for generating score information by recognizing the score of the designated page ;
Second recognition means for recognizing whether or not there is musical score information in units of pages based on the file designated by the file designation means;
The score recognition apparatus , wherein the preview means displays information indicating whether or not there is score information in page units .   2. The score recognition apparatus according to claim 1, further comprising a score display means for displaying a score based on the score information generated by the first recognition means.   3. The score recognition apparatus according to claim 1, wherein the file is a PDF file. The first recognizing unit performs recognition by excluding a page recognized as having no musical score information by the second recognizing unit from the pages designated by the page designating unit. Item 4. The musical score recognition apparatus according to any one of Items 1 to 3 . A file specification step for specifying a music score file including page information;
A preview step of displaying the score of the designated file together with page information;
A page designating step of designating a page to be recognized of the score of the designated file;
A first recognition step of recognizing the score of the designated page to generate score information ;
A program for causing a computer to execute a second recognition step for recognizing whether or not there is musical score information in units of pages based on the file designated in the file designation step ,
In the preview step, information indicating whether or not there is musical score information in units of pages is displayed .

Images