JP3520736B2 - Music reproducing apparatus and recording medium on which background image search program is recorded - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a music reproducing device, and more particularly to a karaoke device and a BG device having a background image search function.
Recording medium in which M device and background image retrieval program are recorded
About the body.

[0002]

2. Description of the Related Art In a karaoke apparatus, not only the lyrics but also an image corresponding to the image of the song is generally displayed as a still image or a moving image on the display. By the way, if the music and the background image are in a one-to-one correspondence, the same background image is always displayed when the same music is played back, which makes the user tired and has no interest. There is known a karaoke device that automatically selects a selected image each time it is reproduced. As an example, in Japanese Patent Laid-Open No. 9-138689, which is a prior application of the applicant company, a plurality of attributes are individually attached to each music and image in advance, and when a reproduction request is made, a plurality of attributes of the music are A technique is shown in which the image is selected and displayed by comparing it with the attribute of the image and referring to the past display history from among the images having the matched attribute.

[0003]

However, in this conventional technique, only the matching of attributes is detected.
If the attributes do not match, it is not possible to select an appropriate image, and if the attributes are made rough so that the attributes can easily match, there will be a large number of corresponding images, and if you randomly select from them, the song will be inevitable. There was a point that it was far from the image of.
In addition, the conventional karaoke apparatus has a structure in which a series of related images is displayed for one song, and there is no function of changing the image in the middle of the song in accordance with the image change of the song. .

Therefore, according to the present invention, it is possible to more accurately retrieve an image that matches the image of a song, and even in the middle of a song, the image is selected and displayed in accordance with the image change of the song. An object of the present invention is to provide a karaoke device and a recording medium on which a karaoke background image search program is recorded .

[0005]

In order to achieve the above object, in the present invention, the first information associated with a karaoke piece is a plurality of genre information arranged in order of priority, and this information is intermittent in time series. Associated with the karaoke song,
The image to be selected is accompanied by the second information in which a plurality of genre information is arranged in the priority order, and whether the first information and the second information have the highest priority genre information is matched with each other. When judged and matched, weighting is performed according to the priority order and evaluation is performed. As a result of the evaluation, an image having second information having a high degree of conformity with the first information is selected.

[0006] That is, according to the present invention, it is synchronized with the reproduction of the song.
To display the image to be displayed based on the processing of the control means
A song reproducing device, in which a song is displayed with an image.
Each image is accompanied by multiple search information arranged in groups.
Is accompanied by the searched information, and the search information is in multiple genres.
Information is arranged in order of priority.
Controls the number of genre information in order of priority.
The means performs the evaluation process and the decision process, and the evaluation process is performed again.
Compare with all searched information for each search information of live song
Go to the priority of both of the genre information that matches each other
The evaluation value is calculated based on the evaluation table for each search information.
The process of making and deciding each is based on the order of magnitude of the evaluation value.
Select the search target information for the search information and select the search information
A music reproducing device for determining an image to be reproduced is provided.

[0007]

[0008]

According to the present invention, the evaluation step and the decision
Image to be displayed in synchronization with song playback
A recording medium recorded with the background image search program
The body is arranged at the timing of displaying the image in the song
Search information is attached to each image, and each image is searched.
Information is attached, and search information prioritizes multiple genre information
The information to be searched is displayed in multiple ranks.
Information is arranged in order of priority.
For each piece of search information of the song to be played,
Prioritize both genre information that is compared and matches each other
The evaluation value is calculated based on the ranking, and the evaluation table for each search information is calculated.
Create a bull and determine the steps in the order of magnitude of evaluation values.
Select the search target information for each search information based on
Recorded recording medium background image search program for determining an image is provided for the information.

[0010]

BEST MODE FOR CARRYING OUT THE INVENTION Preferred embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a flowchart showing a processing procedure in the karaoke apparatus according to the present invention. Further, FIG. 2 shows a search code (first information) described later.
It is a figure which shows the format of a to-be-searched code (2nd information). 3 and 5 are schematic block diagrams of different types of karaoke systems to which the karaoke apparatus of the present invention can be applied, and FIGS. 4 and 6 are terminal side of the karaoke system of FIGS. 3 and 5, respectively. It is a schematic block diagram of a karaoke apparatus. Before explaining the flowchart of FIG. 1, the karaoke system of FIGS. 3 to 6 will be described.

FIG. 3 shows a communication karaoke system using a membership network. This network is
It uses the Internet. The karaoke IP server 10 has a function of transmitting a music file in which image data related to the karaoke music data is recorded from the music file authoring device 12 to the user personal computer 16 which is a terminal via the network 14. User PC 1
A hard disk (HDD) 18 and a CD-ROM device for reproducing images from a member CD-ROM 20 distributed in advance to members are connected to the drive 6. CD-R for members
For example, 560 background still image files are recorded in the OM 20, and reproduction of a predetermined karaoke song, selection of background image, display operation, color change display of lyrics, soft synthesizer operation, illegal copy prevention operation on the user personal computer 16 The application software for executing such as is recorded. The user can operate the user personal computer 16 to connect to the karaoke IP server 10 and download a desired song file for a fee.

FIG. 4 is a block diagram showing the functions and peripheral devices of the user personal computer 16 constituting the karaoke apparatus 30, which is the terminal side of FIG. User PC 1 in Figure 3
A terminal player 6 has a sequencer 24, an image processing unit 26, a music analysis unit 28, a screen display control unit 32, a music reproduction control unit 34, and a GUI (graphical user interface) 36 as its functions. There is. Display 38 for displaying images and speaker 4 for outputting sound
2, 44 are provided, and the speaker 44 is connected to the terminal player 16 via the external sound source 40. GU
I36 uses a mouse or keyboard (not shown)
This is an interface for the user to give an instruction to the terminal player 16 while looking at the display screen of the display 38. The image processing unit 26 responds to the data of the 560 still images recorded in the CD-ROM 20 and the data of the replacement image stored in the hard disk 18, performs predetermined processing, and outputs the processed data. The music analysis unit 28 analyzes the MIDI data of the music read from the hard disk 18 and supplies it to the music reproduction control unit 34 under the control of the sequencer 24.

FIG. 5 is a schematic block diagram of a communication karaoke system in which a terminal developed as a communication karaoke terminal 52 and a center host server 48 are connected by a public line via a local host server 50 instead of a general-purpose personal computer. A software production section 46 is connected to the center host server 48 via a communication line, and new karaoke data of new music is sequentially filed and compressed to obtain data from the center host server 48.
Is supplied to. Each file contains MIDI data, lyrics character data, chorus data, and still image data.

FIG. 6 is a block diagram showing a configuration example of the communication karaoke terminal 52 of FIG. A preferred embodiment of the karaoke apparatus of the present invention is also applicable to the system of FIGS.
It is also applicable to the system of FIG. When this embodiment is applied to the system of FIGS. 3 and 4, the flowchart of FIG. 1 is regarded as showing the processing procedure in the user personal computer 16 which constitutes the terminal player, and FIGS. In the case of being applied to the above system, it is regarded as showing one processing procedure of a plurality of CPUs constituting the terminal player.

Before explaining the flowchart of FIG. 1,
The search code A in the present invention is shown in FIGS. 2 and 7 to 10.
The searched code B will be described. The search code A is the information associated with the song, while the searched code B is the information associated with the image. FIG. 2 shows that the formats of the search code A and the searched code B are each 2 bytes × 4, which is a total of 8 bytes. That is, four 2-byte genre codes are arranged in order of priority.
Genre 1 has the highest priority, and genre 4 has the lowest priority. The four genre codes are selected so as not to overlap in one search code A or searched code B. The genre code is prioritized according to the position of the genre code when the search code A or the searched code B is created, and the genre code itself does not have the priority. Note that A and B are used to generally represent the search code and the searched code, and the search code 1 and the searched code 2 are used to represent the individual codes.

The genre information and genre code will be described with reference to FIG. As shown in the table of FIG. 7, the genre information includes “enka”, “town”, “spring”,
It is a concept including a genre in a musical sense such as “flower” and a genre as a subject or a theme, and genre codes such as 10, 20, 30 are attached to each genre information. The genre code is a unique two-digit code (00--9, A-V) (00
.About.VV) are assigned. In this genre code, 00-0V is used as "reservation" for random designation.

FIG. 8 is a timing chart showing a time-series arrangement of the search code A associated with a music piece. The search code A is arranged intermittently with respect to the music information. In this example, three search codes are arranged for one song. Looking now at search code 1, genre 1 is 4U: youth, genre 2 is 31: summer,
Genre 3 as UU: Sunny, Genre 4 as 2U:
You can see that the sea has been selected in advance. The symbol> shown between the genre information in FIG. 8 indicates that the left side thereof has a high priority.

FIG. 9 schematically shows a searched code B associated with an image. The images are recorded in the CD-ROM 20 in advance, and each of the 560 images has the search target code B described with reference to FIG. For example,
The searched code 1 is attached to the image 1, and the contents are 42 as a genre 1 and 4 as a genre 2.
It can be seen that U: youth, 31: summer as genre 3, and UU: fine as genre 4 are selected in advance. The symbol> shown between the genre information in FIG.
Similar to FIG. 8, the left side shows that the priority is high. That is, in the case of the searched code 1 of the image 1, comparing “youth” and “woman” indicates that the latter image is stronger.

FIG. 10 is a schematic diagram showing the contents of the still image index file, and shows that the searched code B is recorded together with the image data.

Returning to FIG. 1, the operation procedure of the preferred embodiment of the present invention will be described. When the power of the karaoke apparatus is turned on, or when a personal computer is used and the karaoke application is started, an initial screen (not shown) is displayed, and a user selects a song. Then, the process of the flowchart of FIG. 1 is started. That is, the selected music file is read in step S1, and the search code A recorded in the music data is read. Next, in step S2, the still image index file is fetched, the searched code B is read, and the searched table is created. Then in step S3. The count value n of the counter is reset to 0. Steps S1 to S3
Constitutes a pretreatment means.

In step S4, an n-th search code evaluation table is created. Next, in step S5, an evaluation process of the searched code is executed. That is, a value is set in the evaluation table and each item in the search table is evaluated. This point will be described with reference to FIGS. 11 to 13. An evaluation value is calculated for each pair of the search code A and the searched code B in the following six steps.

(1) When the same genre code is detected in the searched code B for all four genre codes of the search code A, the score shown in FIG. 11 depends on the position of the search code A. To add points. This added point is referred to as an added point field 1. (2) Next, depending on which position in the searched code B the first genre code of the search code A is located in FIG.
The points shown in are added. This added point is referred to as an added point field 2. (3) Next, points are added in the same manner as in (2) above depending on where in the searched code B the second genre code of the search code A is located. This added point is referred to as an added point field 3. (4) Next, depending on where in the searched code B the third genre code of the search code A is located, points are added in the same manner as in (2) above. This added point is referred to as an added point field 4. (5) Next, points are added in the same manner as in (2) above depending on where in the searched code B the fourth genre code of the search code A is. This added point is referred to as an added point field 5.

FIG. 13 is a diagram showing a method for generating a 20-bit evaluation value by using all of these point addition fields. That is, 4 bits of the point addition field 1 are positioned at the most significant 20 bits, and 4 bits of the point addition field 5 are 2 bits.
Weighting by arranging them in order so that they are located at the least significant bit of 0 bits, and adding them,
Obtain a 20-bit evaluation value. Search code 1 shown in FIG.
The case of the searched code 1 shown in FIG. 9 will be described as an example. Search code 1 is (4U: Youth> 31: Summer> UU: Sunny> 2U: Sea), and Search Code 1 is (42: Woman> 4U: Youth> 31: Summer> UU: Sunny). Therefore, the calculation is performed according to the following procedure.

(1) The genre codes included in both are 4U, 31, and UU. Looking at these positions in the search code 1, since they are the 1st, 2nd, and 3rd, respectively, the point addition field 1 is 4U (1000) +31.
(0100) + UU (0010) = 1110. (2) Regarding the first 4U in the search code 1, when looking at the position in the searched code 1, the position is the second, so the point addition field 2 is 0100. (3) Regarding the second 31 in the search code 1, the position in the searched code 1 is the third, so the point addition field 3 is 0010. (4) Regarding the position of the third UU in the search code 1 in the searched code 1, since it is at the fourth position, the point addition field 4 is 0001. (5) The fourth 2U in the search code 1 does not exist in the searched code 1, so that the point addition field 5 is 0000.
Becomes (6) When all of these point addition fields are weighted and added, the evaluation value is 1110010001000.
It becomes 010000 (hexadecimal E4210).

When the evaluation values of all the searched codes B are calculated for one search code A, evaluation tables for the number of search codes as shown in FIG. 14 are generated. In step S6, the count value n is incremented by 1, and in step S7 it is determined whether or not n has reached the number of search codes. If n has not reached the number of search codes, step S
Return to 4. If n has reached the number of search codes, go to step S8. Steps S4 to S7 constitute a still image evaluation processing means.

In step S8, the one having the highest evaluation value is searched through all the evaluation tables. FIG. 15 shows this state. The evaluation value of the pair of search code 1 and searched code 1 is the largest among all evaluation tables (see FIG. 15).
Medium, which is surrounded by a thick line), the still image to which the searched code 1 is attached is determined. Therefore, the evaluation table to which this still image belongs and the search code 1 are determined.

Next, in step S9, the use of the previously determined still image is determined for the search code 1, and the evaluation table is deleted. FIG. 16 shows a state in which the evaluation table is deleted with a cross mark. Next, in step S10, the entry of the still image of the searched code 1 that has been previously determined is deleted (use is prohibited) from all the evaluation tables. By this method, as shown by a large x mark and a small x mark in FIG. 16, the evaluation table with the fixed search code is deleted, the fixed image entry is prohibited, and the maximum value of the next evaluation value is searched. In this way, the images are successively determined. In step S11, it is determined whether or not there is one or more evaluation tables. If there is one or more evaluation tables, the process returns to step S8, and if it becomes 0, the search ends. Steps S8 to S11 constitute a still image determination means, which prevents the same image from being repeatedly displayed in the same song.

In the above embodiment, the present invention has been described as a karaoke device, but the present invention can be applied to a BGM and a BGM reproducing device for reproducing a background image corresponding to the BGM, and is also associated with the music in the present invention. The first information described above is obtained by arranging a plurality of genre information in the order of priority, and this information is attached to the song, and the image to be selected includes the second information in which the plurality of genre information is arranged in the order of priority. It is attached, and it is determined from the genre information of the first information and the second information having a high priority order whether or not they match each other. When they match, the weighting is performed according to the priority order and the evaluation is performed. As a result, the function of selecting the image having the second information having a high degree of compatibility with the first information can be provided as an application program of a control device such as a personal computer. Therefore, it goes without saying that the present invention also includes a recording medium such as a magnetic recording medium or an optical recording medium in which a program that realizes the functions of the present invention is recorded. The present invention also includes a music recording medium in which the first information is recorded and an image recording medium in which the second information is recorded. In the above embodiment, a plurality of pieces of the first information associated with a piece of music are recorded in a time-sequential and intermittent manner. However, intermittent recording is not always necessary. The first information can be recorded in a concentrated manner.

[0029]

As described above, according to the present invention, the first information associated with a song is a plurality of genre information arranged in order of priority, and this information is associated with a plurality of songs. The image to be selected is accompanied by the second information in which a plurality of genre information is arranged in the priority order, and it is determined whether the genre information having the higher priority order of the first information and the second information matches each other. When they match, the image is weighted according to the priority order and evaluated, and as a result of the evaluation, the image having the second information having a high degree of conformity with the first information is selected. It is possible to more accurately search for an image that matches the selected image, and even in the middle of a song, it is possible to select and change an image in accordance with the image change of the song.

[Brief description of drawings]

FIG. 1 is a flowchart showing a processing procedure in an embodiment of a music piece reproducing apparatus according to the present invention.

FIG. 2 is a diagram showing formats of a search code and a searched code used in the embodiment of the present invention.

FIG. 3 is a schematic block diagram of an example of a karaoke system to which the music reproducing device of the present invention can be applied.

4 is a schematic block diagram of the karaoke system on the terminal side, that is, a karaoke device.

FIG. 5 is a schematic block diagram of another example of a karaoke system to which the music reproducing device of the present invention can be applied.

6 is a schematic block diagram of a terminal side of the karaoke system of FIG. 5, that is, a karaoke device.

FIG. 7 is a table showing an example of genre information and a relationship between genre information and genre codes in the embodiment of the present invention.

FIG. 8 is a timing chart showing a time-series arrangement of search codes associated with music in the embodiment of the present invention.

FIG. 9 is a diagram schematically showing a searched code associated with an image according to the embodiment of the present invention.

FIG. 10 is a schematic diagram showing contents of a still image index file according to the embodiment of the present invention.

FIG. 11 is a table for explaining a still image evaluation method according to the embodiment of the present invention.

FIG. 12 is a diagram illustrating a still image evaluation method according to the embodiment of the present invention.

FIG. 13 is a diagram illustrating a still image evaluation method according to the embodiment of the present invention.

FIG. 14 is a chart showing an evaluation table in the embodiment of the present invention.

FIG. 15 is a chart showing a method of determining a still image on the evaluation table according to the embodiment of the present invention.

FIG. 16 is a chart showing a method of determining a still image on the evaluation table according to the embodiment of the present invention.

[Explanation of symbols]

10 Karaoke IP Server 12 Music File Authoring Device 14 Network 16 User Personal Computer (Terminal Player) 18 Hard Disk 20 CD-ROM 24 Sequencer 26 Image Processing Unit 28 Music Analysis Unit 30 Karaoke Device 32 Image Display Control Unit 34 Music Playback Control Unit 35 User 36 GUI (Graphical User Interface) 38 Display 40 External sound source 42, 44 Speaker 46 Software production unit 48 Center host server 50 Local host server 52 Communication karaoke terminal A Search code (first information) B Search code (second information)

Continuation of front page (58) Fields surveyed (Int.Cl. ⁷ , DB name) G10K 15/04 302 G10H 1/00 102 G11B 27/34 G11B 31/02

Claims (6)

(57) [Claims] 1. A music reproducing apparatus for searching an image to be displayed in synchronization with the reproduction of a music based on the processing of a control means, wherein a plurality of search information arranged in the music at the timing of displaying the image. Each image is accompanied by the searched information, the search information is a plurality of genre information arranged in the priority order, and the searched information is a plurality of genre information arranged in the priority order. The control means performs evaluation processing and determination processing, and the evaluation processing compares each searched information of the music to be reproduced with all the searched information and gives priority to both of the genre information that matches each other. The evaluation value is calculated based on the ranking, an evaluation table is created for each search information, and the determination process selects the search target information for each search information based on the order of the evaluation value and determines the image for the search information. Music playback device. 2. The music reproducing apparatus according to claim 1, wherein in the evaluation processing, the evaluation value is calculated by adding a predetermined score according to the priority order of the genre information matching each other. 3. The music reproducing apparatus according to claim 1, wherein the determination processing deletes the evaluation table of the search information in which the searched information is selected. 4. The music reproducing apparatus according to claim 1, wherein the determination processing does not subsequently select the selected searched information. 5. An evaluation step and a determination step are performed,
A recording medium in which a background image search program for searching an image to be displayed is displayed in synchronism with the reproduction of a song. Each song is accompanied by a plurality of search information arranged at the timing of displaying the image. The image is accompanied by the searched information, the search information is a plurality of genre information arranged in a priority order, and the searched information is a plurality of genre information arranged in a priority order. Calculates the evaluation value based on the priority of both the searched information of the music to be reproduced and all the searched information, and creates the evaluation table for each searched information. Then, in the determining step, the recording medium on which the background image search program for selecting the searched information for each search information based on the order of the evaluation value and determining the image for the search information is recorded. 6. The recording medium of claim 5, wherein the image in addition to the program are also recorded.