JP4161996B2 - Multimedia control device - Google Patents

Description

  The present invention relates to a multimedia control apparatus suitable for use in, for example, a musical educational toy.

  Conventionally, various devices for controlling video and sound according to operation of an operator have been put into practical use. This type of device is called a video game or a TV game, and a shooting game that asks a player's reflexes is known. A video game includes a computer unit that generates a video signal corresponding to a game operation and a display that displays a video signal supplied from the computer unit. The computer unit sequentially reads image information and control information stored in a well-known ROM pack, for example, displays a still image as a screen background on the display, and moves a corresponding character on the still image according to a game operation. The video is displayed and sound effects are generated according to the movement.

  Now, in such a video game, the visual effect by the image is the main, and the acoustic effect often plays a secondary role. In addition, the game is inferior with the player, and in many cases, the game is progressed according to a predetermined story content. For this reason, there is a need for a multimedia control device that allows a game to proceed with the free idea of a player and that combines visual and acoustic effects. In particular, as an educational toy for infants, a multimedia control device that can combine visual effects and sound effects and develop a sense of sound and rhythm as a game is desired. The present invention has been made in view of the above-described circumstances, and combines a visual effect and a sound effect, cultivates a sense of sound and rhythm as a game, and can learn a musical instrument tone and performance method. The object is to provide a media control device.

In the first aspect of the invention, the designation means for designating the position of the area where the plurality of characters to which the different musical instruments are assigned are displayed together with the assigned musical instrument, and designated by the designation means Display control for displaying a character in a specified area by moving the position so that it moves forward with respect to other characters when the position is an area where any of the plurality of characters is displayed Means, and after the character in the designated area is moved and displayed, the instrument sound is generated according to the performance pattern representing the performance of the instrument assigned to the character displayed in the designated area , and designated. And performance control means for performing control so as to increase the musical instrument sound assigned to the character in the specified area.

  According to a second aspect of the present invention, in the first aspect of the invention, the performance control means displays an auxiliary character corresponding to the character and moves the performance position of the character. The display mode of the auxiliary character is different.

  According to the present invention, it is possible to learn the shape, tone color, and performance method of a musical instrument.

Embodiments of the present invention will be described below with reference to the drawings.
A. FIG. 1 is a diagram showing an outline of a multimedia control apparatus according to an embodiment of the present invention. As shown in FIG. 1B, the multimedia control device 1 generates a video signal Vs and an audio signal As composed of stereo components of the L channel and the R channel, and is connected via a cable C. Supplied to the television receiver 20. The television receiver 20 reproduces a video in accordance with the video signal Vs, and generates a musical sound and a sound corresponding to the audio signal As from a speaker in synchronization with the video.

  As shown in FIG. 1 (a), the multimedia control device 1 includes a lid 1a that can be opened and closed and a tablet unit 1b. In addition, the figure (A) has shown the unfolded state, and the cover body 1a is mounted on the tablet part 1b in the accommodation state, and the apparatus 1 is equipped with the structure accommodated in a bowl shape. In FIG. 2A, reference numeral 2 denotes a ROM cassette, which stores a control program, which will be described later, automatic performance data and image patterns, ADPCM data obtained by compression encoding voice and instrument sound, and the like. 3 is a picture book. The picture drawn on each page of the picture book 3 is stored in a form that substantially corresponds to the image pattern of the ROM cassette 2.

  Reference numeral 4 denotes a page detection sensor disposed on the upper portion of the lid 1a, which detects the presence or absence of a notch formed on each page of the picture book 3 and discriminates the currently opened page. Reference numeral 5 denotes a touch pen that generates magnetic flux. The magnetic flux generated by the touch pen 5 is detected by a pen position detection matrix 5a (see FIG. 2) laid on the back surface of the lid 1a and the upper surface of the tablet unit 1b, and determines where the pen 5 is currently located. Reference numeral 6 denotes a power switch for setting the device 1 on and off, and reference numeral 7 denotes a keyboard sheet placed on the tablet unit 1b. This keyboard sheet corresponds to the arrangement position of the pen position detection matrix 5 a, and the pitch and note length can be designated according to the pointing operation of the touch pen 5. Reference numeral 8 denotes a pad operated during rhythm performance, and reference numeral 9 denotes a joypad used as a selection operator. Reference numeral 10 denotes a microphone for voice input.

B. Next, the configuration of the embodiment will be described with reference to FIG. In addition, the same number is attached | subjected to the part which is common in each part shown in FIG. 1, and the description is abbreviate | omitted. In FIG. 2, 5a is a pen position detection matrix laid on the back surface of the lid 1a and the upper surface of the tablet 1b. The matrix 5a detects a potential electromagnetically induced according to the magnetic flux of the touch pen 5, generates the pointing position data of the pen 5, and supplies this to the bus. A CPU 11 controls each part of the apparatus based on a control program read from the ROM cassette 2. The operation of the CPU 11 will be described later.

  A RAM 12 is used as a work area for the CPU 11 and temporarily stores various register data. A tone data input / output terminal 13 outputs MIDI data supplied from an external MIDI musical instrument to the bus, and sends MIDI data supplied from a tone synthesis unit 15 described later to an external sound source. A display control circuit 14 converts an image pattern read from the ROM cassette 2 into a video signal Vs in accordance with an image control signal supplied from the CPU 11 and outputs the video signal Vs. Reference numeral 20 denotes display means such as a television receiver for reproducing the video signal Vs.

  The tone synthesizing circuit 15 has a sound source configured by a well-known waveform memory reading method or calculation method, and supplies a tone signal synthesized with a tone according to performance data supplied from the CPU 11 to the next stage. Reference numeral 16 denotes a reverberation / volume control circuit that applies a reverb with a depth corresponding to the control signal supplied from the CPU 11 to the tone signal output from the tone synthesis circuit 15 and adjusts its volume. Reference numeral 17 denotes a microphone reverberation / volume control circuit that applies a reverberation having a depth corresponding to a control signal supplied from the CPU 11 to an audio signal input from the microphone 10 and adjusts its volume.

  A digital audio processing circuit 18 decodes ADPCM data read from the ROM cassette 2 under the instruction of the CPU 11 and generates an analog audio signal. The processing circuit 18 samples the audio input from the microphone 10 for a certain period of time, encodes it into ADPCM data, and writes it into a predetermined storage area of the RAM 12 via the bus under the control of the CPU 11. Reference numeral 19 denotes a mixer which mixes the outputs of the reverberation / volume control circuits 16 and 17 and the digital audio processing circuit 18 and converts the output into an audio signal As composed of stereo components of the L channel and the R channel and outputs it. An audio output terminal 21 supplies the L-channel and R-channel audio signals As to an external sound system such as the television receiver 20.

C. Operation of the Embodiment Next, the operation of the embodiment having the above-described configuration will be described with reference to FIGS. Here, after the operation of the main routine is described with reference to FIGS. 3 and 4, the operation of icon processing called in the main routine will be described with reference to FIGS. 5 to 9.

(1) Operation of main routine First, when the multimedia control device 1 according to this embodiment is turned on, the CPU 11 loads a predetermined control program from the ROM cassette 2 and starts the main routine shown in FIG. The process proceeds to step Sa1. In step Sa1, various registers and flags stored in the RAM 3 are reset and initialized, and the process proceeds to the next step Sa2. In step Sa2, the CPU 11 sequentially reads the initial image pattern and the corresponding automatic performance data from the ROM cassette 2. The automatic performance data referred to here is pattern data for a predetermined measure for instructing the sound generation timing of each rhythm instrument sound corresponding to the specified rhythm type.

  Next, when proceeding to step Sa3, the CPU 11 transfers the initial image pattern and the automatic performance data thus read out to the display control circuit 14 and the musical tone synthesis circuit 15 via the bus. Thereby, the display control circuit 14 converts the initial image pattern into the video signal Vs and supplies it to the display means (television receiver) 20. On the other hand, the musical tone synthesis circuit 15 synthesizes musical tone signals for each rhythm instrument sound according to the automatic performance data. The tone signal is subjected to reverberation or volume control, and then supplied from the sound output terminal 21 to the sound system via the mixer 19. As a result, an automatic rhythm performance synchronized with the opening screen display is performed.

  Next, the CPU 11 proceeds to step Sa4 and determines whether or not the page of the picture book 3 set on the back surface of the lid 1a (see FIG. 1 (a)) has been turned. Here, if the output of the page detection sensor 4 does not change, it is assumed that the page is still the opening page, the determination result is “NO”, the process returns to step Sa3, and the above-described opening state is maintained. For example, when the “animal stage” page shown in FIG. 4 is opened, the page detection sensor 4 detects this. Thereby, the determination result of step Sa4 becomes “YES”, and the process of the CPU 11 proceeds to step Sa5.

  In step Sa5, the image pattern and automatic performance data of the corresponding page are sequentially read from the ROM cassette 2. Next, in step Sa6, the read image pattern and automatic performance data are transferred to the display control circuit 14 and the tone synthesis circuit 15, respectively. As a result, the “animal stage” screen similar to the picture book page shown in FIG. 4 is displayed as a still image, while the rhythm instrument sounds corresponding to the automatic performance data are synthesized and the stage opening performance is performed.

  Next, when the processing of the CPU 11 proceeds to step Sa7, it is determined whether or not the “icon” on the picture book page shown in FIG. On this page, “1 banana”, “2 bananas”, “3 bananas”, and “4 bananas” drawn at the bottom of the right page are icons EC to EC4. If none of the icons EC1 to EC4 are pointed, the determination result is “NO”, and the “Animal Stage” screen continues to be displayed along with the stage opening performance. On the other hand, when any of the icons EC1 to EC4 is pointed, the determination result here is “YES”, and the process proceeds to step Sa8.

  In step Sa8, an event corresponding to the icon type pointed to is executed. This event is a process in which a sense of sound, a sense of rhythm, and the like are learned in a game sense, and details thereof will be described later. Then, every time the event for each icon is completed, the CPU 11 advances the process to step Sa9, and repeats the above steps Sa6 to Sa8 until there is a page change. As described above, in the main routine, an image corresponding to each page of the picture book 3 and a performance are reproduced in synchronization with each other, thereby realizing a multimedia that places importance on interactivity with a player.

(2) Operation of Icon Processing Routine (2-1: Operation when Icon EC1 is Pointed)
In the picture book page shown in FIG. 4, when the icon EC1 (“one banana”) is pointed with the touch pen 5, the pen position detection matrix 5a gives pointing position data to the CPU 11 accordingly. Thereby, the CPU 11 recognizes that the icon EC1 is pointed and activates the icon EC1 processing routine shown in FIG. 5, and advances the processing to step Sb1. Note that the pen tip of the touch pen 5 is provided with a micro switch, and when the pen tip is pressed against the pen position detection matrix 5a and the switch is turned on, the pointing position data is transferred to the CPU 11. It is captured.

  In step Sb1, a plurality of image data corresponding to the performance actions of the characters A to E of “elephant”, “flamingo”, “giraffe”, “crocodile” and “lion” are read from the ROM cassette 2, and the plurality of images are read. These characters A to E are displayed as moving images so as to perform percussion instrument performance as shown in FIG. In addition, the percussion instrument sounds (elephant: bass drum, flamingo: tambourine, giraffe: claves, crocodile: bongo, lion: cymbal) assigned to each character in synchronism with this percussion instrument performance are synthesized to create a “jungle band”. Start playing.

  Next, when proceeding to step Sb2, it is determined whether or not any of the characters A to E is pointed. Here, for example, it is assumed that the character A (“Elephant”) is pointed. If it does so, a judgment result will be "YES" and will progress to the following step Sb3. In step Sb3, the pointing character A, that is, the image of “elephant” is controlled to move forward one step on the screen, and the “tulip” displayed in front of the selected character has an open shape. Perform image control. In step Sb4, only the performance data corresponding to the character A (“Elephant”) is synthesized. In this case, the volume control is performed so that the volume of the “bass drum sound” that is the musical instrument of the character A (“Elephant”) is increased to enhance the solo.

  When the solo of the designated character is completed for the predetermined phrase in this way, the CPU 11 advances the process to step Sb5 to determine whether or not the reproduction has been completed (pointed) for all the characters A to E. Here, if the solos of all the characters A to E are not completed, the determination result is “NO”, and the above-described steps Sb1 to Sb4 are repeated. On the other hand, if the reproduction has been completed for all the characters A to E, the determination result is “YES”, and the flow proceeds to the next Step Sb6. In step Sb6, the rhythm pattern is updated in order to change the solo contents, assuming that the solos of the characters A to E have been completed.

  In step Sb7, it is determined whether or not all performance data of all rhythm patterns (for example, five types) stored in the ROM cassette 2 have been reproduced. If all types of rhythm patterns are not reproduced, the determination result is “NO”, and steps Sb1 to Sb6 are repeated again based on the rhythm patterns updated in step Sb6. When the solo for each character A to E is made for all the rhythm patterns, the determination result here is “YES”, and the CPU 11 returns the processing to the main routine described above.

  As described above, in the icon EC1 process, the animal (character) selected by the player advances one step on the screen, and the solo by the percussion instrument that the animal has is performed. At this time, since the performance of the animal (character) is controlled in a moving image in synchronization with the performance sound, the visual and acoustic effects as if the animal depicted in the picture book 3 is playing a percussion instrument. can get.

(2-2: Operation when icon EC2 is pointed)
In the picture book page shown in FIG. 4, when the player points the icon EC2 (“two bananas”) with the touch pen 5, the pen position detection matrix 5a provides pointing position data to the CPU 11 accordingly. Thereby, the CPU 11 recognizes that the icon EC2 is pointed and starts the icon EC2 processing routine shown in FIG. 6, and advances the process to step Sc1. In step Sc1, ADPCM data read from the ROM cassette 2 is supplied to the digital audio processing circuit 18 (see FIG. 2). As a result, voice reproduction is performed, and a narration instruction “Please touch a favorite animal” is given.

  Next, when proceeding to step Sc2, the CPU 11 waits until the player points any of the characters A to E in response to the narration instruction. Here, for example, when the character A (“Elephant”) is pointed by the player, the determination result is “YES”, and the process proceeds to the next step Sc3. In step Sc3, movement control is performed so that the image of the pointed “elephant” moves forward one step on the screen, and background image control is performed so that the “tulip” displayed in front of the “elephant” is opened. As a result, the image shown in FIG. 9 is displayed on the television receiver 20.

  In step Sc4, performance data of the percussion instrument corresponding to the designated character A is read out. In this case, the drum sound is played in a rhythm for one measure, and the performance operation of the character A is displayed in a moving image in synchronization with the performance. To do. Next, when this one-measure rhythm performance and moving image display is completed, the CPU 11 advances the process to step Sc5, transfers the ADPCM data read from the ROM cassette 2 to the digital audio processing circuit 18, and reads "pad with the same rhythm. Please give me a narration instruction. Further, in order to prompt the player to perform the pad operation, the narration “Ichini-san, yes” is reproduced by voice.

  Here, when the player hits the pad 8 (see FIG. 2) in response to this narration to cut the rhythm for one measure, the CPU 11 detects the pad operation in Step Sc6 and generates pad operation information. Subsequently, in step Sc7, while the performance operation of the character A is displayed as a moving image in accordance with the pad operation information, the drum sound is synthesized with the musical tone in synchronization with the pad operation information. That is, the character A is caused to perform a drum performance in response to the pad operation, and a drum sound is generated in synchronization with the operation. Next, when proceeding to step Sc8 (see FIG. 7), it is determined whether or not the appropriate rhythm pattern played in step Sc4 matches the pad operation timing by the player. If there is a predetermined error between the rhythm pattern and the pad operation timing, the determination result is “NO”, and the process proceeds to step Sc9.

  In step Sc9, the ADPCM data read from the ROM cassette 2 is transferred to the digital voice processing circuit 18 and voice synthesizes a narration “tap the pad again”. Thereafter, the CPU 11 repeats the above-described step Sc4 and subsequent steps. On the other hand, if the rhythm pattern matches the pad operation timing, the determination result in Step Sc8 is “YES”, and the process proceeds to Step Sc10. If the rhythm pattern matches the pad operation timing and the pad operation can be cleared, the fanfare sound is synthesized with a musical tone. In step Sc10, it is determined whether or not the pad operation has been cleared for all characters A to E. If it is not cleared, the determination result is “NO”, and the flow advances to next Step Sc11.

  In Step Sc11, for example, the next character B (“Flamingo”) is designated following the character A (“Elephant”) described above, and Step Sc3 and subsequent steps described above are repeated. When the pad operations related to all characters A to E are cleared, the determination result in step Sc10 is “YES”, and the flow proceeds to step Sc12. In step Sc12, image data corresponding to the performance actions of all the characters A to E, that is, "elephant", "flamingo", "giraffe", "crocodile" and "lion" are read from the ROM cassette 2, and these characters A to E are read. A video is displayed so that E plays a percussion instrument. Furthermore, in synchronism with this moving image display, the percussion instrument sound assigned to each character is synthesized with a musical tone and a “jungle band” is played.

  In this way, in the icon EC2 processing, a percussion instrument participation event is made, and when the pad is hit so as to match the rhythm of the animal (character) selected according to the instruction of the narration, the character plays a performance specific to the instrument according to the pad operation. An action is performed, and the percussion instrument sound of the character is rhythmically generated. Then, when you hit one bar at the right time, a fanfare sounds and you move to the next character. For this reason, it is possible to cultivate an accurate sense of rhythm while playing like a game with multimedia that combines visual effects and acoustic effects.

  When the icon EC3 ("three bananas") shown in FIG. 4 is pointed, a percussion instrument participation event is performed in the same manner as the icon EC2 process. In the icon EC3 process, when a pad is hit so as to match the rhythm (two bars) of the animal (character) selected according to the narration instruction, the character will perform in response to the pad operation, and the corresponding percussion instrument sound will produce a rhythm sound. Is done. In this case as well, when a two-measure rhythm is carved in a timely manner, a fanfare sounds and the rhythm of the character can be cleared.

  Furthermore, when the icon EC4 (“4 bananas”) is pointed, a free performance event is executed. In this free performance event, any character is selected in a state in which all characters A to E are percussion ensemble ensemble, and the selected character performs according to the player's pad operation. Therefore, in these icon EC3 and EC4 processing, the percussion instrument performance by the actual pad operation is added to the visual effect as if the animal depicted in the picture book is playing the percussion instrument, and the sense of sound and rhythm are nurtured like a game. It becomes possible. In the above embodiment, the musical instruments are all rhythm musical instruments. However, the musical instrument sounds and the image patterns are not limited to this. For example, as shown in FIG. 10, a wind instrument may be assigned to the character. Needless to say, stringed instruments and keyboard instruments may also be used.

It is a figure which shows schematic structure of the multimedia control apparatus 1 by this invention. It is a block diagram which shows the electric constitution of the Example. It is a flowchart which shows the operation | movement of the main routine in the Example. It is a figure which shows an example of the picture book page in the Example. It is a flowchart which shows operation | movement of the icon EC1 process routine in the Example. It is a flowchart which shows operation | movement of the icon EC2 process routine in the Example. It is a flowchart which shows operation | movement of the icon EC2 process routine in the Example. It is a figure for demonstrating operation | movement of the icon EC1 process routine in the Example. It is a figure for demonstrating operation | movement of the icon EC2 process routine in the Example. It is a figure which shows the example of an image pattern at the time of assigning a wind instrument to a character.

Explanation of symbols

  2 ... ROM cassette (sound generation control means, image control means), 5 ... touch pen (musical instrument specifying means), 5a ... pen position detection matrix (musical instrument specifying means), 8 ... pad (performance operator), 11 ... CPU (instrument specifying) Means, sound generation control means, image control means), 12 ... RAM, 14 ... display control circuit (image control means), 15 ... musical tone synthesis circuit (sound generation control means)

Claims (2)

Designating means for designating the position of an area in which a plurality of characters each assigned a different instrument are displayed together with the assigned instrument ;
When the position specified by the specifying means is an area where any one of the plurality of characters is displayed,
Display control means for displaying the character in the designated area by moving the position so that it moves forward with respect to other characters;
After a character of the designated area is moved and displayed to generate the musical instrument sound according to performance pattern which represents the performance of instruments that are assigned to the displayed in the area specified character, and designated areas A multimedia control apparatus, comprising: performance control means for performing control to increase the musical instrument sound assigned to the character. The display control means includes
The multimedia control device according to claim 1, wherein an auxiliary character corresponding to the character is displayed, and a display mode of the auxiliary character is changed according to movement of the performance position of the character.

Images