JP4148355B2 - Mobile terminal device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a portable terminal device that composes and reproduces music corresponding to the contents of text data such as an electronic mail and a web page.
[0002]
[Prior art]
2. Description of the Related Art In recent years, an automatic music composition system in which a server device composes music corresponding to the contents of a received electronic mail in response to receiving an electronic mail transmitted by a user via a terminal device (see, for example, Patent Document 1). According to such a system, the user can listen to music composed according to the contents of the e-mail at any time by calling the server device via the telephone line.
[0003]
[Patent Document 1]
JP 2001-209592 A
[0004]
[Problems to be solved by the invention]
However, in the conventional automatic music composition system as described above, since the processing for composing and storing music is all performed on the server device side, the user makes a telephone call every time music composition is requested or viewed. The server device must be accessed via a line, and music composed according to the contents of the e-mail cannot be easily viewed.
[0005]
Further, in the conventional automatic music composition system as described above, music composed according to the contents of the e-mail is configured to be provided to the user via a telephone line. The user has to pay a lot of communication charges before listening, and cannot use the automatic music service using e-mail at low cost.
[0006]
The present invention has been made in view of such a problem, and an object thereof is to compose and reproduce music corresponding to the contents of text data easily and inexpensively without using a server device. The object is to provide a portable terminal device.
[0007]
[Means for Solving the Problems]
A display unit for displaying text data, a numerical value for controlling the contrast of music to be composed, a numerical value for controlling tempo, and a numerical value for controlling inflection, and a plurality of keywords used as chord candidates for each measure of music A storage unit that stores the chord data, a plurality of note data used as music note candidates for each music beat, and a plurality of melody rule data used as melody rule candidates applicable to each music note; Based on the numerical value stored in the storage unit in association with the keyword acquired by the keyword acquisition unit that analyzes the text data and acquires the keywords included in the text data, and the music tone and speed Specify the progression rules for the genre, motif, rhythm, melody, accompaniment, and drum Each parameter of music to be composed according to a music rule formed by a parameter calculation unit that calculates parameters for forming a music rule, a chord generation processing unit that generates chord progression data, and a parameter calculated by the parameter calculation unit It is formed by the rhythm generation processing unit that extracts the note data in the number of beats from the storage unit and generates the rhythm progression data composed of the data of each note in the number of beats, and the parameter calculated by the parameter calculation unit. In accordance with the music rule, the melody rule data to be applied to each note of the rhythm progression data generated by the rhythm generation processing unit is extracted from the storage unit, and the melody comprising the data of each melody rule to be applied to each note Chord progression by melody generation processing unit that generates progress data and chord generation processing unit Over data, rhythm progression data by the rhythm generation processing unit, and in accordance with the melody progression data by the melody generation processing unit, and the performance data generation processing unit to generate the performance data of music to compose, A playback unit that plays back and outputs music according to the performance data generated by the performance data generation processing unit, an operation unit that scrolls text data displayed on the display unit, and a display that is displayed according to scrolling of the text data by the operation unit A determination unit that determines whether or not the content of the text data displayed on the unit has changed, and the content of the text data displayed on the display unit has changed in response to the scrolling of the text data by the operation unit If the determination unit determines, based on the text data of the portion where the content has changed, the keyword acquisition unit, the parameter calculation unit, the chord generation processing unit, the rhythm generation processing unit, the melody generation processing unit, and the performance data generation processing unit By executing the process, the performance data of the newly composed music is generated corresponding to the text data of the part where the content has changed , Reproduction unit, reproduces and outputs the music in accordance with the performance data of the newly composed music This solves the above-described problem.
[0008]
That is, in the mobile terminal device according to the present invention, in response to the display of text data on the display unit, the control unit automatically composes music corresponding to the content of the displayed text data, and the playback unit composes the music. Play the music that was played.
[0009]
Thereby, the user can appreciate the music corresponding to the content of the e-mail without accessing the server device. In addition, the user can use the automatic song service without paying a communication fee.
[0010]
That is, according to this portable terminal device, music corresponding to the contents of the electronic mail can be composed and reproduced easily and inexpensively without using the server device.
[0011]
DETAILED DESCRIPTION OF THE INVENTION
The present invention can be applied to, for example, a mobile phone as shown in FIG. Hereinafter, a configuration and operation of a mobile phone according to an embodiment of the present invention will be described in detail with reference to the drawings.
[0012]
[Overview of mobile phone]
First, with reference to FIG. 1, an overview configuration of a mobile phone according to an embodiment of the present invention will be described.
[0013]
As shown in FIG. 1, a mobile phone 1 according to an embodiment of the present invention includes a display unit 2, an operation input unit 3, an earpiece 4, and a mouthpiece 5 as main components.
[0014]
The display unit 2 is configured by a display device such as an LCD (Liquid Crystal Display) or an EL (ElectroLuminescence) panel, and in accordance with control of a CPU (Central Processing Unit, see FIG. 2) 15 described later, letters, numbers, symbols, Visible display of icons, cursors, images, moving images, etc.
[0015]
The operation input unit 3 is, for example, input of numbers from “0” to “9”, input of kana characters, input of alphabet characters, input of symbols, input instruction of transmission and reception, input of instructions to turn on / off the power A plurality of key buttons 6 used for operations such as the above are provided. The operation input unit 3 also has a dial (jog dial) 7 used for operations such as moving the cursor displayed on the display unit 2 and scrolling the screen. The earpiece 4 and the mouthpiece 5 are respectively connected to a speaker and a microphone (see FIG. 2), which will be described later, and are used when the user performs a voice call with the other party.
[0016]
[Internal configuration of mobile phone and its basic operation]
Next, with reference to FIG. 2, the internal configuration and the basic operation of the mobile phone 1 will be described. In addition, since the structure and operation | movement of the display part 2 and the operation input part 3 are as above-mentioned, the description is abbreviate | omitted below.
[0017]
In the mobile phone 1 shown in FIG. 2, the microphone 8 connected to the mouthpiece 5 (see FIG. 1) converts the user's call voice into an analog voice signal. The analog audio signal is amplified by an amplifier (not shown) and then input to a DSP (Digital Signal Processor) 9.
[0018]
When an analog audio signal is input, the DSP 9 performs analog / digital (A / D) conversion of the analog audio signal at a predetermined sampling rate. The DSP 9 adds a CRC (Cyclic Redundancy Check) code for each transport block (TB) to the digital audio data obtained by the A / D conversion, and performs channel coding (error correction coding) and interleaving processing. Apply. The transport block is a basic unit of data (a unit in which data is transferred from the MAC (Medium Access Control) layer to the physical layer) to be processed by the physical layer.
[0019]
Further, the DSP 9 adds overhead for channel determination such as pilot bits to the bit sequence after the interleave processing, performs data modulation processing, and performs in-phase (In-Phase on the phase plane to which data modulation mapping is performed). ) And quadrature components are spread with two spreading code sequences. The DSP 9 limits the band of the spread chip data series to a predetermined band (5 MHz) with a raised cosine root Nyquist filter, and then converts the analog signal into an analog signal by digital / analog (D / A) conversion. 10 is output.
[0020]
When an analog signal is input from the DSP 9, the transmitter 10 performs quadrature demodulation on the analog signal, and frequency-converts the quadrature demodulated intermediate frequency signal into a high-frequency signal (2 GHz band RF signal). Then, the transmitter 10 amplifies the high-frequency signal and outputs the amplified high-frequency signal to the duplexer 11 as a transmission signal.
[0021]
The duplexer 11 is an antenna duplexer. That is, the duplexer 11 shares one antenna 12 for the transmission signal and the reception signal, sends the reception signal from the antenna 12 to the reception unit 13, and sends the transmission signal from the transmission unit 10 to the antenna 12. It is composed of a filter circuit having a function.
[0022]
The receiving unit 13 amplifies the high frequency received signal supplied via the antenna 12 and the duplexer 11, and frequency-converts the amplified received signal into an intermediate frequency signal. The receiver 13 linearly amplifies the intermediate frequency signal by automatic gain control, and inputs the linearly amplified intermediate frequency signal to the DSP 9. At this time, the DSP 9 performs quadrature detection on the signal from the receiving unit 13 and A / D converts the in-phase and quadrature component analog signals obtained by the quadrature detection at a predetermined sampling rate. Then, the DSP 9 band-limits the in-phase and quadrature components converted into digital values by A / D conversion using the square cosine root Nyquist filter, and then despreads the same with the spreading code of the received signal, Time separation is performed into a plurality of multipath components having different propagation delay times.
[0023]
In addition, the DSP 9 performs coherent lake combining of the data of each path separated by time, deinterleaves and channel decodes the data sequence after the coherent lake combining, performs binary data determination, and transmits to the destination terminal. Play the data series. The DSP 9 discriminates the reproduced data series into audio data and other communication data. The voice data is D / A converted by the DSP 9 and further amplified by an amplifier (not shown), and then sent to the speaker 14 built in the earpiece 4 (see FIG. 1). The speaker 14 is driven by the amplified analog audio signal. As a result, the call voice from the mobile phone of the call partner is emitted from the speaker 14.
[0024]
Further, the DSP 9 analyzes what kind of data the communication data is, and performs processing corresponding to the analysis result. For example, when the communication data is text data such as e-mail, the DSP 9 sends the text data to the CPU 15, and the CPU 15 controls the display of the text data on the display unit 2. For example, when the communication data is compressed image data, the DSP 9 decompresses the compressed image data and sends it to the CPU 15. The CPU 15 controls the display of the image data on the display unit 2. For example, when the communication data is compressed audio data, the DSP 9 expands the compressed audio data and outputs the audio data to the speaker 14 or the speaker 16.
[0025]
The recording unit 17 is configured by a rewritable memory that does not require a memory holding operation, such as a flash memory. The recording unit 17 includes an application program recording unit 19 that stores various application programs such as an address book function program, a schedule book function program, a user profile registration function program, an electronic mail transmission / reception function program, and an automatic song program 18.
[0026]
The recording unit 17 stores various data such as address book data, schedule data, profile data, transmitted / received e-mails, automatic music piece processing data 20 (details will be described later), performance data created by the automatic music piece processing, and the like. A data recording unit 21 for storing is provided. Further, the recording unit 17 stores setting data including values that can be arbitrarily set by the user among various setting values of the mobile phone. Note that all or part of the information stored in the application program recording unit 19 and the data recording unit 21 may be received via a communication line.
[0027]
A ROM (Read Only Memory) 22 stores various computer programs such as a control program (not shown) for the CPU 15 to control each unit, various initial setting values, and font data. The ROM 22 stores a reproduction program 23 for reproducing performance data created by the automatic music function.
[0028]
The ROM 22 may be a rewritable ROM such as an EEPROM (Electrically Erasable and Programmable Read Only Memory). In the cellular phone 1, the CPU 15 reproduces the performance data in software using the reproduction program 23. For example, a dedicated tone generator circuit is provided in the cellular phone 1, and the CPU 15 inputs the performance data to the tone generator circuit. Thus, the performance data may be reproduced.
[0029]
A RAM (Random Access Memory) 24 functions as a work area when the CPU 15 performs various processes, and stores data as needed. The CPU 15 executes the computer program stored in the recording unit 17 and the ROM 22 to control the operation of each unit in the mobile phone 1 according to the computer program and perform various arithmetic processes.
[0030]
The camera unit 25 includes an image sensor such as a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, and an optical system that forms an optical image of a subject or the like on the image sensor. is there. The image data captured by the camera unit 25 is input to the DSP 9. The DSP 9 that has received the image data from the camera unit 25 sends the image data to the CPU 15, and the CPU 15 controls display of an image based on the image data on the display unit 2. The DSP 9 can also compress the image data as necessary, and send the compressed image data to the transmission unit 10 as transmission data. The compressed image data can also be recorded in the recording unit 17 via the CPU 15.
[0031]
The short-range wireless communication unit 26 and its antenna 27 are for performing so-called Bluetooth wireless communication. The Bluetooth method is a method for realizing wireless networking between a plurality of electronic devices. This Bluetooth method was developed by the Bluetooth SIG (Special Interest Group), and details are disclosed in "Bluetooth (TM) Special Interest Group, Bluetooth Specification Version 1.0".
[0032]
[Operation of mobile phone]
[Automatic song processing]
The mobile phone 1 composes and outputs music corresponding to the content of the e-mail displayed on the display unit 2 when the user is browsing the e-mail received via the display unit 2 (hereinafter, referred to as “e-mail”). This process is referred to as automatic song processing). In this embodiment, the mobile phone 1 composes music when browsing the email, but the display unit 2 displays the email when the user transmits the email (when the dial 7 is pressed) or when browsing the web page. The automatic music piece processing may be executed when the text data is displayed. Hereinafter, with reference to the flowchart shown in FIG. 3, the operation of the mobile phone 1 when executing the automatic music piece processing will be described in detail.
[0033]
The flowchart shown in FIG. 3 starts when the user operates the operation input unit 3 to display the received e-mail on the display unit 2, and the automatic music piece process proceeds to step S1.
[0034]
In step S 1, the CPU 15 loads the automatic song program 18 from the recording unit 17 into the RAM 24, and reads the text data of the electronic mail currently displayed on the display unit 2 into the RAM 24 according to the automatic song program 18. Thereby, the process of step S1 is completed, and the automatic music piece process proceeds from the process of step S1 to the process of step S2.
[0035]
In the process of step S2, the CPU 15 analyzes the text data in accordance with the automatic song program 18, and generates music chord progression data, rhythm progression data, and melody progression data corresponding to the contents of the text data based on the analysis result. (Hereinafter, this process is referred to as a parameter calculation process). The details of the parameter calculation process will be described later with reference to the flowchart shown in FIG. Thereby, the process of step S2 is completed, and the automatic music piece process proceeds from the process of step S2 to the process of step S3.
[0036]
In the process of step S3, the CPU 15 generates music chord progression data corresponding to the contents of the text data based on the calculated parameters in accordance with the automatic song program 18 (hereinafter, this process is referred to as a chord generation process). Details of this code generation processing will be described later with reference to a flowchart shown in FIG. Thereby, the process of step S3 is completed, and the automatic music piece process proceeds from the process of step S3 to the process of step S4.
[0037]
In the process of step S4, the CPU 15 generates rhythm progression data of music for which chord progression has been determined based on the calculated parameters in accordance with the automatic song program 18 (hereinafter, this process is referred to as a rhythm generation process). Details of this rhythm generation process will be described later with reference to a flowchart shown in FIG. Thereby, the process of step S4 is completed, and the automatic music piece process proceeds from the process of step S4 to the process of step S5.
[0038]
In the process of step S5, the CPU 15 generates melody progress data of music whose rhythm progress is determined based on the calculated parameters in accordance with the automatic song program 18 (hereinafter, this process is referred to as a melody generation process). Details of this melody generation process will be described later with reference to a flowchart shown in FIG. Thereby, the process of step S5 is completed, and the automatic music piece process proceeds from the process of step S5 to the process of step S6.
[0039]
In the process of step S6, the CPU 15 generates performance data of the composed music by background processing according to the generated chord progression data, rhythm progression data, and melody progression data. Here, the generated performance data is composed of combinations of scales and notes of a plurality of parts (sound sources). In this embodiment, the performance data is composed of MIDI data such as a standard MIDI (Standard Musical Instruments Digital Interface) file. . The above part is composed of tone information of musical instruments such as piano, organ, guitar, bass, violin, cello, harp, trumpet, saxophone, koto, marimba, flute, etc., and one piece of performance data has a maximum of about 40 Can be included (40 chords). Further, the performance data is generated so as to have a predetermined reproduction time. The performance data is not limited to the MIDI data format, and the performance data may be constituted by other data formats such as MP3 (MPEG Audio Layer-3). Thereby, the process of step S6 is completed, and the automatic music piece process proceeds from the process of step S6 to the process of step S7.
[0040]
In the process of step S7, the CPU 15 determines whether or not other performance data is being reproduced. If other performance data is being reproduced as a result of the determination, the automatic music piece process proceeds from the process of step S7 to the process of step S10. On the other hand, when other performance data is not being reproduced, the automatic music composition process proceeds from the process of step S7 to the process of step S8.
[0041]
In the process of step S8, the CPU 15 switches the performance data to be reproduced from the previously reproduced performance data to the performance data generated in advance by the background process by the process of step S6. According to such processing, it is possible to seamlessly reproduce the performance data by eliminating the time loss until the performance data is reproduced. Thereby, the process of step S8 is completed, and the automatic music piece process proceeds from the process of step S8 to the process of step S9.
[0042]
In step S9, the CPU 15 emits the composed music from the speakers 14 and 16 by interpreting and processing the scale and notes of each part of the performance data to be reproduced in accordance with the reproduction program 23. Thereby, the process of step S9 is completed, and the automatic music piece process proceeds from the process of step S9 to the process of step S10.
[0043]
In the process of step S10, the CPU 15 determines whether or not the reproduction of the performance data has been completed, and the automatic music piece process is changed from the process of step S10 to the process of step S11 in accordance with the completion of the reproduction of the performance data. Proceed. In this embodiment, the CPU 15 determines whether or not the reproduction of the performance data has been completed by measuring the reproduction time using a timer.
[0044]
In the process of step S11, the CPU 15 determines whether or not the content of the e-mail displayed on the display unit 2 has changed due to a process such as a scroll operation by the user. If the content of the e-mail displayed on the display unit 2 is changed as a result of the determination, the CPU 15 returns the automatic song processing to the processing of step S8 from the processing of step S11, and the electronic mail generated in advance by the background processing. Switch to performance data corresponding to the mail content change part. According to such processing, the CPU 15 can seamlessly reproduce the performance data corresponding to the contents of the electronic mail displayed on the display unit 2. On the other hand, if the content of the e-mail displayed on the display unit 2 has not changed, the CPPU 15 returns the automatic music piece process from the process of step S11 to the process of step S9. Then, this series of automatic song processing is repeatedly executed until browsing of the email received by the user is completed.
[0045]
In the above-described automatic music processing, the user may be configured to operate the operation input unit 3 so that performance data is not generated and reproduced. Further, when the mobile phone 1 is playing performance data, the user may be able to stop playing the performance data. In addition, it is desirable that the CPU 15 compose music based only on the newly displayed text data in response to the new display of text data for one paragraph, one sentence, or one screen of the e-mail. Thereby, the mobile phone 1 can reproduce music suitable for the text development of the e-mail. In addition, it is desirable that the performance data created in the automatic music piece processing can be stored in the recording unit 17 in accordance with an instruction from the user. The performance data stored in the recording unit 17 may be transmitted to other users via a communication line.
[0046]
[Parameter calculation processing]
Next, the parameter calculation process in step S2 will be described in detail with reference to the flowchart shown in FIG.
[0047]
The flowchart shown in FIG. 4 starts in response to the reading of e-mail text data displayed on the display unit 2, and the parameter calculation process proceeds to step S21.
[0048]
In the process of step S21, the CPU 15 analyzes the structure of the sentence constituting the text data by executing natural language analysis such as morphological analysis on the read text data. Thereby, the process of step S21 is completed, and the parameter calculation process proceeds from the process of step S21 to the process of step S22.
[0049]
In the process of step S <b> 22, the CPU 15 acquires keywords such as “happy” and “sad” from the automatic music piece processing data 20 stored in the recording unit 17. Here, for each keyword, for example, a numerical value (α) for controlling the brightness (darkness) of music to be composed using a technique such as p / n (positive / negagative) evaluation proposed by Kobayashi et al. A numerical value (β) for controlling the tempo and a numerical value (γ) for controlling the inflection are associated with each other. However, some keywords change their meanings depending on the context, so it is desirable to change the numerical value associated with the keyword according to the sentence to which the keyword belongs and the context before and after the sentence. The details of p / n evaluation are disclosed in "Creation of" p / n Dictionary "Using Sentences", Japanese Society for Artificial Intelligence Language / Speech Understanding and Dialogue Study Group, SLUD-33,2001. Thereby, the process of step S22 is completed, and the parameter calculation process proceeds from the process of step S22 to the process of step S23.
[0050]
In the process of step S23, the CPU 15 determines whether or not the acquired keyword is included in the text data based on the natural language analysis result of the text data. If the acquired keyword is not included as a result of the determination, the parameter calculation process proceeds from step S23 to step S25. On the other hand, if the acquired keyword is included, the parameter calculation process proceeds from step S23 to step S24.
[0051]
In the process of step S24, the CPU 15 stores the numerical values α, β, γ associated with the acquired keyword in the RAM 24. After the second process, if the values of the numerical values α, β, γ are already stored in the RAM 24, the CPU 15 adds the newly stored numerical values to the already stored numerical values. However, when the stored numerical value is created based on other text data, the CPU 15 erases this numerical value and then stores a new numerical value in the RAM 24. Thereby, the process of step S24 is completed, and the parameter calculation process proceeds from the process of step S24 to the process of step S25.
[0052]
In the process of step S25, the CPU 15 determines whether or not an unprocessed (unacquired) keyword is included in the automatic music piece processing data 20. If it is determined that an unprocessed keyword is included, the parameter calculation process returns from the process of step S25 to the process of step S22. On the other hand, if an unprocessed keyword is not included, the parameter calculation process proceeds from step S25 to step S26.
[0053]
In the process of step S26, the CPU 15 performs the music tone, speed, genre, motif (chord), rhythm, melody, accompaniment, drum progression rules based on the numerical values α, β, γ stored in the RAM. The parameter that specifies is calculated. These parameters form a music rule (eg, “C”). The music rule can be changed to a new music rule (for example, “Cm” or “C7”) by dynamically rearranging the parameters according to the difference in genres such as “pops” and “classic”. Thus, along with flexible melody generation, the number of music rules stored in the mobile phone 1 can be minimized, thereby completing the process in step S26 and ending the series of parameter calculation processes.
[0054]
The above music rules are theoretical summaries of “flow of chord progression”, “flow of sound”, “beauty of sound”, etc. that have been established by repeated use by many people. is there. Details of the music rules are described in, for example, Japanese Patent Application Laid-Open No. 2002-23747.
[0055]
[Code generation processing]
Next, the code generation process in step S3 will be described in detail with reference to the flowchart shown in FIG. The flowchart shown in FIG. 5 starts upon completion of the parameter calculation process, and the code generation process proceeds to the process of step S31.
[0056]
In the process of step S31, the CPU 15 determines the chord of the measure to be played first according to the parameter calculated in the parameter calculation process. Thereby, the process of step S31 is completed, and the code generation process proceeds from the process of step S31 to the process of step S32.
[0057]
In the process of step S32, the CPU 15 follows the music rules defined in the previous chord so that the chords of the next measure are selected from the automatic music piece processing data 20 so that the chords are not unnaturally connected ( Extract code candidates). Thereby, the process of step S32 is completed, and the code generation process proceeds from the process of step S32 to the process of step S33.
[0058]
In the process of step S33, the CPU 15 generates a random number. Thereby, the process of step S33 is completed, and the code generation process proceeds from the process of step S33 to the process of step S34.
[0059]
In the process of step S34, the CPU 15 determines the code of the next bar from the extracted code candidates according to the generated random number. Thereby, the process of step S34 is completed, and the code generation process proceeds from the process of step S34 to the process of step S35.
[0060]
In the process of step S35, the CPU 15 generates a chord constituent sound (pitch) according to the genre parameters calculated in the parameter calculation process, and applies the chord constituent sound to the determined chord. Thereby, the process of step S35 is completed, and the code generation process proceeds from the process of step S35 to the process of step S36.
[0061]
In the process of step S36, the CPU 15 determines whether or not the processes of steps S32 to S35 have been executed for all measures within a predetermined performance time. As a result of the determination, if the processes in steps S32 to S35 are not executed for all the bars, the code generation process returns from the process in step S36 to the process in step S32. On the other hand, when the processing of step S32 to step S35 is executed for all measures, the CPU 15 stores the result of the above processing in the RAM 24 as chord progression data as processing of step S37. Thereby, the process of step S37 is completed, and a series of code generation processes ends.
[0062]
In order to make it possible to generate a more flexible chord progression pattern, several established chord progression patterns are stored in advance in the automatic music piece processing data 20 for each genre, and the chord generation processing is executed. It is desirable that the CPU 15 learns based on the processing result every time.
[0063]
[Rhythm generation processing]
Next, the rhythm generation process in step S4 will be described in detail with reference to the flowchart shown in FIG. The flowchart shown in FIG. 6 starts when the code generation process is completed, and the rhythm generation process proceeds to step S41.
[0064]
In the process of step S41, the CPU 15 determines a note to be played first according to the parameter calculated in the parameter calculation process. Thereby, the process of step S41 is completed, and the rhythm generation process proceeds from the process of step S41 to the process of step S42.
[0065]
In the process of step S42, the CPU 15 follows the music rules defined for the previous note so that the musical note candidates in the next beat number are selected from the automatic music piece processing data 20 so that the notes are not unnaturally connected. (Note candidate) is extracted. Thereby, the process of step S42 is completed, and the rhythm generation process proceeds from the process of step S42 to the process of step S43.
[0066]
In the process of step S43, the CPU 15 generates a random number. Thereby, the process of step S43 is completed, and the rhythm generation process proceeds from the process of step S43 to the process of step S44.
[0067]
In the process of step S44, the CPU 15 determines a note at the next beat number from the extracted note candidates in accordance with the generated random number. Thereby, the process of step S44 is completed, and the rhythm generation process proceeds from the process of step S44 to the process of step S45.
[0068]
In the process of step S45, the CPU 15 determines whether or not the processes of steps S42 to S44 have been executed for the number of beats for a predetermined performance time. Then, as a result of the determination, when the processing of steps S42 to S44 is not executed for the number of beats corresponding to the predetermined performance time, the rhythm generation processing returns from the processing of step S45 to the processing of step S42. On the other hand, when the processing of steps S42 to S44 is executed for the number of beats for a predetermined performance time, the CPU 15 stores the result of the processing in the RAM 24 as rhythm progress data as processing of step S46. Thereby, the process of step S46 is completed and a series of rhythm generation processes is completed.
[0069]
In order to make it possible to generate a more flexible rhythm progression, some established rhythm progression patterns are stored in advance in the automatic music piece processing data 20 for each genre, and the rhythm generation processing is executed. It is desirable that the CPU 15 learns based on the processing result every time.
[0070]
[Melody generation processing]
Next, the melody generation process in step S5 will be described in detail with reference to the flowchart shown in FIG. The flowchart shown in FIG. 7 starts upon completion of the rhythm generation process, and the melody generation process proceeds to the process of step S51.
[0071]
In the process of step S51, the CPU 15 reads the rhythm progression data generated by the rhythm generation process and searches for notes that have not been subjected to the melody generation process. Thereby, the process of step S51 is completed, and the melody generation process proceeds from the process of step S51 to the process of step S52.
[0072]
In the process of step S52, the CPU 15 determines whether or not a note that has not been subjected to the melody generation process has been searched as a result of the search. As a result of the determination, if a note that has not been subjected to the melody generation process is not searched, the melody generation process proceeds from the process of step S52 to the process of step S57. On the other hand, when an unexecuted note of the melody generation process is searched, the melody generation process proceeds from the process of step S52 to the process of step S53.
[0073]
In the process of step S <b> 53, the CPU 15 extracts melody rule candidates applicable to the notes from the automatic music piece processing data 20. Thereby, the process of step S53 is completed, and the melody generation process proceeds from the process of step S53 to the process of step S54.
[0074]
In the process of step S54, the CPU 15 generates a random number. Thereby, the process of step S54 is completed, and the melody generation process proceeds from the process of step S54 to the process of step S55.
[0075]
In the process of step S55, the CPU 15 selects a melody rule from melody rule candidates extracted according to the generated random number, and applies the selected melody rule to the searched note. Thereby, the process of step S55 is completed, and the melody generation process proceeds from the process of step S55 to the process of step S56.
[0076]
In the process of step S56, the CPU 15 generates a melody generation rule according to the genre parameter calculated in the parameter calculation process, and applies the generated melody generation rule to the searched note. Thereby, the process of step S56 is completed, and the melody generation process returns from the process of step S56 to the process of step S51.
[0077]
In the process of step S57, the CPU 15 stores the result of the above process in the RAM 24 as melody progress data. Thereby, the process of step S57 is completed, and a series of melody generation processes is completed.
[0078]
In order to make it possible to generate a more flexible melody progression, several established melody progression patterns are stored in advance in the automatic music piece processing data 20 for each genre, and the melody generation processing is executed. It is desirable that the CPU 15 learns based on the processing result every time.
[0079]
[Effect of the embodiment]
As is clear from the above description, the mobile phone 1 according to an embodiment of the present invention automatically plays music corresponding to the content of the displayed e-mail when the e-mail is displayed on the display unit 2. Thus, the user can enjoy music corresponding to the contents of the e-mail without accessing the server device. Further, according to such a configuration, since music composition and playback processing are all performed on the mobile phone 1, the user can use the automatic music service without paying a communication fee. That is, according to the cellular phone 1, music corresponding to the contents of the e-mail can be composed and reproduced easily and inexpensively without using the server device.
[0080]
In addition, when the user changes the content of the e-mail displayed on the display unit 2 by a scroll operation, the mobile phone 1 according to an embodiment of the present invention composes and reproduces the music corresponding to the change in the content again. Therefore, music corresponding to the content of the displayed e-mail can always be played.
[0081]
In addition, since the mobile phone 1 according to an embodiment of the present invention composes and reproduces music corresponding to the content of the email when the user is browsing the email, the sender of the email can visually In addition, both of the auditory approaches can transmit the will, and conversely, the e-mail recipient can understand the contents of the e-mail with two senses of sight and hearing.
[0082]
Further, in the mobile phone 1 according to an embodiment of the present invention, the user can set and reproduce music (motif melody setting) as disclosed in, for example, Japanese Patent Application Laid-Open No. 2002-32078, It is not necessary to prepare data for composing and playing music, and you can easily use the automatic music service. In addition, since the mobile phone 1 determines a music rule to be applied when composing music according to a random number, it can compose music flexibly according to the contents of an e-mail and compose various music. Is possible.
[0083]
[Other Embodiments]
The configuration and operation of the embodiment to which the invention made by the present inventor is applied have been described above. However, the present invention is not limited by the description and drawings that form part of the disclosure of the present invention according to this embodiment. Absent. For example, the above embodiment is the one in which the present invention is applied to a mobile phone, but the present invention is applied to and implemented in an information processing apparatus having a music playback function such as a personal computer or a PDA (Personal Digital Assistant). be able to. As described above, it is added that other embodiments, examples, operation techniques, and the like made by those skilled in the art based on the above-described embodiments are all included in the scope of the present invention.
[0084]
【The invention's effect】
According to the present invention, music corresponding to the contents of text data can be composed and reproduced easily and inexpensively without using a server device.
[Brief description of the drawings]
FIG. 1 is a schematic diagram showing an external appearance of a mobile phone according to an embodiment of the present invention.
2 is a block diagram showing an internal configuration of the mobile phone shown in FIG. 1. FIG.
FIG. 3 is a flowchart showing a flow of automatic song processing according to an embodiment of the present invention.
4 is a flowchart showing a flow of parameter calculation processing shown in FIG. 3. FIG.
FIG. 5 is a flowchart showing a flow of code generation processing shown in FIG. 3;
FIG. 6 is a flowchart showing a flow of rhythm generation processing shown in FIG. 3;
7 is a flowchart showing a flow of melody generation processing shown in FIG. 3; FIG.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 ... Mobile phone, 2 ... Display part, 3 ... Operation input part, 4 ... Earpiece, 5 ... Mouthpiece, 6 ... Key button, 7 ... Dial, 8 ... Microphone, 9 ... DSP (Digital Signal Processor), 10 DESCRIPTION OF SYMBOLS Transmission part, 11 ... Duplexer, 12, 27 ... Antenna, 13 ... Reception part, 14, 16 ... Speaker, 17 ... Recording part, 18 ... Automatic music program, 19 ... Application program recording part, 20 ... Automatic music processing data , 21 ... Data recording section, 22 ... ROM (Read Only Memory), 23 ... Reproduction program, 24 ... RAM (Random Access Memory), 25 ... Camera section, 26 ... Short-range wireless communication section

Claims (1)

A display for displaying text data;
A number of keywords associated with numerical values that control the light and darkness of music to compose, a numerical value that controls tempo, and a numerical value that controls inflection, data of multiple codes that are used as chord candidates for each measure of music, A storage unit storing data of a plurality of notes used as note candidates for each beat number, and data of a plurality of melody rules used as melody rule candidates applicable to each note of music;
A keyword acquisition unit that analyzes the text data and acquires keywords included in the text data;
While specifying the musical tone, speed, genre, motif, rhythm, melody, accompaniment, and drum progression rules based on the numerical values stored in the storage unit in association with the keyword acquired by the keyword acquisition unit A parameter calculator for calculating parameters for forming a predetermined music rule;
A chord generation processing unit for generating chord progression data;
In accordance with the music rule formed by the parameters calculated by the parameter calculation unit, the note data at each beat number of the music to be composed is extracted from the storage unit, and the rhythm composed of the note data at each beat number A rhythm generation processing unit for generating progress data;
In accordance with the music rule formed by the parameter calculated by the parameter calculation unit, the melody rule data applied to each note of the rhythm progression data generated by the rhythm generation processing unit is extracted from the storage unit, A melody generation processing unit for generating melody progression data composed of data of each melody rule applied to each of the above notes;
A performance data generation processing unit for generating performance data of music to be composed according to the chord progression data by the chord generation processing unit, the rhythm progression data by the rhythm generation processing unit, and the melody progression data by the melody generation processing unit;
A reproduction unit that reproduces and outputs music according to the performance data generated by the performance data generation processing unit in response to the text data being displayed on the display unit ;
An operation unit for scrolling text data displayed on the display unit;
A determination unit that determines whether the content of the text data displayed on the display unit has changed in response to the scrolling of the text data by the operation unit,
When the determination unit determines that the content of the text data displayed on the display unit has changed according to the scrolling of the text data by the operation unit, the text data of the portion whose content has changed according to the scrolling Based on the above-described scrolling, the content is changed according to the scroll by executing the processing of the keyword acquisition unit, parameter calculation unit, chord generation processing unit, rhythm generation processing unit, melody generation processing unit, and performance data generation processing unit. Generate performance data of newly composed music corresponding to the text data of
The portable terminal device , wherein the reproduction unit reproduces and outputs music according to the performance data of the new music .

Images