JP5227819B2 - Movie generator - Google Patents

Description

  It also relates to communication using electronic mail, and particularly relates to a moving image generating apparatus for television having a streaming viewing function.

  In recent years, with the spread of digital broadcasting, television systems having communication functions have been developed along with the spread of computer networks in addition to television and recorder equipment. In the future, it is expected that television systems having communication functions including more advanced video and audio will become widespread.

JP 2003-333568 A

  In general, communication using e-mail is mainly based on text and still images, and it has been pointed out that televisions that are premised on watching movies feel unsatisfactory when displaying simple text and still images. Yes.

  The moving image generating apparatus has a function of converting text and still image e-mails into moving images on a server and delivering them.

  When watching e-mail on a television, communication with less discomfort can be realized.

  Hereinafter, embodiments will be described in detail with reference to the drawings.

FIG. 1 is an example of a system configuration diagram illustrating Embodiment 1 of the embodiment.
FIG. 1 is composed of a transmission side terminal 1, a reception side terminal 2, a network 3, and a moving image generation server 4 including a mail reception 5, a moving image conversion 7 and a streaming transmission 6.

  FIG. 1 shows that when an e-mail (hereinafter referred to as e-mail) is sent from the sending terminal 1 to the receiving terminal 2, the e-mail is received by the e-mail reception 5 of the moving image generation server 7 via the network 3. The content is converted into moving image data by the moving image conversion 7, and the streaming transmission 6 is configured to perform streaming transmission to the receiving side terminal 2 via the network 3.

  As an effect of Embodiment 1 of the embodiment, since a mail composed of character information can generally be received as a moving picture, in the case where the receiving terminal 2 is a television suitable for the purpose of watching a moving picture, a mail based on a moving picture in consideration of the viewing environment Can be transmitted.

FIG. 2 is a block diagram of moving image conversion in the first embodiment.
FIG. 2 is a block diagram showing the internal configuration of the moving image conversion 7 shown in FIG. 1. The moving image conversion 7 includes a character → still image conversion processing unit 8, a still image → moving image conversion processing unit 9, and an audio data storage unit 10.

  2 receives character information from the mail reception 5 in FIG. 1 as an input to the character → still image conversion processing unit 8 and converts the character information into a still image, while selecting the corresponding audio data from the audio data storage unit 10. The streaming data is generated by inputting the still image → moving image conversion process 9 and output to the streaming transmission 6 in FIG. 1.

  As an effect here, in the moving image conversion 7, moving image data for streaming can be generated from the character information of the mail.

FIG. 3 is an example of the operation screen of the transmitting terminal in the first embodiment, and specifically shows the mail creation screen 11 on the mobile phone.
Figure 3 shows an email created with the contents of "abc@xyz.co.jp" as the email address, "Gone Sasada" as the subject, and "How are you? I went on a trip." By pressing the “Send Mail” button, you can send mail.

  FIG. 4 is a flow chart of mail conversion in the first embodiment, and shows a mail conversion processing flow of the character → still image conversion processing unit 8 in FIG.

  FIG. 4 shows mail conversion start 12, DATA part extraction 13, character string analysis 14, character string extraction 15 following “Date:”, character string extraction 16 following “From:”, and characters following “Subject:”. Column extraction 17, body (BODY) character string extraction 18, non-target character string 19, “.” (Period) character detection 20, bitmap creation 21 according to template 1, bitmap creation 22 according to template 2, bit according to template 3 It consists of a map creation 23 and a mail conversion end 24.

  Here, it is described as a processing flow in the case where standard SMTP (Simple Mail Transfer Protocol) is used as the mail.

  FIG. 4 starts from the mail conversion start 12 and extracts the mail body by extracting 13 of the DATA part of the mail, followed by the character string analysis 14, the character string extraction 15 following “Date:”, and “From:”. Character string extraction 16, character string extraction 17 following “Subject:”, body (BODY) character string extraction 18, non-target character string 19, and character detection 20 of “.” (Period) are executed. Bitmap creation 21 is performed according to template 1, bitmap creation 22 is performed according to template 2, and bitmap creation 23 is performed according to template 3, and the end of the DATA portion of the mail is detected by character detection 20 of “.” (Period). Then, the process is terminated at the mail conversion end 24.

  As an effect here, still image data can be generated by creating a bitmap of a character string of a specific element of a mail according to a template by a mail conversion flow.

  FIG. 5 is an example of character-to-still image conversion processing according to the first embodiment. Schematically, a mail (DATA portion) is input, and bitmap creation 21 is performed according to template 1 in FIG. It is the figure which showed the relationship between the bitmap creation 23 according to creation 22 and the template 3, and each template and the obtained bitmap data.

  FIG. 5 shows mail (DATA portion) 25, template 1 26, template 2 27, template 3 28, bitmap data 1 29, bitmap data 2 30 and bitmap data 3 31. It is configured.

  FIG. 5 shows that each element of the input of the mail (DATA portion) 25 is processed by 26 of template 1, 27 of template 2, 28 of template 3, and as an output, 29 of bitmap data 1, It shows that 30 of bitmap data 2 and 31 of bitmap data 3 are obtained.

  As an effect here, by changing the processing contents of the template, it is possible to create bitmaps of arbitrary different formats for the input of the same mail (DATA portion) 25, and flexibly still image data Can be generated.

  In this embodiment, as each element of the template, 26 of the template 1 is “display character font size, display coordinates, number of cut characters, character alignment position”, and template 2 27 is “display character font size, display coordinates. , “Character alignment position” 28 of template 3 includes information on “font size of display character, display coordinates, character alignment position, number of characters per line, number of characters per page”.

  FIG. 6 is a flowchart of audio data selection in the first embodiment, and shows a selection process flow of audio data from the audio data storage unit 10 in the still image → video conversion processing unit 9 in FIG. is there.

6 shows voice data selection start 32, DATA portion extraction 13, character string analysis 14, character string extraction 15 following “Date:”, character detection 33 other than “Date:”, “.”, “.”. (Period) character detection 20, voice data of the corresponding month is selected 34 from the month information of the character string following “Data:”, whether the voice data is selected 35, voice data of the corresponding month from the month information of the current date and time It consists of a selection 36 and an audio data selection end 37.
Here, the month information included in the mail is used as a method for selecting audio data.

  6 starts from the voice data selection start 32 and extracts the mail body by extracting 13 of the DATA part of the mail, analyzing the character string 14, extracting the character string 15 following “Date:”, “Date:”, When the character detection 33 other than “.” And the character detection 20 of “.” (Period) are executed and the character string following “Date:” can be extracted, the corresponding voice data is obtained from the month information therein. The end of the DATA part of the mail is detected by the character detection 20 of “.” (Period), and if the voice data is selected or 35 and no voice data is selected, the month of the current date and time is selected. From the information, the voice data of the corresponding month is executed in the selection 36, and the process is ended in the voice data selection end 37.

  As an effect here, since different audio data is selected according to the month information included in the DATA part of the mail or the month information of the current date and time, the audio data (music) suitable for the season can be selected. it can.

  Also, prepare multiple pieces of audio information for each month, select audio data at random in the relevant month, determine the date of the month, and select a specific date (Christmas, New Year, preset destination person) A processing flow and music data may be prepared so that individual music data is selected in accordance with (birthday).

  FIG. 7 is an example of still image → moving image conversion in the first embodiment. Typically, bitmap data and audio data are input to the still image → moving image conversion processing unit 39 in FIG. It is the figure which showed the relationship from which the obtained streaming data is obtained.

  FIG. 7 shows still image → moving image conversion processing 39, and input data, that is, bitmap data 1 29, bitmap data 2 30, bitmap data 3 31, and input audio, audio data 38. And streaming data 40 as an output.

FIG. 7 shows an input image, that is, 29 of bitmap data 1, 30 of bitmap data 2, and 31 of bitmap data 3 are integer multiples of GOP (Group of Picutres), and the encoding method after conversion Is MPEG and GOP is “IBBPBBPBBPBBPBB” (I: I picture, P: P picture, B: B picture) in units of 15 frames, N1 = 20, N2 = 20, N3 = 20, video frame rate = 30 frames / second , The input video of the still image → video conversion process 39 is
1) Bitmap data 1 29: 300 frames = 10 seconds 2) Bitmap data 2 30: 300 frames = 10 seconds 3) Bitmap data 3 31: 300 frames = 10 seconds, a total of 30 It becomes the image of the second.

  In order to match the length of the video data with the length of the audio data, the audio data 38 cut out so that the length of the audio data is 30 seconds is synchronized with the above 30-second video, and the still image → video conversion processing is performed. When input to 39, moving image data with sound for 30 seconds can be generated as streaming data.

The effect here is that the unit of video conversion of bitmap data, which is a still image, is an integer multiple of GOP, so the video encoding unit and the switching timing of bitmap data can be synchronized, so that Degradation can be minimized.
In addition, natural moving image data can be generated by matching the video period and the length of the audio data.

  FIG. 8 is an example of video / audio output of the receiving terminal in the first embodiment. As a result, the streaming data is input to the receiving terminal 2 in FIG. It is the figure which showed the video output and audio | voice output reproduced by.

  FIG. 8 includes streaming data 40, decoding processing 41, video output 42, and audio output 43.

  FIG. 8 shows the streaming data 40 obtained as the output of FIG. 7 received via the network 3 of FIG. 1. In the decoding process 41, the reverse of the still image → video conversion process 39 of FIG. Thus, the video output 42 and the audio output 43 are obtained.

Here, at the time of MPEG encoding, the GOP is in units of 15 frames, N1 = 20, N2 = 20, N3 = 20, and the video frame rate = 30 frames / second. The video output is
1) Bitmap data 1 29: 300 frames = 10 seconds 2) Bitmap data 2 30: 300 frames = 10 seconds 3) Bitmap data 3 31: 300 frames = 10 seconds, a total of 30 It becomes the image of the second. (However, since MPEG video is lossy encoding, it does not completely match the original bitmap data)
A 30-second audio data 38 obtained by matching the video period and the length of the audio data is obtained as an audio output. (However, since MPEG audio is lossy encoding, it does not completely match the original audio data)
FIG. 9 is an internal block diagram of the receiving terminal in the first embodiment.
FIG. 9 shows a video / audio decoding unit 60 composed of a display driver 57, scaling process 56, video decoding process 55, audio driver 59, audio decoding process 58, AV packet separation process 54, speaker 62, and display panel 61. The audio decoding output part, the network processing 51 connected to the network 50, the tuner processing 52 connected to the antenna 49, the output of the network processing 51 and the output of the tuner processing 52 are controlled by the program control of the CPU 46, the program ROM 47, and the RAM 48. It comprises an input switching process 53 for selective output, a remote controller 44 for user operations, and a remote controller process 45.

  In FIG. 9, generally, the TV viewing operation is performed by the user operating the remote control 44 and receiving it by the remote control processing 45, and the control software operating on the CPU 46, the program ROM 47 and the RAM 48 performs tuning control on the tuner processing 52, By selecting a signal from the tuner process 52 as an output of the input switching process 53 and controlling the video / audio decoding unit 60, a television broadcast is output to the speaker 62 and the display panel 61.

  Similarly, in the streaming viewing operation, the user operates the remote controller 44, receives it by the remote control processing 45, and the control software operating on the CPU 46, the program ROM 47, and the RAM 48 performs the network processing 51 via the network 50. Requests data from the above streaming server, receives the obtained streaming data by the network processing 51, selects a signal from the network processing 51 as an output of the input switching processing 53, and controls the video / audio decoding unit 60 As a result, the television broadcast is output to the speaker 62 and the display panel 61.

  FIG. 10 is an example of the operation screen of the transmission side terminal in the second embodiment, and specifically shows the mail creation screen 63 on the mobile phone.

  Fig. 10 shows the contents of "abc@xyz.co.jp" as the email address, "Nothing" as the subject, "20080402.jpg" as the attachment, and "I went on a trip. Then, you can create a mail and send it by pressing the “Send Mail” button.

FIG. 11 is a flowchart of mail conversion in the second embodiment.
FIG. 3 is a diagram showing a mail conversion processing flow of a character → still image conversion processing unit 8 in FIG. 2.

  FIG. 11 shows mail conversion start 12, DATA part extraction 13, character string analysis 14, character string extraction 15 following “Date:”, character string extraction 16 following “From:”, characters following “Subject:” Column extraction 17, body (BODY) character string extraction 18, non-target character string 19, “.” (Period) character detection 20, bitmap creation 21 according to template 1, bitmap creation 22 according to template 2, bit according to template 3 A map creation 23, whether there is an attached photo 64, a bitmap creation 65 according to the template 4, and a mail conversion end 24 are configured.

  Here, it is described as a processing flow in the case where standard SMTP (Simple Mail Transfer Protocol) is used as the mail.

  FIG. 11 starts from the mail conversion start 12 and extracts the mail body by extracting 13 of the DATA part of the mail, followed by the character string analysis 14, the character string extraction 15 following “Date:”, and “From:”. Character string extraction 16, character string extraction 17 following “Subject:”, body (BODY) character string extraction 18, non-target character string 19, and character detection 20 of “.” (Period) are executed. Bitmap creation 21 is performed according to template 1, bitmap creation 22 is performed according to template 2, and bitmap creation 23 is performed according to template 3, and the end of the DATA portion of the mail is detected by character detection 20 of “.” (Period). Then, the presence / absence of an attached photo is determined based on 64 whether there is an attached photo. Running up the creation 65, which is constituted so that the process ends with the mail conversion ends 24.

As an effect here, by creating a bitmap of a character string of a specific element of an email according to a template by the flow of email conversion, it is possible to generate still image data and when there is an attached photo in the email By making a photo into a bitmap according to a template, it becomes possible to maintain consistency with a bitmap of a character string.

  FIG. 12 is an example of a character → still image conversion process in the second embodiment. Schematically, template 1 in FIG. 11 is input by inputting mail (DATA portion) and mail (attached photo: 20080401.jpg). 7 is a diagram showing the relationship between the respective bitmaps and the obtained bitmap data, according to the bitmap creation 21, the bitmap creation 22 according to the template 2, the bitmap creation 23 according to the template 3, the bitmap creation 65 according to the template 4.

  FIG. 12 shows mail (DATA portion) 66, mail (attached photo: 20080401.jpg) 67, template 1 26, template 2 27, template 3 28, template 4 68, bitmap data 1 29, It is composed of 30 of bitmap data 2, 69 of bitmap data 3, and 70 of bitmap data 4.

  In FIG. 12, each element of input of mail (DATA portion) 66 and mail (attached photo: 20080401.jpg) 67 is represented by 26 of template 1, 27 of template 2, 28 of template 3, and 68 of template 4. As a result of the processing, 29 of bitmap data 1, 30 of bitmap data 2, 69 of bitmap data 3, and 70 of bitmap data 4 are obtained as outputs. .

  As an effect here, by changing the processing content of the template, it is possible to create bitmaps of different arbitrary formats even for the input of the same mail (DATA portion) 66, and flexibly still image data As for the mail (attached photo: 20080401.jpg) 67, an arbitrary bitmap according to the template can be created.

  In this embodiment, as elements of the template, 26 of template 1 is “font size of display character, display coordinates, number of cut characters, character alignment position, presence / absence of use of wallpaper data”, and 27 of template 2 is “display Character font size, display coordinates, character alignment position, presence / absence of use of wallpaper data ”, 28 of template 3,“ display character font size, display coordinates, character alignment position, number of characters per line, number of characters per page “68 of template 4 includes information on“ number of display pixels after image conversion by scaling execution ”.

  FIG. 13 is a flowchart of audio data selection in the second embodiment, and shows a selection process flow of audio data from the audio data storage unit 10 in the still image → video conversion processing unit 9 in FIG. is there.

FIG. 13 shows audio data selection start 32, whether there is an attached photo 64, whether there is date / time information 71, selection of audio data of the corresponding month from the month information of the attached photo 72, extraction of DATA portion 13, analysis of character string 14 Applicable from character extraction 15 following “Date:”, character detection 33 other than “Date:” and “.”, Character detection 20 of “.” (Period), and month information of character string following “Data:” The voice data is selected 34, whether the voice data is selected 35, the voice data of the corresponding month is selected 36 based on the month information of the current date and time, and the voice data selection end 37 is configured.
Here, the audio data selection method is based on the month information of the photo attached to the email or the month information included in the email.

  FIG. 13 starts from the audio data selection start 32 and determines whether there is an attached photo by 64. If there is date information from 71, if date information can be taken from the photo, the month information of the attached photo When the voice data is executed in the selection 72 and there is no attached photo or date information cannot be obtained from the attached photo, the mail body is extracted by extracting 13 of the DATA part of the email, the character string analysis 14, and “ Character string extraction 15 following “Date:”, character detection 33 other than “Date:” and “.”, And character detection 20 of “.” (Period) were executed, and the character string extraction following “Date:” was completed. In such a case, the corresponding voice data is selected from the month information in it, the end of the DATA portion of the mail is detected by the character detection 20 of “.” (Period), and the voice data is selected. In the case where voice data is not selected, in which the current running month information from the selected audio data for the month 36 date, and configured to terminate the processing by the audio data selection end 37.

  The effect here is that if there is an attached photo in the email and the date information of that photo can be obtained, priority is given to that date, and if there is no attached photo or the date information of the attached photo cannot be obtained, Since different audio data is selected according to the month information included in the DATA portion or the month information of the current date and time, it is possible to preferentially select audio data (music) suitable for the season in which the photograph was taken.

  Also, prepare multiple audio data by month, select audio data at random in the corresponding month, determine the date of the month, and select a specific date (Christmas, New Year, preset destination person) A processing flow and music data may be prepared so that individual music data is selected in accordance with (birthday).

  FIG. 14 is an example of still image → moving image conversion in the second embodiment, and schematically, bitmap data and audio data are input to the still image → moving image conversion processing unit 39 in FIG. It is the figure which showed the relationship from which the obtained streaming data is obtained.

  FIG. 14 shows still image → moving image conversion processing 39 and input images, that is, bitmap data 1 29, bitmap data 2 30, bitmap data 3 69, bitmap data 4 70, It consists of audio data 73 as input audio and streaming data 74 as output.

FIG. 14 shows input images 29 of bitmap data 1, 30 of bitmap data 2, 69 of bitmap data 3, and 70 of bitmap data 4 which are integer multiples of GOP (Group of Picutres). Assuming that the converted encoding method is MPEG, the GOP is “IBBPBBPBBPBBPBB” (I: I picture, P: P picture, B: B picture) in units of 15 frames, N1 = 20, N2 = 20, N3 = 20, When N4 = 40 and video frame rate = 30 frames / second, the input video of the still image → video conversion process 39 is
1) Bitmap data 1 29: 300 frames = 10 seconds 2) Bitmap data 2 30: 300 frames = 10 seconds 3) Bitmap data 3 69: 300 frames = 10 seconds 4) Bitmap data Data 4: 70: 600 frames = 20 seconds, and a total of 50 seconds of video.

  In order to match the length of the video data with the length of the audio data, the audio data 73 cut out so that the length of the audio data is 50 seconds is synchronized with the above 50-second video, and the still image → video conversion process If it inputs to 39, the moving image data with an audio | voice for 50 seconds can be produced | generated as streaming data.

The effect here is that the unit of video conversion of bitmap data, which is a still image, is an integer multiple of GOP, so the video encoding unit and the switching timing of bitmap data can be synchronized, so that Degradation can be minimized.
In addition, natural moving image data can be generated by matching the video period and the length of the audio data.
In addition, if there is an attached photo in the mail, the image of the photo can be automatically converted to a moving image.

  FIG. 15 is an example of the video / audio output of the receiving terminal in the second embodiment. As a result, the streaming data is input to the receiving terminal 2 in FIG. It is the figure which showed the video output and audio | voice output reproduced by.

  FIG. 15 includes streaming data 74, decoding processing 41, video output 75, and audio output 76.

  FIG. 15 shows the streaming data 74 obtained as the output of FIG. 14 received via the network 3 of FIG. 1. In the decoding process 41, the reverse of the still image → moving picture conversion process 39 of FIG. Thus, the video output 75 and the audio output 76 are obtained.

Here, at the time of MPEG encoding, the GOP is in units of 15 frames, N1 = 20, N2 = 20, N3 = 20, N4 = 40, and the video frame rate = 30 frames / second. The resulting video output is
1) Bitmap data 1 29: 300 frames = 10 seconds 2) Bitmap data 2 30: 300 frames = 10 seconds 3) Bitmap data 3 69: 300 frames = 10 seconds 4) Bitmap data Data 3: 70: 600 frames = 20 seconds, and a total of 50 seconds of video. (However, since MPEG video is lossy encoding, it does not completely match the original bitmap data)
Audio data 76 of 50 seconds obtained by matching the video period and the length of the audio data is obtained as an audio output. (However, since MPEG audio is lossy encoding, it does not completely match the original audio data)
FIG. 16 is a system configuration diagram showing Embodiment 3 of the embodiment.
FIG. 16 includes a transmission side terminal 1, a reception side terminal 2, a network 3, and a moving image generation server 77 including a mail reception 5, a moving image conversion 7, a streaming transmission 78, and a mail transmission 79.

  FIG. 16 shows that when an e-mail (hereinafter referred to as e-mail) is sent from the sending terminal 1 to the receiving terminal 2, the e-mail is received by the e-mail reception 5 of the moving image generation server 7 via the network 3. The content is converted into moving image data by the moving image conversion 7, the mail transmission 79 is controlled from the streaming transmission 78, and mail transmission and streaming transmission are performed via the network 3 to the receiving side terminal 2. .

  As an effect of Embodiment 3 of the present embodiment, a mail composed of character information can be generally received as a moving image. Therefore, when the receiving terminal 2 is a television suitable for the purpose of watching a moving image, a mail based on a moving image considering the viewing environment However, by having a mail transmission function, it is possible to realize a function of notifying that the streaming transmission is ready.

FIG. 17 is an example of the character → still image conversion process in the third embodiment, and schematically shows an example of the contents of the mail transmission 79 in FIG. 16 with mail (DATA portion) as an input.
FIG. 17 includes a mail (DATA portion) 66, a mail (attached photo: 20080401.jpg) 67, and a mail (information notification) 80.

  In FIG. 17, information other than date information in each element of the input of the mail (DATA portion) 66 is defined in advance as a standard format. In the mail (information notification) 80, “video mail has arrived”. "Is only notified to the receiving terminal.

  As an effect here, by generating the mail (information notification) 80, it is possible to actively notify the receiving side terminal that “the moving image mail has arrived”.

FIG. 18 is a block diagram of moving image conversion in the fourth embodiment.
FIG. 18 is a block diagram showing the internal configuration of the moving image conversion 81 corresponding to the moving image conversion shown in FIG. 1. The moving image conversion 81 includes characters → still image conversion processing unit 8, still image → moving image conversion processing unit 82, and wallpaper data storage unit 83. ing.

  18 receives character information from the mail reception 5 of FIG. 1 as an input to the character → still image conversion processing unit 82 and converts the character information into a still image, while selecting the corresponding wallpaper data from the wallpaper data storage unit 83. Then, by inputting to the still image → moving image conversion processing 82, streaming data is generated and output to the streaming transmission 6 of FIG.

  As an effect here, when generating moving image data for streaming from mail text information in the moving image conversion 81, it is necessary to temporarily convert the character information into a still image, but wallpaper data is used as the background of the still image. Can be added.

  FIG. 19 is a flowchart of wallpaper data selection in the fourth embodiment, and shows a selection process flow of audio data from the wallpaper data storage unit 83 in the still image → moving image conversion processing unit 82 in FIG. is there.

  FIG. 19 shows the start of wallpaper data selection 84, whether there is an attached photo 64, whether there is date / time information 71, selection of wallpaper data for the month from the month information of the attached photo 85, extraction of the DATA portion 13, analysis of the character string 14 Applicable from character extraction 15 following “Date:”, character detection 33 other than “Date:” and “.”, Character detection 20 of “.” (Period), and month information of character string following “Data:” This comprises the selection of wallpaper data for the month 86, whether the wallpaper data is selected 87, the selection of the wallpaper data for the relevant month 88 from the month information of the current date and time, and the end of the wallpaper data selection 89.

  Here, the wallpaper data selection method is based on the month information of the photo attached to the email or the month information included in the email.

  FIG. 19 starts from wallpaper data selection start 32 and determines whether there is an attached photo by 64. If there is date information from 71, if date information can be taken from the photo, the month information of the attached photo shows the corresponding month. When the wallpaper data is selected 85 and there is no attached photo or date information cannot be obtained from the attached photo, the mail body is extracted by extracting 13 of the DATA part of the email, the character string analysis 14, and “ Character string extraction 15 following “Date:”, character detection 33 other than “Date:” and “.”, And character detection 20 of “.” (Period) were executed, and the character string extraction following “Date:” was completed. In such a case, the corresponding wallpaper data is selected from the month information, the end of the DATA portion of the mail is detected by the character detection 20 of “.” (Period), and the wallpaper data is selected. In the case where picture data is not selected, in which the current running wallpaper data for the month than the moon date and time information on the selected 88, and configured to terminate the processing with picture data selection end 89.

  The effect here is that if there is an attached photo in the email and the date information of that photo can be obtained, priority is given to that date, and if there is no attached photo or the date information of the attached photo cannot be obtained, Since different wallpaper data is selected according to the month information included in the DATA portion or the month information of the current date and time, it is possible to preferentially select wallpaper data suitable for the season in which the photograph was taken.

  Also, prepare several wallpaper data for each month, select wallpaper data at random in the corresponding month, determine the date of the month, and select a specific day (Christmas, New Year, preset destination person A processing flow or wallpaper data may be prepared so that individual wallpaper data is selected in accordance with (birthday).

  Furthermore, since the audio data selection according to FIGS. 2 and 6 and the wallpaper data selection according to FIGS. 18 and 19 can be performed independently, both the audio data selection and the wallpaper data selection are performed. Even if both functions are implemented, there is no problem.

  In the embodiment shown in FIGS. 2 and 6, voice data is prepared in advance, and an example in which the voice data is selected is shown. However, as a method of converting a mail sentence itself into voice data using a character-to-speech conversion function. good.

  3 and 10 have been described with respect to mail creation on a mobile phone as an example. However, since these mail creation functions are extremely common, if a personal computer or a dedicated device has a mail function, the same is true. Can be processed.

  7 and 14, in the embodiment, the switching of bitmap data has been described assuming that the bitmap data is simply switched. However, switching with movement may be performed by morphing, wiping, or the like.

  In template 4 68 of FIG. 12, “scaling of attached photo” is performed. However, scaling is not performed, and an image is cut out from the attached photo according to a pixel, or the coordinates of image cutting are smoothly changed. Thus, panning may be performed to generate a pseudo moving image from one still image.

1 is an example of a system configuration diagram illustrating a first embodiment. 3 is an example of a block diagram of moving image conversion in Embodiment 1. FIG. 3 is an example of an operation screen of a transmission side terminal in the first embodiment. 3 is an example of a flowchart of mail conversion in Embodiment 1. FIG. 4 is an example of a character → still image conversion process in the first embodiment. FIG. 4 is an example of a flowchart of audio data selection in the first embodiment. 4 is an example of still image → moving image conversion in the first embodiment. 4 is an example of video / audio output of a receiving terminal according to the first embodiment. 3 is an example of an internal block diagram of a receiving side terminal according to Embodiment 1. FIG. 10 is an operation screen example of a transmission side terminal in the second embodiment. FIG. 10 is an example of a flowchart of mail conversion in the second embodiment. It is an example of the character-> still image conversion process in Embodiment 2. FIG. 10 is an example of a flowchart of audio data selection in the second embodiment. 10 is an example of still image → moving image conversion in the second embodiment. 6 is an example of video / audio output of a receiving terminal according to the second embodiment. 10 is an example of a system configuration diagram illustrating Embodiment 3. FIG. 14 is an example of a transmission mail in the third embodiment. FIG. 10 is an example of a block diagram of moving image conversion in the fourth embodiment. FIG. 16 is an example of a flowchart of wallpaper data selection in the fourth embodiment.

DESCRIPTION OF SYMBOLS 1 Sending side terminal 2 Receiving side terminal 3 Network 4 Movie generation server 5 Mail reception 6 Streaming transmission 7 Movie conversion 8 Character → Still image conversion processing unit 9 Still image → Movie conversion processing unit 10 Audio data storage unit 11 Mail creation screen 12 Mail Start of conversion 13 DATA part extraction 14 Character string analysis 15 Character string extraction following “Date:” 16 Character string extraction following “From:” 17 Character string extraction following “Subject:” 18 Body (BODY) character string extraction 19 Excluded character string 20 Character detection of “.” (Period) 21 Bitmap creation according to template 1 22 Bitmap creation according to template 2 Bitmap creation according to template 3 24 Mail conversion end 25 Mail (DATA portion)
26 Template 1
27 Template 2
28 Template 3
29 Bitmap data 1
30 Bitmap data 2
31 Bitmap data 3
32 Voice data selection start 33 Character detection other than “Date:”, “.” 34 Select voice data of the month from the month information of the character string following “Date:” 35 Whether voice data is selected 36 Current date and time 36 Select audio data for the month from month information 37 Audio data selection end 38 Audio data 39 Still image → video conversion process 40 Streaming data 41 Decode process 42 Video output 43 Audio output 44 Remote control 45 Remote control process 46 CPU
47 Program ROM
48 RAM
49 antenna 50 network 51 network processing 52 tuner processing 53 input switching processing 54 AV packet separation processing 55 video decoding processing 56 scaling processing 57 display driver 58 audio decoding processing 59 audio driver 60 video / audio decoding section 61 display panel 62 speaker 63 mail creation Screen 64 Is there an attached photo? 65 Create bitmap according to template 4 66 Mail (DATA part)
67 E-mail (Attached photo: 20080401.jpg)
68 Template 4
69 Bitmap data 4
70 Bitmap data 5
71 Is there date / time information? 72 Selects audio data for the month from the month information of the attached photo 73 Audio data 74 Streaming data 75 Video output 76 Audio output 77 Video generation server 78 Streaming transmission 79 Mail transmission 80 Mail (information notification)
81 Video conversion 82 Still image → video conversion processing 83 Wallpaper data storage unit 84 Wallpaper data selection start 85 Select wallpaper data for the month from the month information of the attached photo 86 Select the month of the month from the month information of the character string following “Date:” Select wallpaper data 87 Is wallpaper data selected? 88 Select wallpaper data for the month from the current month information 89 End of wallpaper data selection

Claims (3)

In a moving image generating apparatus having a mail receiving unit, a streaming transmitting unit, and a moving image converting unit that performs character string analysis, extraction, and conversion function processing,
The mail receiving unit receives mail from a sending terminal via a network,
The moving image conversion unit stores a plurality of wallpaper data in advance, receives mail character string information from the mail receiving unit, and from the received character string information, characters corresponding to a specific keyword related to a mail date Extracting a column , selecting one of the plurality of wallpaper data according to the date information of the extracted character string , converting the extracted character string into an image, and converting the converted image into the selected wallpaper Convert to video information including data , output to the streaming transmitter,
The streaming transmission unit, along with receiving the video information from the video converting section, via the network, with respect to the streaming request from the receiving terminal, to stream the video information, it moving image generating apparatus according to claim . The moving image conversion unit according to claim 1, wherein a plurality of audio data is stored in advance, a character string corresponding to a specific keyword related to a date of mail received from the mail receiving unit is extracted, and the extracted character selects one of the plurality of audio data according to the date information of the column, movies converted, including the selection audio data, that the moving image generating apparatus according to claim.   In a moving image generating apparatus having a mail receiving unit, a streaming transmitting unit, and a moving image converting unit that performs character string analysis, extraction, and conversion function processing,
  The mail receiving unit receives mail from a sending terminal via a network,
  The moving image conversion unit stores a plurality of audio data in advance, receives mail character string information from the mail reception unit, and from the received character string information, characters corresponding to a specific keyword related to a mail date Extracting a string, selecting one of the plurality of audio data according to the extracted date information of the character string, converting the extracted character string into an image, and converting the converted image into the selected audio Convert to video information including data, output to the streaming transmitter,
  The streaming generation unit receives moving image information from the moving image conversion unit, and performs streaming distribution of the moving image information in response to a streaming request from a receiving terminal via the network. .

Images