JP4823977B2 - Electronic device and control method thereof - Google Patents

Description

  The present invention relates to an electronic apparatus capable of reproducing images and audio data by a reproduction program and having a voice reading function, and a control method thereof.

In recent years, mobile communication terminals have become highly functional, and there are an increasing number of devices that can execute a camera function, a music playback function, a video playback function, a television or radio program viewing function, a navigation function, etc. in addition to a call function. Yes.
In particular, mobile communication terminals having a web browser function for obtaining and displaying information by connecting to a network such as the Internet have become common, and web services for mobile communication terminals have been enriched.

As one of web services, there is a method of embedding an image or sound in a web page and reproducing the image or sound when the embedded page is browsed. Since the web browser function does not have a function for reproducing embedded image or audio data, the image or audio data is reproduced using a reproduction program (hereinafter also referred to as a plug-in program).
When a main program reads a subroutine and proceeds with processing, the plug-in is executed by replacing the subroutine with a different processing content (for example, a subroutine of an external program) instead of executing the original subroutine. It is. In other words, the plug-in program includes a program added to the main program. Hereinafter, an external program such as a program that reads and reproduces an image or sound while the web browser program is running is operated in a subroutine, and the function of reproducing the image or sound in the web browser is referred to as plug-in reproduction. .

By the way, there is a voice reading function as a function installed in a mobile communication terminal in recent years. The voice-to-speech function is a function for reproducing, for example, the text of an email or a character string displayed on a web browser as a voice, and by recognizing the character string to be read out, the voice output unit or the like outputs it as voice. Realized.
The speech reading function is disclosed in Patent Document 1, for example.
JP 2006-201977 A

  Patent Document 1 discloses a mobile terminal device that extracts a display object from web information and extracts the display object, a speech reading method thereof, and a speech reading program.

  Here, in the mobile communication terminal having the voice reading function disclosed in Patent Document 1 described above, the plug-in playback function and the voice reading function may be executed by the same processing chip (for example, a voice playback chip). is there. In this case, when a web page having a window for performing plug-in playback (hereinafter referred to as a plug-in playback window) is browsed and simultaneously reading out the speech of the web page, these are simultaneously processed by the same processing chip. Because it is not possible, it is necessary to stop either function.

  For example, it is assumed that the voice reading of the web page is started during the display of the web page including the image data during plug-in playback. In this case, if the voice reading function is set to be prioritized, the image being reproduced is stopped by plug-in reproduction. In general, when the plug-in playback function is stopped during playback, the image displayed in the plug-in playback window is the plug-in playback image at the moment when the plug-in playback is stopped, and after that, until the plug-in playback is resumed, No updates are made.

  Here, when the web page including the plug-in playback window in which the plug-in playback function is stopped is scrolled, the plug-in playback window is scrolled out once, and the plug-in playback window is scrolled in the display screen again. A phenomenon occurs in which the display in the plug-in playback window is disturbed.

FIG. 4 is a diagram for explaining an example of a display when the plug-in playback window that is once scrolled out and the plug-in playback function is stopped is scrolled in again.
FIG. 4A is a diagram for explaining a state where the plug-in playback window is scrolled out. As shown in FIG. 4A, a plug-in playback window 201 is displayed in the web page screen 200. In FIG. 4A, the plug-in playback window 201 is partially out of the frame.
FIG. 4B is a diagram for explaining the result of scrolling from the state shown in FIG. 4A so that the entire plug-in playback window 201 is displayed in the web page screen 200. In FIG. 4B, the plug-in playback window 201 is completely displayed in the web page screen 200.

  Here, in the plug-in playback window 201 shown in FIGS. 4A and 4B, an image at the moment when the plug-in playback is stopped is displayed, but the image is updated by the plug-in playback function. The situation is not. For this reason, when the portion scrolled out in FIG. 4A in the plug-in playback window 201 is scrolled in again as the shaded portion in the plug-in playback window 201 shown in FIG. Since there is no information on the image data to be displayed (because the plug-in playback function is stopped), only the part that was scrolled out in the plug-in playback window is displayed in white, for example. There is a disadvantage that an image to be displayed is not displayed.

  The present invention has been made to solve the above disadvantages, and an object thereof is to provide an electronic device that suitably displays image data for reproduction and a control method thereof.

  In order to solve the above-described problems, an electronic device according to a first aspect of the present invention stores a display unit capable of displaying a screen including a reproduction window for reproducing an image by a reproduction program, and audio data for reading aloud. A voice output unit that reads out a text string that can be read out from the screen displayed on the display unit using the voice data stored in the storage unit, and a control unit The control unit obtains a request for causing the voice output unit to read out a character string in the screen while displaying the screen including the reproduction window on the display unit. In this case, the reproduction of the image by the reproduction program is stopped and a predetermined image is displayed in the reproduction window.

  According to a second aspect of the present invention, there is provided a control method for an electronic device capable of displaying a screen including a reproduction window for reproducing an image by a reproduction program and reading out a character string in the screen. In the control method, when a screen including the playback window is displayed on the display unit and a request to read out a text string in the screen is acquired, the playback program can play back the image. Determining whether or not an image is being executed, stopping the reproduction of an image by the reproduction program when reproduction of the image is being executed by the reproduction program in the step, and And a step of displaying a predetermined image in the reproduction window where reproduction has been stopped.

  ADVANTAGE OF THE INVENTION According to this invention, the electronic device which displays suitably the image data for reproduction | regeneration, and its control method can be provided.

Hereinafter, a portable terminal 100 will be described as an example of the electronic apparatus of the present invention.
The mobile terminal 100 of this embodiment is a mobile phone, for example.
FIG. 1 is a diagram illustrating an example of the configuration of the mobile terminal 100.
As illustrated in FIG. 1, the mobile terminal 100 includes a communication unit 1, a storage unit 2, a display unit 3, an input unit 4, an audio output unit 5, and a control unit 6.

The communication unit 1 is a wireless communication unit that communicates with a public network and transmits / receives data via a base station (not shown in FIG. 1). Examples of data transmitted and received by the communication unit 1 include voice data when the mobile terminal 100 is in a voice call, web page data when web browsing, and the like.
The storage unit 2 is a memory that stores data necessary for various operations of the mobile terminal 100, and includes, for example, an SRAM (Static Random Access Memory). The data stored in the storage unit 2 includes, for example, a program for executing various operations of the mobile terminal 100, and a plug-in program as a playback program of the present invention for executing a plug-in playback function at the time of web browsing to be described later Address book data for voice calls and mail transmission / reception, voice data necessary for executing a voice reading function to be described later, and the like.

The display unit 3 is a display device for performing display related to various operations of the mobile terminal 100, and includes, for example, a liquid crystal display (LCD) or an organic EL (electroluminescence) panel. The display unit 3 performs display by being controlled by a display control unit 61 described later. The display unit 3 is, for example, an outgoing / incoming screen for voice calls, a voice call screen for voice calls, a web browser screen for web browsing, a mail creation screen, a mail reception screen, or the like.
The input unit 4 is an input device that accepts various inputs to the mobile terminal 100, and includes, for example, a cross key, a numeric keypad, and a touch panel.

  The audio output unit 5 is an audio output device for performing various audio outputs of the mobile terminal 100. For example, audio data for audio output is D / A (digital / analog) converted and an analog audio signal is output. Output from the terminal for connecting speakers, headphones and earphones. The audio output unit 5 performs audio output under the control of the audio output control unit 62 described later.

The control unit 6 is a control device for comprehensively controlling various configurations of the mobile terminal 100, and is configured by, for example, a CPU (Central Processing Unit).
The control unit 6 further includes a display control unit 61 and an audio output control unit 62.
The display control unit 61 is a block that performs control for causing the display unit 3 to perform display.
The audio output control unit 62 is a block that performs control for causing the audio output unit 5 to execute audio output.
The control unit 6 controls various configurations of the mobile terminal 100 and can execute the following functions. That is, for example, a voice call function, a mail transmission / reception function, a web browsing function, a voice reading function, and the like.

  When the voice call function is executed, the control unit 6 causes the communication unit 1 to execute transmission processing to the base station (not shown in FIG. 1) or incoming processing from the base station to establish communication with the base station. The voice data acquired via a voice input device such as a microphone is encoded and transmitted to the base station, or the voice data acquired from the base station by the communication unit 1 is decoded and The output control unit 62 causes the audio output unit 5 to reproduce and output.

  When the mail transmission / reception function is executed, the display control unit 61 displays the mail editing screen on the display unit 3, and the mail data (including transmission destination address, title and text data of the body text, attached data, etc.) is input to the control unit 6. Causes the communication unit 1 to transmit. Alternatively, the control unit 6 acquires mail data from the mail server via the communication unit 1, and the display control unit 61 causes the display unit 3 to display the mail data.

  At the time of executing the web browsing function, the control unit 6 executes the web browsing function in accordance with a user input or the like via the input unit 4. At this time, if image / sound data for plug-in reproduction exists in the web page, the display control unit 61 displays a web page including a window for reproducing the image data on the web page on the display unit 3. The audio output control unit 62 causes the audio output unit 5 to output audio data. The plug-in playback data starts to be played at the timing when the web page data including the plug-in playback data is displayed on the mobile terminal 100 of the present embodiment.

When the voice reading function is executed, the control unit 6 acquires the input text (character string) data for voice reading, and the voice output control unit 62 causes the voice output unit 5 to read the text data. The voice data for voice reading is stored in advance in the storage unit 2, for example, as words, idioms, or single notes. The control unit 6 divides the input character string data into parts of speech and phrases, for example, and searches whether there is speech data that matches the divided parts of speech and phrases. The output control unit 62 causes the audio output unit 5 to reproduce and output the audio data, and when there is no suitable audio data, the audio data for each single sound is reproduced and output in combination.
The voice reading function can perform a parallel operation when various functions of the mobile terminal 100 are executed. That is, the contents of the mail received from the mail server during the mail transmission / reception function and displayed on the display unit 3 are read aloud, or the content displayed on the display unit 3 during the web browsing function is executed. Or the like, text data such as a link destination URI (Uniform Resource Identifier), a caption set in advance in image data in the content, or the like can be read aloud.

In particular, when a speech reading function is executed during web browsing, the control unit 6 extracts a character string that can be read aloud in the web page data acquired by the communication unit 1 from the web server, and uses the character string as a part of speech. The audio output control unit 62 reproduces / outputs the audio data to which the audio output control unit 62 conforms by dividing each phrase.
In the portable terminal 100 according to the present embodiment, the voice reading function is set in advance so that voice reading is started after a predetermined time (for example, one second) has elapsed since the target to be read is displayed on the display unit 3. Yes. That is, for example, when reading aloud during web browsing, the voice output control unit 62 causes the voice output unit 5 to start reading aloud, for example, one second after the web page is displayed on the display unit 3.

Next, a case where the control unit 6 simultaneously executes a web browsing function for displaying a web page including data for plug-in reproduction and a speech reading function for the web page will be described.
As described above, in the mobile terminal 100 according to the present embodiment, since the voice reading function can be executed even when other functions are executed, the web browsing function for displaying the web page including the data for plug-in reproduction is displayed. In addition, the control unit 6 may simultaneously execute the function for reading out the web page by voice.
In such a case, playback of the image / sound data for plug-in playback and speech reading are required at the same time for the sound output unit 5, but it is impossible to perform playback / output at the same time. In the portable terminal 100 according to the embodiment, the setting is made so that speech reading is prioritized. Therefore, when the speech reading function of the web page is executed while the web page including the data for plug-in playback is displayed, the playback of the plug-in during playback is stopped and the speech reading function is preferentially executed. Will be.

Hereinafter, an operation example of the mobile terminal 100 when the speech reading function is executed during the display of a web page including data for plug-in reproduction will be described.
FIG. 2 is a flowchart for explaining an operation example of the mobile terminal 100 when the speech reading function is executed while a web page including data for plug-in reproduction is displayed.
Step ST1:
The display control unit 61 causes the display unit 3 to display a web page including a character string that can be read aloud. The half of whether or not the web page to be displayed on the display unit 3 includes a character string that can be read aloud is not limited in the present embodiment. For example, each character string in the web page data is in which language (English, Japanese) If there is a character string written in a language that can be read out aloud, such as English or Japanese, it is determined that there is a character string that can be read out. To do.
Step ST2:
The control unit 6 acquires a speech reading request for the web page displayed in step ST <b> 1 according to an input or the like via the user input unit 4.

Step ST3:
The control unit 6 determines whether or not the plug-in playback data in the web page displayed on the display unit 3 in step ST1 is being played back. If plug-in playback is in progress, the process proceeds to step ST4. If plug-in playback is not in progress, the process proceeds to step ST6.
Step ST4:
The display control unit 61 stops plug-in playback.

Step ST5:
The display control unit 61 displays predetermined image data in the plug-in playback window whose playback has been stopped in step ST4.
The predetermined image data is not particularly limited in the present invention. For example, the image data for plug-in reproduction when plug-in reproduction is stopped in step ST4 or the same color as the background color of the web page displayed in step ST1. The background image that fills the plug-in playback window, or a white-colored image.
Step ST6:
The speech output control unit 62 uses the speech data for speech reading stored in the storage unit 2, reads out a text string that can be read out in the web page, and causes the speech output unit 5 to output it.

Step ST7:
The voice output control unit 62 ends the voice reading started in step ST6. The condition for the voice output control unit 62 to finish reading aloud is, for example, that the voice reading of all the character strings that can be read out aloud in the web page is finished, or the voice is input by the user via the input unit 4 or the like. The stop of reading is required, etc.
Step ST8:
The display control unit 61 resumes the plug-in playback function on the condition that the speech reading function has ended in step ST7, and plays back the data for plug-in playback in the web page.

  As described above, according to the mobile terminal 100 of the present embodiment, when the execution of the speech reading function is requested during the data reproduction for plug-in reproduction, the execution of the speech reading function is started until it ends. Plug-in playback is stopped, and a predetermined image is displayed in the plug-in playback window while the plug-in playback is stopped. Since the predetermined image displayed in the plug-in playback window when the plug-in playback function is stopped by the display control unit 61 is not based on the plug-in playback function, scrolling out of the plug-in playback window when the plug-in playback function is stopped, It is possible to prevent display disturbance in the plug-in playback window that occurs during scroll-in.

In the flowchart described with reference to FIG. 2, an example in which a predetermined image is displayed in the plug-in playback window when execution of the speech reading function is requested and the plug-in playback function is stopped has been described. For example, the following is also possible.
FIG. 3 is a flowchart for explaining another example of the operation of the portable terminal 100 when the speech reading function is executed during the display of the web page including the data for plug-in reproduction.

Step ST11:
The display control unit 61 causes the display unit 3 to display a web page including a character string that can be read aloud.
Step ST12:
The control unit 6 obtains a speech reading request for the web page displayed in step ST <b> 11 according to an input or the like via the user input unit 4.

Step ST13:
The control unit 6 determines whether or not the plug-in playback data in the web page displayed on the display unit 3 in step ST11 is being played back. If the plug-in is being reproduced, the process proceeds to step ST14, and if the plug-in is not being reproduced, the process proceeds to step ST18.
Step ST14:
The display control unit 61 stops plug-in playback.

Step ST15:
The control unit 6 determines whether or not a scroll operation of the web page screen displayed on the display unit 3 is requested by the user via the input unit 4 or the like. If the scroll operation is requested, the process proceeds to step ST16, and if not requested, the process proceeds to step ST17.
Step ST16:
The display control unit 61 determines whether or not the plug-in playback window has been scrolled out of the web page screen by the scroll operation requested in step ST15. If the plug-in playback window scrolls out of the web page screen, the process proceeds to step ST17. If the plug-in playback window does not scroll out, the process proceeds to step ST18.

Step ST17:
The display control unit 61 displays predetermined image data in the plug-in playback window.
Step ST18:
The speech output control unit 62 uses the speech data for speech reading stored in the storage unit 2, reads out a text string that can be read out in the web page, and causes the speech output unit 5 to output it.

Step ST19:
The voice output control unit 62 ends the voice reading started in step ST18.
Step ST20:
The display control unit 61 resumes the plug-in playback function on the condition that the speech reading function is finished in step ST19, and plays back the data for plug-in playback in the web page.

  According to the operation example of the mobile terminal 100 of the present embodiment described with reference to FIG. 3, it is determined whether or not the plug-in playback window has been scrolled out, and a predetermined image is displayed in the plug-in playback window only when scrolling out. Is displayed, the display in the plug-in playback window can be maintained when the plug-in playback window does not scroll out.

  As described above, according to the portable terminal 100 of the present embodiment, when the execution of the speech reading function is requested during the playback of the data for plug-in playback, the display control unit 61 starts executing the speech reading function. The plug-in playback is stopped until it is finished, and a predetermined image is displayed in the plug-in playback window while the plug-in playback is stopped. Since the predetermined image displayed in the plug-in playback window when the plug-in playback function is stopped by the display control unit 61 is not based on the plug-in playback function, scrolling out of the plug-in playback window when the plug-in playback function is stopped, It is possible to prevent display disturbance in the plug-in playback window that occurs during scroll-in.

  Further, according to the mobile terminal 100 of the present embodiment, it is possible to determine whether or not the plug-in playback window has been scrolled out and display a predetermined image in the plug-in playback window only when the plug-in playback window has been scrolled out. Therefore, when the plug-in playback window does not scroll out, the display in the plug-in playback window can be maintained, and the user's uncomfortable feeling due to the change of the image in the plug-in playback window is minimized. be able to.

The present invention is not limited to the embodiment described above.
That is, when implementing the present invention, various modifications, combinations, sub-combinations, and alternatives may be made to the components of the above-described embodiments within the technical scope of the present invention or an equivalent scope thereof.

  In the above-described embodiment, an example in which plug-in playback is stopped during speech reading when the speech-reading function is turned on when a web page including plug-in playback data is displayed has been described. Is not limited. The present invention is applicable even when data including data for plug-in reproduction and including a character string to be read out is displayed. That is, for example, in the mail transmission / reception function, if the read-to-speech function is on when the received mail contains data for plug-in playback, the characters to be read out by the voice-speech function in the mail The plug-in playback may be stopped until the reading out of the column is completed.

  Moreover, although embodiment mentioned above demonstrated the portable terminal 100 as an example of the electronic device of this invention, this invention is not limited to this. That is, the electronic device of the present invention can read out content data including plug-in playback data and a character string portion of the content data by voice other than a mobile terminal such as a mobile phone. The present invention can be applied to all electronic devices having a voice reading function. That is, the present invention can be applied to a desktop PC (Personal Computer) or the like.

FIG. 1 is a diagram illustrating an example of the configuration of the mobile terminal according to the present embodiment. FIG. 2 is a flowchart illustrating an operation example when the web browsing function is activated in the mobile terminal according to the present embodiment. FIG. 3 is a flowchart showing another example of the operation when the web browsing function is activated in the portable terminal of the present embodiment. FIG. 4 is a diagram for explaining an example of a display when the plug-in playback window that is once scrolled out and the plug-in playback function is stopped is scrolled in again.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 ... Portable terminal, 1 ... Communication part, 2 ... Memory | storage part, 3 ... Display part, 4 ... Input part, 5 ... Audio | voice output part, 6 ... Control part, 61 ... Display control part, 62 ... Audio | voice output control part

Claims (4)

A display unit capable of displaying a screen including a reproduction window for reproducing an image by a reproduction program;
A storage unit for storing voice data for voice reading;
Using the voice data stored in the storage unit, a voice output unit that reads out a text string that can be read out from the screen displayed on the display unit;
A control unit;
Have
When the control unit obtains a request for the voice output unit to read out a character string in the screen while displaying the screen including the playback window on the display unit, the playback program The electronic device according to claim 1, wherein the reproduction of the image is stopped and a predetermined image is displayed in the reproduction window. When the control unit obtains a request for the voice output unit to read out a character string in the screen while displaying the screen including the playback window on the display unit, the playback program Determining whether or not there is a request to scroll the display of the screen after stopping the reproduction of the image according to, and displaying the predetermined image in the reproduction window when there is a request to scroll. The electronic device according to claim 1. The control unit determines whether or not the playback window is scrolled out of the screen by the scroll, and displays the predetermined image in the playback window when scrolling out. 2. The electronic device according to 2. An electronic device control method capable of displaying a screen including a reproduction window for reproducing an image by a reproduction program and capable of reading out a character string in the screen.
When displaying a screen including the playback window on the display unit, when obtaining a request to read out a text string in the screen,
Determining whether image reproduction is being executed by the reproduction program;
A step of stopping reproduction of an image by the reproduction program when reproduction of the image is being executed by the reproduction program in the step;
Displaying a predetermined image in a reproduction window in which reproduction of the image is stopped in the step;
A method for controlling an electronic device, comprising:

Images