JP5458697B2 - Information processing device - Google Patents

Description

  The present invention relates to an information processing apparatus, and more particularly to three-dimensional graphic processing.

  A process for displaying an image obtained by drawing of a three-dimensional graphic process on a display unit is known, and is used for, for example, displaying a game screen or a standby screen of a mobile communication device. 3D graphic processing is described using APIs such as OpenGiel (registered trademark, OpenGL) and DirectX (registered trademark, DIRECTX), and the implementation of the API is performed using a general-purpose computer (CPU). Depending on the operating software, dedicated hardware (three-dimensional graphics acceleration chip) may be used. In any case, if the same API is used, the same image can be obtained in principle.

  When hardware is used, high-speed processing is possible and high-definition drawing can be performed in a short time, but more power is consumed. Therefore, for each type of job, any one of processing by software, processing by hardware, and processing regardless of software or hardware is set and consumed when multiple jobs are executed simultaneously. Processing for improving processing performance by efficiently using software and hardware while managing power is known (for example, see Patent Document 1).

JP 2006-173843 A (4th, 7th, 12th pages, FIGS. 15 and 16)

  However, in the method disclosed in Patent Document 1 described above, when 3D graphic processing can be performed regardless of software or hardware, a criterion for determining which processing is appropriate is not clear. There was a problem.

  The present invention has been made to solve the above-described problems, and an object thereof is to provide an information processing apparatus that performs three-dimensional graphic processing using one of software and hardware.

  In order to achieve the above object, an information processing apparatus of the present invention includes an input unit, a display unit that displays an image, and a first drawing that draws and displays the image obtained by the drawing on the display unit And a second drawing means that draws and displays an image obtained by the drawing on the display means, consumes less power for drawing than the first drawing means, and is slower in drawing speed And application means for executing content including a drawing instruction, and when the application means starts executing the content, the drawing instruction included in the content is executed by the first drawing means, or the first A drawing means selection means for selecting whether the drawing means is to be executed. When specified by input from the input means, the drawing instruction is executed by the first drawing means, and / or when the content is specified without input from the input means, the drawing instruction Is executed by the second drawing means.

  According to the present invention, three-dimensional graphic processing can be performed using appropriate one of software and hardware.

The block diagram which shows the structure of the mobile communication apparatus which concerns on embodiment of this invention. The figure which shows the 1st example of the attribute information of the application content which concerns on embodiment of this invention. The figure which shows the 2nd example of the attribute information of the application content which concerns on embodiment of this invention. The figure which shows the 3rd example of the attribute information of the application content which concerns on embodiment of this invention. 7 is a flowchart of a control operation for selecting which of software and hardware performs 3D drawing of the 3D drawing engine switching function according to the embodiment of the present invention. The 1st table | surface for selecting whether software or hardware performs three-dimensional drawing of the three-dimensional drawing engine switching function which concerns on embodiment of this invention. The 2nd table | surface for selecting whether software or hardware performs 3D drawing of the 3D drawing engine switching function which concerns on embodiment of this invention. The 3rd table | surface for selecting whether software or hardware performs 3D drawing of the 3D drawing engine switching function which concerns on embodiment of this invention. The 4th table | surface for selecting which of software and hardware performs 3D drawing of the 3D drawing engine switching function which concerns on embodiment of this invention.

  Hereinafter, an embodiment of a mobile communication apparatus to which an information processing apparatus according to an embodiment of the present invention is applied will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration of a mobile communication apparatus according to an embodiment of the present invention. This mobile communication device includes a control unit 11 that controls the entire device, an antenna 12a that transmits and receives radio waves to and from a base station (not shown) of the mobile communication network, a communication unit 12b, and a transmission / reception unit 13 The speaker 14a used for receiving, the microphone 14b used for transmitting, the calling unit 14c, the display unit 15, the input unit 16, the standby screen processing unit 21, the game processing unit 22, and a three-dimensional accelerator. And a power supply unit 41.

  As a function related to the present invention realized by operating a program using a CPU, the control unit 11 includes a three-dimensional drawing engine switching function 11-1, a three-dimensional drawing engine library 11-2, and chip usage 3. Dimension drawing engine library 11-3. The content storage unit 24 stores application content including a 3D drawing instruction described by the 3D drawing API. This application content is described in Java (registered trademark, JAVA), for example.

  The operation of each part of the mobile communication apparatus configured as described above according to the embodiment of the present invention will be described with reference to FIG.

  The 3D rendering engine switching function 11-1 is described in the content when the processing unit that executes the application content (the standby screen processing unit 21 and the game processing unit 22, as will be described later) executes the application content. The processed 3D drawing API is executed by either the 3D drawing engine library 11-2 or the chip-based 3D drawing engine library 11-3, and an image obtained by the drawing is displayed on the display unit 15. Display. Which is to be performed is determined by the content or the like. When the chip-based 3D rendering engine library 11-3 performs the processing, power is supplied to the 3D acceleration chip 23.

  The three-dimensional drawing API includes a definition of a three-dimensional object, an instruction to move the object, an instruction to rotate the object, and the like. The definition of an object includes the resolution of the object.

  The three-dimensional drawing engine library 11-2 is a library of programs that execute processing of the three-dimensional drawing API using a computer (CPU). The chip-based 3D rendering engine library 11-3 is a program library for performing at least a part of the processing of the 3D rendering API using the 3D acceleration chip 23.

  Since the same 3D drawing is performed when one application content is executed by the 3D drawing engine library 11-2 and when it is executed by the chip-using 3D drawing engine library 11-3, the same image is obtained. Is displayed on the display unit 15, but is not limited thereto. For example, when there is a difference in the three-dimensional drawing API processed by both, the application content using the API related to this difference operates only by either one.

  The 3D rendering engine library 11-2 lowers the resolution of the 3D object given via the 3D rendering API, increases the minimum movement amount and minimum rotation angle during movement and rotation, The number of drawing operations performed per unit time may be reduced. By doing so, although the image quality is inferior, drawing can be performed at a higher speed, for example, at the same speed as in the case of using the chip-based three-dimensional drawing engine library 11-3. In addition, power consumption can be reduced.

  The communication unit 12b outputs the high-frequency signal received by the antenna 12a to the transmission / reception unit 13, and transmits the high-frequency signal output from the transmission / reception unit 13 from the antenna 12a.

  The transmission / reception unit 13 amplifies, frequency-converts and demodulates the high-frequency signal from the communication unit 12b, and sends a digital voice signal obtained thereby to the call unit 14c and a control signal to the control unit 11. Furthermore, the digital voice signal output from the communication unit 14c and the control signal output from the control unit 11 are modulated, frequency converted and amplified to obtain a high frequency signal, which is sent to the communication unit 12b.

  The call unit 14c converts the digital audio signal output from the transmission / reception unit 13 into an analog audio signal, amplifies it, and sends it to the speaker 14a. The analog audio signal output from the microphone 14 b is amplified, converted into a digital audio signal, and transmitted to the transmission / reception unit 13.

  The display unit 15 is a backlit LCD that is used to display an operation prompting the user, display the contents operated by the user, display the operation state of the apparatus, and the like, and is controlled by the control unit 11. Thus, an image including a cursor and characters / numbers is displayed, and the displayed data is switched by an input operation from the input unit 16 or an instruction from the control unit 11.

  The input unit 16 designates a telephone number of a communication partner, and a plurality of keys including a numeric key for inputting hiragana characters, alphabetic characters and symbol characters by a toggle type input method, a cursor movement key, and a scroll key. It consists of keys including function keys. When the key of the input unit 16 is pressed, the identifier of the key is notified to the control unit 11.

  The standby screen processing unit 21 is turned on according to the operation of the user of the device (in this embodiment, the call unit 14c, the game processing unit 22, and the short-range wireless). When the display unit 15 is not displaying the communication unit 31.), the control unit 11 activates the application content stored in the content storage unit 24 to perform drawing, and the drawn image is awaited. It is displayed on the display unit 15 as a screen. Thus, the standby screen processing unit 21 does not operate according to a direct operation instruction from the user of the apparatus.

  The game processing unit 22 interactively executes one of the application contents stored in the content storage unit 24 that is selected according to a predetermined key operation of the input unit 16. That is, drawing is performed according to the key operation of the input unit 16 and the drawn image is displayed on the display unit 15.

  The three-dimensional acceleration chip 23 is hardware that performs drawing by three-dimensional graphic processing in accordance with instructions from the chip-using three-dimensional drawing engine library 11-3.

  The short-range wireless communication unit 31 performs communication using a Bluetooth (registered trademark, Bluetooth) method. This communication is used, for example, for a telephone call via a hands-free device (not shown). Note that the short-range wireless communication unit 31 may perform communication using infrared rays. This communication is used for transmission / reception of an address book (not shown), for example.

  The power supply unit 41 includes a storage battery, and supplies power from the storage battery to each unit of the apparatus according to the control of the control unit 11. Further, when a charger (not shown) is connected, the storage battery is appropriately charged with electric power supplied from the charger. Note that the power supply unit 41 may include a primary battery instead of the storage battery.

  Next, application content stored in the content storage unit 24 will be described. This content includes, for example, a program including a description of a three-dimensional drawing API by JAVA (R) and attribute information. The execution of application content is execution of a program included in the application content.

  The attribute information of this content will be described. 2 to 4 show examples of content attribute information. The attribute information of this content is associated with a name (MIDlet-Name) 24a, a designated three-dimensional drawing (MIDxlet-3dRender) 24b, a designated screen size (MIDxlet-ScreenSize) 24c, and a designated activation (MIDxlet-Resident) 24d. Information.

  The name 24a is a name for identifying application content. The designated three-dimensional drawing 24b indicates a resource used when executing the application content, that is, whether it is software or hardware, and is “SW”, “HW”, or “ANY”. The value is stored, the value is not stored, or the designated 3D drawing 24b is not included in the content attribute information. Hereinafter, the fact that the value is not stored includes that the designated three-dimensional drawing 24b is not included in the content attribute information.

  When “SW” is stored, it indicates that the execution is performed by the three-dimensional drawing engine library 11-2, the drawing load is small, and an operation with low power consumption is assumed. In addition, when “HW” is stored, it indicates that execution is performed by the chip-based 3D rendering engine library 11-3, and it is assumed that the rendering load is large and high-definition rendering is performed in a short time. ing.

  When “ANY” is stored, execution may be performed by either the 3D rendering engine library 11-2 or the chip-based 3D rendering engine library 11-3. It shows that it is entrusted to 11-1. If no value is stored, this embodiment assumes that “HW” is stored. However, the present invention is not limited to this, and it may be considered that “ANY” is stored.

  The designated screen size 24c is the size of a display screen that displays an image obtained by executing a drawing instruction included in the application content, that is, assumed by the application content, that is, the number of displayable pixels. The application content program includes a drawing instruction using a parameter suitable for display at the size of the display screen indicated by the designated screen size 24c, for example, the resolution of the object. Here, the execution of a program suitable for display on a large display screen requires a lot of processing and consumes a lot of power.

  The designated activation 24d is an activation method assumed by the application content, and stores a value of “resident” or “normal”. When “resident” is stored, it indicates that the apparatus is activated according to a predetermined setting, and is not activated by a direct operation of the user of the apparatus, and therefore operation with low power consumption is assumed. When “NORMAL” is stored, it indicates that it is started in accordance with the operation of the input unit 16 and is started by a direct operation of the user of the apparatus, so that an image that gives a particularly good impression to the user should be displayed. It is assumed that high-definition drawing is performed in a short time.

  Here, what kind of application content includes the attribute information of the contents shown in FIGS. 2 to 4 will be described. The content attribute information shown in FIG. 2 includes a designated three-dimensional drawing 24b “SW” and a designated activation 24d “resident”, and is included in an application content that is activated according to a predetermined setting and has a small drawing load. It is what This content is mainly executed and displayed by the standby screen processing unit 21.

  The content attribute information shown in FIG. 3 includes a designated three-dimensional drawing 24b “HW” and a designated activation 24d “normal”, and is included in application content that is activated in accordance with the operation of the input unit 16 and has a large rendering load. It is what This content is mainly a game executed by the game processing unit 22.

  The content attribute information shown in FIG. 4 includes a designated three-dimensional drawing 24b “ANY”, the drawing load is medium, and even if executed by the three-dimensional drawing engine library 11-2, the chip-based three-dimensional drawing engine Even if executed by the library 11-3, it is included in the application content for creating an appropriate image. Here, depending on which is executed, there may be a difference in, for example, the fineness of the rendered image.

  Next, referring to the flowchart shown in FIG. 5, when executing the application content in the mobile communication device having the above configuration, the 3D rendering engine switching function 11-1 uses the 3D rendering API described in the content. A control operation for selecting which of the three-dimensional drawing engine library 11-2 and the chip-using three-dimensional drawing engine library 11-3 to perform processing will be described.

  The 3D rendering engine switching function 11-1 starts a control operation when the execution of application content is started (step S11-1a). First, the specified 3D content attribute information of the application content to be executed is started. Which one is selected is determined by the drawing 24b (step S11-1b).

  When the designated 3D drawing 24b is “SW”, the 3D drawing engine switching function 11-1 determines that the application content is to be executed by the 3D drawing engine library 11-2 (step S11-1c). The selected control operation is terminated (step S11-1d). On the other hand, if it is “HW” or no value is stored, the 3D rendering engine switching function 11-1 determines that the application content is to be executed by the chip-based 3D rendering engine library 11-3. (Step S11-1e), the control operation to be selected is terminated (Step S11-1d). These decisions are valid until the end of execution of the application content.

  If the designated 3D rendering 24b is “ANY” in step S11-1b, the 3D rendering engine switching function 11-1 includes content attribute information other than the designated 3D rendering 24b of the application content to be executed, It is determined whether or not it is appropriate to use the three-dimensional acceleration chip 23 according to the state of the device not related to the application content (step S11-1f), and it is determined that it is appropriate not to use the three-dimensional acceleration chip 23. If it is determined that the application content is to be executed by the 3D rendering engine library 11-2 (step S11-1c), the selected control operation is terminated (step S11-1d).

  On the other hand, when it is determined that it is appropriate to use the three-dimensional acceleration chip 23, the three-dimensional rendering engine switching function 11-1 determines that the application content is executed by the chip-using three-dimensional rendering engine library 11-3. (Step S11-1e) and the control operation to be selected is terminated (Step S11-1d).

  Details of the determination in step S11-1f will be described. The 3D rendering engine switching function 11-1 makes a determination based on any one of the following determination criteria or a plurality of combinations of the following determination criteria.

  The first criterion is that when the designated start 24d of the application content to be executed is “normal”, it is determined that it is appropriate to use the three-dimensional acceleration chip 23. Judge that it is appropriate not to. If the application content is designated by a predetermined key operation of the input unit 16 without referring to the designated activation 24d, it is determined that it is appropriate to use the three-dimensional acceleration chip 23. You may decide that it is not appropriate.

  The second criterion is that the power source unit 41 is inquired about the state of the storage battery, and when the storage battery stores a power amount equal to or greater than a predetermined threshold, and when the storage battery is being charged, the three-dimensional acceleration chip 23 is used. In other cases, i.e., when the storage battery does not store an amount of power equal to or higher than a predetermined threshold, and when the storage battery is not being charged, it is determined that it is appropriate not to use it. .

  The third criterion is that when the processing unit with high power consumption, that is, the short-range wireless communication unit 31 is not in operation, it is determined that it is appropriate to use the three-dimensional acceleration chip 23. Judge that it is appropriate not to use.

  The fourth criterion is to compare the designated screen size 24c of the application content to be executed with the size of the display screen of the display unit 15, that is, the number of displayable pixels. When the quotient obtained by dividing the latter by the former is equal to or less than a predetermined threshold, it is determined that it is appropriate to use the three-dimensional acceleration chip 23. When the quotient exceeds the predetermined threshold, it is determined that it is not appropriate to use the three-dimensional acceleration chip 23.

  Here, the number of pixels on the display screen is usually two, the number of pixels in the vertical direction and the number of pixels in the horizontal direction, but the ratio is almost the same, so the quotient is calculated with the number of pixels in either direction. To do. Alternatively, the quotient is calculated with the number of pixels in each direction, and the average of the two quotients is calculated. The predetermined threshold is a positive number of 1 or more.

  According to this criterion, when an image drawn on a display screen larger than that assumed by the application content is displayed, fine display is impossible, so even if the three-dimensional acceleration chip 23 is used. As a result of not being able to obtain a fine display effect, an effect of avoiding unnecessary power consumption can be obtained.

  In the above description, the determination based on the specified three-dimensional drawing 24b in step S11-1b, the content attribute information other than the specified three-dimensional drawing 24b in step S11-1f, and the state of the device not related to the application content. However, the present invention is not limited to this. In particular, in step S11-1f, when any one of the determination criteria is used, the above two determinations can be regarded as a single determination with reference to a table.

  FIG. 6 shows a table used for the above determination when the first determination criterion is used in step S11-1f. The horizontal direction of the table indicates the value stored in the designated three-dimensional drawing 24b, while the vertical direction indicates the value stored in the designated activation 24d. “Use” in the table indicates that the 3D acceleration chip 23 is used, that is, it is determined that the chip use 3D rendering engine library 11-3 is used, and “Not used” indicates 3D acceleration chip. 23 is not used, that is, it is determined to be based on the three-dimensional drawing engine library 11-2.

  FIGS. 7 to 9 show tables used for the above determination in the case of the second to fourth determination criteria in step S11-1f, respectively, and the description of the same as FIG. 6 described above is omitted. In FIG. 7, the vertical direction of the table indicates the state of the storage battery in the power supply unit 41. In FIG. 8, the vertical direction of the table indicates whether or not the short-range wireless communication unit 31 is operating. In FIG. 9, the vertical direction of the table indicates the size of the display screen of the display unit 15.

  Although the above description has been made taking an example in which the present invention is applied to a mobile communication device, the present invention is not limited to this. The present invention can naturally be applied to any information processing apparatus including a personal computer. The present invention is not limited to the above configuration, and various modifications are possible.

DESCRIPTION OF SYMBOLS 11 Control part 11-1 Three-dimensional drawing engine switching function 11-2 Three-dimensional drawing engine library 11-3 Chip utilization three-dimensional drawing engine library 15 Display part 16 Input part 21 Standby screen process part 22 Game process part 23 Three-dimensional accelerator Configuration chip 24 content storage unit 24a name 24b specified three-dimensional drawing 24c specified screen size 24d specified activation 31 short-range wireless communication unit 41 power supply unit

Claims (3)

Input means;
Display means for displaying an image;
First drawing means for drawing and causing the display means to display an image obtained by the drawing;
Drawing, displaying an image obtained by the drawing on the display unit, a second drawing unit that consumes less power for drawing than the first drawing unit, and has a lower drawing speed;
Application means for executing content including drawing instructions;
Drawing means selection for selecting whether the first drawing means or the second drawing means executes a drawing instruction included in the content when the application means starts executing the content Means,
The drawing means selection means causes the first drawing means to execute the drawing instruction when the content to be executed by the application means is designated by the input from the input means, and / or the content is An information processing apparatus that causes the second drawing unit to execute the drawing instruction when a designation is made without input from the input unit. Whether or not the content is specified by input from the input means as attribute information of the content;
The drawing means selecting means further causes the first drawing means to execute the drawing instruction and / or the content when the content includes attribute information indicating that the content is designated by an input from the input means. 2. The information processing apparatus according to claim 1, wherein the second rendering unit is caused to execute the rendering instruction when the attribute information is not specified by an input from the input unit. The first drawing means uses drawing hardware for at least a part of drawing,
The second drawing means, the information processing apparatus according to claim 1 or 2, characterized in that drawn by a program utilized in the computer.

Images