JP5140950B2 - Operation screen generation method, operation screen generation device, electronic device, program - Google Patents

Description

  The present invention is a user interface of a method in which an operation of an electronic device is instructed by operating a graphical operation component (Control Widget) such as an icon or a window displayed on a screen by using a pointing device such as a mouse. The present invention relates to a method and apparatus for generating a graphical user interface screen (GUI) and a program for generating a GUI.

  For example, as an instruction method when operating various electronic devices such as a printer device, a facsimile device, a copying device, or a multi-function device having these functions in combination, or a computer device, In particular, a keyboard method for operating the device by a keyboard, a CUI method (Character Based User Interface) for operating the device by a command, and a GUI method for operating an operation component displayed on the screen by using a pointing device. There is.

  In the GUI method, it is necessary to operate an operation component (also referred to as a GUI component) while looking at icons, cursors, menu items, and the like, and at the same time, drawing processing (graphics processing) is involved. Although the response of the device tends to be slow compared, the operation menu is displayed as a picture, so it has the advantage that it is easy for beginners to understand and quick to learn the operation method, and is adopted by many electronic devices today. It is a method.

  Here, it becomes a problem how to construct an operation screen according to the GUI method, and various mechanisms have been proposed (see, for example, Patent Documents 1 to 3).

JP 2004-38733 A Japanese Patent Application Laid-Open No. 08-045446 Japanese Patent Laid-Open No. 10-091412

  For example, in the design stage, in the display operation keys for operating the device according to the connection configuration of various devices constituting the device and the combination configuration of a plurality of devices determined uniquely such as optional devices to be added as necessary. An arrangement of switches and buttons (also referred to as operation key arrangement) or a menu screen may be uniquely determined.

  However, it may be necessary to change (customize) the created GUI from the viewpoint of ease of use or the like when the installation environment of the optional device is changed. For example, the guideline (1194.22 Web-based intranet and internet information and applications.) Stipulated in the US Rehabilitation Law Article 508, which was enforced on June 20, 2001, requires a GUI that is easy to see for low vision people. From the pursuit of ease of use, attention has been focused on a function for customizing the GUI for each individual.

  However, with the conventional mechanism, it is difficult to respond flexibly to this kind of change on the user side, and in fact, the equipment provider side (design side) must redesign the GUI again. However, it requires a large amount of design cost, man-hours, and equipment cost. That is, it is a burden on the device provider side to change the software for generating the GUI in order to customize the GUI.

  For example, in the mechanism described in Patent Document 1, since it is necessary to associate a predefined command with a GUI component such as an operation button for operating a digital photo printer, an operation button after the change is required when the GUI is changed. Therefore, it is necessary to perform a process for associating each of the defined commands with each of them, and a program design for that is required.

  In the mechanism described in Patent Document 2, it is necessary to interpose a communication mechanism when associating a command with a GUI component. In this case, the same communication protocol (an example of a control command system) is required for operating the communication mechanism, and this point needs to be taken into consideration when changing the GUI component. If a GUI component that uses the communication protocol A is changed to a GUI component that uses another communication protocol B, it becomes necessary to tamper with the command-side communication protocol used by the apparatus.

  On the other hand, in order not to tamper with the communication protocol on the command side used by the apparatus side, it is necessary to use the same communication protocol for various GUI components. In other words, a general-purpose communication protocol must be used as a solution technique.

  However, in practice, each GUI component provided by the GUI library generally uses a unique communication protocol at the request of the provider of the GUI component. Using is not realistic.

  Further, the mechanism described in Patent Document 3 discloses a mechanism for automatically generating a processing code by selecting an optimal GUI component from the use of an operation menu item. However, this mechanism is applied to a GUI construction apparatus used on the design side and involves a development act, and it is difficult to respond to changing the GUI on the user side.

  On the other hand, as one solution for dealing with a change in GUI, it is conceivable to design a GUI of a type that only corresponds to the assumed combination of devices and the needs of each user. However, when an unexpected combination or request arises, it is necessary to redesign the user interface or manufacture a new user interface device. That is, it is difficult to flexibly and easily cope with unexpected things.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a mechanism that can flexibly or easily cope with a GUI change request.

  In the mechanism according to the present invention, firstly, information on operation parts contributing to the configuration of the graphical user interface, each type of operation menu item for operating the electronic device, and each type of operation part constituting the graphical user interface, Is registered in a predetermined storage medium.

  Then, the screen configuration definition information is defined based on the screen configuration definition information that defines the screen configuration of the graphical user interface, and the operation menu definition information that associates the operation components that configure the graphical user interface with the operation menu items that operate the electronic device. For each attached operation menu item, the relay component that associates the operation component that matches the type of the operation menu item was identified, and the operation component and the operation menu item that were defined in the screen configuration definition information were identified. Use relay parts to relate.

  Note that screen configuration definition information and operation menu definition information may be entered interactively, but in order to achieve more efficient processing, definition information that defines the screen configuration of the graphical user interface is described in advance. Prepare the menu item definition file that describes the operation menu definition information that associates the operation configuration items that configure the graphical user interface and the operation menu items that operate the electronic device. Each definition information should be specified from the file contents.

  After associating operation parts with operation menu items via relay parts, each operation part is placed at a predetermined position according to the screen configuration definition file, as in the general graphical user interface generation process. A graphical user interface may be determined by assigning a function to a component and adding a character (functional character) indicating the function information.

  The mechanism according to the present invention can be realized by software using an electronic computer (computer), and a program for this purpose and a recording medium storing this program can also be extracted as an invention. The program may be provided by being stored in a computer-readable storage medium, or may be provided by distribution via wired or wireless communication means.

  According to the present invention, when information on relay components that associate each type of operation component and each type of operation menu item is registered in advance in a storage medium, and a graphical user interface is created according to screen configuration definition information, Since the association between the operation component defined in the screen configuration definition information and the operation menu item is performed using the adapter component prepared in advance so as to associate the both, It is not necessary for the device provider to intervene in program creation or program change, and the user can freely create a graphical user interface without changing the logic part of the program.

  If the created graphical user interface is to be changed, only the screen configuration definition information needs to be rewritten, and only the user can flexibly cope with the screen configuration change.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

<Circuit configuration example of electronic equipment>
FIG. 1 is a diagram illustrating an example of a system architecture of a circuit configuration in an image output terminal which is an example of an electronic device. It should be noted that the illustrated image output terminal shows a form in the case where it is used as a digital copying apparatus or a multifunction peripheral.

  In the present embodiment, an image output terminal having various functions (composite functions) such as a printer, a copier, or a FAX apparatus is taken as an example of an electronic apparatus in which an operation screen generating apparatus for creating a graphical user interface is incorporated. However, the present invention is not limited to this, and any printer, copier, FAX device, mobile phone, digital camera, personal computer, CD (compact disc) recorder, DVD recorder, MD recorder, etc. Good.

  Here, the image output terminal 7 of the present embodiment is not limited to a part of various functional units configured by a hardware processing circuit, and is similar to an electronic computer (computer) based on a program code that realizes the function. It is configured to be realized as software using the above mechanism.

  By adopting a mechanism for executing predetermined processing (especially information access management in the present embodiment) by software, it is possible to have a configuration in which some of the functional elements configured by the hardware processing circuit are removed, and hardware It is possible to enjoy the advantage that the processing procedure and the like can be easily changed without changing the wear. On the other hand, it is possible to construct an accelerator system with a higher speed by using a hardware processing circuit. Even if the processing is complicated, the accelerator system can prevent a reduction in processing speed and can obtain a high throughput.

  When various functions are executed by software using a mechanism similar to that of an electronic computer, a program (such as an embedded microcomputer) in which a program constituting the software is incorporated in dedicated hardware or a CPU (Central Processing) Unit), logic circuit, ROM (Read Only Memory) as a read-only memory, RAM (Random Access Memory) as an example of a volatile memory that can be written and read at any time, or nonvolatile memory SOC (System On a Chip) that implements a desired system by mounting functions such as a storage device such as a RAM (described as NVRAM) that is an example of a unit on one chip, or It is possible to execute various functions by installing various programs. Is installed.

  The recording medium causes a state change of energy such as magnetism, light, electricity, etc. according to the description contents of the program to the reading device provided in the hardware resource of the computer, and in the form of a signal corresponding to the change. The program description can be transmitted to the reader.

  For example, a magnetic disk (including a flexible disk FD), an optical disk (CD-ROM (Compact Disc-Read Only Memory)), a DVD on which a program is recorded, which is distributed to provide a program to a user separately from a computer. (Including Digital Versatile Disc), magneto-optical disc (including MD (Mini Disc)), or package media (portable storage media) made of semiconductor memory, etc. It may be configured by a ROM, a hard disk, or the like in which a program is recorded, which is provided to the user in a state of being recorded.

  The program constituting the software is not limited to being provided via a recording medium, and may be provided via a wired or wireless communication network.

  For example, a storage medium storing software program codes for realizing various functions is supplied to a system or apparatus, and a computer (or CPU or MPU) of the system or apparatus reads and executes the program code stored in the storage medium. Even in this case, the same effect as that of the hardware processing circuit can be achieved. In this case, the program code itself read from the storage medium realizes various functions.

  Further, not only various functions are realized by executing the program code read by the computer, but an OS (Operating Systems; basic software) running on the computer based on the instruction of the program code performs actual processing. It may be a case where some or all of the above are performed and various functions are realized by the processing.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. The CPU or the like provided in the card or the function expansion unit may perform a part or all of the actual processing, and various functions may be realized by the processing.

  The program is provided as a file in which program codes for realizing various functions are described. In this case, the program is not limited to being provided as a batch program file, but depending on the hardware configuration of the system configured by the computer. May be provided as individual program modules.

  For example, on the processing board (not limited to one) of the image output terminal 7 of the present embodiment configured as a computer system, a controller unit 100 that is an example of an operation control unit is first arranged. The controller unit 100 includes a CPU (processor) 110, a memory bridge unit (Memory Bridge) 120, which is an example of a central processing unit, and a volatile storage medium or a nonvolatile storage medium that retains stored contents only when power is supplied. A main memory (main storage unit) 130 is provided.

  Although not shown, the controller unit 100 incorporates (installs) a non-volatile storage medium (NVRAM) in which an operating system OS and application software for controlling each functional part related to image formation or peripheral devices are installed (installed). Is provided.

  In the above, the “volatile storage medium” means a storage medium in which the stored contents are lost when the power of the apparatus is turned off. On the other hand, the “nonvolatile storage medium” means a storage medium in a form that keeps stored contents even when the main power of the apparatus is turned off. Any memory device can be used as long as it can retain the stored contents. The semiconductor memory device itself is not limited to a nonvolatile memory device, and a backup power supply is provided to make a volatile memory device “nonvolatile”. You may comprise as follows.

  Note that the present invention is not limited to a semiconductor memory element, and can be used as a pseudo-nonvolatile storage medium by using a medium such as a magnetic disk or an optical disk. In addition, it can be used as a nonvolatile storage medium by adopting a configuration for reading information from a recording medium such as a CD-ROM.

  The CPU 110 is a main controller that executes operation control and data processing of the entire image output terminal 7, and executes various programs under the control of the operating system OS.

  The main memory 130 is a volatile semiconductor memory such as a RAM (random access memory) for loading a program executed by the CPU 110 and using it as a work area. When the program code and data cannot be stored in the main memory 130, the virtual memory system and the file system can be exchanged (swapping) with an auxiliary storage device such as a hard disk device (HDD) 54 by the cooperative operation of the file system. It is supposed to be done.

  The memory bridge unit 120 incorporates a memory controller that controls input / output of data between the CPU 110 and the main memory 130 in cooperation with the CPU 110. The main memory 130 is connected to the CPU 110 via the memory bridge unit 120. Data is transferred between the CPU 110 and the main memory 130 in units of a predetermined byte block by a DMA (Direct Memory Access) operation.

  The controller unit 100 also includes an I / O bridge unit (Input / Output Bridge) 140 and a switch unit 150 that is an example of a switching unit that switches a communication interface with a peripheral device. The I / O bridge unit 140 incorporates an I / O (input / output) controller that functions in cooperation with the CPU 110. Various add-on boards (driver boards) 250 in which an input / output interface driver that takes an interface with peripheral devices is incorporated are additionally connected (add-on) to the switch unit 150.

  For example, a LAN board 252 taking an interface with a gigabit LAN and a 1394 board 254 taking an interface with an IEEE 1394 standard device can be connected to the switch unit 150. The input / output interface driver incorporated in the switch unit 150 is connected to each add-on board 250 (such as the LAN board 252 or the 1394 board 254) interposed between peripheral devices in a one-to-one (Peer to Peer) manner. Configured to do.

  It should be noted that the I / O bridge unit 140 is directly connected to the USB board 256 that interfaces with the USB (Universal Serial Bus) 2.0 standard device 3g without going through the switch unit 150. It has become. The LAN board 252 and the 1394 board 254 may be connected without going through the switch unit 150. In this case, the I / O bridge unit 140 is provided with a mechanism for peer-to-peer connection with the LAN board 252 or the like.

  The controller unit 100 includes a hard disk device 54 although it is not arranged on the processing substrate. The hard disk device 54 is connected to the I / O bridge unit 140 according to the “Serial ATA” standard, which is an example of a hard disk interface. In this embodiment, the “Serial ATA” standard includes “Serial ATA II”, which is a higher standard of the standard “Serial ATA 1.0”, or a further higher standard that will be standardized in the future.

  The I / O bridge unit 140 is directly connected to a user interface device including the operation panel 14 and the operation keys 16. The controller unit 100 may optionally be provided with a graphics driver unit (Graphics) 160, which is an example of a user interface driver, as indicated by a dotted line in the figure. In this case, the user interface device 15 having a large user interface or a maintenance screen is connected to the memory bridge unit 120 via the graphics driver unit 160.

  The I / O bridge unit 140 is an image capturing unit that obtains digital image data by optically scanning an image with a scanner device (not shown) as a functional part constituting the image output terminal 7 that functions as a multifunction peripheral or the like. (Image Input Terminal) 210 and an image processing unit that performs predetermined image processing on digital image data acquired by the image capturing unit 210 or digital image data obtained from a LAN (Local Area Network) or other peripheral device ( An image processing system (220) and an image output unit (image output terminal) 230 for forming an image on a predetermined recording medium based on digital image data subjected to predetermined image processing by the image processing unit 220 are connected.

  On the electrical signal transmission line between the connections, image data input / output to / from the image forming function unit 202 such as the image capturing unit 210, the image processing unit 220, and the image recording unit 230, and the controller unit 100 includes the image forming function unit. A control command for controlling the operation of 202 is commonly placed.

  In addition, a recording media reading unit (memory reader) for reading a semiconductor memory such as a flash memory, a recording media writing unit using a CD-R or CD-RW as a recording medium, or another image recording unit is expanded. The unit 240 may be connected to the I / O bridge unit 140.

  An electric circuit of a functional part (device) related to image formation such as the image capturing unit 210, the image processing unit 220, or the image recording unit 230 is different from a printed circuit board (motherboard) on which the electric circuit of the controller unit 100 is mounted. It is detachably mounted on the motherboard on another printed circuit board (module board).

  The module boards on which the electrical circuits of these devices are mounted are physically connected and distributed via a cable, away from the motherboard on which the electrical circuit of the controller unit 100 is mounted. Alternatively, the module board may be mounted and connected on the mother board via an on-board type board connector.

  Note that an image forming function unit (device), which is a functional part related to image formation, such as the image capturing unit 210, the image processing unit 220, or the image recording unit 230 is a board used to configure the image forming apparatus. It may be provided as a level (module board), or may be provided as a functional unit in which this module board is housed in a housing. The module substrate and the functional unit are collectively referred to as a functional module.

  The image output terminal 7 as an example of the image forming apparatus having such a configuration includes an image forming function unit 202 such as an image capturing unit 210, a driver circuit 204 for peripheral devices, or a main body of the image output terminal 7 such as a user interface device. Information (UI configuration J4) related to a user interface function included in a peripheral device that can be attached to and detached from the device, and arrangement of operation keys (an example of operation components) based on the acquired UI configuration J4 A user interface that controls the functions of the device by determining the function assignment and building a display menu to be presented to the user and displaying it on a predetermined display device, and accepting user instructions based on the presented display menu and operation keys A control unit 190 is provided. That is, the controller unit 100 which is an example of the operation control unit is configured to also serve as the user interface control unit 190.

  In response to this, each image forming function unit receives a request from the user interface control unit 190 on the main body side, and notifies a device configuration J0 including a power supply configuration J1 and a UI configuration J4. Is also provided. For example, a non-volatile memory is provided in the device system control unit, and a predetermined storage unit (configuration register) of this memory is information indicating the attribute of each connected device in relation to the image forming apparatus. A device configuration (system information unique to the connected device) J0 indicating whether or not the connected device can operate properly is recorded.

  For example, when the connected device is a scanner (image capturing unit 210), the reading resolution, effective image size, determination result calculation time for various document detection functions, process speed, scanning start command to actual data transmission Detailed operation specifications for each model such as time are recorded.

  In addition, in the device configuration (system information) J0, a power supply configuration J1 that is information on the power consumption (either a rated value or a maximum value) of the connected device is also recorded. When the power consumption of the connected device differs depending on the operation state of the connected device, the device configuration J0 for each operation state is recorded. Furthermore, UI configuration J4, which is information related to a user interface function provided in the peripheral device, is also recorded in the device configuration (system information) J0.

  The user interface control unit 190 acquires a device configuration J0 indicating the device attribute from each connected device, and refers to the UI configuration J4 included in the device configuration J0 according to the function of each device. By presenting a user interface (such as operation keys and a display menu), an efficient user interface is constructed even in a configuration in which a plurality of devices are arbitrarily combined.

  In the UI configuration J4, information related to user interface keys (buttons) and display menus necessary for the functions provided in the device is associated with each function.

  In addition, the user interface control unit 190 according to the present embodiment accepts a desired condition for satisfying the user's convenience by changing or adding a module of control software for controlling each device or changing a defined operation screen. It also has functions.

  For example, the user interface control unit 190 may connect a connection device that is not connected to the I / O bridge unit 140 via the I / O bridge unit 140 from a connection device that is connected to the I / O bridge unit 140, for example. The device configuration J0 of each connected device is acquired through the memory bridge unit 120.

  Further, the user interface control unit 190 also displays, for example, screen data of a display menu when presenting a user interface screen (such as an operation key or a display menu) corresponding to each device based on the device configuration J0 of each connected device. Sends to display devices and accepts user instructions.

  In the image output terminal 7 which is an example of the image forming apparatus, the controller unit 100 includes hardware parts such as a copying function and a printing function, for example, between devices such as the image capturing unit 210, the image processing unit 220, or the image recording unit 230. With regard to the interconnection of the image data input / output system, each device is controlled so as to continuously manage a large amount of data flowing between the devices at the same time and to perform functions such as a copying machine.

  Note that a user interface driver 162 indicated by a dotted line in the drawing may be arranged between the user interface device including the operation panel 14 and the operation keys 16 and the I / O bridge unit 140.

  The controller unit 100 (specifically, the I / O bridge unit 140) and each device such as the image capturing unit 210, the image processing unit 220, or the image recording unit 230 are connected in accordance with a predetermined connection interface, By attaching each device such as the image capturing unit 210 to the apparatus (specifically, the I / O bridge unit 140), the controller unit 100 acquires basic information of each device, and performs a desired setting (for example, a device driver). Set).

  As described above, if the image forming apparatus is substantially one computer and the controller unit incorporates an operating system OS and application software for controlling each functional part or peripheral device related to image formation, a functional module Can improve general versatility, applicability, expandability, or share resources.

  In addition, from these facts, it is easy for a device manufacturer and easy to use for a user. For example, in order to improve performance, increase functionality, or speed by changing function module versions or combinations of function modules, simply change the application software installed in the controller unit according to those changes. Thus, the function module after the change can be appropriately controlled and used.

  Even if the version is upgraded or the combination of the function modules is changed, the connection configuration of the function modules with respect to the controller unit does not change. Therefore, it is easy to update the application software in accordance with the changes.

  On the other hand, since each function module and peripheral device can be arbitrarily replaced and mounted, the unique user interface cannot sufficiently use the functions provided by each device. For example, in a configuration in which a plurality of devices are arbitrarily combined, depending on the combination of devices, it is necessary to determine an appropriate user interface for the entire apparatus in relation to other connected devices.

  In addition, the unique operation screen constructed at the design stage is not convenient for a certain user, and the user may want to change the operation screen according to the user's desire.

  Therefore, for this countermeasure, as shown in FIG. 1, the image output terminal 7 of the present embodiment acquires the UI configuration J4 related to the user interface function included in the peripheral device from each peripheral device, and the connected device A user interface control unit 190 that determines a user interface corresponding to the provided function is provided. Hereinafter, functions of the user interface control unit 190 will be described in detail.

<User interface control system>
FIG. 2 is a diagram illustrating a configuration example of the user interface control unit 190. As shown in FIG. 2, the user interface control unit 190 includes a UI function information acquisition unit 192 that acquires a UI configuration J4 related to a user interface (User Interface) function from each connected device, and various types of definition information that contributes to GUI generation. Definition information storage unit 194 to be stored, definition file reading unit for reading definition files describing various types of definition information related to generation of operation screens, and other definition files describing various types of information stored in the definition information storage unit 194 195.

  The definition information storage unit 194 is a storage area for storing information (screen component part information; GUI part information G2) of all GUI parts (basic display patterns) necessary for all possible combinations of devices. Widget Class Repository) and adapter component (also referred to as adapter object or relay component) definition information (adapter) that associates each type of operation menu item for operating an electronic device with each type of operation component constituting the GUI A storage area (Adapter Class Repository) for storing information G3) is prepared.

  The GUI component information G2 and adapter information G3 are registered in the definition information storage unit 194 in advance on the device provider side. Further, as described later, the GUI part information G2 and the adapter information G3 can be registered later.

  When associating an operation menu item with a GUI component, if the control command system for the GUI component is different from the control command system for the operation menu item, the adapter component also manages the conversion of the control command system. Thereby, even when trying to change from a GUI part using the control instruction system A to a GUI part using another control instruction system B, the GUI part and the operation menu can be used without any inconvenience by interposing the adapter part. Can be associated with an item.

Definition file reading unit 195, a graphical user interface (GUI) screens and configuration file F1 that describes Teigizukeru screen configuration definition information G0 screen configuration of used associated with the operation part and the operation menu item constituting the GUI operation The menu item definition file F2 describing the menu definition information G1 is also read. Of course, the screen configuration definition file F1 and the menu item definition file F2 can be updated as appropriate.

  The screen configuration definition file F1 describes the types of GUI components constituting the GUI and the relationship between the GUI components with identifiers. In the menu item definition file F2, for example, operation menu definition information G1 that defines the type and structure of an operation menu item (data object) such as an enumeration type, an integer type, or a character string type such as a date type is stored. Describe.

  The definition file reading unit 195 also associates (associates) the GUI library, which is an example of a definition file describing the GUI part information G2 stored in the definition information storage part 194, and the operation menu definition information G1 and the GUI part information G2. For example, an adapter library as an example of a definition file describing adapter component information (adapter information G3). The GUI part information G2 and the adapter information G3 are both software parts.

  Under the control of the CPU 110, the UI function information acquisition unit 192 is an image forming function unit 202 such as an image capturing unit 210, an image processing unit 220, and an image recording unit 230, a peripheral device driver circuit 204, or a user interface device. Each connection device such as 14, 15, 16 and the like can be arbitrarily attached to and detached from the main body of the image output terminal 7 by using a connection interface between these connection devices and the I / O bridge unit 140 or the memory bridge unit 120. Device configuration J0 (in this case, UI configuration J4 in particular) is acquired.

  Further, the user interface control unit 190 determines a user interface corresponding to an operation mode corresponding to the combination of connected devices and the function of each connected device, and uses a GUI component stored in the definition information storage unit 194, An operation screen generation unit 196 that generates an operation screen having a software key (software switch) reflecting the determined user interface and presents the operation screen on a predetermined display device, and software keys and hardware on a display menu presented on the display device A user instruction reception control unit 199 that receives a user instruction via the (mechanical) operation key 16 and operates the apparatus (the functional units of the main body and the connected device) according to the instruction.

  An operation screen generation device 193 that generates a graphical user interface (GUI) for operating the image output terminal 7, which is an example of an electronic device, by the definition information storage unit 194, the definition file reading unit 195, and the operation screen generation unit 196. Composed.

  The GUI component stored in the definition information storage unit 194 is a new GUI component that is generated and provided externally (for example, purchased (installed) by purchasing a commercially available GUI library and reading the definition file reading unit 195). Display pattern).

  In addition, graphical software (an application program for graphic operation) may be incorporated in the operation screen generation unit 196, a GUI component may be generated manually by the operation screen generation unit 196, and updated to the generated GUI component.

  When there is a GUI screen change request accompanied by a change of the GUI part, if the adapter part needs to be changed, the adapter part information (adapter information G3) is also stored in the definition information storage unit 194. To.

  Even when an unexpected device combination or GUI screen change request occurs at that time, it is only necessary to register the GUI component and adapter component information necessary for the changed GUI screen configuration in the definition information storage unit 194. For this registration, a definition file in which the GUI part information G2 and adapter information G3 information is described may be read by the definition file reading unit 195 and registered in the definition information storage unit 194 without using the device provider side. It can be handled by the person on the side.

  Based on the screen configuration definition file F1 and the menu item definition file F2 read by the definition file reading unit 195, the operation screen generation unit 196 sets the operation menu item for each of the operation menu items described in the screen configuration definition file F1. Relay component search that searches and identifies relay components that associate operation components that match the types of operation menu items, taking into account the types of GUI components associated with types (enumeration type, integer type, character string type, etc.) An adapter search unit 197 which is an example of a unit.

  The operation screen generation unit 196 reads the GUI component described in the screen configuration definition file F1 from the definition information storage unit 194, and the operation menu items described in the read GUI component and the screen configuration definition file F1. By connecting both the associated operation menu item and GUI component via the adapter component specified by the adapter search unit 197, the GUI component group included in the screen configuration definition information G0 is associated with the operation menu item. A part menu correspondence unit 198 for creating or editing a menu item.

  The operation screen generation unit 196 reads the GUI component stored in the definition information storage unit 194, and is not related to the UI configuration J4 acquired by the UI function information acquisition unit 192 among the read GUI components (not supported) N) Make the display part inactive. For example, in the case of a soft key using display, the display is masked (hidden). Alternatively, it may be possible to notify the user that the soft key is invalid, for example, by displaying it in a lighter color than the active key or displaying it in a color prompting prohibition.

  The user instruction reception control unit 199 is notified of the arrangement information of the soft keys after being made inactive. The user instruction acceptance control unit 199 accepts a user instruction via a soft key excluding this inactive part. The user's access to the soft keys may use contact with a touch panel provided on the display device, or may use a pointing device such as a mouse or a cross shift key.

  Further, the operation screen generating unit 196 determines the function assignment of each button of the operation key 16 operated by the user. For example, among the basic key patterns, keys that are not related to (not compatible with) the UI configuration J4 acquired by the UI function information acquisition unit 192 are made inactive (invalid). This function assignment information is notified to the user instruction acceptance control unit 199. The user instruction reception control unit 199 receives a user instruction via the operation key 16 based on the determined function assignment.

  When there is an access to the key set to inactive, the user instruction acceptance control unit 199 does not accept the access. In this case, the user may be notified of the unauthorized access with a warning sound or the like. As for the hardware operation keys 16, the inactive keys may be locked in hardware. In the case of a hard key, it is desirable to present the determined key assignment information to the user as an image (when requested by the user). In this way, it is possible to cope with a hard key by attaching a label.

<How to build a graphical user interface>
3 to 7 are diagrams for explaining a user interface (especially GUI) construction method by the operation screen generation device 193 of the user interface control unit 190. Here, FIG. 3 is a diagram illustrating an example of an operation menu in a hierarchical presentation format. 4A is a diagram for explaining the operation menu definition information G1 (menu data object group) in the operation menu in the hierarchical presentation format, and FIG. 4B is a diagram illustrating the operation menu definition information G1 and the GUI component. It is the figure which showed the relationship between the information G2 and adapter information G3. FIG. 5 is a diagram showing an overall outline of a GUI construction method. FIG. 6 is a diagram showing an example of the screen configuration definition file F1, and FIG. 7 is a diagram showing an example of the menu item definition file F2.

  The GUI generation method of the present embodiment is characterized in that a display menu suitable for a combination of devices, an operation mode, a user's request, and the like is generated using a GUI component stored in the definition information storage unit 194.

At this time, the user interface control unit 190 of the present embodiment is assumed to be operation menu definition information G1 (menu data object group; may be generated from the menu item definition file F2) that defines the type of the menu item. Define adapter parts for functionally connecting the operation menu definition information G1 and GUI parts from the definition information (GUI part information G2) of all GUI parts (basic display patterns) required for the combination of devices The adapter search unit 197 searches for adapter information G3.

  The component menu association unit 198 uses the adapter component searched by the adapter search unit 197 to connect both the associated operation menu definition information G1 and the GUI component.

  Then, the operation screen generation unit 196 generates a GUI by arranging each GUI component at a predetermined position, assigning a function to each GUI component, and adding a character (function character) indicating the function information. Edit it.

  The adapter component is not limited to the adapter component corresponding to one element of the tree constituting the menu item, and corresponds to a combination of a menu data object group composed of an arbitrary number of operation menu definition information G1 and a combination of a plurality of GUI components. An adapter part may be prepared.

  The operation menu includes a batch presentation format that presents a desired operation menu within one screen, and a hierarchical presentation format that sequentially selects from a higher concept to a lower concept in a hierarchical structure. Any of them may be adopted.

  For example, as in the example shown in FIG. 3, a GUI (FIG. 3 (B)) having soft keys is created by combining GUI parts (FIG. 3 (A)) stored in the definition information storage unit 194. You can also Here, FIG. 3B shows an example of a copy mode display menu when any of the image capturing unit 210, the image processing unit 220, and the image recording unit 230 is monochrome compatible.

  In other words, the user interface display is a button or a component layout component (Container Widget) corresponding to a region where the GUI component is disposed as a GUI component (Control Widget) necessary for operating the setting value of the menu item. Tabs are already stored as basic parts (screen component parts).

  For example, as shown in FIG. 3A, the definition information storage unit 194 includes a pull-down menu (Pulldown Menu), a radio button menu (Radio Button Menu), a spinner button menu (Spinner Button Menu), and a rectangular shape. Square buttons, circular buttons, star buttons, hexagon buttons, and counter buttons are stored as GUI components, and multiple types of tab parts (Tabbed Pane) and component storage (Content Grid) with different tab positions are elements. Stored as an arrangement part.

  The operation screen generation unit 196 of the user interface control unit 190 selects buttons and tabs necessary for display based on the UI configuration J4 acquired by the device information acquisition unit 192 and a predetermined selection condition, Change the size of the selected button or tab (independent vertical / horizontal scaling), set the character (function character) indicating the function of the key in the function display area, and change the display color of the button, tab, or function character as necessary. By setting, further setting explanatory characters and display colors to be arranged in parts other than the buttons, and finally determining the arrangement positions of the respective buttons, tabs or explanatory characters, as shown in FIG. Generate a GUI.

  Since information related to user interface keys (buttons) and display menus necessary for the functions of the device is associated with each function, the buttons can be assigned by referring to the UI configuration J4. I can go.

  For example, by incorporating graphical software (an application program for graphic operation) into the operation screen generation unit 196, it is efficient to automatically execute these series of processes by software processing. . The selection condition may be various conditions such as a color copying machine, a monochrome copying machine, or a use frequency.

  Whatever connection device is combined with the apparatus, a corresponding GUI can be constructed flexibly, simply and at low cost. When a connected device is recognized, an appropriate user interface can be displayed, and device replacement after factory shipment can be handled without changing a new user interface design.

  In addition, by making it possible to appropriately add and register GUI parts and adapter parts in the definition information storage unit 194, for example, when a new device combination or user change request that was not initially assumed occurs, for example, size Even if buttons (GUI parts) that cannot be handled by changes (independent vertical / horizontal scaling) are required, registering GUI parts and adapter parts according to the new combination can be used for these changes. A corresponding GUI can be realized.

  Even in this case, it is not necessary to make any changes to the basic processing and the hardware environment. Therefore, it is possible to flexibly and easily cope with unexpected combinations, and the development man-hours and costs can be greatly reduced. Moreover, even if the device configuration is changed by changing the connected device, it is not necessary to change the control software each time, and the development man-hours and costs can be greatly reduced.

  In the above description, graphical software is incorporated in the operation screen generation unit 196 and the user interface screen is automatically generated by software processing. However, human intervention may be used. In addition, since the buttons specified in the UI configuration J4 are not registered in the definition information storage unit 194, those that have been omitted in the automatic generation can be clearly indicated and added manually. It may be.

  For example, after being automatically generated as described above, the button shape, size, function character, display color, or the arrangement position thereof may be corrected. This makes it possible for the user to change the color setting of keys and tabs, or the function assigned characters (names) to the keys. Further, it may be instructed to forcibly use a registered GUI component for a function button that has been leaked in automatic generation. By doing so, it is possible to realize a more flexible and simple response to unexpected combinations.

  By the way, as an operation menu presentation method, for example, as shown in FIG. 4, an enumeration type, an integer type, a character string type such as a date type, or the like can be adopted. As a specific presentation form, in the case of an enumerated type, a pull-down menu method or a radio button menu method that allows a plurality of operation menu items to be listed and selected can be adopted. In addition, in the case of the integer type or the character string type, a spinner button menu method in which a numerical value or a character is changed by operating the up / down buttons can be adopted in addition to a method of directly inputting a numerical value or a character with a keyboard.

  Here, which of the enumeration type, the integer type, and the character string type is preferably adopted as the operation menu presentation method depends on the contents of the operation menu items and the setting method thereof. This is because the number of setting methods for setting one operation menu is not limited to one.

  For example, in the case of an operation menu for setting a copy magnification, as in the example of the menu structure shown in FIG. 4A, a dimensional designation scaling method for specifying and inputting a vertical and horizontal magnification, and a vertical and horizontal magnification. It is possible to adopt a zoom method in which the same magnification is specified and a magnification is specifically input and a fixed magnification method in which one is selected from a plurality of predetermined magnifications.

  Also, in the dimensional scaling method and zoom method, the magnification is specifically specified and input, so the operation menu presentation method is an integer type. In that case, the operation menu of the direct input method or spinner button menu method is used. It can be. On the other hand, in the fixed magnification method, since it is necessary to present multiple types of magnifications as options, it becomes an enumeration type, and in this case, it is preferable to adopt a pull-down menu method or a radio button menu method.

  As can be seen from this, since there are a plurality of types of presentation methods for one operation menu method (type), when an operation screen for a certain operation menu is to be constructed, It is unclear whether the presentation method should be related.

  Therefore, in this embodiment, as shown in FIG. 4B, an adapter part is prepared as a connection member (relay part) that associates the type of the operation menu with the GUI part. In each adapter part, operation menu definition information G1 for distinguishing the type of the operation menu and adapter information G3 for defining an adapter part for functionally connecting each GUI part are set.

  When constructing the operation screen, first, as shown in FIG. 5, a menu item definition file F2 in which which presentation method is to be adopted for each operation menu item is defined in advance, for example, XML ( Create with Extensible Markup Language) file.

  In the menu item definition file F2, for example, as shown in FIG. 7, a menu structure such as various job parameters including a copy magnification is defined.

  In addition, a screen configuration definition file F1_1 in which the structure of the entire operation screen is defined in advance is created using, for example, an XML (Extensible Markup Language) file.

  In this screen configuration definition file F1_1, for example, as shown in FIG. 6A, a GUI GUI component configuration and which operation menu item (Data Model) each GUI component is connected to are defined.

The screen configuration definition file F1 is based on GUI part information G2 indicating definition information of all GUI parts (basic display patterns) necessary for all possible device combinations and adapter information G3 for defining adapter parts. For the GUI defined by # 1, the adapter part for connecting to the operation menu item defined in the menu item definition file F2 is searched.

  Then, both the associated operation menu definition information G1 and the GUI component are connected using the searched adapter component. Also, each GUI part is arranged at a predetermined position defined in the screen configuration definition file F1_1, and further, a function is assigned to each GUI part, and a function character indicating the function information is added, so that the GUI is Generate.

  If the GUI created in this way is to be edited (customized) to another GUI, the user can configure the GUI GUI component configuration and which operation menu item each GUI component has, as shown in FIG. 6B. Another screen configuration definition file F1_2 in which it is defined whether it is connected to (Data Model) is created, read by the definition file reading unit 195, and analyzed by the operation screen generation unit 196. That is, the screen configuration definition file F1_1 is rewritten to the screen configuration definition file F1_2.

  In the illustrated example, the “radio button menu” before correction is corrected to “pull-down menu”, and the attribute information (for example, color and size) of the GUI component is also corrected.

  When the screen configuration definition file F1_1 is updated to the screen configuration definition file F1_2, the user interface control unit 190 creates a GUI in the same manner as described above based on the updated screen configuration definition file F1_2.

  In other words, based on the rewritten GUI setting defined in the updated screen configuration definition file F1_2, the adapter part for connecting to the invariant menu item definition is searched, and the GUI GUI part configuration and each GUI part are operated. By defining whether the menu item (Data Model) is connected, the updated GUI is created.

  Thus, if the created GUI is to be changed (customized), it is only necessary to rewrite the screen configuration definition file F1 for defining GUI settings. The association between the GUI component and the operation menu item is performed by using an adapter component prepared in advance so as to associate the two, so that there is no need for the user to create a program or program change for associating the two.

  Therefore, since it is not necessary to change the logic part of the basic program for generating the GUI at all, the user can only rewrite the screen configuration definition information without redesigning the GUI on the design side. It is possible to flexibly cope with configuration changes.

  In addition, when a new operation menu item structure is required, it is possible to flexibly cope with a change in the GUI configuration by simply rewriting the operation menu definition information that associates the GUI component that configures the GUI with the operation menu item to be operated. Can do.

  In addition, in the operation screen generation device 193 of the present embodiment, when rewriting the screen configuration definition information G0 and the operation menu definition information G1, the definition information is not input in an interactive format, but the screen configuration definition information G0 in advance. Is prepared, and a menu item definition file F2 in which operation menu definition information G1 is described is prepared. The definition file reading unit 195 reads the definition information G0 and G1 from the read file contents. Since the identification is performed, there is an advantage that the GUI automatic creation processing can be realized only by correcting the file contents.

It is a figure which shows an example of the system architecture of the circuit structure in the image output terminal which is an example of an electronic device. It is a figure which shows the example of 1 structure of a user interface control part. It is a figure which shows an example of the operation menu of a hierarchy presentation form. FIG. 4A is a diagram for explaining operation menu definition information in an operation menu in a hierarchical presentation format, and FIG. 4B is a diagram showing a relationship among operation menu definition information, GUI component information, and adapter information. It is the figure which showed the whole outline | summary of the construction method of GUI. It is the figure which showed an example of the screen structure definition file. It is the figure which showed an example of the menu item definition file.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 7 ... Image output terminal, 100 ... Controller part, 120 ... Memory bridge part, 140 ... I / O bridge part, 190 ... User interface control part, 192 ... UI function information acquisition part, 193 ... Operation screen generation apparatus, 194 ... Definition Information storage unit, 195 ... definition file reading unit, 196 ... operation screen generation unit, 197 ... adapter search unit, 198 ... component menu correspondence unit, 199 ... user instruction reception control unit

Claims (8)

An operation screen generation method for creating a graphical user interface for operating an electronic device,
A relay part that associates a data type corresponding to each of a plurality of operation menu presentation methods that can be used in an operation menu item for operating the electronic device and a plurality of operation parts constituting the graphical user interface is prepared. ,
Screen configuration definition information for designating operation menu items constituting the screen of the graphical user interface rewritten by the user, a method for presenting the operation menu items, a plurality of operation menus usable in the operation menu items, and the plurality of operations The screen configuration definition information rewritten by the user based on operation menu definition information that defines data types corresponding to the respective menu presentation methods and component information that defines a plurality of operation components that constitute the graphical user interface. Identifying the relay component that associates each of the plurality of operation menu presentation methods that can be used in the operation menu item specified in, and the operation component that conforms to each of the plurality of operation menu presentation methods,
A method of generating an operation screen, comprising using the identified relay component to create an association between each of a plurality of operation menu presentation methods that can be used in the specified operation menu item and the operation component. An operation screen generation device for creating a graphical user interface for operating an electronic device,
The operation component information contributing to the configuration of the graphical user interface, the data type corresponding to each of the plurality of operation menu presentation methods that can be used in the operation menu item for operating the electronic device, and the graphical user interface are configured. A definition information storage unit for storing information of relay parts that associate each of the plurality of operation parts;
Screen configuration definition information for designating operation menu items constituting the screen of the graphical user interface rewritten by the user, the operation menu items, a plurality of operation menu presentation methods that can be used in the operation menu items, and the plurality of the operation menu items The screen configuration definition rewritten by the user based on operation menu definition information that defines a data type corresponding to each operation menu presentation method and component information that defines a plurality of operation components constituting the graphical user interface A relay component search unit that identifies each of the plurality of operation menu presentation methods that can be used in the operation menu item specified in the information, and the relay component that associates the operation components that match each of the plurality of operation menu presentation methods; ,
The operation component adapted to each of the plurality of operation menu presentation methods that can be used in the operation menu item specified in the screen configuration definition information is read from the definition information storage unit, the read operation component, A component menu association unit that associates each of the plurality of operation menu presentation methods that can be used in the operation menu item specified in the screen configuration definition information using the relay component specified by the relay component search unit. An operation screen generating device characterized by the above. A definition file reading unit that reads a screen configuration definition file describing the screen configuration definition information;
The relay component search unit and the component menu association unit perform processing based on the screen configuration definition information of the screen configuration definition file read by the definition file reading unit. Operation screen generator. A definition file reading unit for reading an operation menu definition file describing the operation menu definition information;
The relay component search unit and the component menu association unit perform processing based on the operation menu definition information of the operation menu definition file read by the definition file reading unit. The operation screen generation device described. The definition file reading unit reads an operation component information file in which information on the operation component is defined, and registers the operation component information described in the operation component information file in the definition information storage unit. The operation screen generation device according to any one of claims 2 to 4. The definition file reading unit reads a relay component information file in which the relay component information is defined, and registers the relay component information described in the relay component information file in the definition information storage unit. The operation screen generation device according to any one of claims 2 to 5. Information of operation parts contributing to the configuration of the graphical user interface, data types corresponding to each of the plurality of operation menu presentation methods that can be used in the operation menu items, and each of the plurality of operation parts constituting the graphical user interface A definition information storage unit for storing information of the relay component to be associated;
Definition information for designating operation menu items constituting the screen of the graphical user interface rewritten by the user, the operation menu items, a method of presenting a plurality of operation menus that can be used in the operation menu items, and the plurality of operation menus In the screen configuration definition information rewritten by the user on the basis of the operation menu definition information that defines the data type corresponding to each presentation method and the component information that defines a plurality of operation components that constitute the graphical user interface. Each of the plurality of operation menu presentation methods that can be used in the designated operation menu item, and the relay component search unit that identifies the relay component that associates the operation components that match each of the plurality of operation menu presentation methods,
The operation component adapted to each of the plurality of operation menu presentation methods that can be used in the operation menu item specified in the screen configuration definition information is read from the definition information storage unit, the read operation component, A component menu association unit that associates each of the plurality of operation menu presentation methods that can be used in the operation menu item specified in the screen configuration definition information using the relay component specified by the relay component search unit. Electronic equipment characterized by A program for performing operation screen generation processing for creating a graphical user interface for operating an electronic device using a computer,
A relay part that associates a data type corresponding to each of a plurality of operation menu presentation methods that can be used in an operation menu item for operating the electronic device and a plurality of operation parts constituting the graphical user interface is prepared. ,
The computer,
Screen configuration definition information for designating operation menu items constituting the screen of the graphical user interface rewritten by the user, the operation menu items, a plurality of operation menu presentation methods that can be used in the operation menu items, and the plurality of the operation menu items The screen configuration definition rewritten by the user based on operation menu definition information that defines a data type corresponding to each operation menu presentation method and component information that defines a plurality of operation components constituting the graphical user interface A relay component search unit that identifies each of the plurality of operation menu presentation methods that can be used in the operation menu item specified in the information, and the relay component that associates the operation components that match each of the plurality of operation menu presentation methods; ,
A plurality of operation parts that can be used in a plurality of operation menu presentation methods that can be used in operation menu items specified in the screen configuration definition information, and a plurality of operation menu items that can be used in operation menu items specified in the screen configuration definition information. A program that causes each of the operation menu presentation methods to function as a component menu association unit that associates each operation menu presentation method using the relay component specified by the relay component search unit.

Images