JP5046801B2 - Image processing apparatus and program - Google Patents

Description

  The present invention relates to an image processing apparatus and a program, and in particular, individual modules are connected in a pipeline form or a directed acyclic graph form so that a buffer module is connected to at least one of the front and rear stages of the image processing module. And an image processing program for causing a computer to function as the image processing apparatus.

  In an image processing device that performs image processing on input image data, a DTP (desktop publishing) system that can handle images, a print system that records an image represented by input image data on a recording material, etc. Various types of image processing such as enlargement / reduction, rotation, affine transformation, color conversion, filter processing, and image synthesis are performed on the image data. In these apparatuses and systems, for example, when various image data having different color spaces and the number of bits per pixel are input, or when image processing contents, procedures, parameters, and the like are variously changed, an image to be executed A configuration that can change processing flexibly is required. In order to satisfy such a requirement, Patent Document 1 discloses that each module is connected in a pipeline form or a DAG (Directed Acyclic Graph: Existence) so that a buffer module is connected to at least one of the front and rear stages of the image processing module. There has been proposed a technique for constructing an image processing unit connected in the form of a non-circular graph) and performing image processing.

Further, in relation to the above, in Patent Document 2, in a system in which a plurality of information processing apparatuses share processing data and perform processing, it is continuously performed without changing the connection state of information processing apparatuses participating in the processing. In the entire process (a series of processes), each time a process is performed, the sharing rate, which is the ratio of each information processing device, and the time taken for each information processing device to finish the processing By storing the time and reading and comparing the above allotted times, it is possible to identify the information processing device A that took more time than the other information processing devices in the previous processing to finish the processing shared by itself In the next process, a technique is disclosed in which the sharing ratio of the information processing apparatus A is set to a value smaller than the previous value in the processing data.
JP 2006-338498 A JP 2006-4382 A

  When image processing is performed by constructing an image processing unit using the technique described in Patent Document 1, depending on the contents of image processing to be realized and the size of input image data, a large processing load is imposed on the computer that performs image processing. Therefore, depending on the ability of the computer, the processing time may increase significantly. On the other hand, considering that it has become common in recent years to construct a computer network by connecting multiple computers via a communication line, the processing time increases significantly as described above. In such a case, it is conceivable that image processing is shared by a plurality of computers and the image processing is performed in parallel by each computer, as in the technique described in Patent Document 2.

  However, as in the technique described in Patent Document 1, when image processing is performed by constructing an image processing unit formed by connecting an image processing module and a buffer module, each module of the image processing unit is executed during image processing. Information is frequently transmitted and received between the modules and the processing management unit that manages the operation of the image processing unit. Information is exchanged between modules or between the processing management unit and the module when the image processing unit is operated on a single computer (when the program of the image processing unit is executed on a single computer). Can be realized by a very simple process (for example, a process in which the information transmitting side writes information in a predetermined area of the memory and the information receiving side refers to information written in the predetermined area). When the processing unit is divided into a plurality of parts and the divided parts are operated on different computers (when the divided programs are executed on different computers), it is necessary to send and receive information via a communication line. Therefore, communication processing for sending and receiving information via a communication line is added to each computer as a relatively large overhead, and is connected to a computer. By transmitting and receiving the frequent information between Yuta is performed, also increases drastically traffic between computers.

  Therefore, if the image processing unit is simply divided and the divided units are operated on different computers, the processing efficiency is lowered, and the problem arises that the processing capability of each computer cannot be used effectively. Become.

  The present invention has been made in consideration of the above facts, and an object thereof is to obtain an image processing apparatus and an image processing program capable of realizing improvement in processing efficiency when image processing is shared by a plurality of computers.

In order to achieve the above object, an image processing apparatus according to the first aspect of the present invention performs image processing different from each other on image data acquired from a previous stage of its own module, and the image data that has undergone the image processing or the image processing A plurality of types of image processing modules that output the processing results of the module to the subsequent stage, and the image data output from the preceding module is written to the buffer and the image data stored in the buffer is read by the subsequent module. A storage unit for storing each of the buffer module programs to be output; and a pre-stage and a post-stage of each of the one or more image processing modules selected from the plurality of types of image processing modules by the program stored in the storage unit The buffer module is connected to at least one of the A construction unit for constructing an image processing unit connected in a pipeline form or a directed acyclic graph form, and operating on the first computer, and operating the image processing unit constructed by the construction unit on the first computer When the predicted value of the processing load of the first processing management unit and the image processing unit is greater than or equal to a first threshold, or provided in the first computer and usable for the operation of the image processing unit When the number of program execution resources is less than or equal to the second threshold, the image processing unit constructed by the construction unit is divided into a first image processing unit and a second image processing unit, and the first image processing And a second computer connected to the first computer via a communication line, with the first processing management unit performing management processing for operating a part on the first computer Generating a second processing management unit for performing management processing for operating the second image processing unit on the second computer, and operating the second image processing unit on the second computer And means.

  In the first aspect of the present invention, a plurality of image processings are performed on the image data acquired from the previous stage of the own module, and the image data subjected to the image processing or the processing result of the image processing is output to the subsequent stage of the own module. Various kinds of image processing modules and buffer module programs for causing the image data output from the preceding module to be written to the buffer and reading the image data stored in the buffer by the subsequent module are stored in the storage means. Has been. The construction means according to the first aspect of the invention provides at least a front stage and a rear stage of each of one or more image processing modules selected from a plurality of types of image processing modules by a program stored in the storage means. A buffer module is connected to one side, and an image processing unit is constructed in which each module is connected in a pipeline form or a directed acyclic graph form. The first processing management unit operating on the first computer performs management processing for operating the image processing unit constructed by the construction unit on the first computer. Therefore, the image processing unit constructed by the construction unit normally operates on the first computer by the management processing being performed by the first processing management unit (the program of the image processing unit is executed by the first computer). ).

According to a first aspect of the present invention, there is provided a program that can be used for the operation of the image processing unit provided in the first computer when the predicted value of the processing load of the image processing unit is greater than or equal to the first threshold When the number of execution resources is less than or equal to the second threshold , the image processing unit constructed by the construction unit is divided into a first image processing unit and a second image processing unit, and the first image processing unit is divided into the first image processing unit and the first image processing unit. Management for operating on the computer is performed by the first processing management unit, and management for operating the second image processing unit on the second computer connected to the first computer via a communication line A second processing management unit that performs processing is generated on the second computer, and the second image processing unit is operated on the second computer. As described above, when the second image processing unit, which is a part of the image processing unit, is operated on the second computer, the second processing for performing the management process for operating the second image processing unit on the second computer is performed. Is generated on the second computer, information is transmitted / received between the individual modules of the second image processing unit, and the individual modules and the processing management unit (second management unit) of the second image processing unit are generated. Between the first computer and the second computer for transmission / reception of the information is performed in the second computer using a memory or the like provided in the second computer. Therefore, it is possible to reduce the overhead added to each computer and to reduce the traffic between the first computer and the second computer. . Therefore, according to the first aspect of the present invention, it is possible to improve the processing efficiency when image processing is shared by a plurality of computers.
When the dividing unit is configured to divide the image processing unit and generate the second processing management unit when the predicted value of the processing load of the image processing unit is greater than or equal to the first threshold value, it is compared with the first computer. If the processing time can be predicted to increase due to a large processing load, the image processing unit will be automatically divided and so on. This saves you time and effort. Further, when the number of program execution resources provided in the first computer and available for the operation of the image processing unit is equal to or smaller than the second threshold, the image processing unit is divided and the second processing management unit is generated. When the means is configured, when the processing time can be predicted to increase due to the lack of the number of program execution resources available for the operation of the image processing unit, the division of the image processing unit is automatically performed. As a result, it is possible to save the trouble of selecting whether or not to divide the image processing unit.

  In the first aspect of the present invention, the first processing management unit and the second processing management unit constitute the management processing target image processing unit as described in the second aspect, for example. Memory is allocated and allocated in response to requests from individual modules, memory management processing for releasing unnecessary memory, image data is acquired from the previous stage of its own module, image data or In the workflow management process that repeats the process of outputting the processing result of the predetermined image processing to the subsequent stage of its own module in each image processing module of the management process target image processing unit, and the management process target image processing unit It may be configured to perform at least one of error management processing for notifying an error that has occurred using a predetermined notification method. The first process management unit and the second process management unit perform at least one of the above-described processes as the management process, so that the first image processing unit on the first computer and the second image processing unit Each can be operated on the second computer.

Further, in the first aspect of the present invention, the second process management unit is generated on the second computer by storing the program of the second process management unit in the storage means as described in the third aspect , for example. In addition, the dividing means is realized by transferring the program of the second processing management unit to the second computer via the communication line and instructing the second computer to execute the transferred program. Can do.

The image processing program according to the invention of claim 4 performs different image processing on the image data acquired from the previous stage of the own module, and the image data obtained through the image processing or the processing result of the image processing is stored in the own module. A plurality of types of image processing modules to be output to the subsequent stage, and a buffer module program that causes the image data output from the previous module to be written to the buffer and the image data stored in the buffer to be read by the subsequent module. A first computer connected to each storage means and connected to a second computer via a communication line is selected from the plurality of types of image processing modules by a program stored in the storage means. Each of the one or more image processing modules Constructing means for constructing an image processing unit in which at least one of the buffer modules is connected and each module is connected in a pipelined form or a directed acyclic graph form, and the image processing part constructed by the constructing means is the first A first processing management unit that performs management processing for operating on a computer, and a predicted value of a processing load of the image processing unit equal to or greater than a first threshold; or the image provided in the first computer When the number of program execution resources available for the operation of the processing unit is equal to or smaller than the second threshold, the image processing unit constructed by the construction unit is divided into a first image processing unit and a second image processing unit. , Causing the first processing management unit to perform management processing for operating the first image processing unit on the first computer, and executing the management processing on the second computer. A second processing management unit that performs a management process for operating the second image processing unit on the second computer, and functions as a dividing unit that operates the second image processing unit on the second computer Let

According to a fourth aspect of the present invention, there is provided an image processing program that is connected to the storage unit, and that connects the first computer connected to the second computer via a communication line, the construction unit, and the first processing management unit. Since the first computer executes the image processing program according to the fourth aspect of the invention, the first computer executes the image processing program according to the first aspect. It functions as an apparatus, and, similarly to the first aspect of the invention, it is possible to realize improvement in processing efficiency when image processing is shared by a plurality of computers.

  As described above, the present invention divides the image processing unit constructed by the construction unit into the first image processing unit and the second image processing unit when the predetermined condition is satisfied, and performs the first image processing. Management processing for operating the computer on the first computer is performed by the first processing management unit, and the second image processing unit is operated on the second computer connected to the first computer via a communication line Since the second processing management unit for performing management processing is generated on the second computer and the second image processing unit is operated on the second computer, the image processing is shared among a plurality of computers. In this case, the processing efficiency can be improved.

  Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 shows a computer 10 that can function as an image processing apparatus according to the present invention. The computer 10 is incorporated in any image handling apparatus that needs to perform image processing internally, such as a copying machine, a printer, a facsimile machine, a multifunction machine having these functions, a scanner, a photographic printer, or the like. Alternatively, it may be an independent computer such as a personal computer (PC), or may be a computer incorporated in a portable device such as a PDA (Personal Digital Assistant) or a cellular phone.

  The computer 10 includes a CPU 12, a memory 14 including a DRAM or SRAM, a display unit 16, an operation unit 18, a storage unit 20, an image data supply unit 22, and an image output unit 24, which are connected to each other via a bus 26. Has been. When the computer 10 is incorporated in an image handling device as described above, a display panel, a numeric keypad, or the like composed of an LCD or the like provided in the image handling device can be applied as the display unit 16 and the operation unit 18. When the computer 10 is an independent computer, a display, a keyboard, a mouse, or the like connected to the computer can be applied as the display unit 16 or the operation unit 18. The storage unit 20 is preferably an HDD (Hard Disk Drive), but other nonvolatile storage means such as a flash memory can be used instead.

  The image data supply unit 22 only needs to be able to supply image data to be processed. For example, an image reading unit that reads an image recorded on a recording material such as paper or photographic film, and outputs the image data. A receiving unit that receives image data from the outside via a line, an image storage unit (memory 14 or storage unit 20) that stores image data, and the like can be applied. The image output unit 24 only needs to output image data that has undergone image processing or an image represented by the image data. For example, the image recording unit records an image represented by the image data on a recording material such as paper or a photosensitive material. A display unit that displays an image represented by image data on a display, a writing device that writes image data to a recording medium, and a transmission unit that transmits image data via a communication line can be applied. The image output unit 24 may be an image storage unit (memory 14 or storage unit 20) that simply stores image data that has undergone image processing.

  The communication control unit 25 is connected to a computer network 26 via a communication line, and a plurality of computers including a server computer 27 are connected to the computer network 26 (in FIG. 1, the server is a server). (The illustration of computers other than the computer 27 is omitted). The communication control unit 25 manages communication with other computers via the computer network 26. The server computer 27 includes a CPU 27A, a memory 27B, an HDD 27C, and a communication control unit 27D. The communication control unit 27D is connected to the computer network 26 via a communication line. The computer 10 corresponds to the first computer according to the present invention, and the server computer 27 corresponds to the second computer according to the present invention.

  The storage unit 20 corresponds to the storage unit according to the present invention. As shown in FIG. 1, the storage unit 20 manages resources such as the memory 14 and the like as various programs executed by the CPU 12. Management of program execution, a program of the operating system 30 that manages communication between the computer 10 and the outside, the image processing program group 34 for causing the computer 10 to function as the image processing apparatus according to the present invention, and the CPU 12 are the image processing program group. Each of the programs of various applications 32 (denoted as application program group 32 in FIG. 1) for causing the image processing apparatus realized by executing the desired image processing is stored.

  The image processing program group 34 reduces the development load when developing the above-described various image handling devices and portable devices, and reduces the development load when developing an image processing program usable on a PC or the like. The purpose is a program developed so that it can be commonly used in various devices (platforms) such as various image handling devices, portable devices, and PCs, and corresponds to the image processing program according to the present invention. The image processing apparatus realized by the image processing program group 34 constructs an image processing unit that performs image processing instructed by the application 32 in accordance with a construction instruction from the application 32, and executes the image processing unit in accordance with an execution instruction from the application 32. The image processing program group 34 instructs the construction of an image processing unit (an image processing unit having a desired configuration) for performing desired image processing, or the constructed image processing unit. The application 32 is provided with an interface for instructing execution of image processing according to the above. For this reason, even when newly developing an arbitrary device that needs to perform image processing internally, regarding the development of a program for performing the image processing, the above-described interface is used to perform the image processing required for the device. It is only necessary to develop the application 32 to be used and executed by the image processing program group 34, and it is not necessary to newly develop a program for actually performing image processing, so that the development load can be reduced.

  Further, as described above, the image processing apparatus realized by the image processing program group 34 constructs an image processing unit that performs image processing instructed by the application 32 according to the construction instruction from the application 32, and constructs the constructed image processing unit. Therefore, for example, when the color space of the image data to be processed and the number of bits per pixel are indefinite or the contents of the image processing to be executed, the procedure / parameter, etc. are indefinite, When the application 32 instructs to reconstruct the image processing unit, the image processing executed by the image processing apparatus (image processing unit) can be flexibly changed according to the image data to be processed.

  Hereinafter, the image processing program group 34 will be described. As shown in FIG. 1, the image processing program group 34 is roughly divided into a module library 36, a process construction unit 42 program, and a process management unit 46 program. As will be described in detail later, the processing construction unit 42 according to the present embodiment, according to an instruction from the application, as illustrated in FIG. 2 as an example, one or more image processing modules 38 that perform predetermined image processing, A buffer module 40 that is arranged in at least one of the preceding stage and the succeeding stage of each image processing module 38 and has a buffer for storing image data, and a pipeline form or a DAG (Directed Acyclic Graph) form An image processing unit 50 formed by linking is constructed. The entity of each image processing module constituting the image processing unit 50 is a first program executed by the CPU 12 and causing the CPU 12 to perform predetermined image processing, or an external unit not shown in FIG. 2 is a second program for instructing execution of processing to the image processing apparatus (for example, a dedicated image processing board), and the module library 36 described above stores predetermined different image processing (for example, input processing and filter processing). , Color conversion processing, enlargement / reduction processing, skew angle detection processing, image rotation processing, image composition processing, output processing, and the like) are registered. Hereinafter, in order to simplify the description, it is assumed that each image processing module constituting the image processing unit 50 is the first program.

  As shown in FIG. 3A as an example, each image processing module 38 includes an image processing engine 38A that performs image processing on image data by a predetermined unit processing data amount, and a front stage and a rear stage of the image processing module 38. The control unit 38B performs input / output of image data with the module and controls the image processing engine 38A. The unit processing data amount in each image processing module 38 is the image processing engine 38A from an arbitrary number of bytes including one line of the image, a plurality of lines of the image, one pixel of the image, one surface of the image, and the like. Is selected and set in advance according to the type of image processing to be performed. For example, in the image processing module 38 that performs color conversion processing and filter processing, the unit processing data amount is one pixel, and the image to be enlarged / reduced is processed. In the processing module 38, the unit processing data amount is equivalent to one line of the image or a plurality of lines of the image, and in the image processing module 38 that performs image rotation processing, the unit processing data amount is equivalent to one image, and the image compression / decompression processing is performed. In the image processing module 38 to be performed, the unit processing data amount is set to N bytes depending on the execution environment.

  The module library 36 also registers image processing modules 38 having the same type of image processing executed by the image processing engine 38A and different contents of the image processing executed (in FIG. 1, this type of image processing is performed). Modules are indicated as “module 1” and “module 2”). For example, with respect to the image processing module 38 that performs enlargement / reduction processing, the image processing module 38 that performs reduction processing to reduce the input image data to 50% by thinning out every other pixel is designated for the input image data. A plurality of image processing modules 38 such as an image processing module 38 that performs enlargement / reduction processing at the enlarged / reduced rate are prepared. For example, the image processing module 38 that performs color conversion processing includes an image processing module 38 that converts the RGB color space to the CMY color space, an image processing module 38 that converts the color space to the opposite, and an L * a * b * color space. Image processing modules 38 for performing other color space conversions are prepared.

  In addition, the control unit 38B of the image processing module 38 receives an image from a module (for example, the buffer module 40) in the previous stage of its own module in order to input image data necessary for the image processing engine 38A to process each unit processing data amount. Data is acquired for each unit read data amount, and image data output from the image processing engine 38A is output for each unit write data amount to a subsequent module (for example, the buffer module 40) (data amount such as compression by the image processing engine 38A). If the image processing with the increase / decrease is not performed, the unit writing data amount = the unit processing data amount) or the result of the image processing by the image processing engine 38A is output to the outside of the module (for example, the image processing engine 38A When performing image analysis processing such as skew angle detection processing, a scan is performed instead of image data. The image analysis processing result such as the angle detection result may be output). However, the module library 36 has the same type and content of the image processing executed by the image processing engine 38A, and the unit processing described above. Image processing modules 38 having different data amounts, unit read data amounts, and unit write data amounts are also registered. For example, the unit processing data amount in the image processing module 38 that performs image rotation processing is not limited to the one image plane described above, and the same image rotation processing is performed and the unit processing data amounts are different from each other (for example, one image). A plurality of image processing modules 38 (for a line, a plurality of lines, etc.) may be included in the module library 36.

  The program of each image processing module 38 registered in the module library 36 is composed of a program corresponding to the image processing engine 38A and a program corresponding to the control unit 38B, but a program corresponding to the control unit 38B. The image processing module 38 having the same unit read data amount and unit write data amount among the individual image processing modules 38 is concerned with the type and content of image processing executed by the image processing engine 38A. However, the program corresponding to the control unit 38B is shared (the same program is used as the program corresponding to the control unit 38B). Thereby, the development load in developing the program of the image processing module 38 is reduced.

  In the image processing module 38, the unit read data amount and the unit write data amount are not fixed when the input image attribute is unknown, and the input image data attribute is acquired and acquired. There is a module in which the unit read data amount and the unit write data amount are determined by substituting the attribute into a predetermined arithmetic expression, and this type of image processing module 38 has a unit read data amount and For the image processing module 38 in which the unit write data amount is derived using the same arithmetic expression, a program corresponding to the control unit 38B may be shared. The image processing program group 34 according to the present embodiment can be mounted on various devices as described above, but the number, type, and the like of the image processing modules 38 registered in the module library 36 in the image processing program group 34. Needless to say, addition, deletion, replacement, and the like can be appropriately performed in accordance with image processing required by various devices that implement the image processing program group 34.

  Further, as shown in FIG. 3B as an example, the individual buffer modules 40 constituting the image processing unit 50 are configured to input / output image data between the buffer 40A and modules before and after the buffer module 40. The buffer control unit 40B manages the buffer 40A. The buffer 40A is composed of a memory area secured from the memory 14 provided in the computer 10 through the operating system 30 and the resource management unit 46B. The buffer control unit 40B of each buffer module 40 is also a program executed by the CPU 12, and the program of the buffer control unit 40B is also registered in the module library 36 (in FIG. 1, the program of the buffer control unit 40B is registered). "Buffer module")

In the present embodiment, in consideration of the possibility that a plurality of image processing modules 38 may access the buffer 40A of the buffer module 40 at the same time, an exclusive control function that performs exclusive control on access to the buffer 40A. A buffer module 40 with a buffer and a buffer module 40 without an exclusive control function are prepared, and a program for each buffer module 40 is registered in the module library 36.

  In addition, the processing construction unit 42 that constructs the image processing unit 50 in accordance with an instruction from the application 32 includes a plurality of types of module generation units 44 as shown in FIG. The plural types of module generation units 44 support different image processing, and are activated by the application 32 to generate a module group including an image processing module 38 and a buffer module 40 for realizing the corresponding image processing. Perform the process. In FIG. 1, the module generation unit 44 corresponding to the type of image processing executed by each image processing module 38 registered in the module library 36 is shown as an example of the module generation unit 44. The image processing corresponding to the generation unit 44 may be image processing realized by a plurality of types of image processing modules 38 (for example, skew correction processing including skew angle detection processing and image rotation processing). When the required image processing is processing combining a plurality of types of image processing, the application 32 sequentially activates the module generation unit 44 corresponding to any of the plurality of types of image processing. As a result, an image processing unit 50 that performs necessary image processing is constructed by the module generation unit 44 that is sequentially activated by the application 32.

  Further, in the storage unit 20 according to the present embodiment, as a program of the process management unit 46, a program of the client process management unit 46 for operating the process management unit 46 on the computer 10 (client), and a process management A program for the server process management unit 46 for operating the unit 46 on the server computer 27 is stored. As will be described later, the program of the server processing management unit 46 is divided into the processing management unit 46 on the computer 10 and the server when the image processing unit 50 is divided and a part thereof is operated on the server computer 27. Used to operate each on the computer 27. As shown in FIG. 1, each processing management unit 46 includes a workflow management unit 46 </ b> A that controls execution of image processing in the image processing unit 50, a memory 14 by each module of the image processing unit 50, and a computer 10 such as various files. Alternatively, a resource management unit 46B that manages the use of resources of the server computer 27 and an error management unit 46C that manages errors that have occurred in the image processing unit 50 are configured.

  Next, the operation of this embodiment will be described. In a device in which the image processing program group 34 is installed, when a situation where it is necessary to perform some kind of image processing, this situation is detected by a specific application 32. In addition, as a situation where it is necessary to perform image processing, for example, an image is read by an image reading unit as the image data supply unit 22, and is recorded as an image on a recording material by an image recording unit as the image output unit 24, or image output Whether the image is displayed on the display unit as the unit 24, the image data is written to the recording medium by the writing device as the image output unit 24, the image data is transmitted by the transmission unit as the image output unit 24, or the image output When the execution of a job to be stored in the image storage unit as the unit 24 is instructed by the user, or received by the reception unit as the image data supply unit 22 or stored in the image storage unit as the image data supply unit 22 For the image data being recorded, recording on the recording material, display on the display unit, writing to the recording medium, transmission, Any execution of a job for the storage of the image storage unit include when instructed by the user. In addition, the situation where image processing needs to be performed is not limited to the above. For example, in a state where the names of processes that can be executed by the application 32 in accordance with an instruction from the user are displayed on the display unit 16 as a list, For example, the execution target process may be selected by the user.

  As described above, when it is detected that the situation where it is necessary to perform some kind of image processing is performed, the application 32 first executes a thread (a process or an object; the same applies below) that executes the program of the processing management unit 46 for the client. Are generated, the workflow management unit 46A, the resource management unit 46B, and the error management unit 46C of the processing management unit 46 operating on the computer 10 are generated. Next, the application 32 recognizes the type of the image data supply unit 22 that supplies the image data to be processed, and if the recognized type is a buffer area (partial area of the memory 14), the image data supply is performed. A parameter for causing the buffer control unit 40B to recognize the buffer area designated as the unit 22 as an already secured buffer 40A is set, and a thread for executing the program of the buffer control unit 40B is generated (the buffer control unit 40B is generated). Thus, the buffer module 40 including the designated buffer area (the buffer module 40 functioning as the image data supply unit 22) is generated.

  Subsequently, in the same manner as described above, the application 32 recognizes the type of the image output unit 24 as the output destination of the image data subjected to image processing, and the recognized type is the buffer area (partial area of the memory 14). In this case, the buffer module 40 including the buffer area designated as the image output unit 24 is generated in the same manner as described above. The buffer module 40 generated here functions as the image output unit 24. Further, the application 32 recognizes the contents of the image processing to be executed, decomposes the image processing to be executed into a combination of image processing at a level corresponding to each module generation unit 44, and realizes the image processing to be executed. Therefore, the type of image processing necessary for the purpose and the execution order of individual image processing are determined. In this determination, for example, the type of image processing and the execution order of the individual image processing are registered in advance as information in association with the type of job that can be instructed by the user. Can be realized by reading out information corresponding to the type of job instructed.

  Then, the application 32 activates the module generation unit 44 corresponding to the specific image processing (generates a thread for executing the program of the module generation unit 44) based on the type and execution order of the image processing determined above. Input module identification information for identifying an input module for inputting image data to the module group as information necessary for generating the module group by the module generation unit 44 for the activated module generation unit 44, and the module group Output module identification information for identifying an output module that outputs image data, input image attribute information that represents an attribute of input image data input to the module group, and a corresponding module that notifies parameters of image processing to be executed Instruct the generation of a group. In addition, when the required image processing is a combination of a plurality of types of image processing, the application 32 responds to individual image processing when notified of completion of generation of the module group from the instructed module generation unit 44. The process of starting the other module generation unit 44 and notifying the information necessary for generating the module group is repeated in ascending order of the execution order of the individual image processes.

  In the above input module, the image data supply unit 22 is the input module for the module group with the first execution order, and the last module (usually the buffer) for the module group with the second execution order or later. Module 40) is the input module. As for the above output modules, the image output unit 24 is designated as the output module in the module group whose execution order is the last, so that the image output unit 24 is designated as the output module. Specification by the application 32 is not performed for confirmation, and the module generation unit 44 generates and sets it when necessary. The input image attributes and image processing parameters are registered as information in advance in association with, for example, the type of job that can be instructed by the user, and information corresponding to the type of job instructed to be executed is read out. As a result, the application 32 may recognize it, or the user may specify it.

  On the other hand, the module generation unit 44 performs module generation processing when activated by the application 32. In the module generation process, first, input image attribute information representing an attribute of input image data input to the generation target image processing module 38 is acquired. Note that the processing for acquiring the attributes of the input image data is performed in the case where the buffer module 40 exists in the previous stage of the generation target image processing module 38 and the image processing module in the previous stage that writes image data in the buffer module 40. This can be realized by acquiring the attributes of the output image data from the image data 38.

  Then, based on the attribute of the input image data represented by the acquired information, it is determined whether the generation of the image processing module 38 to be generated is necessary. For example, the module generation unit 44 is a module generation unit that generates a group of modules that perform color conversion processing. When the CMY color space is designated as the color space of the output image data by the image processing parameter from the application 32, the acquired input image When the input image data is found to be RGB color space data based on the attribute information, it is necessary to generate an image processing module 38 that performs RGB → CMY color space conversion as an image processing module 38 that performs color space processing. However, when the input image data is data in the CMY color space, the attribute of the input image data and the attribute of the output image data match with respect to the color space, so that the image processing module 38 that performs color space conversion processing generates Judge as unnecessary.

  If it is determined that the generation target image processing module 38 needs to be generated, it is determined whether the buffer module 40 is required after the generation target image processing module 38. This determination is made when the subsequent stage of the image processing module is the output module (image output unit 24) (see, for example, the last stage image processing module 38 in the image processing unit 50 shown in FIGS. 2A to 2C). As an example, like the image processing module 38 that performs skew angle detection processing in the image processing unit 50 shown in FIG. 2B, the image processing module performs image processing such as analysis on the image data, and the result is the other. In the case other than the above, the determination is affirmed, and the buffer control unit 40B is activated to activate the buffer module 40 connected to the subsequent stage of the image processing module 38. Is generated.

  Subsequently, information on the preceding module (for example, the buffer module 40), information on the succeeding buffer module 40 (only the image processing module 38 that generated the buffer module 40 in the succeeding stage), and input image data input to the image processing module 38 Attributes and processing parameters are given and registered in the module library 36. Among a plurality of candidate modules that can be used as the image processing module 38, the attributes of the input image data acquired earlier and the image processing module 38 An image processing module 38 that matches the processing parameter to be executed is selected and generated.

  For example, the module generation unit 44 is a module generation unit that generates a group of modules that perform color conversion processing. The CMY color space is specified as the color space of the output image data by the processing parameter, and the input image data is data in the RGB color space. If there is, an image processing module 38 that performs RGB → CMY color space conversion is selected and generated from a plurality of types of image processing modules 38 that perform various color space processing registered in the module library 36. The The image processing module 38 is an image processing module 38 that performs enlargement / reduction processing. If the designated enlargement / reduction ratio is other than 50%, the input image data is enlarged at the designated enlargement / reduction ratio. If the image processing module 38 that performs the reduction process is selected and generated and the designated enlargement / reduction ratio is 50%, the enlargement / reduction process specialized for the enlargement / reduction ratio of 50%, that is, the input image data is one pixel. An image processing module 38 that performs a reduction process of reducing to 50% by thinning out at intervals is selected and generated.

  The selection of the image processing module 38 is not limited to the above. For example, a plurality of image processing modules 38 having different unit processing data amounts in image processing by the image processing engine 38A are registered in the module library 36, and the image processing unit The image processing module 38 having an appropriate unit processing data amount is selected according to the operating environment such as the size of the memory area that can be allocated to 50 (for example, the image processing module 38 having a smaller unit processing data amount as the size decreases). Or the application 32 or the user may select it. In the generated image processing module 38 and buffer module 40, identification information for identifying which module is the front stage and the rear stage of the own module is set.

  When the generation of the image processing module 38 is completed, the workflow management unit 46A is notified of the set of the ID of the subsequent buffer module 40 and the ID of the generated image processing module 38. The ID may be information that can uniquely identify each module, and may be, for example, a number given in the order of generation of each module, an address of an object of the buffer module 40 or the image processing module 38 on a memory, or the like. Further, the module generation unit 44 performs image processing realized by a plurality of types of image processing modules 38 (for example, skew correction processing realized by the image processing module 38 that performs skew angle detection processing and the image processing module 38 that performs image rotation processing). When generating a module group for performing the above, the above process is repeated to generate a module group including two or more image processing modules 38. The module generation processing described above is sequentially performed by the individual module generation units 44 that are sequentially activated by the application 32, so that the necessary image processing can be performed as shown in FIGS. An image processing unit 50 to perform is constructed. The above processing corresponds to the construction means according to the present invention.

  Next, prior to the description of the image processing unit division processing performed by the processing construction unit 42 after the image processing unit 50 is constructed, individual images when image processing is performed by the image processing unit 50 constructed by the above processing. Operations of the processing module 38 and the buffer module 40 will be described in order.

  When executing image processing, a processing request is input from the workflow management unit 46A to each image processing module 38 (see also (1) in FIG. 3A). When the processing request is input, the image processing module 38 requests image data from the module (usually the buffer module 40) in front of the own module defined by the preset identification information (FIG. 3 ( (See also A) (2)). If readable readable data is stored in the buffer 40A of the buffer module 40 in a unit read data amount or more, the buffer module 40 notifies the start address of the read area and requests reading of image data. As a result, the image processing module 38 reads the image data of the unit read data amount from the read area of the preceding module notified of the head address (see also (3) in FIG. 3A).

  Next, the image processing module 38 requests an area for data output from the module subsequent to the module itself, and if the data output area (the module at the subsequent stage is the buffer module 40), the buffer module 40 notifies the start address. (See also (4) in FIG. 3A), the image data acquired from the previous module and the data output area (first address) acquired from the subsequent module are converted into an image. The image data is input to the processing engine 38A and predetermined image processing is performed on the input data (see also (5) in FIG. 3A), and the processed data is written in the data output area (FIG. 3 ( (See also A) (6)). When the input of the unit read data amount to the image processing engine 38A is completed and all the data output from the image processing engine 38A is written in the data output area, the output completion is notified to the subsequent module, and The workflow management unit 46A is notified that the process corresponding to the previously input process request has been completed (see also (7) in FIG. 3A). The image processing in the image processing unit 50 is realized by the above processing being repeated in each image processing module 38.

  When the buffer controller 40B of the buffer module 40 requests image data from a module (usually the image processing module 38) subsequent to its own module defined by preset identification information (FIG. 3B ) (See also (1))), it is checked whether or not the requested image data is stored in the buffer 40A (see also (2) in FIG. 3B), but readable valid data is stored in the buffer 40A. If the unit read data amount is not stored, the image data is requested to the workflow management unit 46A (see also (3) in FIG. 3B). In this case, the workflow management unit 46A recognizes the module (usually the image processing module 38) located in the preceding stage of the buffer module 40 that is the image data request source, and inputs a processing request to the recognized module (FIG. 3 ( (See also B) (4)).

  Then, through the sequence shown in FIG. 3A, the image data is written into the buffer 40A by the image processing module 38 in the previous stage (see also (5) and (6) in FIG. 3B), and from the buffer 40A. When the readable effective data exceeds the unit read data amount, the buffer module 40 notifies the subsequent image processing module 38 of the start address of the reading area, and the subsequent image processing module 38 uses the buffer 40A of the buffer module 40 from the buffer 40A. Image data is read out (see also (7) in FIG. 3B).

  On the other hand, when the processing construction unit 42 constructs the image processing unit 50 as described above, the processing construction unit 42 performs image processing unit division processing shown in FIG. 4 on the constructed image processing unit 50. This image processing section division processing corresponds to the dividing means according to the present invention. First, in step 100, the number N of groups representing how many groups the image processing section 50 is divided into is determined. As the number of groups N, for example, the number of computation resources provided in the computer 10 (for example, resources that can execute computations in parallel, such as a CPU core or a DSP (Digital Signal Processor)) can be applied. The number of computing resources can be obtained using a function provided by the OS. Further, instead of simply using the number of computing resources provided in the computer 10 as the number of groups N, after obtaining the number of computing resources, the usage rate in each computing resource is further obtained. You may make it use the number of the calculation resources below a threshold value as the number N of groups. If the number of groups is N = 1, it is desirable to skip the processing after the next step 102 and end the image processing section division processing.

  In the next step 102, based on the number N of groups determined in step 100, the previously constructed image processing unit 50 is divided into N groups. There are several methods for dividing the image processing unit 50. The first division method uses the total number of image processing modules 38 in the image processing unit 50 as the number M of image processing modules in the image processing unit 50, divides the number M of the above image processing modules by the number N of groups, and generates a remainder. Is generated, the fraction processing such as truncation is performed on the quotient to obtain the number L of image processing modules 38 per group, the image processing unit 50 is scanned in order from the top, and L image processing modules 38 are obtained. Each time it appears, up to the L-th image processing module 38 is grouped as one group, and the count value of the number of image processing modules 38 is reset to 0, so that the image processing unit 50 is divided into N groups. It is a method of dividing. Of the image processing modules 38 constituting the image processing unit 50, the image processing module 38 (image processing module 38 that performs image processing such as image rotation) cannot start image processing unless image data for one surface is prepared. As the number M of image processing modules, a value obtained by subtracting the number of recognized image processing modules 38 from the total number of image processing modules 38 in the image processing unit 50 may be used. The first division method has an advantage that the processing becomes simple.

  Further, the second division method is a method of dividing so that the processing load of each group (here, CPU processing time is used as an example of the processing load) is equal. That is, first, the processing load (CPU processing time) of each image processing module 38 constituting the image processing unit 50 is predicted. Here, among the various image processing modules 38, for the image processing module 38 that performs image processing in which the CPU processing time does not change greatly regardless of changes in the image size and processing parameters, the CPU processing time set in advance is fixed. By acquiring, the CPU processing time can be predicted. In addition, for the image processing module 38 that performs image processing in which the CPU processing time changes greatly with respect to changes in the image size and processing parameters, the relationship between the change in the image size and processing parameters and the CPU processing time is in a form such as a prediction formula. The CPU processing time can be predicted by obtaining the prediction formula in advance and calculating the CPU processing time according to the image size and processing parameters.

  Next, the sum of the CPU processing times of the individual image processing modules 38 constituting the image processing unit 50 is calculated, the calculated sum of the CPU processing times is divided by the number of groups N, and the calculation result (CPU processing per group) The average value of time) is set to the threshold Th. Then, while integrating the CPU processing time of the image processing module 38 in order from the top of the image processing unit 50, the integrated value of the CPU processing time is compared with the threshold value Th, and each time the integrated value of the CPU processing time becomes equal to or greater than the threshold value Th, The image processing module 38 whose integrated value is equal to or greater than the threshold Th is grouped as one group, and the integrated value of the CPU processing time is returned to 0, thereby dividing the image processing unit 50 into N groups. . The second division method is more preferable because the processing load of each group can be made as uniform as possible, although the processing is slightly more complicated than the first division method.

  Note that the division method when dividing the image processing unit 50 into N groups is not limited to the above method, and other division methods (for example, the CPU of the j-th image processing module in the second division method). If the integrated value becomes equal to or greater than the threshold Th at the stage where the processing time is added to the integrated value, the difference A between the integrated value and the threshold Th is integrated before adding the CPU processing time of the jth image processing module. When the deviation A is small, the subsequent stage of the j-th image processing module is used as the group boundary. When the deviation B is small, the previous stage of the j-th image processing module is used as the group boundary. A dividing method) may be used.

  When the image processing unit 50 is divided into N groups as described above, in the next step 104, the buffer module 40 located at the boundary of each group is replaced with the buffer module 40 with the exclusive control function. As a result, as shown in FIG. 5A, for example, the initially constructed image processing unit 50 has image processing modules M1, M2, M3, and M6 and buffer modules B1, B2, and B3 connected alternately and in series. In addition, a partial image processing unit in which the image processing modules M4 and M5 and the buffer modules B4 and B5 are alternately and serially connected is connected between the buffer module B1 and the image processing module M6. As shown in FIG. 5B, the image processing unit 50 divides the group A including the modules M1, B1, and the group B including the modules M2, B2, M3, and B3 by dividing the image processing unit 50 described above. When divided into a group C consisting of modules M4, B4, M5 and B5 and a group D consisting of modules M6, the buffer module B1 located at the boundary between group A and groups B and C, Buffer module B3 is positioned on the boundary of the loop B and Group D, and a buffer module B5 which is located on the boundary of the group C and group D is that replace each buffer module with exclusive control function.

In the next step 106, it is necessary to divide a part of the image processing unit 50 (corresponding to the second image processing unit according to the present invention) and cause the server computer 27 to operate, so-called division of the image processing unit 50 is necessary. To determine .

Determination of step 106 can be automatically performed by performing one of the following determinations. That is, for example, the above determination may be performed by determining whether or not the total CPU processing time of the individual image processing modules 38 constituting the image processing unit 50 is equal to or greater than the first threshold. The number of computation resources that are provided and can be used for the operation of the image processing unit 50 (the number of computation resources may be the total number of computation resources provided in the computer 10 or the current number of computation resources provided in the computer 10 The above determination may be made by determining whether or not the usage rate is the total number of computing resources having a predetermined value or less) or less than the second threshold, or the CPU processing time of each image processing module 38 The above-mentioned determination is performed by calculating the sum for each group and determining whether there is a group having a total CPU processing time equal to or greater than the second threshold. Unishi may be.

  Further, for example, the image processing unit 50 shown in FIG. 5A has a configuration in which image processing cannot be performed in group D unless the results of image processing in group B and the results of image processing in group C are complete. In order to avoid a long time, it is desirable to perform image processing in group B and image processing in group C in parallel. Therefore, the maximum number of paths that are desirably executed in parallel is determined based on the configuration of the image processing unit 50 (for example, in the configuration shown in FIG. 5A, the maximum number of paths is “2”). The determination in step 106 may be performed by determining whether or not the maximum number of paths is larger than the number of computing resources provided in the computer 10 and available for the operation of the image processing unit 50.

  If the determination in step 106 is negative, that is, if it is determined that the division of the image processing unit 50 is unnecessary, the process proceeds to step 108, where each group of the image processing unit 50 is assigned as a thread executed by the computer 10 (each A thread for executing the program of the group is generated on the computer 10), and the image processing section dividing process is terminated. In this case, the image processing unit 50 operates only on the computer 10 (processing corresponding to the image processing unit 50 is performed only by the computer 10).

  On the other hand, if the determination in step 106 is affirmative, that is, if it is determined that the image processing unit 50 needs to be divided, the process proceeds to step 110 and a group to be divided is selected from each group of the image processing unit 50. As the group to be divided, for example, a group having the maximum processing load (a group having the maximum total CPU processing time of the image processing module 38 calculated for each group) can be applied. This is particularly effective when the server computer 27 has a higher processing capacity than the computer 10. In addition, when there are a plurality of groups in the image processing unit 50 where it is desirable to perform image processing in parallel, such as groups B and C in the image processing unit 50 shown in FIG. Any of a plurality of groups in which it is desirable to perform processing in parallel (for example, when the server computer 27 has a higher processing capacity than the computer 10, the group with the largest processing load among them, the computer 10 is more than the server computer 27. If the processing capability is high, the group with the largest processing load) may be applied as the group to be divided.

  In step 112, the program of each module constituting the group to be divided is transferred to the server computer 27 via the network 26 by the communication control unit 25. In the next step 114, the server program stored in the storage unit 20 is transferred. Is transferred to the server computer 27 via the network 26 by the communication control unit 25. In step 116, the server computer 27 is requested to execute each program transferred in steps 112 and 114. As a result, the group and server process management unit 46 to be divided are respectively allocated as threads to be executed by the server computer 27 (the thread and server process management unit 46 for executing the program of the group to be divided). Each thread is generated on the server computer 27), and each thread is executed by the server computer 27.

  Thereby, for example, when the group C composed of the modules M4, B4, M5, and B5 is selected as the group to be divided in the image processing unit 50 shown in FIGS. As shown in FIG. 5C, the image processing unit 50 is divided into a group C and other parts (corresponding to the first image processing unit according to the present invention), and the group C is executed by the server computer 27. A process management unit 46 (workflow management unit 46A, resource management unit 46B, and error management unit) that is generated on the server computer 27 as a thread (operating on the server computer 27) and that operates on the server computer 27 46C) is newly generated. The process management unit 46 operating on the server computer 27 corresponds to the second process management unit according to the present invention, and the process management unit 46 operating on the computer 10 is the first process according to the present invention. It corresponds to the management department.

  When the buffer control unit 40B of the group C buffer modules B4 and B5 generated on the server computer 27 requests the resource management unit 46B operating on the server computer 27 to secure a memory area, The resource management unit 46B secures a memory area from the memory 27B provided in the server computer 27 through an operating system operating on the server computer 27, and the secured memory area is transferred from the resource management unit 46B to the buffer module B4, By being handed over to the buffer controller 40B of B5, the group C including the buffer modules B4 and B5 can be executed. Note that the above-described memory allocation processing by the resource management unit 46B operating on the server computer 27 corresponds to “management processing for operating the second image processing unit” by the second processing management unit according to the present invention. is doing. In parallel with this process, the computer 10 performs a process of releasing the memory area once reserved for the buffer modules B4 and B5 operating on the computer 10.

  In the next step 118, the processing management unit 46 operating on the server computer 27 is notified of the configuration information that defines the configuration of the group operating on the server computer 27 and the group operating on the computer 10. By transmitting connection information that defines how the group is connected, the processing management unit 46 operating on the server computer 27 sets the transmitted information. Similarly, in step 120, the configuration information and connection information set in the process management unit 46 are corrected for the process management unit 46 operating on the computer 10. Accordingly, in the example shown in FIG. 5C, the processing management unit 46 operating on the server computer 27 includes the image processing unit (group C) to be managed as modules M4, B4, M5, and B5 in series. This indicates that the configuration is connected, the preceding stage of the image processing module M4 is the buffer module B1 that operates on the computer 10, and the subsequent stage of the buffer module B5 is the image processing module M6 that operates on the computer 10. Information is set for each. The information set in the processing management unit 46 operating on the computer 10 includes the image processing units (groups A, B, D) to be managed by the modules M1, B1, M2, B2, M3, B3, M6. The configuration is that they are connected in series, the image module M4 that operates on the server computer 27 is also present after the buffer module B1, and the image processor M6 operates on the server computer 27 before the image processing module M6. To the information indicating that the buffer module B5 is also present.

  In this embodiment, a program for each module can be used in common regardless of whether or not the image processing unit 50 is divided. Therefore, a pair of modules for transmitting and receiving information is on different computers. When operating, the process management unit 46 is interposed between the pair of modules to transmit and receive information (details will be described later). For this reason, each processing management unit 46 is a processing management unit 46 in which the modules in the previous stage (or the subsequent stage) operate on the same computer with respect to the modules existing before and after the division position of the image processing unit 50. Set the information that represents that. For example, in the example shown in FIG. 5C, the processing management unit 46 operating on the server computer 27 includes a front module for the image processing module M4 and a rear module for the buffer module B5. Information indicating that it is the processing management unit 46 operating on the computer 27 is set, and the processing management unit 46 operating on the computer 10 is connected to the preceding module and buffer module B1 for the image processing module M6. On the other hand, information indicating that the processing management unit 46 operating on the computer 10 is also included in each subsequent module.

  In step 122, each group other than the group to be divided (the group generated on the server computer 27 as a thread operating on the server computer 27) is executed by the computer 10 (operates on the computer 10). ) As a thread, it is generated on the computer 10, and the image processing section dividing process is terminated.

  When the construction of the image processing unit 50 is completed by the above processing, the workflow management unit 46A of the processing management unit 46 operating on the computer 10 generates a plurality of threads generated on the computer 10 by the processing construction unit 42. While being executed in parallel by the CPU 12 (and other computing resources), a processing request is input to the image processing module 38 located at the last stage of the image processing unit 50. Similarly, the workflow management unit 46A of the process management unit 46 operating on the server computer 27 also converts the thread generated on the server computer 27 by the process construction unit 42 to the CPU 27A (and other computations) of the server computer 27. Resource).

  Each time the data request is input from any buffer module 40 or image processing module 38 operating on the same computer, the individual workflow management unit 46A determines that the data request destination in the input data request is on another computer. In response to the input data request, communication is performed with the workflow management unit 46A operating on another computer. Acquire the data, and provide the acquired data to the module that is the data request input source. Hereinafter, this process will be described with reference to FIG.

  In FIG. 6, the image processing module 38 operates on a certain computer (for example, a server), while the buffer module 40 indicated as “previous stage buffer module” in FIG. 6 is divided by the image processing unit 50. It is running on another computer (eg client). In this embodiment, in such a case, for the image processing module 38 described above, the workflow management unit 46A (the “server-side workflow management unit” shown in FIG. 6) in which the previous module operates on the same computer. Information indicating the presence is set, and for the buffer module 40, the subsequent module is the workflow management unit 46A ("client-side workflow management unit" shown in FIG. 6) that operates on the same computer. Information that represents is set.

  Therefore, the data request from the image processing module 38 is input to the server-side workflow management unit (see also (2) in FIG. 6), and the server-side workflow management unit sends the client-side workflow management unit on the server. The operating image processing module 38 notifies that image data is requested (see also (3) in FIG. 6). As a result, the client-side workflow management unit recognizes the buffer module 40 preceding the image processing module 38 that operates on the server and requests image data, and requests image data from the recognized buffer module 40. The image data is read from the buffer 40A of the buffer module 40 (see also (5) in FIG. 6), and the read image data is transferred to the server-side workflow management unit (see FIG. 6). (See also (6)). When the server-side workflow management unit receives the image data from the client-side workflow management unit, the server-side workflow management unit temporarily stores the received image data in the memory, and then notifies the image processing module 38 of the data request input source of the memory request. As a result, the image processing module 38 reads the image data received from the client-side workflow management unit. As a result, transmission / reception of the image data from the buffer module 40 operating on a different computer to the image processing module is realized, and in each module, the modules before and after the own module operate on the same computer as the own module. It is possible to perform processing without being aware of whether or not it is operating (without switching processing depending on whether or not it is operating on the same computer as its own module).

  The above sequence is a sequence for transferring image data from the client (computer 10) to the server (server computer 27), but the transfer of image data from the server computer 27 to the computer 10 is also realized in the same sequence. The The above sequence is a sequence when the image processing module 38 reads image data from the preceding buffer module 40, but the same sequence is realized when the image processing module 38 writes image data to the succeeding buffer module 40. Is done.

  In addition, each workflow management unit 46A receives a data request from an arbitrary module operating on the same computer, and determines that the data request destination in the input data request is a module operating on the same computer. In this case, a data request is input to the determined module, and each time a processing completion notification is input from any image processing module operating on the same computer, the processing request is input to the image processing module of the notification source. The process is repeated until the end of the entire process (end of image processing for image data for one surface) is notified from the last image processing module. Also, the workflow management unit 46A operating on the server computer 27 completes image processing with respect to the workflow management unit 46A operating on the computer 10 when the image processing by each module operating on the server computer 27 is completed. To be notified. Note that the processing described above by the individual workflow management unit 46A also corresponds to the management processing by the first processing management unit or the second processing management unit according to the present invention. Then, the individual workflow management unit 46A performs the above-described processing, so that the part of the image processing unit 50 excluding the group to be divided operates on the computer 10, and the group to be divided is parallel to the operation. Since it operates on the server computer 27, the processing time can be shortened compared with the case where the image processing unit 50 operates only on the computer 10.

  Further, when an error occurs in any module during the execution of image processing, if the module in which the error has occurred is a module operating on the computer 10, the process management operating on the same computer (computer 10) If the occurrence of an error is notified to the error management unit 46C of the unit 46, and the module in which the error has occurred is a module operating on the server computer 27, the process management operating on the same computer (server computer 27) The error management unit 46C of the unit 46 is notified of the occurrence of the error.

  When the occurrence of an error is notified, the individual error management unit 46C acquires error information such as the type and location of the error that has occurred, and the type of the computer (computer 10 or server computer 27) that is operating, The device environment information representing the configuration and the like is acquired from the storage unit 20 or the HDD 27C, and an error notification method according to the device environment represented by the acquired device environment information is determined. Then, the error management unit 46C operating on the computer 10 notifies the occurrence of an error by the determined error notification method, and the error management unit 46C operating on the server computer 27 generates an error by the determined error notification method. Is requested to the error management unit 46C operating on the computer 10, the error management unit 46C operating on the computer 10 notifies the occurrence of an error. Note that the processing described above by each error management unit 46C also corresponds to the management processing by the first processing management unit or the second processing management unit according to the present invention.

  When the image processing in the server computer 27 is completed, resources such as a memory area secured by the resource management unit 46B operating on the server computer 27 are all released through the resource management unit 46B, and the image in the computer 10 is displayed. When the processing is completed, all resources such as a memory area secured by the resource management unit 46B operating on the computer 10 are also released through the resource management unit 46B. The resource release processing by these resource management units 46B also corresponds to the management processing by the first processing management unit or the second processing management unit according to the present invention.

  When a part of the image processing unit 50 is divided and operated on the server computer 27, when the processing management unit 46 is provided only on the computer 10, each module operating on the server computer 27 is a resource It is necessary to communicate with the processing management unit 46 operating on the computer 10 when securing, releasing, generating an error, or executing image processing, and traffic between the computer 10 and the server computer 27 is greatly increased. At the same time, the processing efficiency is greatly reduced by delaying the processing by the time required for communication.

  On the other hand, in the present embodiment, when a part of the image processing unit 50 is divided and operated on the server computer 27, in addition to the processing management unit 46 operating on the computer 10, 5 is also provided, the communication between the computer 10 and the server computer 27 is performed between modules existing before and after the division position of the image processing unit 50 (example in FIG. 5C). Then, communication for transferring image data between the buffer module B1 and the image processing module M4 and between the buffer module B5 and the image processing module M6) is mostly performed. As a result, an increase in traffic between the computer 10 and the server computer 27 can be suppressed, and the time required for communication between the individual modules operating on the server computer 27 and the processing management unit 46 can be shortened. Therefore, the processing efficiency can be improved, and the processing time can be shortened by performing image processing in parallel in the computer 10 and the server computer 27.

  In the above, after dividing the image processing unit 50 into a plurality of groups based on the number of image processing modules, processing load, etc., a group to be operated on the server computer 27 is selected from the plurality of groups. Although the aspect which divides | segments an image processing part into the part (2nd image processing part) operated on the server computer 27 and the other part (1st image processing part) was demonstrated, this invention is limited to this. For example, without dividing the image processing unit 50 into a plurality of groups in advance, the image processing unit 50 directly determines a portion that should be executed in parallel, and based on the determination result, the image processing unit 50 may be divided into a first image processing unit and a second image processing unit.

  In the above description, the second computer according to the present invention is set in advance (the second computer is fixed to the server computer 27). However, the present invention is not limited to this. A computer for operating the image processing unit may be selected from a plurality of computers each time. For selection of the computer that operates the second image processing unit, for example, information such as processing capability and configuration of each of a plurality of computers may be stored in advance, and may be selected based on the information. The processing load applied to each of the plurality of computers may be acquired when the computer that operates the second image processing unit is selected, and may be selected based on the acquired processing load.

  In the above description, the case where there is one second computer according to the present invention has been described. However, in the present invention, there may be a plurality of second computers. In this case, the image processing unit is connected to one first computer. What is necessary is just to divide | segment into an image processing part and the 2nd image processing part of the same number as a 2nd computer. Further, the number of second computers is variable, and the number of divisions of the image processing unit is determined based on the configuration of the image processing unit (for example, a desirable value of the number of parallel executions in a portion of the image processing unit that is desirably executed in parallel). Then, the same number of second computers as the value obtained by subtracting 1 from the determined number of divisions may be selected.

  Furthermore, in the above description, the process management unit 46 including the workflow management unit 46A, the resource management unit 46B, and the error management unit 46C is provided on the second computer (server computer 27) as the second process management unit operating on the second computer. However, the present invention is not limited to this, and the second processing management unit operated on the second computer is the workflow management unit 46A, resource management unit 46B, and error management unit 46C. Any configuration having at least one function may be used. In order to suppress an increase in traffic between the first computer and the second computer, it is particularly effective that the second processing management unit has a function corresponding to the workflow management unit. It is desirable that the unit has at least a function corresponding to the workflow management unit.

  In the above description, the image processing program group 34 corresponding to the image processing program according to the present invention is stored (installed) in the storage unit 20 in advance. However, the image processing program according to the present invention is a CD-ROM. It is also possible to provide it in a form recorded on a recording medium such as a DVD-ROM.

It is a block diagram which shows schematic structure of the computer (image processing apparatus) which concerns on this embodiment. It is a block diagram which shows the structural example of an image process part. (A) is an image processing module, and (B) is a block diagram showing a schematic configuration of a buffer module and processing to be executed. It is a flowchart which shows the content of the image process part division | segmentation process performed by the process construction part. It is a block diagram which shows an example of the image process part for demonstrating the division | segmentation of the image process part by an image process part division | segmentation process. It is a block diagram which shows an example of the transmission / reception sequence of information when the front | former stage module of an image processing module is operate | moving on another computer.

Explanation of symbols

10 Computer 12 CPU
20 storage unit 27 server computer 38 image processing module 40 buffer module 42 processing construction unit 46 processing management unit 50 image processing unit

Claims (4)

A plurality of types of image processing modules that perform different image processing on the image data acquired from the previous stage of the own module, and output the image data that has undergone the image processing or the processing result of the image processing to the subsequent stage of the own module, and Storage means for storing each of the programs of the buffer modules for causing the image data output from the previous module to be written in the buffer and for causing the image data stored in the buffer to be read by the subsequent module;
The buffer module is connected to at least one of the preceding stage and the succeeding stage of each of the one or more image processing modules selected from the plurality of types of image processing modules by a program stored in the storage means, Construction means for constructing image processing units connected in a pipeline form or a directed acyclic graph form;
A first process management unit that operates on the first computer and performs a management process for causing the image processing unit constructed by the construction unit to operate on the first computer;
When the predicted value of the processing load of the image processing unit is greater than or equal to a first threshold, or the number of program execution resources provided in the first computer and available for operation of the image processing unit is less than or equal to a second threshold In this case, the image processing unit constructed by the construction unit is divided into a first image processing unit and a second image processing unit, and management for operating the first image processing unit on the first computer is performed. A second process for performing a management process for operating the second image processing unit on a second computer connected to the first computer via a communication line, while causing the first processing management unit to perform the process. A dividing unit for generating the processing management unit on the second computer and operating the second image processing unit on the second computer;
An image processing apparatus.   The first process management unit and the second process management unit secure and allocate memory as the management process in response to requests from individual modules constituting the image processing unit to be managed. Memory management processing for releasing unnecessary memory, acquiring image data from the previous stage of the own module, performing predetermined image processing, and outputting the image data or the processing result of the predetermined image processing to the subsequent stage of the own module Workflow management processing for repeating the processing in each image processing module of the image processing unit targeted for management processing, and error management for notifying an error occurring in the image processing unit targeted for management processing by a predetermined notification method The image processing apparatus according to claim 1, wherein at least one of the processes is performed. The storage means also stores a program of the second process management unit,
The dividing means transfers the program of the second process management unit to the second computer via the communication line, and instructs the second computer to execute the transferred program, thereby The image processing apparatus according to claim 1, wherein the management unit is generated on the second computer. A plurality of types of image processing modules that perform different image processing on the image data acquired from the previous stage of the own module, and output the image data that has undergone the image processing or the processing result of the image processing to the subsequent stage of the own module, and The image data output from the previous module is written to the buffer and is connected to storage means for storing each of the buffer module programs for causing the image data stored in the buffer to be read by the subsequent module. A first computer connected to the computer via a communication line;
The buffer module is connected to at least one of the preceding stage and the succeeding stage of each of the one or more image processing modules selected from the plurality of types of image processing modules by a program stored in the storage means, Construction means for constructing image processing units connected in a pipeline form or a directed acyclic graph form,
A first processing management unit for performing management processing for operating the image processing unit constructed by the construction unit on the first computer;
When the predicted value of the processing load of the image processing unit is equal to or greater than a first threshold, or the number of program execution resources provided in the first computer and available for the operation of the image processing unit is a second threshold In the following case, the image processing unit constructed by the construction unit is divided into a first image processing unit and a second image processing unit, and the first image processing unit is operated on the first computer. The second process management unit on the second computer for performing the management process for operating the second image processing unit on the second computer. And an image processing program for causing the second image processing unit to operate on the second computer.

Images