JP5693766B2 - Client device, server device, control method thereof, and program - Google Patents

Description

The present invention relates to a client device, a server device, a control method thereof, and a program .

  In recent years, when recording image data, RAW format image data that records data obtained from an image sensor such as a CCD or CMOS as it is is used together with a general JPEG format. It was. The RAW format is a format unique to each digital camera manufacturer.

  For this reason, in order to develop RAW format image data, the user needs to install a dedicated software program (development software) provided by each manufacturer in the information device. That is, there is a problem in that image data in the RAW format (RAW image data) cannot be developed and cannot be displayed on the display unless the information device has the development software installed.

  As a solution to this problem, when a client device transmits RAW image data to a server device via a network, the server device develops the RAW image data and returns image data in a general format to the client. (See Patent Document 1). As a result, the client can display or print using the image data returned from the server device.

  However, since the RAW image data has a large data size, it takes a lot of time to transmit it from the client device to the server device via the network. At present, in general RAW image data, the size of a CCD or CMOS image sensor is about 4000 pixels horizontally and 3000 pixels vertically. When each pixel of this data is digitized and stored with 14 bits, it is generally about 20 Mbytes per sheet, depending on the complexity of the subject.

  Moreover, the communication speed of a currently common network is, for example, about 1 Mbps in the upstream direction. When 20 Mbytes of RAW image data is transmitted at a communication speed of 1 Mbps, since 20 MByte = 160 Mbit, it takes 160 Mbit / 1 Mbps = 160 seconds (2 minutes and 40 seconds).

  Furthermore, when a user wants to develop a large amount of RAW image data, a great amount of time is spent, and usability is reduced.

JP 2009-044256 A

According to the present invention , when a RAW image is transmitted from a client apparatus to a server apparatus, and the server apparatus develops RAW image data and transmits the RAW image data to the client apparatus, the time required for displaying the RAW development result on the client apparatus is reduced. It is an object of the present invention to provide a client device, a server device, a control method thereof, and a program .

In order to achieve the above object, a client device according to claim 1 is a client device connected to a server device via a network, and a reduction unit that generates a reduced image by reducing an original image; Transmission means for transmitting a reduced image to the server device, first receiving means for receiving the result of image processing of the reduced image by the server device from the server device, and the result of image processing of the reduced image on the screen Display means for displaying, issuing means for issuing an image processing execution instruction for the original image to the server device after the display means displays the image processing result of the reduced image on the screen, and the transmitting means includes the When the reduced image is transmitted to the server device, the image processing device includes start means for starting transmission processing of the original image to the server device .
The server device according to claim 8 is a server device connected to the client device via a network, wherein the server device receives a reduced image from the client device, and executes image processing on the reduced image. An image processing means for performing transmission, a transmission means for transmitting the result of image processing performed on the reduced image by the image processing means to the client device, and a receiving means for receiving the reduced image from the client device. Start means for starting reception processing of the original image from the client device, wherein the image processing means executes image processing on the reduced image, and issues an instruction to execute image processing on the original image to the client After receiving from the apparatus, the image processing for the original image is performed using the adjustment value used for the image processing for the reduced image. Characterized in that it run.

  According to the present invention, when an image is transmitted from a client device to a server device, and the result of image processing in the server device is received by the client device and displayed in the display area, the time required to display the result is displayed. Can be shortened.

1 is a schematic diagram illustrating a configuration of an image processing system according to an embodiment of the present invention. It is a block diagram which shows the structure of the client apparatus which concerns on one Embodiment of this invention. It is a block diagram which shows the structure of the server apparatus which concerns on one Embodiment of this invention. It is a figure which shows the raw image data which concern on one Embodiment of this invention. It is a flowchart which shows the process sequence of the client apparatus which concerns on one Embodiment of this invention. It is a flowchart which shows the process sequence of the client apparatus which concerns on one Embodiment of this invention. It is a flowchart which shows the process sequence of the server apparatus which concerns on one Embodiment of this invention. It is a flowchart which shows the process sequence of the server apparatus which concerns on one Embodiment of this invention. It is a figure which shows the image display window which concerns on one Embodiment of this invention. It is a screen figure which shows the image display state in 2nd Embodiment. It is a screen figure which shows the image display state in 2nd Embodiment. It is a flowchart which shows the process sequence by the side of the client apparatus in 2nd Embodiment. It is a conceptual diagram for demonstrating the reduction RAW image data cut out from the original RAW image data. It is a conceptual diagram for demonstrating the reduction RAW image data cut out from the original RAW image data. It is a flowchart which shows the process sequence by the side of the server apparatus in 2nd Embodiment. It is a screen figure which shows the image display state when a user instruct | indicates equal magnification. FIG. 10 is a sequence diagram when the user instructs equal magnification. It is a screen figure which shows the image display state at the time of a user performing scroll operation. It is a sequence diagram at the time of a user performing scroll operation.

[First Embodiment]
<Configuration of image processing system>
FIG. 1 is a schematic diagram showing a schematic configuration of an image processing system according to an embodiment of the present invention.

  As shown in FIG. 1, this image processing system includes a client device 101, a digital camera 102, and a server device 105. The digital camera 102 is connected to the client device 101 via the USB cable 103, and the client device 101 and the server device 105 are connected via the Internet line 104.

  The client device 101 may be the same as a PC (personal computer) that is generally used at present, and is equipped with a network card adapter and connected to the Internet line 104.

  The digital camera 102 records the captured image in the RAW format, and transmits the RAW format image file (RAW image file) to the client device 101 via the USB cable 103.

  The server device 105 is installed and executed with server software for performing an online development service. Normally, the server device 105 includes a high-speed CPU and a large amount of storage media in order to perform a large amount of data processing and network communication at high speed. However, the hardware configuration may be the same as that of the client device 101.

<Internal Configuration of Client Device 101 and Server Device 105>
First, FIG. 2 is a block diagram showing an internal configuration of the client apparatus 101.

  The client device 101 includes a display unit 201 composed of a liquid crystal display, an input unit 202 composed of a mouse and a keyboard, a hard disk 203 as a nonvolatile storage medium, a DRAM 204 as a volatile storage medium, and a CPU 205 as a central processing unit. ing. These are connected to the internal bus 221.

  The internal bus 221 directly or indirectly connects the display unit 201, the input unit 202, the hard disk 203, the CPU 205, the DRAM 204, and the Internet line 104 to other units not shown, and can send and receive data to and from each other. It is a bus to do.

  The hard disk 203 stores an operating system (OS), a program, and a RAW image file. The program is for operating the client apparatus 101 as a client apparatus of the image processing system, and the CPU 205 reads the program of the hard disk 203 into the DRAM 204 and executes it sequentially, thereby realizing functions and processing described later.

  The RAW image file is taken by the digital camera 102 and received from the digital camera 102. Then, the CPU 205 manages the RAW image data generated for each photographing in units of files by the operating system.

  The DRAM 204 includes the above-described program, RAW image file, original image data (original RAW image data) that is the actual image data of the RAW image file, reduced RAW image data, original RAW development result, reduced RAW development result, development conditions, and The original RAW transmission completion flag is stored.

  Note that the DRAM 204 reads and stores a required program from among the programs of the hard disk 203. The DRAM 204 reads and stores a RAW image file selected by the user via the input unit 202 from the RAW image files on the hard disk 203.

  The DRAM 204 stores contrast = 0 and brightness = 0 as initial values of the development conditions. When the user changes the development conditions via the input unit 202, the DRAM 204 updates and stores the values. . Here, the development condition is a set of image quality adjustment parameters used when developing RAW image data. In the present embodiment, eleven levels of adjustment values from −5 to +5 can be designated for contrast and brightness. To do.

  The DRAM 204 stores “0” indicating incomplete as an initial value of the original RAW transmission completion flag, and indicates “1” indicating completion when transmission to all the RAW image files to be selected is completed. Update to "" and store.

  The CPU 205 is a PC for file IO, memory IO, display processing on the display unit 201, image processing, user input acceptance processing from the input unit 202, and command / data transmission / reception processing with the server device 105 via the Internet line 104. Control the basic processing. In addition, the CPU 205 executes control of each processing order and other processing that is currently required for a general PC.

  Next, the internal configuration of the server device 105 will be described with reference to FIG. FIG. 3 is a block diagram showing the internal configuration of the server device 105 in detail.

  The server device 105 includes a hard disk 222 that is a nonvolatile storage medium, a DRAM 239 that is a volatile storage medium, and a CPU 224 that is a central processing unit, and these are connected to an internal bus 243.

  The internal bus 243 is a bus that directly or indirectly connects the hard disk 222, the CPU 224, the DRAM 239, the Internet line 104, and other units not shown, and enables data transmission / reception with each other.

  The hard disk 222 stores an operating system (OS) and a program for operating the server device 105 as the server device 105 of the image processing system. Note that the CPU 224 implements functions and processes to be described later by reading the program of the hard disk 222 into the DRAM 239 and sequentially executing the program.

  The DRAM 239 stores the above-described program, original RAW image data, reduced RAW image data, an original RAW development result, a reduced RAW development result, and an original RAW data received flag which will be described later.

  Note that the DRAM 239 reads and stores a required program from among the programs of the hard disk 222. The DRAM 239 stores original RAW image data and reduced RAW image data received from the client apparatus 101 via the Internet line 104.

  The DRAM 239 stores “0” indicating incomplete as an initial value of the original RAW received flag, and updates and stores “1” indicating reception completion when reception of the original RAW image data is completed.

  The CPU 224 controls file IO, memory IO, image processing, command / data transmission / reception processing with the server device 105 via the Internet line 104, and basic processing as a PC. In addition, the CPU 224 executes control of each processing order and other processing required for a general PC.

<Processing Procedure of Client Device 101>
Next, the processing procedure of the client apparatus 101 according to the present embodiment will be described with reference to the flowcharts of FIGS.

  First, in step S501, when the user operates the client apparatus 101 and specifies the URL of the server apparatus 105, the CPU 205 accesses the server apparatus 105 via the Internet line 104 and requests a development service. At this time, the CPU 205 also transmits information necessary for the development service, such as a user account and a password, to the server device 105.

  In step S <b> 502, in response to a user operation, the CPU 205 selects a RAW image file to be developed from a plurality of RAW image files existing on the hard disk 203.

  Since the client device 101 is not installed with software for developing and converting a RAW image file into a displayable format, the user imagines the image content from attribute information such as the file name and the shooting date and time. Select a RAW image file. Therefore, since there is a high possibility that the user will erroneously select the RAW image file, it is necessary to display the content quickly so as to reduce the trial and error of the selection operation.

  In step S <b> 503, the CPU 205 communicates with the server device 105, performs negotiation processing, and when the processing is completed, activates an original RAW transmission thread for transmitting original RAW image data. Here, the thread is the same as that of a general operating system at present, and is an execution unit of parallel processing that is finer than the process in program execution. Thereafter, the CPU 205 executes the original RAW transmission thread process in the background of the main thread process. Then, the CPU 205 advances the process to step S504 in the main thread. On the other hand, in the original RAW transmission thread, the process proceeds to the process shown in the flowchart of FIG.

  In the negotiation process in step S503, the CPU 205 also transmits / receives information necessary for the original RAW image data reduction process. The CPU 205 transmits the data of the header part of the RAW image file to be developed to the server device 105 when negotiating with the server device 105. The server device 105 analyzes the data in the header part, and acquires information for specifying the detailed format and the model of the digital camera 102. Then, a decoder program and a reduction processing program corresponding to the corresponding format and model are transmitted to the client apparatus 101. In this embodiment, the server apparatus 105 transmits only the decoder and reduction processing program corresponding to the format and model to the client apparatus 101, but this is not restrictive. For example, the server apparatus 105 transmits to the client apparatus 101 a decoder program and a reduction processing program corresponding to all formats and models supported in advance. The CPU 205 may selectively use the program according to the format and model of the RAW image file.

  In step S504, the CPU 205 performs original RAW image data reduction processing according to the decoder program and reduction processing program acquired in the negotiation processing in step S503. In the present embodiment, the size of the image display area 751 of the image display window 750 as shown in FIG. 9 in the display unit 201 is 640 pixels in the horizontal direction and 480 pixels in the vertical direction (hereinafter simply expressed as 640 × 480). And Also, the original RAW image data is a Bayer array composed of R (red), G (green), G (green), and B (blue) filter components as shown in FIG. The height is 3840 pixels. The CPU 205 detects the display size of this image display area, and reduces the original RAW image data according to the display size to generate reduced RAW image data. That is, the original RAW image data as shown in FIG. 4A is thinned out to 1/8 in the vertical and horizontal directions to generate reduced RAW image data of 640 pixels in the horizontal direction and 480 pixels in the vertical direction as shown in FIG. To do. Since each of the vertical and horizontal sizes is 1/8, the size of the reduced RAW image data is 1/64 of the size of the original RAW image data. Then, the CPU 205 stores the generated reduced RAW image data in the hard disk 203.

  In the reduction processing in the present embodiment, adjacent R, G, G, and so on are arranged so that the adjacent patterns of the Bayer array are not disturbed as indicated by arrows P1, P2, and P3 in FIGS. A B pixel is handled as one block, and thinning processing is performed in units of blocks.

  Next, in step S505, the CPU 205 transmits the reduced RAW image data of 640 × 480 size stored in the hard disk 203 to the server device 105 via the Internet line 104 (first transmission process). Thereafter, in step S506, the CPU 205 receives the development result of the reduced RAW image data transmitted to the server apparatus 105 in step S505 from the server apparatus 105 (first reception process), and stores it in the hard disk 203.

  In the present embodiment, the development result of the reduced RAW image data is compressed in the JPEG format in the server device 105. Therefore, in step S507, the CPU 205 performs JPEG decoding processing on the development result of the reduced RAW image data. In step S508, the CPU 205 displays the development result of the reduced RAW image data subjected to the decoding process in the image display area 751 of the display unit 201.

  At this point, the user can confirm the image content of the RAW image file selected in step S502 on the display unit 201. Therefore, even if the user selects the RAW image file by mistake, it can be noticed.

  In step S509, the CPU 205 determines whether the user has input a file reselection command via the input unit 202. If the RAW image file displayed in step S508 is not an image intended by the user, the user can input a file reselection command by operating the input unit 202. If the determination in step S509 is yes, the CPU 205 resets the original RAW transmission thread in step S510, and then returns the process to step S502.

  In the reset process of the original RAW transmission thread in step S510, the CPU 205 initializes the original RAW transmission flag of the DRAM 204 to “0”, sends a selection RAW change notification to the server device 105, and then ends the original RAW transmission thread. .

  On the other hand, if the determination in step S509 is NO, in step S511, the CPU 205 reads from the DRAM 204 the development conditions used during the development processing of the currently displayed reduced RAW development result and the newly entered development conditions from the DRAM 204, and changes them. Judgment is made. In the present embodiment, the user can input two adjustment items of contrast and brightness as development conditions by operating the slider control from the input unit 202. If the determination in step S511 is YES, in step S523, the CPU 205 transmits the development conditions to the server device 105, and then returns the process to step S506.

  For example, the development condition used during the development process of the reduced RAW development result currently displayed on the display unit 201 is <contrast = 0, brightness = 0>, and the newly input development condition is <contrast = 2. If brightness = 1>, it is determined that there is a change in development conditions.

  On the other hand, if the newly input development condition is also <contrast = 0, brightness = 0>, it is determined that the development condition has not been changed.

  In step S512, in response to a user operation, the CPU 205 determines whether or not an execution instruction for the development of the original RAW image has been input. When the user is satisfied with the reduced RAW development result, the user inputs an execution instruction for the development processing of the original RAW image data via the input unit 202, and in response thereto, the CPU 205 issues an execution instruction to the server device 105. If the determination in step S512 is no, the CPU 205 returns the process to step S511.

  On the other hand, if the determination in step S512 is YES, in step S513, the CPU 205 refers to the original RAW transmission completion flag in the DRAM 204, and determines whether transmission of the original RAW image data to the server device 105 has been completed. In step S513, if the value of the original RAW transmission completion flag is “1”, the CPU 205 determines that transmission of all the original RAW image data has been completed. Thereafter, in step S <b> 514, the CPU 205 receives the development result of the original RAW image data from the server device 105 and stores it in the hard disk 203. When reception of the development results of all the original RAW image data is completed, the CPU 205 performs service end processing with the server device 105 in step S515, and then ends this processing procedure. Thereafter, the CPU 205 reads the development result of the original RAW image data from the hard disk 203, executes JPEG data code processing, and displays it on the display unit 201.

  Next, the processing procedure of the original RAW image transmission thread activated by the CPU 205 in step S503 will be described with reference to the flowchart of FIG.

  In parallel with the main thread described above, the CPU 205 performs processing of the original RAW transmission thread after step S517 in FIG. Note that parallel processing in a single CPU with a general single CPU is not actually performed in parallel. The CPU 205 performs pseudo parallel processing by processing the processing of each thread in order according to the operating system. The parallel processing in the present embodiment may be the same as this.

  In step S517, the CPU 205 negotiates with the server apparatus 105 and notifies the server apparatus 105 that transmission of the original RAW image data is started. In step S518, the CPU 205 determines whether or not the main thread is transmitting / receiving data to / from the server device 105. If the main thread is transmitting / receiving data to / from the server device 105, the determination in step S518 is performed again after a predetermined waiting time.

  On the other hand, if the main thread is not transmitting / receiving data to / from the server apparatus 105, the CPU 205 divides the original RAW image data into small units and transmits the divided data to the server apparatus 105 in step S519.

  As described above, in this embodiment, network resources (bandwidth) are preferentially allocated to transmission / reception of reduced RAW image data and reduced RAW development results by the main thread. As a result, even if the original RAW image data is transmitted in the background, the response of the display of the reduced RAW image data and the display update is improved. In addition, by dividing the original RAW image data in step S519 into small units and transmitting each part, the amount of data to be transmitted / received is reduced, and the load on the image processing for transmission / reception processing and display is reduced. .

  In step S520, the CPU 205 determines whether all of the original RAW image data has been transmitted to the server apparatus 105. If there is untransmitted data, the determination in step S520 is NO, and the CPU 205 returns the process to step S518. When all the original RAW image data has been transmitted to the server apparatus 105, the determination in step S520 is YES, and in step S521, the CPU 205 updates the original RAW transmission completion flag of the DRAM 204 to “1”, and then the processing of the original RAW transmission thread. Exit.

<Processing Procedure of Server Device 105>
Next, the processing procedure of the server apparatus 105 according to the present embodiment will be described with reference to the flowcharts of FIGS.

  In step S601, the CPU 224 receives a request for a development service and information necessary for the development service from the client apparatus 101, and performs a development service start process. In the development service start processing, the server device 105 performs authentication of the user of the client device 101 and initialization processing of the original RAW received flag.

  Next, in step S602, the CPU 224 performs a negotiation process with the client apparatus 101. When the process is completed, the CPU 224 activates the original RAW reception thread in step S603. Then, the CPU 224 executes the original RAW reception thread process in the background of the main thread process (second reception process). Then, the CPU 224 advances the process to step S604 in the main thread. On the other hand, the original RAW reception thread proceeds to the process shown in the flowchart of FIG.

  In step S <b> 604, the CPU 224 receives the reduced RAW image data from the client apparatus 101 and stores it in the hard disk 222. In step S <b> 605, the CPU 224 reads development conditions from the DRAM 239 for the reduced RAW image data on the hard disk 222, performs development processing accordingly, and stores the development results in the hard disk 222. Note that the initial value of the development condition of the DRAM 239 is <contrast = 0, brightness = 0>.

  In step S606, the CPU 224 compresses the result developed in step S605 in the JPEG format, and transmits it to the client apparatus 101 in step S607 (second transmission process). In step S <b> 608, the CPU 224 determines whether the development condition update has been received from the client apparatus 101. If this determination is YES, the CPU 224 returns the process to step S605, updates the DRAM 239 with the adjustment value of the received development condition, and again performs the development process on the RAW reduced image data using the updated development condition. I do.

  For example, when the CPU 224 receives a development condition <contrast = 2, brightness = 1>, which is different from the initial value, from the client apparatus 101, the CPU 224 updates the adjustment value of the development condition of the DRAM 239 and uses the new adjustment value. Development of reduced image data is performed.

  If the determination in step S608 is NO, in step S609, the CPU 224 determines whether a selection RAW change notification has been received from the client apparatus 101. If this determination is YES, in step S610, the CPU 224 initializes the original RAW received flag and the like, and then returns the process to step S602.

  In the next step S611, the CPU 224 determines whether or not an instruction to execute the original RAW development has been received from the client apparatus 101. If the determination in step S611 is no, the CPU 224 returns the process to step S608. When the determination in step S611 is YES, in step S612, the CPU 224 refers to the original RAW received flag and determines whether or not reception of all the original RAW image data has been completed. If the determination is NO, the CPU 224 performs the determination in step S612 again after a predetermined waiting time. If the determination in step S612 is YES, in step S613, the CPU 224 reads out the development processing conditions used in step S605 from the DRAM 239, develops the original RAW image data using it, and stores the result in the hard disk 222.

  In the next step S 614, the CPU 224 performs JPEG encoding processing on the development result of the original RAW image data on the hard disk 222. In step S615, the CPU 224 transmits the development result of the original RAW image data subjected to JPEG encoding processing to the client apparatus 101. When the transmission is completed, in step S616, the CPU 224 performs a service end process, and then ends the main thread process in this flow.

  Next, the processing procedure of the original RAW reception thread activated by the CPU 224 in step S603 will be described with reference to the flowchart of FIG.

  First, in step S617, the CPU 224 determines whether the main thread is transmitting / receiving data. If this determination is YES, the CPU 224 performs the determination in step S617 again after a predetermined waiting time. If this determination is NO, in step S618, the CPU 224 receives partial data of the original RAW image data. In subsequent step S <b> 619, the CPU 224 determines whether there is a selection RAW change notification from the client apparatus 101. If the determination in step S619 is YES, the CPU 224 ends the original RAW reception thread because the original RAW image data currently being received is unused data.

  When the determination in step S619 is NO, in step S620, the CPU 224 determines whether or not all the original RAW image data has been received. If reception of all the original RAW image data is completed, the CPU 224 updates the original RAW reception flag to “1” in step S621, and then ends the original RAW reception thread. If the determination in step S620 is no, the CPU 224 returns the process to step S617.

  Hereinafter, an example of the time required for each process will be described. The following equations (1) and (2) indicate the data sizes of the original RAW image data and the reduced RAW image data when the bit depth of each pixel is 16 bits (2 bytes).

Data size of original RAW image data:
5120 x 3840 x 2 bytes = 39, 321, 600 bytes (approximately 40 Mbytes)
... Formula (1)
Data size of reduced RAW image data:
640 × 480 × 2 bytes = 614400 bytes (about 614K bytes)
... Formula (2)

  The reduction processing of the RAW image data in step S504 is a simple thinning process as described above, and the processing content is a copy of the data on the memory of 614 Kbytes on the memory. The following short-time processing.

  Further, the time required for the transmission processing of the reduced RAW image data in step S505 is about 2.5 seconds as shown in the equation (3) when the upstream communication speed of the Internet line 104 is about 2 Mbps. Become.

Reduced RAW image data transmission time:
614 Kbytes = 614,000 × 8 bits = 4, 912,000 bits
4,912,000 bits / 2,000,000 bps = 2.456 s
(About 2.5 seconds) ... Formula (3)

  On the other hand, the time taken for the transmission processing of the original RAW image data in step S503 is about 160 seconds as shown in equation (4).

Original RAW image data transmission time:
40 Mbytes = 40,000,000 × 8 bits = 320,000,000 bits
320,000,000 bits / 2,000,000 bps = 160 s (about 160 seconds) (4)

  In addition, the time required for developing the reduced RAW image data in step S605 is about 1 second in the currently general development software on the currently general PC.

  Further, the time required for the JPEG encoding / decoding process in steps S507 and S614 is on the order of a comma 1 second or less in a general PC, and can be ignored.

  The data size of the reduced RAW development result is about 92 Kbytes as shown in equation (5). This is a value when 8-bit data of RGB3 component is used and the JPEG compression rate is set to about 1/10 of a general rate.

Original data: 640 × 480 × 3 × 1 = 921, 600 bytes After JPEG compression: 921, 600 bytes ÷ 10 = 92, 160 bytes (about 92 Kbytes) (5)

  Also, the time taken to transmit the reduced RAW development result in step S607 is about 0.14 seconds as shown in equation (6). This is a value when the communication speed in the downstream direction of the Internet line 104 is about 5 Mbps, which is currently typical.

Reduced RAW development result transmission time:
92, 160 bytes x 8 bits = 737, 280 bits
737, 280 bits / 5,000,000 bps = 0.14 s (about 0.14 seconds)
... Formula (6)

  From the above, after selecting a RAW image file, the time T1 required for the image content to be displayed in the image display area 751 of the display unit 201 of the client apparatus 101 is about 3.64 seconds as shown in Equation (7). It is.

Reduced RAW transmission time in step S505 = about 2.5 seconds Reduced RAW development time in step S605 = about 1.0 seconds Reduced RAW development result transmission time in step S607 = about 0.14 seconds
T1 = 2.5 seconds + 1.0 seconds + 0.14 seconds = 3.64 seconds
... Formula (7)

  The time taken to transmit the updated development condition in step S523 is negligible because the data to be transmitted is two integer values relating to contrast and brightness, and the data amount is on the order of several tens of bytes.

  As described above, the time T2 required until the development result reflecting the change in the development conditions is displayed in the image display area 751 is about 1.14 seconds as shown in the equation (8) described later.

Reduced RAW development time = about 1.0 second (same as S605)
Reduced RAW development result transmission time = about 0.14 seconds (same as S607)
T2 = 1.0 seconds + 0.14 seconds = 1.14 seconds (8)

  Note that the waiting time until the reception of the original RAW image data in step S612 differs depending on the time taken by the user to adjust the RAW image data. For example, when it takes about 2 minutes, as shown in Expression (9), It takes about 40 seconds.

Original RAW image data reception time = Original RAW image data transmission time−Adjustment work time
= 160 seconds-120 seconds = 40 seconds
... Formula (9)

  It should be noted that the time required for the development processing of the original RAW image data is about 10 seconds on a current general PC.

  As described above, according to the present embodiment, the server apparatus 105 receives the reduced RAW image data from the client apparatus 101 before the original RAW image data and performs the development process. Therefore, until the user confirms the outline of the development result. The amount of data sent and received can be reduced.

  Since the server apparatus 105 develops the reduced RAW image data and provides the result to the client apparatus 101 before developing the original RAW image data, the user of the client apparatus 101 quickly confirms the outline of the image development result. can do.

  Further, since the server apparatus 105 receives the reduced RAW image data and receives the original RAW image data from the client apparatus 101 in parallel with the development processing, the server apparatus 105 receives the original RAW as soon as the user confirms the outline of the development result. Image data development processing can also be performed.

  In the present embodiment, the CPU 205 of the client apparatus 101 loads each program from the hard disk 203. However, the present invention is not limited to this, and the CPU 205 may be downloaded from the server device 105 as a plug-in of the Web browser.

[Second Embodiment]
The image processing system according to the second embodiment provides an enlargement function for the RAW image data displayed in the image display area 751. By using this enlargement function, the user can confirm details of a specific part in the image. When the user clicks the image display area 751 with a mouse cursor, the client apparatus 101 switches the RAW image data from the 1/8 reduced display to the equal display. Hereinafter, description of the same parts as those in the first embodiment will be omitted, and a configuration unique to the present embodiment will be described in detail.

<Image display>
Hereinafter, with reference to FIGS. 10A and 10B and FIGS. 11A and 11B, the state of image display according to the present embodiment will be described. FIGS. 10A and 10B and FIGS. 11A and 11B are screen views showing an image display state in the second embodiment.

  The image display window 750 in this embodiment has an enlarge button 1001 and a reduce button 1002 as shown in FIG. When the user clicks on the enlarge button 1001 with the mouse cursor, the mouse cursor changes to an enlarge button mark. When the left button of the mouse is clicked at an arbitrary position on the image display area 751 in this state, the display is switched to the same magnification display centered on the click position.

  FIG. 10B shows a state in which the flower part is displayed at the same magnification after the user clicks on the flower part. In this state, there are areas that are not displayed such as a stem portion and a leaf portion, but reference numerals 1101 and 1102 in the figure denote scroll buttons for displaying a non-display portion. As shown in FIG. 11A, when the user drags the scroll button 1101 downward, the display state of the image display area 751 is changed. FIG. 11B shows that the leaf area under the flower is displayed when the user scrolls the scroll button 1101 downward.

<Processing Procedure on Client Device 101 Side>
Next, a processing procedure on the client apparatus 101 side in the present embodiment will be described with reference to FIGS. FIG. 12 is a flowchart showing a processing procedure on the client apparatus 101 side in the present embodiment. 13 and 14 are conceptual diagrams for explaining the reduced RAW image data cut out from the original RAW image data.

  As shown in FIG. 12, the processing procedure of the client apparatus 101 in the present embodiment is almost the same as the processing procedure of the first embodiment, and only the steps S801 and S802 are different.

  In step S <b> 801, the CPU 205 performs reduction processing or partial cutout processing on the original RAW image data depending on the state of the image display area 751. When the magnification to be displayed at present is the same magnification display, the CPU 205 first calculates the display target area. For example, when the coordinates at which the user clicks the enlarge button 1001 is X, Y = (200, 200) with the upper left corner of the image as the origin, the following calculation is performed.

  First, click coordinates are converted to the original coordinate system. That is, (200, 200) in the 1/8 coordinate system is multiplied by 8 (1600, 1600) in the original coordinate system. Then, the coordinates of each vertex of the display area are calculated as follows. That is, the coordinates of the vertices having a size of 640 × 480 with the (1600, 1600) coordinates as the center are calculated by the equations (11) to (14).

X coordinate of upper left corner = 1600− (640/2) = 1280 (11)
Y coordinate of upper left corner = 1600− (480/2) = 1360 (12)
X coordinate of lower right corner = 1280 + 640-1 = 1919 (13)
Y coordinate of lower right corner = 1360 + 480-1 = 1840 39 (14)

  Using the calculated coordinates, in step S801, the CPU 205 generates reduced RAW image data cut out from the original RAW image data as shown in FIG. Note that when the magnification to be displayed is reduced display of 640 × 480 size, the same reduction process as in the first embodiment is performed.

  Next, a case where the user performs a scroll operation on the image display area 751 from the state of Expression (11) to Expression (14) = (1280, 1360, 1919, 1839) will be described.

  In this embodiment, when the user moves the scroll button 1101 by 1 dot, the area is scrolled and displayed by 20 dots. In this case, if the user drags the scroll button downward by 50 dots, the area in the coordinate system of the original RAW image data is shifted down by 100 pixels, so the CPU 205 calculates the coordinates of the area as follows: To do.

X coordinate of upper left corner = Formula (11)... Formula (15)
Y coordinate of upper left corner = formula (12) + 100 = 1460 (formula 16)
X coordinate of the lower right corner = Formula (13) ... Formula (17)
Y coordinate of lower right corner = Formula (14) + 100 = 1939 (Formula (18))

  Using the calculated coordinates, in step S801, the CPU 205 generates reduced RAW image data cut out from the original RAW image data as shown in FIG.

  In step S <b> 802, the CPU 205 determines whether the user has performed an operation for changing the display state, such as an enlargement / reduction / scroll operation, from the input unit 202. When the user performs a display state change operation, the CPU 205 returns the process to step S801, and performs the process of creating reduced RAW image data again.

<Processing procedure on the server device 105 side in the second embodiment>
Next, the processing procedure on the server device 105 side in the present embodiment will be described with reference to the flowchart of FIG.

  As shown in FIG. 15, the processing procedure of the client apparatus 101 in the present embodiment is substantially the same as the processing procedure of the first embodiment, and only the procedure of step S901 is different.

  In step S <b> 901, the CPU 224 determines whether there is a request for retransmission of the reduced RAW image data from the client apparatus 101. If the determination is YES, the CPU 224 returns the process to step S604 and receives the reduced RAW image data from the client device 101 again. If the determination is NO, the CPU 224 advances the process to step S608.

<Sequence of image processing system>
Next, the sequence of each processing procedure of the client apparatus 101 and the server apparatus 105 described with reference to the flowcharts of FIGS. 12 and 15 will be described in more detail.

(A) Sequence when User Instructs Same Magnification First, a sequence when the user instructs equal magnification will be described with reference to FIGS. 16 and 17. FIGS. 16A and 16B are screen diagrams showing an image display state when the user instructs the same size, and FIG. 17 is a sequence diagram at that time.

  A case where the user clicks on the image display area 751 with the enlarge button 1001 from the reduced display state as shown in FIG. When the user clicks, in step S1601, the client apparatus 101 calculates a cut-out area of the original RAW image data according to the above expressions (11) to (14). Then, after cutting out the original RAW image data of the flower portion based on the calculation result to generate reduced RAW image data, the reduced RAW image data is transmitted to the server device 105.

  When the server apparatus 105 receives the reduced RAW image data from the client apparatus 101, the server apparatus 105 performs development processing on the reduced RAW image data in step S1602. In step S1603, the server apparatus 105 JPEG-encodes the result and transmits the result to the client apparatus 101.

  When the client apparatus 101 receives the development result from the server apparatus 105, in step S1604, the display update of the image display area 751 is performed, so that the flower part as shown in FIG. To do.

(B) Sequence when user performs scroll operation Next, a sequence when the user performs a scroll operation will be described with reference to FIGS. 18 and 19. FIGS. 18A and 18B are screen diagrams showing an image display state when the user performs a scroll operation, and FIG. 19 is a sequence diagram at that time.

  When the user drags the scroll button 1101 downward from the display state as shown in FIG. 18A, the client apparatus 101 extracts the original RAW image data as shown in Expressions (15) to (18) in Step S1701. Calculate the area. Next, after the raw RAW image data of the grass portion is cut out based on the calculation result to generate reduced RAW image data, the reduced RAW image data is transmitted to the server device 105.

  When the server apparatus 105 receives the reduced RAW image data from the client apparatus 101, the server apparatus 105 develops the reduced RAW image data in step S1702, and JPEG-encodes the result in step S1703, and transmits the result to the client apparatus 101. When the client apparatus 101 receives the development result from the server apparatus 105, in step S1704, by updating the display of the image display area 751, the grass portion as shown in FIG. To do.

  As described above, in the present embodiment, the client apparatus 101 cuts out the original RAW image data to generate reduced RAW image data in accordance with the change in the image display state such as the enlargement / reduction / scroll operation by the user, and the server apparatus Retransmit to 105. Then, the server apparatus 105 performs development processing on the retransmitted reduced RAW image data, and transmits the result to the client apparatus 101. Thus, the user can partially confirm the RAW development result at the same magnification.

  Further, at the same magnification display, the client apparatus 101 performs a clipping process on the original RAW image data in consideration of the display area, and transmits the minimum necessary original RAW image data to the server apparatus 105. Therefore, confirmation with a high-resolution image can be performed while maintaining a response to image display update. This is because when the user needs to check the details of the in-focus position, it is possible to display the portion desired by the user at higher speed and higher image quality when there is no need to check the entire image, and the usability is improved. To do.

[Other embodiments]
The object of the present invention can also be achieved by executing the following processing. That is, a storage medium that records a program code of software that realizes the functions of the above-described embodiments is supplied to a system or apparatus, and a computer (or CPU, MPU, etc.) of the system or apparatus is stored in the storage medium. This is the process of reading the code.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code and the storage medium storing the program code constitute the present invention.

  Moreover, the following can be used as a storage medium for supplying the program code. For example, floppy (registered trademark) disk, hard disk, magneto-optical disk, CD-ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, DVD-RW, DVD + RW, magnetic tape, nonvolatile memory card, ROM or the like. Alternatively, the program code may be downloaded via a network.

  Further, the present invention includes a case where the function of the above-described embodiment is realized by executing the program code read by the computer. In addition, an OS (operating system) running on the computer performs part or all of the actual processing based on an instruction of the program code, and the functions of the above-described embodiments are realized by the processing. Is also included.

  Furthermore, a case where the functions of the above-described embodiment are realized by the following processing is also included in the present invention. That is, the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, based on the instruction of the program code, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing.

101 Client Device 102 Digital Camera 104 Internet Line 105 Server Device

Claims (20)

A client apparatus connected via the server apparatus and the network,
Reduction means for generating a reduced image by reducing the original image;
A transmit unit that sends the reduced image to the server apparatus,
First receiving means for receiving, from the server device, a result of image processing of the reduced image by the server device;
Display means for displaying a result of image processing of the reduced image on a screen;
An issuing means for issuing an image processing execution instruction for the original image to the server device after the display means displays the image processing result of the reduced image on the screen;
A client device , comprising: a start unit that starts transmission processing of the original image to the server device when the transmission unit transmits the reduced image to the server device . The client device according to claim 1, wherein the reduction unit reduces the original image according to a display size of the screen. 2. The reduction unit according to claim 1, wherein when there is an instruction to change an area of an image displayed on the screen, the reduction unit generates a reduced image by cutting out a portion corresponding to the area of the original image. 3. The client device according to 2. 4. The client apparatus according to claim 1, wherein the original image is RAW image data, and the image processing is development processing of the RAW image data. 5. The apparatus according to claim 1, further comprising a program receiving unit configured to receive at least one of a decoder program and a reduction processing program used for generating the reduced image from the server device. The client device described. 2. The image processing apparatus according to claim 1, further comprising a receiving unit configured to receive, from the server device, a result of image processing performed on the original image using an adjustment value used for image processing on the reduced image. 6. The client device according to any one of items 1 to 5. A determination unit for determining whether or not the transmission process of the original image to the server device is completed;
If it is determined that the transmission processing has been completed, the reception unit uses the adjustment value used for the image processing on the reduced image to indicate the result of image processing performed on the original image on the server. The client device according to claim 6, wherein the client device receives the information from the device. A server device connected to a client device via a network,
Receiving means for receiving a reduced image from the client device;
Image processing means for performing image processing on the reduced image;
Transmitting means for transmitting the result of image processing performed on the reduced image by the image processing means to the client device;
When the receiving unit receives the reduced image from the client device, the receiving unit includes a starting unit that starts reception processing of the original image from the client device,
The image processing unit performs image processing on the reduced image, receives an instruction to perform image processing on the original image from the client device, and then uses the adjustment value used for image processing on the reduced image. A server device that performs image processing on the original image. 9. The server apparatus according to claim 8, wherein the original image is RAW image data, and the image processing is development processing of the RAW image data. A method of controlling a client device connected to a server device via a network,
A reduction process for generating a reduced image by reducing the original image;
A transmission step of transmitting the reduced image to the server device;
A first receiving step of receiving, from the server device, a result of image processing of the reduced image by the server device;
  A display step of displaying a result of image processing of the reduced image on a screen;
An issue step of issuing an image processing execution instruction for the original image to the server device after the image processing result of the reduced image is displayed on the screen in the display step;
A method for controlling a client device, comprising: a start step of starting transmission processing of the original image to the server device when the reduced image is transmitted to the server device in the transmission step. The method according to claim 10, wherein in the reduction step, the original image is reduced in accordance with a display size of the screen. The reduced image is generated by cutting out a portion corresponding to the area of the original image when there is an instruction to change the area of the image displayed on the screen in the reducing step. 11. A method for controlling a client device according to 11. 13. The method of controlling a client device according to claim 10, wherein the original image is RAW image data, and the image processing is development processing of the RAW image data. The program receiving step of receiving at least one of a decoder program and a reduction processing program used for generating the reduced image from the server device, further comprising: Client device control method. 11. The method according to claim 10, further comprising: a reception step of receiving, from the server device, a result of image processing performed on the original image using an adjustment value used for image processing on the reduced image. 14. The method for controlling a client device according to claim 14. A determination step of determining whether transmission processing of the original image to the server device is completed;
If it is determined that the transmission process has been completed, the reception step uses the adjustment value used for the image processing on the reduced image, and the result of executing the image processing on the original image is the server. 16. The method of controlling a client device according to claim 15, wherein the method is received from the device. A method for controlling a server device connected to a client device via a network,
Receiving a reduced image from the client device;
An image processing step of performing image processing on the reduced image;
A transmission step of transmitting a result of image processing performed on the reduced image in the image processing step to the client device;
When receiving the reduced image from the client device in the receiving step, the method includes a start step of starting reception processing of the original image from the client device,
The image processing step executes image processing on the reduced image, receives an instruction to execute image processing on the original image from the client device, and then uses the adjustment value used for image processing on the reduced image. A method for controlling a server apparatus, comprising performing image processing on the original image. The server device control method according to claim 17, wherein the original image is RAW image data, and the image processing is development processing of the RAW image data. A program for causing a computer to execute a control method of a client device connected to a server device via a network,
The control method of the client device is:
A reduction process for generating a reduced image by reducing the original image;
A transmission step of transmitting the reduced image to the server device;
A first receiving step of receiving, from the server device, a result of image processing of the reduced image by the server device;
A display step of displaying a result of image processing of the reduced image on a screen;
An issue step of issuing an image processing execution instruction for the original image to the server device after the image processing result of the reduced image is displayed on the screen in the display step;
A program comprising: a start step of starting transmission processing of the original image to the server device when the reduced image is transmitted to the server device in the transmission step. A program for causing a computer to execute a control method of a server device connected to a client device via a network,
The control method of the server device is:
Receiving a reduced image from the client device;
An image processing step of performing image processing on the reduced image;
A transmission step of transmitting a result of image processing performed on the reduced image in the image processing step to the client device;
When receiving the reduced image from the client device in the receiving step, the method includes a start step of starting reception processing of the original image from the client device,
The image processing step executes image processing on the reduced image, receives an instruction to execute image processing on the original image from the client device, and then uses the adjustment value used for image processing on the reduced image. A program for executing image processing on the original image.