JP4158538B2 - Image processing system, image processing method, and imaging apparatus used therefor - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image processing system suitable for image composition processing, an image processing method, and an imaging apparatus used therefor.
[0002]
[Prior art]
In recent years, with the development of the Internet, a transaction form in which content such as images is acquired from a Web server via a communication line has appeared. In particular, with the development of mobile communication systems, it has become possible to easily acquire the above content with a mobile terminal such as a mobile phone.
[0003]
On the other hand, downsizing and higher performance of digital cameras are progressing, and there is a strong demand for combining and enjoying original images taken with a digital camera and additional images acquired from a Web server.
[0004]
Therefore, in order to meet such a demand, a digital camera that can capture an additional image from a Web server via a mobile phone and combine the additional image acquired from the Web server with an original image that has been captured and stored in advance is proposed. (For example, Patent Document 1).
[0005]
In this digital camera, when the additional image is combined with the original image, the position and size of the additional image in the original image can be adjusted. In addition, when combining these images, it is conceivable to combine characters in the original image.
[0006]
According to the digital camera having the above configuration, the additional image acquired from the Web server can be combined with the original image that has been captured and stored in advance, so that the user can create and enjoy various images.
[0007]
[Patent Document 1]
JP 2001-268421 A
[0008]
[Problems to be solved by the invention]
However, in the conventional digital camera, when the additional image acquired from the Web server via a communication terminal such as a mobile phone is combined with the original image that has been captured and stored in advance, the size and position of the additional image are determined. There is a problem that operability is poor in making adjustments and inputting characters.
[0009]
The reason is that it is difficult to provide a large number of character input keys or the like in the digital camera due to space, and it takes time to input characters, and it is difficult to operate the digital camera with one hand. On the other hand, a communication terminal such as a cellular phone is provided with a large number of character input keys and cursor keys, and the characters can be input by operating these keys with one hand.
[0010]
Therefore, a method is conceivable in which after compositing images with a communication terminal, the composite image is transmitted to a digital camera. However, this method has a problem that a large-capacity image needs to be transmitted and received between the communication terminal and the digital camera, and the time required for transmission and reception becomes long.
[0011]
The present invention solves the above-described conventional problems, and can perform image composition processing with a communication terminal with good operability, and is necessary for data transmission / reception between the communication terminal and the imaging device during image composition processing. An object of the present invention is to provide an image processing system, an image processing method, and an imaging device used therefor, which can shorten the time required.
[0012]
[Means for Solving the Problems]
To achieve this object, an imaging apparatus according to a first aspect of the present invention is an imaging apparatus capable of transmitting / receiving data to / from a communication terminal that can generate additional information consisting of additional images or additional character information or can be acquired from the outside. A storage means for storing an image, and a transmission / reception means for transmitting the image stored in the storage means to the communication terminal and receiving link information for combining the additional information with the image stored in the storage means from the communication terminal. And image combining means for combining the additional information acquired from the communication terminal with the image stored in the storage means based on the link information acquired from the communication terminal.
[0013]
With this configuration, operations related to image composition or character composition can be performed on a communication terminal with good operability, and data can be transferred from the communication terminal to the imaging device in a short time by reducing the size of data required for image composition processing. can do.
[0014]
In addition, an imaging apparatus according to a second aspect of the invention transmits resolution conversion means for generating a resized image by converting the resolution of the original image stored in the storage means, and transmits the resized image generated by the resolution conversion means to the communication terminal. Transmitting / receiving means for receiving link information for compositing the additional information with the original image stored in the storage means from the communication terminal; and communicating with the original image stored in the storage means based on the link information acquired from the communication terminal. Image synthesizing means for synthesizing additional information acquired from the terminal.
[0015]
With this configuration, operations related to image composition or character composition can be performed on a communication terminal with good operability, and the size of data necessary for image composition processing is reduced and transferred from the communication terminal to the imaging apparatus in a short time. Furthermore, by reducing the size of data necessary for the image composition process, the image data can be transferred from the imaging device to the communication terminal in a short time.
[0016]
The image processing system according to the third invention is capable of transmitting / receiving data between a communication terminal capable of generating additional information consisting of an additional image or additional character information or acquiring it from the outside, and the communication terminal. An image processing system including an imaging device to be recorded, wherein a communication terminal acquires an image recorded in the imaging device, and generates link information for combining additional information with the image acquired from the imaging device. The additional information and the link information are transmitted to the imaging device, and the imaging device synthesizes the additional information acquired from the communication terminal with the image recorded in the imaging device based on the link information acquired from the communication terminal. To do.
[0017]
In addition, an image processing method according to a fourth aspect of the present invention is an image processing method capable of generating additional information including additional images or additional character information, or transmitting and receiving data between a communication terminal capable of acquiring external information and a communication terminal, An image processing method realized by an image processing system including an imaging device to be recorded, wherein the communication terminal acquires an image recorded in the imaging device, and the communication terminal acquires additional information from the imaging device A step of generating link information for combining with an image, a step of transmitting additional information and link information to the imaging device by the communication terminal, and a recording by the imaging device in the imaging device based on the link information acquired from the communication terminal And a step of synthesizing the additional information acquired from the communication terminal with the obtained image.
[0018]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to FIGS.
[0019]
(Embodiment)
FIG. 1 is a block diagram showing the configuration of a system according to an embodiment of the present invention. In FIG. 1, an image processing system 101 includes a digital camera 102 and a mobile phone 103. The digital camera 102 and the mobile phone 103 can exchange data with each other, and the mobile phone 103 can communicate with the base station 104. The base station 104 is connected to the Internet 105, and a Web server 106 is connected to the Internet 105 in addition to the base station 104. An additional image 107 is stored in the Web server 106. The additional image 107 is a cartoon character or a portrait of a celebrity.
[0020]
With this configuration, the mobile phone 103 can acquire an additional image stored in the Web server 106 via the Internet 105 and the base station 104, and the digital camera 102 can acquire the additional image 107 acquired by the mobile phone 103. Can be received from.
[0021]
FIG. 2 is a block diagram showing the configuration of the digital camera 102. The imaging unit 201 is composed of a lens, a CCD, an A / D conversion circuit, a YC conversion circuit, etc. (all not shown), and converts an optical signal of an image into an electrical YC signal to generate an original image. To do. The image memory 202 stores the original image generated by the imaging unit 201, the resized image generated by the resolution converting unit 203, the image combined by the image combining unit 204, and the image compressed or expanded by the compression / expansion unit 205. To do. When the resolution conversion unit 203 acquires an original image from the image memory 202, the resolution conversion unit 203 converts the resolution to generate a resized image. For example, the resolution conversion unit 203 inputs an original image of 1600 pixels × 1200 pixels and inputs 132 pixels × 99 pixels. Generate a resized image. The image synthesizing unit 204 inputs a plurality of images and character information stored in the image memory 202 and synthesizes them. The compression / decompression unit 205 performs compression conversion or expansion conversion when an image is input from the image memory 202, the memory card 206, or the transmission / reception unit 207. The memory card 206 is composed of a flash memory (not shown) or the like, is detachable from the digital camera 102, and stores data such as images. The transmission / reception means 207 transmits / receives data to / from the mobile phone 103, and may be a wireless interface such as Bluetooth or a wired interface such as a serial bus. The control unit 208 controls the imaging unit 201, the image memory 202, the memory card 206, and the transmission / reception unit 207. In accordance with a control signal from the control unit 208, the imaging unit 201 starts or stops imaging, the image memory 202 and the memory card start or stop storing data, and the transmission / reception unit 207 transmits or receives data.
[0022]
FIG. 3 is a front view showing the appearance of the mobile phone 103. The display means 401 is composed of a liquid crystal panel (not shown) or the like and displays an image. The antenna 410 transmits or receives electromagnetic waves for communication with the base station 104. A cursor key 301 is used to operate the position of an image or character information displayed on the display unit 401. The character input button group 302 is for inputting character information. By pressing each button, a different character can be input. The determination button 303 is an operation button for determining an operation performed by the user. Since the mobile phone 103 is large enough to fit in a person's palm, each operation button of the cursor key 301 and the character input button group 302 holds the mobile phone 103 while holding the mobile phone 103 with one hand. It is configured to be operated with the thumb of the hand.
[0023]
FIG. 4 is a block diagram showing the configuration of the mobile phone 103. The communication unit 401 receives a signal from the base station 104 received by the antenna 410 or transmits a signal to the base station 104 via the antenna 410. The compression / decompression unit 402 performs compression conversion or expansion conversion when an image is input from the communication unit 401, the main memory 403, or the transmission / reception unit 407. The main memory 403 is composed of a DRAM (not shown) or the like, and stores an image input from the compression / decompression unit 402 or the image composition unit 405. The image synthesizing unit 405 synthesizes a plurality of images and character information input from the main memory 403. The information generating unit 406 generates link information necessary when the image combining unit 204 of the digital camera 102 combines additional information with an original image. The transmission / reception unit 407 transmits data such as an image acquired from the compression / expansion unit 402 and link information acquired from the information generation unit 406 to the digital camera 102 or receives data from the digital camera 102.
[0024]
The digital camera 102 is an example of the imaging apparatus of the present invention, the mobile phone 103 is an example of the communication terminal of the present invention, and the image memory 202 is an example of the storage means of the present invention.
[0025]
An operation when an additional image is synthesized with an original image using the image processing system 101 including the digital camera 102 and the mobile phone 103 configured as described above will be described below with reference to FIGS.
[0026]
FIG. 5 is a flowchart showing an operation when an additional image is combined with an original image using the digital camera 102 and the mobile phone 103. In FIG. 5, the user first operates the cellular phone 103 to acquire the additional image 107 from the Web server 106 via the Internet 105 and stores it in the main memory 403 (S1). Here, the data configuration of the additional image 107 acquired from the Web server 106 is a configuration in which a header 601 is added to the data portion 602 of the additional image as shown in FIG. The header 601 includes information such as the size of the data portion 602 of the additional image.
[0027]
Further, the user takes an image with the digital camera 102 and prepares an original image (S2). Specifically, when the user operates a shutter button (not shown) of the operation unit 209, the control unit 208 transmits a control signal to the imaging unit 201 to capture an image. Upon receiving the control signal from the control unit 208, the imaging unit 201 converts the optical signal of the image input to the imaging unit 201 into an electrical signal, digitizes the signal, and then converts the YC signal by YC conversion. The image is generated and output to the image memory 202 as an original image. Next, the control unit 208 sends a signal instructing the image memory 202 to output the original image to the memory card 206 via the compression / decompression unit 205, and the image memory 202 receives the signal and sends the signal to the compression / decompression unit 205. Output the original image. The original image input to the compression / expansion means 205 is compressed and converted and output to the memory card 206. Next, the control means 208 sends a signal for instructing the memory card 206 to store the compressed original image input from the compression / decompression means 205, and the memory card 206 receives the signal to compress it. The original image made is stored. In this state, the original image has been prepared. The data configuration of the original image is a configuration in which a header 603 is added to the data portion 604 of the original image as shown in FIG. 6B, and the header 603 includes information such as the size of the data portion 604 of the original image. Is included.
[0028]
In the above state, the image composition process can be started by requesting a resized image from the mobile phone 103 to the digital camera 102 by the user's operation (S3). Specifically, the control unit 408 transmits to the transmission / reception unit 407 a control signal for requesting a resized image and a control signal for transmitting the control signal to the digital camera 102. The transmission / reception means 407 transmits a control signal for requesting a resized image to the digital camera 102 in accordance with this control signal.
[0029]
Next, when the digital camera 102 receives a signal requesting a resized image from the mobile phone 103 by the transmission / reception unit 207, the signal is transmitted to the control unit 208, and the control unit 208 is compressed into the memory card 206. When the original image compressed from the memory card 206 is input, the compression / expansion unit 205 performs an expansion process, returns to the original image, and outputs the original image to the image memory 202. Note that the memory card 206 stores the compressed original image after the compressed original image is output to the compression / expansion means 205. Next, the control unit 208 instructs the image memory 202 to output the original image to the resolution conversion unit 203. Upon receiving the original image, the resolution conversion unit 203 converts the resolution of the original image and generates a resized image. It returns to the image memory 202 (S4). The data structure of the resized image is a structure in which a header 605 is added to the data portion 606 of the resized image as shown in FIG. 6C, and the header 605 is information such as the size of the data portion 606 of the resized image. Is included. By performing the resolution conversion process, the data size of the data portion 604 of the original image can be reduced to the data size of the data portion of the resized image.
[0030]
Next, the control unit 208 instructs the image memory 202 to output the resized image to the transmission / reception unit 207 via the compression / decompression unit 205. When the compression / decompression unit 205 receives the original image, the control unit 208 compresses the image by compression processing. A resized image is generated and output to the transmission / reception means 207. Next, the control unit 208 instructs the transmission / reception unit 207 to transmit the compressed resized image to the mobile phone 103, and in response to this, the transmission / reception unit 207 sends the compressed resized image to the mobile phone 103. Transmit (S5). As described above, since the digital camera 102 transmits the resized image to the mobile phone 103, the time required for data transmission / reception can be shortened compared to the case of transmitting an original image having a large amount of image data.
[0031]
Next, in the mobile phone 102, when the transmission / reception means 407 receives the compressed resized image (S6), the control means 408 is notified to that effect, and the control means 408 is compressed with respect to the transmission / reception means 407. An instruction is given to output the resized image to the main memory 403 via the compression / decompression means 402. The compression / decompression unit 402 receives the compressed resized image from the transmission / reception unit 407, decompresses and converts the compressed resized image, and transmits the decompressed image to the main memory 403. The main memory 403 stores the resized image. Here, the resized image is not limited to a single image, and may be a plurality of images.
[0032]
Next, the user causes the display unit 404 to display the resized image stored in the main memory 403 by operating the operation unit 409, and selects a desired resized image from the plurality of resized images (S7). As a result, the resized image 701 shown in FIG.
[0033]
Next, when the user desires to combine an additional image with the selected resized image (S8), the resized image 701 and the additional image stored in the main memory 403 in step S1 are stored from the main memory 403. The data is read out by the image synthesis means 405, image synthesis processing is performed, and the result is displayed on the display means 404 (S9). As a result, as shown in FIG. 7B, the additional image 702 is displayed at the center of the screen so as to overlap the resized image 701. Next, the user operates the cursor key 301 of the operation unit 409, and each time the image composition unit 405 performs image composition processing again to change the display position of the additional image 702 and display it at a desired position. . When the additional image 702 is positioned at a desired position, the user can determine the display position of the additional image 702 by pressing the determination button 303 (S10).
[0034]
On the other hand, when the user does not wish to synthesize the additional image 702 with the selected resized image 701 (S8), the process proceeds to the character information synthesis step (S11).
[0035]
Next, in step S <b> 11, the user determines whether to add character information 703. When the user adds the character information 703, the character information 703 is displayed on the screen by pressing the character input button group 302, the position of the character information 703 is changed with the cursor key 301, and the enter button 303 is pressed. The display position of the character information 703 is determined by pressing (S12). As a result, it is displayed on the display means 404 as shown in FIG. On the other hand, when the character information 703 is not input (S11), the process proceeds to step S13.
[0036]
Next, the information generation unit 406 displays the display position and display size of the additional image 702 displayed on the display unit 404, the display position and display size of the character information 703, and the data portion 606 of the additional image when acquired from the Web server. The digital camera 102 converts the additional image 702 and the additional character information 703 into the original image based on the information included in the header 605 added to the data size, the information included in the header 603 added to the data portion 604 of the resized image, and the like. Link information 607, which is information necessary for the composition, is generated (S13). The link information 607 is integrated with the additional image data portion 608 and the additional character information 609 by the transmission / reception means 407, as shown in FIG. 6D, and transmitted to the digital camera 102 (S14). At this time, the compression / decompression unit 402 may naturally compress the data in which the link information 607, the additional image data portion 606, and the additional character information 609 are integrated. However, since the data portion 608 and the additional character information 609 of the additional image are originally small in size, it does not need to be compressed because it does not require much time for transmission to the digital camera. Thus, only the link information 607, the additional image data portion 608 and the additional character information 609 are transmitted from the mobile phone 103 to the digital camera 102, and the resized image data portion 604 is not transmitted. The time required for transmission and reception can be shortened.
[0037]
Next, the transmission / reception means 207 of the digital camera 102 receives data in which the link information 607, the additional image data portion 606 and the additional character information 609 shown in FIG. 6D are integrated from the mobile phone 103 (S15). Based on the information, the image composition unit 204 synthesizes the additional image and the additional character information with the original image (S16). Thereafter, the synthesized image is input to the compression / expansion means 205 via the image memory 202, compressed by the compression / expansion means 205, stored in the memory card 206, and a series of image processing ends.
[0038]
As described above, according to the present embodiment, the digital camera 102 can generate additional information 608 and 609 including the additional image 702 or the additional character information 703 or generate data with the mobile phone 103 that can be acquired from the outside. An image memory 202 that can transmit and receive images, and a link for transmitting the image stored in the image memory 202 to the mobile phone 103 and combining the additional information 608 and 609 with the image stored in the image memory 202 Based on the link information 607 acquired from the mobile phone 102 and the transmission / reception means 207 that receives the information 607 from the mobile phone 103, the additional information 608 and 609 acquired from the mobile phone 103 is combined with the image stored in the image memory 202. By having the image synthesizing means 204, the mobile phone 103 with good operability can In addition to performing operations related to composition or character composition, the size of data necessary for image composition processing can be reduced and transferred from the mobile phone 103 to the digital camera 102, so the time required for data transmission / reception can be shortened. it can.
[0039]
Further, according to the present embodiment, the digital camera 102 converts the resolution of the original images 603 and 604 stored in the image memory 202 to generate resized images 605 and 606, and the resolution conversion unit 203. The resized images 605 and 606 generated in the above are transmitted to the mobile phone 103, and link information 607 for combining the additional information 608 and 609 with the original images 603 and 604 stored in the image memory 202 is received from the mobile phone 103. Based on link information 607 acquired from the mobile phone 103, the image transmitting / receiving means 207 and image combining means 204 for combining the additional information 608 and 609 acquired from the mobile phone 103 with the original image 602 stored in the image memory 202 are provided. Mobile phone 103 with good operability In addition to performing operations related to image composition or character composition, the size of data necessary for image composition processing can be reduced and transferred from the mobile phone 103 to the digital camera 102. Further, it is necessary for image composition processing. Since the data size can be reduced and transferred from the digital camera 102 to the mobile phone 103, the time required for data transmission / reception can be shortened.
[0040]
In the embodiment of the present invention, the additional image is a still image, but the additional image may be a moving image. In this case, the data portion 608 of the additional image is moving image data, and information relating to the moving image is incorporated in the link information 607.
[0041]
In the embodiment of the present invention, the resized image, the link information 607, the additional image 608, and the additional character information 609 are transmitted and received between the digital camera 102 and the mobile phone 103 through wired or wireless communication. However, the memory card 206 may be used as a medium. At that time, the cellular phone 103 needs a card slot that is an interface with the memory card 206.
[0042]
【The invention's effect】
As described above, the present invention can perform operations related to image composition or character composition on a communication terminal with good operability, and is necessary for data transmission / reception between the communication terminal and the imaging apparatus during image composition processing. An excellent effect is obtained that an image processing system, an image processing method, and an imaging apparatus used therefor can be obtained.
[Brief description of the drawings]
FIG. 1 is a schematic diagram showing an image processing system according to an embodiment of the present invention.
FIG. 2 is a block diagram showing the configuration of the digital camera in the embodiment of the present invention.
FIG. 3 is a front view of the mobile phone according to the embodiment of the present invention.
FIG. 4 is a block diagram showing a configuration of a mobile phone according to the embodiment of the present invention.
FIG. 5 is a flowchart of image processing in the embodiment of the present invention.
FIG. 6 is a schematic diagram showing the structure of image data in the embodiment of the present invention.
FIG. 7 is a schematic diagram showing a screen displayed on the display means of the mobile phone in the embodiment of the present invention.
[Explanation of symbols]
101 Image processing system
102 Digital camera
103 Mobile phone
104 base station
105 Internet
106 Web server
107 Additional images
201 Imaging means
202 Image memory
203 Resolution conversion means
204 Image composition means
205 Compression / decompression means
206 Memory card
207 Transmission / reception means
208 Control means
209 Operating means
301 Cursor key
302 Character input buttons
303 OK button
401 Communication means
402 Compression / expansion means
403 main memory
404 Display means
405 Image composition means
406 Information generation means
407 Transmission / reception means
408 Control means
409 Operating means
410 Antenna

Claims (4)

An imaging device capable of transmitting / receiving data to / from a communication terminal capable of generating additional information consisting of additional images or additional character information or acquiring externally,
Storage means for storing images;
Transmitting / receiving means for transmitting from the communication terminal link information for transmitting an image stored in the storage means to the communication terminal and combining additional information with an image stored in the storage means;
An image pickup apparatus comprising: image combining means for combining additional information acquired from the communication terminal with an image stored in the storage means based on link information acquired from the communication terminal. An imaging device capable of transmitting / receiving data to / from a communication terminal capable of generating additional information consisting of additional images or additional character information or acquiring externally,
An imaging means for capturing an image by converting an optical signal into an electrical signal;
Storage means for storing an image captured by the imaging means as an original image;
Resolution conversion means for generating a resized image by converting the resolution of the original image stored in the storage means;
Transmitting / receiving means for transmitting from the communication terminal link information for transmitting the resized image generated by the resolution converting means to the communication terminal and combining additional information with the original image stored in the storage means;
An image pickup apparatus comprising: image combining means for combining additional information acquired from the communication terminal with an original image stored in the storage means based on link information acquired from the communication terminal. An image processing system comprising a communication terminal capable of generating additional information consisting of additional images or additional character information or capable of acquiring from the outside, and an imaging device capable of transmitting / receiving data to / from the communication terminal and recording an image Because
The communication terminal acquires an image recorded in the imaging device, generates link information for combining additional information with the image acquired from the imaging device, and transmits the additional information and link information to the imaging device. ,
The imaging apparatus synthesizes additional information acquired from the communication terminal with an image recorded in the imaging apparatus based on link information acquired from the communication terminal. An image processing system comprising a communication terminal capable of generating additional information consisting of additional images or additional character information or capable of acquiring from the outside, and an imaging device capable of transmitting / receiving data to / from the communication terminal and recording an image An image processing method realized by
The communication terminal acquiring an image recorded in the imaging device;
Generating link information for the communication terminal to synthesize additional information with the image acquired from the imaging device;
The communication terminal transmitting additional information and link information to the imaging device;
And a step of combining the additional information acquired from the communication terminal with the image recorded in the imaging apparatus based on the link information acquired from the communication terminal.

Images