JP4192487B2 - Image processing method - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
  The present inventionImage processing methodIn particular, for example, it is suitable for use in creating an animation image from an image photographed with a digital still camera.Image processing methodAbout.
[0002]
[Prior art]
Conventionally, digital still cameras have various modes such as a shooting mode and a playback mode. Furthermore, some models have a mode for creating an animation image in which a plurality of still images are continuously reproduced.
[0003]
Normally, when a mode for creating an animation image is used, the user sets the mode before shooting the subject, and continuously presses the shutter and shoots the subject under the set mode. Thereby, one animation image is created from a plurality of continuous images.
[0004]
[Problems to be solved by the invention]
However, the user must continuously shoot without changing the mode for creating the animation image, and can add another image to the once created animation image, or a plurality of consecutive images. There is a problem that editing cannot be performed such as deleting a predetermined image from the animation image configured by the above.
[0005]
Therefore, the user has to perform shooting for creating an animation image under the same conditions many times until a satisfactory animation image is created.
[0006]
It is more preferable that not only a still image but also a moving image can be used for creating an animation image.
[0007]
The present invention has been made in view of such a situation, and makes it possible to edit an animation image easily and efficiently from various image materials such as still images and moving images. .
[0012]
[Means for Solving the Problems]
  A first image processing method of the present invention includes a recording control step for controlling recording of an image of a photographed subject,A thumbnail image generated from a specified image is taken as one frame, and is generated from a thumbnail image generated from a still image as an image and a thumbnail image generated from a moving image as an image.A generation step for generating an index image corresponding to the animation image from the animation image, a display step for displaying the index image generated from the image and the index image corresponding to the animation image side by sideWhen the index image corresponding to the animation image displayed in the processing of the display step is selected, the animation image corresponding to the selected index image is played, deleted, re-edited, or according to the user operation, or An execution step of executing any processing of print control, and in the generation step, the animation image is expanded in the storage means, and an index image is generated from the animation image temporarily stored in the storage means, When re-editing of the animation image is instructed by the user's operation, the index image generated from the image is further displayed in the execution step, and the index image of the image used for re-editing the animation image from the displayed index image Selected index as selected When the image corresponding to the image is a moving image, a thumbnail image that is the basis of the animation image is generated from a predetermined frame of the plurality of frames constituting the moving image, and the thumbnail image is instructed to be edited again And a new animation image is edited.
[0015]
  In the first image processing method of the present invention, an image of a photographed subject is recorded,A thumbnail image generated from a specified image is taken as one frame, and is generated from a thumbnail image generated from a still image as an image and a thumbnail image generated from a moving image as an image.An index image corresponding to the animation image is generated from the animation image, and the index image generated from the image and the index image corresponding to the animation image are displayed side by side.In addition, when an index image corresponding to an animation image is selected, any one of reproduction, deletion, re-editing, and printing control of the animation image corresponding to the selected index image is performed according to a user operation. When executed and an index image is generated, the animation image is developed in the storage unit, and the index image is generated from the animation image temporarily stored in the storage unit. Furthermore, when re-editing of an animation image is instructed by the user's operation, an index image generated from the image is further displayed and selected as an index image of an image used for re-editing of the animation image from the displayed index image When the image corresponding to the predetermined index image is a moving image, a thumbnail image that is the basis of the animation image is generated from a predetermined frame of a plurality of frames constituting the moving image, and the thumbnail image is re-edited. A new animation image is edited by adding to the designated animation image.
  The second image processing method of the present invention comprises:Thumbnail images generated from still images and thumbnail images generated from moving imagesWhen the re-editing of the animation image is instructed, the first display step for displaying an index image generated from the images of a plurality of subjects that have been shot and recorded, and the display by the processing of the first display step When a predetermined index image is selected from the selected index images and the image corresponding to the selected predetermined index image is a moving image, an animation image is generated from a predetermined frame of a plurality of frames constituting the moving image. A new generation image by adding the thumbnail image generated by the process of the first generation step to the first generation step of generating a thumbnail image that is the basis of Editing steps for editing images, index images generated from images, and new animations It characterized in that it comprises a second displaying step of displaying side by side index image corresponding to the new animation image generated from down image.
  In the image processing method, an image and a new animation image are developed in the storage means, and an index image displayed by the processing of the second display step is selected from the image temporarily stored in the storage means and the new animation image. A second generation step of generating can be further included.
  The image processing method further includes a third display step of displaying a moving image corresponding to the selected predetermined index image. In the first generation step, the selected predetermined image of the displayed moving image is selected. A thumbnail image can be generated from the frames.
  In the second image processing method of the present invention,Thumbnail images generated from still images and thumbnail images generated from moving imagesWhen the re-editing of an animation image consisting of is instructed, an index image generated from a plurality of captured and recorded subject images is displayed, and a predetermined index image is selected from the displayed index images. When the image corresponding to the selected predetermined index image is a moving image, a thumbnail image that is the basis of the animation image is generated from a predetermined frame of a plurality of frames constituting the moving image, and re-editing is instructed. The generated thumbnail image is added to the generated animation image to edit the new animation image, the index image generated from the image, and the index corresponding to the new animation image generated from the new animation image Images are displayed side by side.
[0016]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[0017]
FIG. 1 and FIG. 2 are diagrams showing an example of the external configuration of a digital still camera to which the present invention is applied.
[0018]
The digital still camera 1 includes a main body 2, a display unit 3 built in the main body 2, and various operation buttons. FIG. 1 is a rear view of the main body 2, and FIG. 2 is an enlarged view of a later-described cross key 13 provided on the main body 2.
[0019]
An LCD (Liquid Crystal Display) 11 for displaying an image is provided in front of the display unit 3, and an index image, various buttons, and the like are displayed in an animation image editing process to be described later.
[0020]
The main body 2 has a cross key 13 that is operated when a cursor displayed on the LCD 11 is moved, a button group 14 that is operated when a menu screen is displayed on the LCD 11, a display state is switched, and the like. A zoom lever 15 that is operated when the displayed image is reduced or enlarged, and a jog dial 16 that is capable of rotating in the vertical direction in the figure, in which a scrolling operation, an image frame advancement operation, or the like is performed. It is provided on the back. In addition, a mode dial 12 that is operated when selecting a mode and a shutter button 17 that is pressed when shooting a subject are provided on the upper surface thereof.
[0021]
The cross key 13 is provided, for example, on the left side of the display unit 3 on the back surface of the main body 2 in the drawing. As shown in FIG. 2, the cross key 13 includes an upper button 13a that is operated when the cursor displayed on the LCD 11 is moved upward, a lower button 13b that is operated when the cursor is moved downward, and a left direction. The left button 13c is operated when moving to the right, the right button 13d is operated when moving in the right direction, and the center button 13e is operated when confirming the operation.
[0022]
FIG. 3 is a block diagram showing an example of the electrical configuration of the digital still camera.
[0023]
The lens block 21 condenses light from the subject on the image sensor 22. For example, the image sensor 22 configured by a CCD (Charge Coupled Devices) or the like converts light from a subject into an electrical signal and outputs the electrical signal to an AGC (Automatic Gain Control) circuit 23. The AGC circuit 23 adjusts the level of the input signal.
[0024]
The SDRAM (Synchronous Dynamic Random Access Memory) interface module 24 includes a camera signal processing unit 41 that processes an input signal from the AGC circuit 23, and a video encoding that converts a signal from the SDRAM 25 into a display RGB (Red Green Blue) signal. And an on-screen display unit 42, a JPEG module 43 that compresses or decompresses an image signal using a JPEG (Joint Photographic Experts Group) method, and a resolution converter 44 that changes the image to a specified size.
[0025]
The SDRAM interface module 24 is connected to an SDRAM 25 that temporarily stores data and has a function of calling the stored data. The SDRAM 25 stores an area 51 (for example, an output image of the camera signal processing unit 41), an area 52 (for example, a recorded image), and an area 53 (for example, a display image) depending on the type of data to be stored. Memory).
[0026]
The microcontroller 26 primarily receives data in processing of the mode dial 12, the cross key 13, the button group 14, the zoom lever 15, the jog dial 16, the shutter button 17, and the microcontroller 26 that are operated when the user inputs various commands. An SDRAM 27 having a function of storing the stored data and calling the stored data, and a recording medium 28 for temporarily storing the data temporarily stored in the SDRAM 27 are connected. A part of a program executed by the microcontroller 26 is provided with a file system for converting image data into a file. The SDRAM interface module 4 is connected to an LCD 11 for displaying a photographed image.
[0027]
A drive 29 is connected to the microcontroller 26 as necessary, and a magnetic disk 31, an optical disk 32, a magneto-optical disk 33, a semiconductor memory 34, or the like is mounted on the drive 29 as necessary. The drive 29 reads data or a program recorded on the magnetic disk 31, the optical disk 32, the magneto-optical disk 33, or the semiconductor memory 34, and supplies the data or program to the microcontroller 26.
[0028]
Next, with reference to the flowchart of FIG. 4, the photographing process executed by the digital still camera of FIG. 3 will be described. This process is started when the user operates the mode dial 12 to set the shooting mode.
[0029]
In step S1, the lens block 21 captures light from the subject. In step S <b> 2, the image sensor 22 converts the captured light into an electrical signal. In step S <b> 3, the AGC circuit 23 adjusts the signal level of the signal input from the image sensor 22. The image signal whose signal level has been adjusted is subjected to gain adjustment, camera signal processing, and the like by the camera signal processing unit 41 and is developed in the SDRAM 25.
[0030]
In step S4, the area 51 of the SDRAM 25 temporarily stores the image signal supplied from the camera signal processing unit 41. In step S <b> 5, the resolution converter 44 reads the image signal temporarily stored in the area 51 of the SDRAM 45 and changes the image size to an image size of 320 × 240 (pixels) for displaying on the LCD 11. Execute. The image signal whose image size has been changed is developed in the SDRAM 25.
[0031]
In step S6, the area 53 of the SDRAM 25 temporarily stores the image whose image size has been changed. In step S <b> 7, the video encoding & on-screen display unit 42 reads the image signal temporarily stored in the area 53 of the SDRAM 25, converts it into an RGB signal, and then outputs it to the LCD 11. In step S8, the LCD 11 displays the captured image.
[0032]
In this way, the image of the subject is displayed on the LCD 11 in real time. When the user operates the shutter button 17 at a predetermined timing, the microcontroller 26 executes a recording process in step S9.
[0033]
That is, the resolution converter 44 reads the image signal temporarily stored in the area 51 of the SDRAM 25 at this time, and performs a process of converting the image size to the image size designated by the user for the image signal. Apply. The image signal whose image size has been changed is developed in the area 52 of the SDRAM 25. The area 52 of the SDRAM 25 temporarily stores an image signal whose image size has been changed. The JPEG module 43 reads an image signal temporarily stored in the area 52 of the SDRAM 25, compresses the image signal using the JPEG method, and transfers the image signal to the microcontroller 26. The microcontroller 26 controls the file system, creates image data (file) based on the image signal compressed by the JPEG method, develops it on the SDRAM 27, reads the data, and stores it in the recording medium 28.
[0034]
As described above, an arbitrary number of images are recorded on the recording medium 28 as one image data. Of course, images in TIFF (Tagged Image File Format) format, MPEG (Moving Picture Experts Group) format, or other various formats can also be stored in the storage medium 28.
[0035]
Next, animation image editing processing executed by the digital still camera will be described with reference to the flowcharts of FIGS. In this process, the index is set such that the user operates the mode dial 12 to set the playback mode, and further operates the button group 14 or the cross key 13 to reproduce a plurality of (for example, nine) images. Started when set to mode. Here, the animation image means an image that realizes an animation by continuously reproducing a plurality of images, such as an animated GIF (Graphics Interchange Format).
[0036]
In step S <b> 21, the microcontroller 26 reads out the image data stored in the recording medium 28 based on an instruction to start the animation image editing process from the user and develops it in the SDRAM 27. Then, the microcontroller 26 reads out the image signal via the SDRAM 27 and transfers it to the JPEG module 43. The JPEG module 43 outputs the transferred index image to the resolution converter 44 via the SDRAM 25.
[0037]
The resolution converter 44 generates an index image based on the image signal input via the SDRAM 25 and develops the index image in the area 53 of the SDRAM 25. The video encode & on-screen display unit 42 reads the index image temporarily stored in the area 53 of the SDRAM 25 and outputs it to the LCD 11. The index image can be generated in advance and recorded on the recording medium 28 together with the image signal. In this case, in step S21, the reading process of the index image recorded on the recording medium 28 is executed. In step S22, the LCD 11 displays the generated index images side by side.
[0038]
FIG. 7 shows a display example of the index image in this case. In this example, eight index images 100 are displayed, and are numbered 0 to 7 for convenience of explanation. A delete button 101, a clip button 102, a print button 103, and a copy button 104 are displayed below the index image 100. These buttons are the left button of the cross key 13 when the user deletes the index image 100, clips it (when selecting an image for generating an animation image), prints, or copies it, respectively. It is selected by operating 13c or the right button 13d. In this case, the user selects the clip button 102 in order to perform clip processing (animation image generation processing).
[0039]
When the clip button 102 is selected, in step S23, the microcontroller 26 sets the clip mode. At this time, the microcontroller 26 changes the display on the LCD 11 as shown in FIG. In this example, a cancel button 111 and a selection button 112 are displayed below the index image 100. These buttons are used when the user presses the left button 13c or the right button 13d of the cross key 13 when canceling the animation image editing process or selecting (clip) an image for each frame for generating an animation image, respectively. Selected by manipulating.
[0040]
When the selection button 112 is selected, the microcontroller 26 changes the display on the LCD 11 as shown in FIG. In this example, an anchor 121 is displayed corresponding to a predetermined index image 100 (in the example of FIG. 9, the index image 100 with number 0). The user operates the cross key 13 to move the anchor 121 up, down, left, and right, and operates the center button 13e at a desired position to select a predetermined index image.
[0041]
Returning to the description of FIG. In step 24, the microcontroller 26 determines whether or not an index image for creating an animation image has been selected by the user. If it is determined that selection of an index image (for example, index image 100 of number 0 shown in FIG. 9) for creating an animation image has been instructed, the process proceeds to step S25, and the microcontroller 26 further selects the selected index. It is determined whether or not the original image corresponding to the image is a still image. When it is determined that the index image generated from the still image is selected, the process proceeds to step S26, where the microcontroller 26 displays a number indicating the selection order on the index image and selects the identification number of the corresponding image signal. Store in order.
[0042]
For example, when the index image 100 of number 0 (the original image corresponding to this index image is a still image) is selected, the microcontroller 26 adds the index image 100 of number 0 to the index image 100 of number 0 as shown in FIG. An icon 131 having a number indicating the order of selection of index images (in this case, since it was selected for the first time, number 1) is displayed, and the identification number of the corresponding image signal is stored in the order of selection. Thereby, the identification number of the image signal corresponding to the index image 100 of the number 0 is stored in association with the selection number 1 of the animation image.
[0043]
After the process of step S26, or in the process of step S24, it is determined that selection of an index image for creating an animation image has not been instructed (that is, the cancel button 111 shown in FIG. 8 has been operated). If YES in step S32, the microcontroller 26 determines whether the image selection is completed, that is, whether the menu button constituting the button group 14 is operated by the user. If it is determined that the image selection has not ended, the process returns to step S24, and the above-described processing is repeatedly executed. When the menu button is operated, the microcontroller 26 changes the display on the LCD 11 as shown in FIG. 20 (described later).
[0044]
Hereinafter, the processing in steps S24 to S26 will be described in more detail.
[0045]
For example, as shown in FIG. 11, the user selects the index image 100 of number 2 (the original image corresponding to this index image is a still image) (step S24), and the original image corresponding to the index image Is determined to be a still image (step S25), the microcontroller 26 adds a number 2 icon 131 representing the order of selection to the selected number 2 index image 100, as shown in FIG. At the same time, the identification numbers of the corresponding image signals are stored in the order of selection. Thereby, the identification number of the image signal corresponding to the index image 100 of the number 2 is stored in association with the selection number 2 of the animation image.
[0046]
Further, for example, as shown in FIG. 13, the index image 100 of number 4 (the original image corresponding to the index image is a still image) is selected by the user (step S24), and the original corresponding to the index image is selected. If it is determined that the image is a still image (step S25), the microcontroller 26, as shown in FIG. 14, adds the number 131 icon 131 indicating the selection order to the selected number 4 index image 100. And the identification numbers of the corresponding image signals are stored in the order of selection. Thereby, the identification number of the image signal corresponding to the index image 100 of the number 4 is stored in association with the selection number 3 of the animation image.
[0047]
As described above, a still image to be used for an animation image is selected.
[0048]
Further, for example, when the user selects the index image 100 of number 6 (the original image corresponding to this index image is a moving image) as shown in FIG. 15 (step S24), in step S25, Since it is determined that the original image corresponding to the index image is not a still image, that is, a moving image, the process proceeds to step S27, where the microcontroller 26 sets the single mode for reproducing the moving image, and displays the display on the LCD 11 as follows. As shown in FIG. 16, the screen is changed to a screen for playing back a moving image.
[0049]
In the example of FIG. 16, a moving image 141 (in this case, one frame image A constituting the moving image) is displayed, and a bar 142 indicating a reproduction scale of the entire moving image is displayed below the moving image 141. A cursor 143 indicating the current playback position is displayed. In the figure, when the cursor 143 is positioned at the leftmost end, the image of the first frame (frame) constituting the moving image 141 is displayed, and the cursor 143 is positioned at the rightmost end. In this case, the image of the last frame of the moving image 141 is displayed.
[0050]
The user starts the reproduction of the moving image 141 by operating the center button 13e of the cross key 13. As a result, as shown in FIG. 17, an icon 151 indicating that the image is being reproduced is displayed on the moving image 141. In addition, the display of the moving image 141 is switched from the image A (FIG. 16) to the image F as the reproduction proceeds. If the center button 13e of the cross key 13 is operated again during the reproduction of the moving image 141, the reproduction is stopped.
[0051]
During the reproduction of the moving image 141, the user operates the right button 13d of the cross key 13 or rotates the jog dial 16 to move the moving image 141 frame by frame and operates the left button 13c of the cross key 13. Alternatively, the jog dial 16 is rotated downward to move back the moving image 141, thereby displaying an image (one frame) desired to be used for the animation image.
[0052]
When the user operates a menu button constituting the button group 14 on an image to be clipped (selected) (for example, image H), the microcontroller 26 displays a moving image 141 below the moving image 141 as shown in FIG. A cancel button 161 and a selection button 162 are displayed. Each of these buttons is operated when canceling the clipping process of the moving image or selecting an image for generating an animation image (in this case, an image for one frame constituting the moving image).
[0053]
In the display state of any of FIGS. 16 to 18, when a predetermined button (9-sheet index image transition button) cancel button is operated in the single mode, the microcontroller 26 displays the display on the LCD 11 before 9. The screen is returned to the screen selected in the index mode for reproducing one image (FIG. 14). In this case, the moving image is not selected, and the display returns to the index image display of FIG.
[0054]
Returning to the description of FIG. In step S28, the microcontroller 26 determines whether or not an image has been selected, that is, whether or not the menu button has been operated and the selection button 162 (FIG. 18) has been operated on the desired image 141. If it is determined that an image has been selected, the process proceeds to step S29, where the selected image is captured and stored in the area 52 of the SDRAM 25. In step S30, the microcontroller 26 changes the display on the LCD 11 as shown in FIG. 19 to display the number 131 icon 131 indicating the selection order on the number 6 index image 100 and the area of the SDRAM 25. The storage location of the captured image stored in 52 is stored in the order of selection. Thereby, the storage location of the area 52 of the SDRA 25 storing the captured image is stored in association with the selection number 4 of the animation image.
[0055]
If it is determined in step S28 that the selection button 162 has not been operated, the process proceeds to step S31, in which the microcontroller 26 is instructed to end without selecting an image, that is, to return to the display state of FIG. It is determined whether or not the predetermined button (9-image index image transition button) has been operated. If it is determined that the end is not instructed, the process returns to step S28 and the above-described processing is repeatedly executed.
[0056]
If it is determined in step S31 that the end is instructed without selecting an image, the microcontroller 26 returns the display on the LCD 11 to the display shown in FIG.
[0057]
After step S26, S30, or S31, if it is determined in step S32 that the image selection has been completed, that is, it is determined that the menu button constituting the button group 14 has been operated in the index image display state. In step S33, the microcontroller 26 displays a review button 171, an end button 172, and an execution button 173 below the index image 100, as shown in FIG. These buttons are selected by the user operating the left button 13c or the right button 13d of the cross key 13 when reviewing the clipped image, when finishing the clip process, or when executing the clip process, respectively. The
[0058]
In step S33, the microcontroller 26 determines whether or not the user has instructed execution of a process for creating an animation image, that is, whether or not the execution button 173 has been operated, and the execution has not been instructed. If it is determined, the process proceeds to step S34, and it is further determined whether or not the user has instructed to end the process for creating the animation image, that is, whether or not the end button 172 has been operated.
[0059]
If it is determined in step S34 that the end button 172 has not been operated, the process returns to step S24, and the subsequent processing described above is repeatedly executed, and the end button 172 for ending the animation image creation processing has been operated. If determined, the microcontroller 26 terminates the process without editing the animation image.
[0060]
If it is determined in step S33 that the execution button 173 has been operated, the process proceeds to step S35, and the microcontroller 26 stores the Nth (current number) of the selection numbers of the images used for the animation image stored in itself. In this case, the first selected image is called up. Here, when a still image is selected, an identification number is stored in association with the selection number, and therefore the microcontroller 26 selects one corresponding sheet from the recording medium 28 based on the identification number. Recall image signal. When a moving image is selected, since the storage location of the area 52 of the SDRAM 25 is stored in association with the selection number, the microcontroller 26 responds from the area 52 of the SDRAM 25 based on the storage location. Recall the captured image.
[0061]
If a still image is called up, the microcontroller 26 temporarily records an image signal in the SDRAM 27 in step S36. In step S <b> 37, the microcontroller 26 reads the image signal from the SDRAM 27 and transfers it to the JPEG module 43. The JPEG module 43 decompresses the input image signal by the JPEG method and develops it in the SDRAM 25. In step S38, the area 52 of the SDRAM 25 temporarily stores the decompressed image. In step S39, the resolution converter 44 reads the decompressed image stored in the area 52 of the SDRAM 25, and reduces the image size to a size of 160 × 120 (pixels) (hereinafter referred to as a thumbnail size). To do.
[0062]
On the other hand, when the captured image (moving image) is called, the processing of steps S36 to S38 is not executed, and the resolution converter 44 sets the image size of the captured image called from the area 52 of the SDRAM 25 in step S39. , Reduce to thumbnail size.
[0063]
That is, a thumbnail image for displaying an animation image is generated in the process of step S39. In step S40, the resolution converter 44 develops the thumbnail image in the area 52 of the SDRAM 25 and temporarily stores it in the area.
[0064]
In step S41, the microcontroller 26 reads out the thumbnail image from the area 52 of the SDRAM 25, and compresses it with LZW (Lempel-Zev-Welch). The compressed image data is temporarily stored in the SDRAM 27 of the microcontroller 26 as one frame of an animation image.
[0065]
In step S <b> 42, the microcontroller 26 determines whether a plurality of images have been selected by the user for creating an animation image and there is a frame image of an animation image that has not yet been created. If it is determined that there is a frame image that has not yet been created, the process returns to step S35 and the above-described processing is repeatedly executed. Specifically, by repeating the same processing, the second and third frame images are created from the images selected for creating the animation image.
[0066]
If it is determined in step S42 that the processing has been completed for all the images selected to create the animation image, the process proceeds to step S43. In step S43, the microcontroller 26 controls the file system, creates one file including the compressed thumbnail image signal (displayed as one index (handled)), and develops it on the SDRAM 27. The file is stored in the recording medium 28. At this time, an index image corresponding to the animation image is generated and displayed as an index image of number 8 as shown in FIG. Here, for example, the index image is generated from the first thumbnail image signal among the thumbnail image signals constituting the animation image.
[0067]
Through the above processing, one animation image (so-called animation GIF) composed of thumbnail images is generated from an arbitrary number of still images selected based on the user's judgment. Therefore, when the user gives an instruction to reproduce the recording medium 28, the microcontroller 26 causes the LCD 11 to display an index image as shown in FIG. As is clear from comparison between FIG. 21 and FIG. 7, the index image corresponding to the created animation image is displayed as the index image 100A of number 8, and the icon 181 indicating that it is an animation image (FIG. 21). In this example, CLIP) is displayed.
[0068]
Accordingly, the user can easily know which animation image is the index image, and can select the animation image in the same manner as one still image.
[0069]
When execution is instructed in step S33 described above, animation image creation processing (that is, processing in steps S35 to S42) is immediately executed from all images selected to create an animation image. The user can review the clipped image by operating the review button 17 shown in FIG. 20 before instructing execution. Therefore, the user can edit the animation image while confirming the clipped image, so that it is possible to easily create a favorite animation image.
[0070]
Next, an image reproduction process for reproducing an animation image, a still image, and a moving image created by the series of processes described above will be described with reference to the flowchart of FIG. This processing is performed when the user operates the mode dial 12 to set the playback mode, sets the index mode in which a plurality of images can be played, and then selects one index image from the plurality of images. To begin.
[0071]
In step S71, the microcontroller 26 calls one piece of image data designated by the user from the recording medium 28. In step S72, the microcontroller 26 develops the called image data in the SDRAM 27 and temporarily stores it. In step S73, a decompression process is performed. When the selected image is a still image, the JPEG module 43 of the SDRAM interface module 24 decompresses the data stored in the SDRAM 27 by the JPEG method. When the selected image is a moving image, the data stored in the SDRAM 27 is decompressed by, for example, the MPEG method. If the selected image is an animation image, the microcontroller 26 decompresses the data stored in the SDRAM 27 by the LZW method.
[0072]
In step S74, the area 53 of the SDRAM 25 temporarily stores the decompressed image. In step S75, the video encoding & on-screen display unit 42 changes the image to a designated size (in this case, an image size to be displayed on the LCD 11) in order to output the image as a video. In step S76, the LCD 11 displays an image on the display. If the selected image is a still image, a still image is displayed. If the selected image is a moving image, a moving image is displayed. If the selected image is an animation image, an animation image (pseudo moving image) is displayed. Is displayed.
[0073]
Through the above processing, the user can play back still images, moving images, and animation images in the same playback mode regardless of their types.
[0074]
The user can also re-edit the animation image such as adding or deleting an image to the animation image generated by the above processing, or changing the playback order.
[0075]
For example, when the user operates the button group 14 or the cross key 13 to instruct reediting processing of the animation image, the microcontroller 26 performs the animation stored in the recording medium 28 based on the instruction from the user. An image (animated image created by the above-described processing) is read out, expanded in the SDRAM 27, temporarily stored, and then decompressed by the LZW method. Then, the decompressed image is temporarily stored in the area 53 of the SDRAM 25, and after being changed to the designated size by the video encoding & on-screen display unit 42, the thumbnail image of the animation image is displayed side by side on the LCD 11.
[0076]
FIG. 23 shows a display example of each thumbnail image of the animation image in this case. In this example, anchors 211 corresponding to four thumbnail images 200 and a predetermined thumbnail image 200 (in this case, thumbnail image 200 with number 0) are displayed. Since these thumbnail images 200 are created in the order of images of number 0, number 2, number 4, and number 6 by the above-described processing, the thumbnail images 200 are displayed in the order of creation, and icons representing the selection order are displayed. 212 (selection numbers 1 to 4) is displayed. Below the thumbnail image 200, an add button 201, a delete button 202, a sort button 203, and a cancel button 204 are displayed. These buttons are respectively displayed when the user adds a new image to the animation image, deletes it, sorts (reorders), or cancels the re-editing process. It is selected by operating the right button 13d.
[0077]
When the user selects the add button 201, the microcontroller 26 changes the display on the LCD 11 to the display of the index image shown in FIG. Accordingly, the user operates the cross key 13 to move the anchor 121 up, down, left, and right, and operates the center button 13e at a desired position, thereby selecting a new image to be added. At this time, the microcontroller 26 stores the identification number of the added image signal. A plurality of images can be selected by continuing the selection process.
[0078]
For example, when the index image 100 of number 5 is selected, the microcontroller 26 changes the display on the LCD 11 as shown in FIG. In this example, since the addition process is executed while the anchor 211 selects the thumbnail image 200 with the number 0, the index image with the number 5 is added before the thumbnail image with the number 0. As a result, the display of the icon 212 indicating the selection order is updated, and the index image with the number 5 becomes the selection number 1. At this time, the microcontroller 26 stores the identification number of the image signal corresponding to the index image of number 5 in association with the selection number 1, and the thumbnail images of number 0, number 2, number 4, and number 6 are These are stored in the SDRAM 27 in association with the selection numbers 2 to 5, respectively.
[0079]
When the user moves the anchor 212 to the thumbnail image 200 of number 2 and selects the delete button 202 in the display of each thumbnail image in FIG. 23, the microcontroller 26 displays the display on the LCD 11 as shown in FIG. Change as follows. In this example, when the image of number 2 is deleted, the selection number is updated, the icon 212 of the thumbnail image 200 of number 4 is changed to number 2, and the icon 212 of the thumbnail image 200 of number 6 is numbered. Is changed to 3. At this time, the microcontroller 26 stores the thumbnail images of number 0, number 4, and number 6 in the SDRAM 27 in association with the selection numbers 1 to 3, respectively.
[0080]
When the user selects the sort button 203 in the display of each thumbnail image in FIG. 23, the microcontroller 26 changes the display on the LCD 11 as shown in FIG. In this example, the display of the icon 212 is deleted, and the image selection order can be changed. Below the thumbnail image 200, an OK button 221 and a cancel button 222 are displayed. These buttons are selected by the user operating the left button 13c or the right button 13d of the cross key 13 when rearranging the thumbnail images in the newly selected order or canceling the rearrangement of the thumbnail images, respectively. Is done.
[0081]
The user operates the cross key 13 and operates the center button 13e at a desired position to select a predetermined thumbnail image. When a predetermined thumbnail image is selected, the microcontroller 26 displays an icon 212 having a number indicating the selection order on the thumbnail image.
[0082]
For example, as shown in FIG. 27, when the thumbnail images of number 4, number 6, number 2, and number 0 are selected in this order and the OK button 221 is operated, the microcontroller 26 displays the display on the LCD 11 as follows. Changes are made as shown in FIG. In this example, the selection number is updated by rearranging the thumbnail images, the thumbnail image icon 212 of the number 4 is changed to the number 1, the thumbnail image icon 212 of the number 6 is changed to the number 2, and the number 2 The thumbnail image icon 212 is changed to the number 3, and the thumbnail image icon No. 0 is changed to the number 4. At this time, the microcontroller 26 stores the thumbnail images of number 4, number 6, number 2, and number 0 in the SDRAM 27 in association with the selection numbers 1 to 4, respectively.
[0083]
As described above, the animation image once created can be re-edited. When the user operates the menu buttons constituting the button group 14, the microcontroller 26 displays a review button 231, an end button 232, and an execution button below the thumbnail image 200, as shown in FIG. 233 is displayed. These buttons indicate that the user operates the left button 13c or the right button 13d of the cross key 13 when reviewing the re-edited image, when finishing the re-editing process, or when executing the re-editing process, respectively. Selected by.
[0084]
When the user operates the execution button 233, the animation image is re-edited. Specifically, when a new image is added to the animation image, the microcontroller 26 calls the corresponding image signal from the recording medium 28 based on the identification number of the additional image stored by itself. Then, the data is transferred to the JPEG module 43 via the SDRAM 27, where it is decompressed by the JPEG method. The decompressed image is temporarily stored in the area 52 of the SDRAM 25, the image size is reduced to the thumbnail size by the resolution converter 44, is LZW-compressed by the microcontroller 26 via the area 52 of the SDRAM 25, and is temporarily stored in the SDRAM 27. Memorized. The microcontroller 26 controls the file system, creates one file including the re-edited thumbnail image signal and develops it on the SDRAM 27, and then overwrites the file on the recording medium 28 or as another file. It is stored in the recording medium 28.
[0085]
When the thumbnail images of the animation images are sorted or deleted, the microcontroller 26 controls the file system to create one file including the re-edited thumbnail image signal stored in the SDRAM 27. It is stored in the storage medium 28.
[0086]
Through the above processing, the animation image once created is re-edited. Therefore, the user can freely create an animation image, or perform re-editing such as addition, deletion, or rearrangement of images, thereby improving the operability of animation image creation.
[0087]
The series of processes described above can be executed by hardware, but can also be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a recording medium in a general-purpose personal computer or the like.
[0088]
As shown in FIG. 3, a recording medium for recording a program installed in a computer and made executable by the computer includes a magnetic disk 31 (including a flexible disk), an optical disk 32 (CD-ROM, DVD (Digital Versatile Disc)), magneto-optical disc 33 (including MD (Mini-Disc) (registered trademark)), or a package medium comprising semiconductor memory 34, or Flash in which a program is recorded temporarily or permanently. Consists of ROM and hard disk drive. Program recording on recording media uses wired or wireless communication media such as public network, local area network or Internet, digital satellite broadcasting, etc. via interfaces such as routers and modems as necessary. Done.
[0089]
In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.
[0090]
【The invention's effect】
As described above, according to the present invention, animation images can be edited easily and efficiently.
[0091]
Further, according to the present invention, it is possible to easily and efficiently edit an animation image from various image materials such as a still image and a moving image.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a configuration example of an external appearance of a digital still camera to which the present invention is applied.
2 is an enlarged view of a cross key of the digital still camera of FIG. 1. FIG.
FIG. 3 is a block diagram illustrating an electrical configuration example of a digital still camera.
FIG. 4 is a flowchart for describing a photographing process.
FIG. 5 is a flowchart illustrating an animation image editing process.
FIG. 6 is a flowchart following FIG. 4;
FIG. 7 is a diagram illustrating a display example of an index image.
8 is a diagram showing a display example of an index image when the clip button in FIG. 7 is selected. FIG.
FIG. 9 is a diagram illustrating a display example of an index image when the selection button in FIG. 8 is selected.
FIG. 10 is a diagram illustrating a display example of another index image.
FIG. 11 is a diagram illustrating a display example of another index image.
FIG. 12 is a diagram illustrating a display example of another index image.
FIG. 13 is a diagram illustrating a display example of another index image.
FIG. 14 is a diagram illustrating a display example of another index image.
FIG. 15 is a diagram illustrating a display example of another index image.
FIG. 16 is a diagram illustrating a display example of a moving image playback screen.
FIG. 17 is a diagram illustrating a display example of a moving image playback screen when playback is instructed.
FIG. 18 is a diagram illustrating a display example of another moving image reproduction screen.
FIG. 19 is a diagram illustrating a display example of an index image.
FIG. 20 is a diagram illustrating a display example of another index image.
FIG. 21 is a diagram illustrating a display example of another index image.
FIG. 22 is a flowchart illustrating image reproduction processing.
FIG. 23 is a diagram illustrating a display example of each thumbnail image of an animation image.
24 is a diagram showing a display example of each thumbnail image when the add button in FIG. 23 is selected.
FIG. 25 is a diagram showing a display example of each thumbnail image when the delete button in FIG. 23 is selected.
FIG. 26 is a diagram showing a display example of each thumbnail image when the sort button in FIG. 23 is selected.
FIG. 27 is a diagram illustrating a display example of other thumbnail images.
FIG. 28 is a diagram illustrating a display example of other thumbnail images.
FIG. 29 is a diagram showing a display example of other thumbnail images.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Digital still camera, 2 Main body, 3 Display part, 11 LCD, 12 Mode dial, 13 Cross key, 14 Button group, 15 Zoom lever, 16 Jog dial, 17 Shutter button, 24 SDRAM interface module, 25 SDRAM, 26 Microcontroller, 27 SDRAM, 28 recording media, 29 drive, 31 magnetic disk, 32 optical disk, 33 magneto-optical disk, 34 semiconductor memory, 41 camera signal processing unit, 42 video encoding & on-screen display unit, 43 JPEG module, 44 resolution converter , 41-53 area

Claims (4)

In an image processing method of a portable device that captures a subject and reproduces the captured image,
A recording control step for controlling recording of the photographed image of the subject;
A thumbnail image generated from the specified image is taken as one frame, from a thumbnail image generated from a still image as the image, and an animation image generated from a thumbnail image generated from a moving image as the image Generating an index image corresponding to the animation image;
A display step of arranging and displaying an index image generated from the image and an index image corresponding to the animation image ;
When the index image corresponding to the animation image displayed in the processing of the display step is selected, the animation image corresponding to the selected index image is reproduced, deleted, or replayed according to a user operation. An execution step for executing either editing or printing control processing;
Including
In the generating step, the animation image is expanded in a storage unit, and the index image is generated from the animation image temporarily stored in the storage unit,
When re-editing of the animation image is instructed by the user's operation, in the execution step, the index image generated from the image is further displayed, and the animation image is reproduced from the displayed index image. When the image corresponding to the predetermined index image selected as the index image of the image used for editing is a moving image, a thumbnail that is a base of an animation image from a predetermined frame among a plurality of frames constituting the moving image An image is generated, and the thumbnail image is added to the animation image for which re-editing is instructed, and a new animation image is edited.
Image processing method, characterized in that. In an image processing method of a portable device that captures a subject and reproduces the captured image,
An index image generated from a plurality of images of the subject that have been shot and recorded when an instruction to re-edit a thumbnail image generated from a still image and an animation image including a thumbnail image generated from a moving image is issued. A first display step for displaying
When a predetermined index image is selected from the index images displayed by the processing of the first display step, and the image corresponding to the selected predetermined index image is a moving image, the moving image is A first generation step of generating a thumbnail image that is a basis of an animation image from a predetermined frame of a plurality of frames;
An editing step of editing the new animation image by adding the thumbnail image generated by the processing of the first generation step to the animation image instructed to be re-edited;
An image processing method comprising: a second display step of displaying an index image generated from the image and an index image corresponding to the new animation image generated from the new animation image side by side. The index displayed by the processing of the second display step from the image and the new animation image that are temporarily stored in the storage means and the image and the new animation image are expanded in the storage means. The image processing method according to claim 2 , further comprising a second generation step of generating an image. A third display step of displaying the moving image corresponding to the selected predetermined index image;
The image processing method according to claim 3 , wherein, in the first generation step, the thumbnail image is generated from the selected predetermined frame of the displayed moving image.

Images