JP4765879B2 - Image browsing device - Google Patents

Description

The present invention relates to images viewing device.

An image search apparatus that transfers an image instructed to search and an image deeply related to the image to the display memory, and reads and displays an image instructed deeply from the display memory in the subsequent search instructions Is known (for example, Patent Document 1).
JP-A-6-350948

  However, since an image is selected and displayed based on the past image search history, there is a problem that the next and subsequent images are not selected correctly if the image search history is not accumulated.

The image browsing apparatus according to claim 1, wherein a sorting unit that sequentially arranges a plurality of images recorded on a first recording medium along a predetermined reference axis, and designates an image from the plurality of images. A selection unit, a display unit that displays the designated image, and a selection process that selects an image that is highly likely to be designated by the designation unit as a next image are executed, and the reading speed is higher than that of the first recording medium. Selection recording means for recording on a fast second recording medium, and the designation order designated by the designation means for the plurality of images is opposite to the first direction on the reference axis and the first direction. A direction determination unit that determines which direction is designated as the second direction of the direction, and a selection that determines a rule of the selection process executed by the selection recording unit based on the determination of the direction determination unit Rule decision means The direction determination unit may determine that the direction is unspecified when the designation order designated by the designated image for the plurality of images does not apply to either the first orientation or the second orientation. The selection rule determining means determines, based on the unspecified determination by the direction determining means, the selection processing rule as a first determination rule that is determined based on feature data characterizing the image, and the direction determining means A second determination rule for determining a rule of the selection process based on the feature data and the direction determined by the direction determination unit in response to the determination of the first direction or the determination of the second direction; It is characterized by doing.
The image browsing device according to claim 2 is the image browsing device according to claim 1, wherein the second determination rule determines the direction from the position on the reference axis of the image displayed on the display means. An image is selected based on the feature data for an image existing in the direction determined by the means, and then determined by the direction determination means from the position on the reference axis of the image displayed on the display means It is a rule that selects an image based on the feature data with respect to an image that exists in a direction opposite to the orientation.
The image browsing device according to claim 3 is the image browsing device according to claim 1 or 2, wherein the selection rule determining means includes the feature data relating to a reference image and feature data of the plurality of images. Correlation determining means for determining the degree of correlation between the first determination rule and the first determination rule determining that the correlation is higher than an image determined to have low correlation by the correlation determination means The rule is that the selected image is first selected.
The image browsing device according to claim 4 is the image browsing device according to claim 1 or 2, wherein the feature data is priority designation data representing a priority order of displaying the images. To do.
The image browsing apparatus according to claim 5, a sorting unit that sequentially arranges a plurality of images recorded on the first recording medium along a predetermined reference axis, and designates an image from the plurality of images. A selection unit, a display unit that displays the designated image, and a selection process that selects an image that is highly likely to be designated by the designation unit as a next image are executed, and the reading speed is higher than that of the first recording medium. Selection recording means for recording on a fast second recording medium, and the designation order designated by the designation means for the plurality of images is opposite to the first direction on the reference axis and the first direction. A direction determination unit that determines which direction is designated as the second direction of the direction, and a selection that determines a rule of the selection process executed by the selection recording unit based on the determination of the direction determination unit Rule decision means The direction determining unit determines the first direction or the second direction based on the designation that the designation unit performs in the same direction with respect to a plurality of images a predetermined number of times, and the designation unit Determines that the orientation is unspecified based on the fact that the designations made in the same direction with respect to the plurality of images are less than a predetermined number of times, and the selection rule determining means determines the direction by the direction determining means. According to the determination of the direction of 1 or the second direction, the rule of the selection process is a third determination rule that takes into account the determination result of the direction determination unit, and according to the unspecified determination by the direction determination unit, The selection processing rule is a fourth determination rule that does not take into account the determination result of the direction determination means.
The image browsing apparatus according to claim 6, a sorting unit that sequentially arranges a plurality of images recorded on the first recording medium along a predetermined reference axis, and designates an image from among the plurality of images. A selection unit, a display unit that displays the designated image, and a selection process that selects an image that is highly likely to be designated by the designation unit as a next image are executed, and the reading speed is higher than that of the first recording medium. Selection recording means for recording on a fast second recording medium, and the designation order designated by the designation means for the plurality of images is opposite to the first direction on the reference axis and the first direction. A direction determination unit that determines which direction is designated as the second direction of the direction, and a selection that determines a rule of the selection process executed by the selection recording unit based on the determination of the direction determination unit Rule decision means The designation means includes an operation member that designates the next image by switching the image displayed on the display means to the first orientation of the reference axis or the second orientation of the reference axis. The determining means determines a rule of the selection process based on an operation direction of the operation member when the operation member is operated.

According to the present invention , the next image can be appropriately selected .

  A viewer will be described with reference to the drawings as an embodiment of an image browsing apparatus according to the present invention. FIG. 1 is an external view of the viewer 100, and FIG. 2 is a control block diagram of the viewer 100. The features of the viewer 100 of this embodiment will be outlined.

(Image size)
The viewer 100 captures a 7 million pixel main image from an external device, for example. The viewer 100 resizes the captured main image to an image size of 2 million pixels, for example, and records it as a first reduced image on a large-capacity recording medium 114 such as an HDD. A thumbnail image (for example, 120 pixels × 160 pixels) is attached to the main image, and the viewer 100 displays a list of thumbnail images on the first LCD 103. When the user selects at least one image from the thumbnail images displayed in a list, the viewer 100 resizes the first reduced image resized to 2 million pixels to, for example, a VGA size (640 pixels × 480 pixels), The second reduced image is recorded on a recording medium 111 such as SDRAM (hereinafter referred to as SDRAM 111) that can be read at a higher speed than the large-capacity recording medium 114, and is displayed on the first LCD 103 and the second LCD 104.

(Image look-ahead)
The viewer 100 according to this embodiment performs prefetching of image data, which will be described in detail later, to increase the speed of image display. As will be described later, the prefetching process is a process in which the RISC 110 predicts in advance a plurality of images that are likely to be instructed to be viewed next by the user, and the RISC 110 writes the plurality of predicted images to the SDRAM 111 as VGA image file data. It is. In order to perform prefetching, data characterizing the image is attached to each of the first 2 million pixel reduced images recorded in the HDD 114. For example, when one thumbnail image is selected by the user, the RISC 110 can select a plurality of first images that are highly likely to be browsed based on the feature data, and can read data at a higher speed than the HDD 114. A VGA image is recorded as a second reduced image in the SDRAM 111. At this time, the RISC 110 also records the created VGA image on the HDD 114.

(Image switching)
The viewer 100 includes a double-open liquid crystal display device that is opened and closed by a hinge 101. That is, the viewer 100 includes a plurality of double-opening pairs of the first LCD 103 and the second LCD 104, and the second LCD 104 has a touch panel. The first LCD 103 and the second LCD 104 can display a second reduced image of VGA size. In addition, the viewer 100 can divide one screen of the first LCD 103 or the second LCD 104 into two regions and collectively display one image in each region. The display image in this case is created by further resizing the second reduced image of VGA size. Furthermore, it is possible to display an image obtained by enlarging the VGA size by two times by using both the screens of the first LCD 103 and the second LCD 04. In this case, the display image is first displayed by creating a coarse enlarged image by interpolating the VGA size. In the meantime, the first reduced image is reduced to create a fine enlarged image, and when the fine enlarged image creation processing is completed, the fine enlarged image is displayed on the first LCD 103 and the second LCD 104 instead of displaying the coarse enlarged image. .

  The user can instruct various operations by touching the screen with a finger or the like using the touch panel 122. For example, the viewer 100 can detect a finger rubbing operation on the display screen and perform image switching, that is, image scrolling. For example, when the finger is rubbed horizontally on the screen, display switching is performed by frame advance or frame reverse. Further, when the screen is rubbed along a diagonal line, the number of displayed images in one screen is switched.

(Attitude priority mode and size priority mode)
The viewer 100 can select either the posture priority mode or the size priority mode. In the posture priority mode, the viewer 100 displays the top and bottom of a plurality of images in the vertical direction of the first LCD 103 and the second LCD 104. For example, when displaying two screens of an image obtained by horizontal position shooting and an image obtained by vertical position shooting, the viewer 100 displays the top and bottom of both images so as to coincide with the vertical direction of the screen. Therefore, one image is displayed with a margin. In the size priority mode, when the viewer 100 displays two screens of an image obtained by horizontal position shooting and an image obtained by vertical position shooting, the longitudinal direction of each of the images of horizontal position shooting and vertical position shooting is the first. The display is made to coincide with the longitudinal direction of the first LCD 103 or the second LCD 104.

Hereinafter, the viewer 100 according to the present embodiment will be described in detail with reference to the drawings.
As shown in FIG. 1, the viewer 100 includes a hinge unit 101, an open / close detection switch 102, a first LCD 103, a second LCD 104, a battery 105, operation buttons 106, and a joystick 107. The viewer 100 is configured to be opened and closed by a hinge unit 101. FIG. 1A shows a state in which the viewer 100 is opened.

  FIG. 2 is a control block diagram of the viewer 100. The viewer 100 includes a RISC 110, an SDRAM 111, an SDRAM control unit 112, an image processing circuit 113, an HDD (hard disk drive) 114, an HDD drive circuit 115, an attitude sensor 116, a touch panel 122, and a memory card slot 301S. The viewer 100 also includes an attitude sensor interface 117, a first LCD interface 118, a second LCD interface 119, a memory card interface 120, an operation system interface 123, an HDMI interface 124, a USB interface 125, and a cradle interface 126. An HDMI compatible monitor 501 is detachably connected to the HDMI interface 124, a personal computer 502 is connected to the USB interface 125, and a cradle 503 is detachably connected to the cradle interface 126.

  The open / close detection switch 102 detects opening / closing of the viewer 100. When the viewer 100 is opened by the user, the open / close detection switch 102 outputs an ON signal to the RISC 110. When an ON signal is output from the open / close detection switch 102, the RISC 110 outputs a power supply instruction signal to a power supply circuit (not shown) connected to the battery 105. The power supply circuit that has received the power supply instruction signal supplies power to each component device of the viewer 100. The operation buttons 106 and the joystick 107 are operation switches for the user to perform various settings on the viewer 100. For example, by operating the operation button 106 or the joystick 107, a prefetch mode to be described later can be selected, or one of the metadata matching priority mode and the favorite image priority mode in the prefetch mode can be selected. The joystick 107 is a cross key switch. The image displayed on the first LCD 103 or the second LCD 104 can be switched and displayed by operating the cross key of the joystick 107.

  The RISC 110 is an arithmetic processing circuit that controls each element device of the viewer 100. The SDRAM 111 temporarily stores various data as a work area memory of the RISC 110. The SDRAM 111 records VGA image data as a prefetch image to be described later. Further, the SDRAM 111 has a function as a frame memory for displaying an image on the first LCD 103 and the second LCD 104. The SDRAM control unit 112 controls the SDRAM 111 based on an instruction signal from the RISC 110. The SDRAM 111 is a volatile semiconductor memory and can read and write data faster than the HDD 114.

  The HDD 114 is a hard disk drive that can perform nonvolatile storage. Image data and various data are recorded in the HDD 114. The HDD 114 is driven via the HDD drive circuit 115 based on an instruction from the RISC 110, and data writing and data reading are controlled. The recording data of the HDD 114 will be described in detail later. The image processing circuit 113 executes various types of image processing on image data stored in the HDD 114 or the SDRAM 111 based on an instruction from the RISC 110.

  The posture sensor 116 has three types of postures of the viewer 100, that is, a horizontal position posture with the arrow AR direction shown in FIG. 1A as the top and bottom of the screen, and the viewer 100 rotates 90 degrees clockwise from the horizontal position posture indicated by the arrow CW. From the rotated +90 degree vertical position and horizontal position and orientation, a −90 degree vertical position and orientation obtained by rotating the viewer 100 by 90 degrees counterclockwise as indicated by the arrow CCW are detected. The horizontal position is a posture of the viewer 100 in which the first and second LCDs 103 and 104 are arranged side by side. The detected posture information is output to the posture sensor interface 117. The attitude sensor interface 117 drives the attitude sensor 116 based on an instruction from the RISC 110 and outputs attitude information input from the attitude sensor 116 to the RISC 110 via the data bus.

  The first LCD 103 is a display for displaying an image. When an image designation operation is performed by the user, the first LCD 103 can display an image of, for example, a VGA size (640 pixels × 480 pixels). That is, the first LCD interface 118 displays a VGA size image on the first LCD 103 based on display image data (hereinafter also simply referred to as VGA image data) written in the SDRAM 111 under the control of the RISC 110. The second LCD 104 is a display for displaying an image in the same manner as the first LCD 103. Similar to the first LCD 103, the second LCD 104 can display, for example, an image of VGA size (640 pixels × 480 pixels) when an image designation operation is performed by the user. That is, the second LCD interface 119 displays a VGA size image on the second LCD 104 based on the VGA image data written in the SDRAM 111 under the control of the RISC 110. Further, the second LCD 104 displays a menu screen for performing various settings in the viewer 100.

  A touch panel 122 is disposed on the surface of the second LCD 104. The touch panel 122 is an operation switch for the user to perform various settings in the viewer 100, like the operation button 106 and the joystick 107. In addition, the image displayed on the first LCD 103 or the second LCD 104 can be switched and displayed in the same manner as the joystick 107 by a horizontal finger rubbing operation on the touch panel 122. The switching display is to switch from a currently displayed frame image to another image by forward or backward feeding. In addition, the number of displayed images can be switched by a finger rubbing operation on the touch panel 122 in an oblique direction (diagonal direction). The operation system interface 123 receives operation signals from the operation buttons 106, the joystick 107 and the touch panel 122 and outputs them to the RISC 110.

  The memory card interface 120 is an interface for performing data communication with the memory card 301. The HDMI interface 124 is an interface for outputting image data to an external high-definition monitor 501. The USB interface 125 is an interface for performing data communication with an external device 502 such as a PC via a predetermined cable or wireless transmission path. The cradle interface 126 is an interface for performing data communication with an external cradle 503 connected to the viewer 100.

  The memory card 301 is a semiconductor memory card such as a compact flash (registered trademark) or an SD card, and is detachable from the memory card slot 301 </ b> S of the viewer 100. When the memory card 301 is inserted into the memory card slot 301S, image data can be transmitted to and received from the viewer 100 via the memory card interface 120 of the viewer 100 as described above. That is, the memory card 301 functions as a storage medium for the viewer 100.

  A menu screen displayed on the second LCD 104 will be described with reference to FIG. FIG. 19 shows the structure of the menu. When the operation button 106 is operated by the user, the RISC 110 displays a menu screen on the second LCD 104. The items “image display”, “image input”, “slide show”, and “setting” are displayed by the RISC 110 as the top menu of the menu screen. “Image display” is an item for displaying an image on the first LCD 103 and the second LCD 104. “Image input” is an item for instructing the viewer 100 to capture an image from an external device. “Slide show” is an item for instructing display or creation of a slide show. “Setting” is an item for setting the number of displayed images, the display form, the sort order, and the like. Note that the user selects one of the items on the menu screen using any of the operation buttons 106, the joystick 107, and the touch panel 122.

  When “image display” in the top menu is selected, the RISC 110 displays thumbnail images on the first LCD 103 and the second LCD 104 as shown in FIG. 10, as shown in the first hierarchy in FIG. An image selected by the joystick 107 or the touch panel 122 from the thumbnail-displayed images is enlarged and displayed by the RISC 110. The number to be displayed is set from the “simultaneous display number” menu described later.

  While displaying an image such as a thumbnail image, the user can call a submenu by operating one of the operation buttons 106, the joystick 107, and the touch panel 122. When a sub menu call instruction is issued by the user, RISC 110 displays the sub menu superimposed on the image on second LCD 104. The submenu includes four items: “simultaneous display number”, “enlargement”, “display priority”, and “image editing”.

  First, “simultaneous display number” in the submenu will be described. When the one-sheet simultaneous display is set, the RISC 110 displays the image selected from the thumbnail images on the first LCD 103 and the second LCD 104. When the two images are set to be displayed simultaneously, the RISC 110 displays on the first LCD 103 and the second LCD 104 images from the images selected from the thumbnail images up to the second sorting order. When the simultaneous display of four images is set, the RISC 110 displays the fourth image in the sort order from the image selected from the thumbnail images on the first LCD 103 and the second LCD 104. Note that setting the number of displayed sheets to be one is possible only when the viewer 100 is fully opened.

  “Enlarge” is an item that is set so that the size of the image displayed on the first LCD 103 and the second LCD 104 is increased. Available image sizes are 100% (640 pixels × 480 pixels), 150% (960 pixels × 720 pixels), 200% (1280 pixels × 960 pixels), and 250% (1600 pixels × 1200 pixels). is there. In “display priority”, “high priority” or “low priority” can be designated. For example, the user designates a high priority for a favorite image.

  “Image editing” is an item for setting an image to be displayed so as to have a pattern that matches the user's preference. “Image editing” further includes menus of “brightness”, “color tone”, “tone correction”, “sharpness”, “monochrome”, and “sepia”. When “brightness” is selected, the user can set the degree of brightness of the image. The user sets the degree of brightness while referring to “brightness bar display” displayed on the second LCD 104 by the RISC 110. When “Hue” is selected, the user can set the hue of the screen. The user sets the hue while referring to the “red intensity bar display”, “blue intensity bar display”, and “green intensity bar display” displayed on the second LCD 104 by the RISC 110. When “gradation correction” is selected, one of “hard tone”, “standard”, and “soft tone” can be set. When “sharpness” is selected, the user can set the degree of edge enhancement of the image. The user sets the degree of edge enhancement while referring to the “strong bar display” displayed on the second LCD 104 by the RISC 110.

  When “image input” in the top menu is selected, the RISC 110 displays “image capture” and “image capture cancel” on the second LCD 104. When “image capture” is selected by the user, the RISC 110 starts capture processing of the image recorded in the external device. When “Cancel image capture” is selected, the RISC 110 ends the image capture processing from the external device.

  When “slide show” is selected from the top menu, the RISC 110 displays “display slide show” and “create slide show” on the second LCD 104. In “slide show display”, the user selects images to be used in the slide show. The user designates an image to be used in the slide show from the items “select slide show data” or “select all images”. In “slide show data selection”, the user designates images to be used in the slide show from images displayed as thumbnails by the RISC 110. When “select all images” is selected, the RISC 110 displays a slide show using all the images recorded in the HDD 114. In “create slide show”, selection of images to be used in the slide show, display time, display effect, and BGM can be set.

  When “setting” in the top menu is selected, the RISC 110 displays items of “number of simultaneous display”, “display mode”, “display priority”, and “sort order” on the second LCD 104. The items “simultaneous display number” and “display priority” can be set in the same manner as the “simultaneous display number” and “display priority” items in the submenu. In the “display mode”, a display form of an image to be displayed on the first LCD 103 and the second LCD 104 can be set. When “display mode” is selected, the RISC 110 displays items of “posture priority” and “size priority” on the second LCD 104. In “posture priority”, one of “posture sensor”, “vertical opening”, and “lateral opening” is selected by the user. In the “posture sensor”, the RISC 110 displays the image so that the vertical direction of the image matches the vertical direction of the viewer 100 detected by the posture sensor 116. In “vertical opening”, the RISC 110 displays the image so that the vertical direction of the image matches the vertical direction of the viewer 100 in the vertical position and orientation. In “horizontal opening”, the RISC 110 displays the image with its top-to-bottom direction aligned with the vertical direction in the horizontal position and orientation of the viewer 100. When “size priority” is selected, the RISC 110 displays the image with the longitudinal direction of the side of the image aligned with the longitudinal direction of the side of the first LCD 103 or the second LCD 104.

  The “sort order” is an item for setting the image sort order, that is, the image display order. The user selects a sort order of “file name order” or “shooting date order”. When “file name order” is selected, the RISC 110 sorts the image files in ascending order (A to Z) or descending order (Z to A) in alphabetical order according to the dictionary rules based on the file name of the image file. When “order of photographing date / time” is selected, the RISC 110 sorts the image files in ascending order (from the past to the future) or descending order (from the future to the past) based on the photographing date / time information recorded in the image file.

The recorded data in the HDD 114 will be described with reference to FIG.
Inside the HDD 114, a resized image file folder F1, a VGA image data folder F2, an image processing data folder F3, and a slide show data folder F4 are provided. Further, the HDD 114 is also provided with a viewer image management table T1 and a display priority table T2.

  The resized image file folder F1 is a folder for storing a resized image file of 2 million pixels (1600 pixels × 1200 pixels), for example. The image data of the resized image file is compressed in, for example, JPEG format. The resized image generation process will be described in detail later. The VGA image data folder F2 is a folder for storing VGA size image data created for display on the first LCD 103 and the second LCD 104. The VGA size image data is generated by the RISC 110 based on the resized image file, and is stored as a luminance color difference format (YCbCr422 format) file (VGA image file). The image processing data folder F3 is a folder for storing data indicating the contents of image processing performed on the resized image file, that is, image processing data. The slide show data folder F4 is a folder for storing slide show data.

  The viewer image management table T1 is a table for managing resized image files stored in the HDD 114 of the viewer 100. The viewer image management table T1 will be described in detail later. The display priority table T2 is a table that the RISC 110 refers to when determining the display priority of the viewer image management table T1. The display priority table T2 will also be described in detail later.

  Next, the viewer image management table T1 will be described with reference to FIG. FIG. 4 is a diagram illustrating an example of the viewer image management table T1. “No.” is a serial number added based on the order recorded in the viewer image management table T1. “Resize image file name” represents the file name of the resize image file. No. 4 in FIG. The resized image file name “DSC_0005 — 2006 — 01 — 01 — 1930.rsz” shown in FIG. 1 is given based on the following rule.

  The file name prefix DSC_0005, which is the file name prefix, is the file name DSC_0005. This is the same character string as the part excluding the extension jpg of jpg. _2006 — 01 — 01 — 1930, which is the suffix of the file name (end part), is added based on the shooting date and time of the image file. That is, in this example, since the image was taken at 19:30 on January 1, 2006, the suffix is _2006_01_01_1930.

  “VGA image file name” is the file name of the VGA image file, and is the file name obtained by replacing the extension rsz of the resized image file name with ycc. Therefore, the resized image file name and the VGA image file name are associated with each other. “Shooting date and time” represents information on the shooting date and time, that is, the date and time when the file was generated by the camera during shooting. “Shooting date and time No.” is a number added in order of shooting date and time. A larger “shooting date / time No.” indicates that the image was shot later. “Display priority” is data referred to by the RISC 110 when performing the above-described image prefetching process. The larger the display priority value, the higher the display priority. As described above, the prefetch process is a process in which the RISC 110 predicts in advance a plurality of images that are likely to be browsed by the user and writes the image data of the VGA image file into the SDRAM 111. The prefetch process by the RISC 110 is performed in order to realize high-speed image display. Details of the prefetch process will be described later.

  Next, a display priority determination rule by the RISC 110 will be described. The display priority table T2 shown in FIG. 5 is a table that is referred to when the RISC 110 determines the display priority. The display priority table T2 is a table showing the correspondence between the image shooting date and the number of display times in the viewer 100 and the weighting value assigned to them, that is, the display priority. The RISC 110 refers to the display priority table T2 and determines that the display priority of the image shot on the last shooting date is 10. In general, the user tends to view the latest image, so the priority is set highest. The RISC 110 determines that the display priority of the images used for the slide show is 5. Since the images used in the slide show are user's favorite images, the priority is increased. The RISC 110 determines the display priority with reference to the display count of images recorded in the viewer image management table T1 and the display priority table T2. However, the display of thumbnail images is not counted by the RISC 110 as the number of display times. The RISC 110 counts the number of times of display when the image is displayed in a size larger than a predetermined size. For example, when the image display size is equal to or larger than that for the simultaneous display of four images, the RISC 110 counts the number of times of display and updates the display number field of the viewer image management table T1.

  The RISC 110 determines the display priority of the image designated as having a high priority by the user as 5 with reference to a “high priority designation” column described later in the viewer image management table T1. Therefore, since the RISC 110 refers to the display priority when performing prefetching as described above, there is a high possibility that an image for which high priority has been designated is prefetched by the RISC 110. Further, the RISC 110 fixes the display priority of an image designated as low priority by the user with reference to a “low priority designation” column described later in the viewer image management table T1. That is, the RISC 110 does not change the display priority no matter how many times an image with a low priority is displayed. Therefore, an image for which low priority is specified is less likely to be prefetched by the RISC 110. The images before and after the user's favorite image are likely to increase in the number of display times as the image is switched. However, these images are not always user's favorite images. Therefore, by fixing the display priority of such an image to 1, the RISC 110 can prefetch an image with a higher display priority.

  Returning to the description of the viewer image management table T1. “Use slide show” is information indicating whether an image is used for a slide show. When an image is used for the slide show for the first time, the RISC 110 updates the slide show use column corresponding to the image. “Specifying high priority” is information indicating whether or not an image is designated as having high priority by the user. When high priority is set by the user from the menu screen described above, the RISC 110 updates the high priority designation field. “Low priority designation” is information indicating whether or not an image has been designated by the user as having low priority. When the low priority is set by the user from the menu screen described above, the RISC 110 updates the low priority designation field.

  “Sort order” represents an image display order determined by a user sort instruction. The “sort order” is rewritten every time the user gives a sort instruction. There are two sort conditions that can be specified by the user, for example, file name order or shooting date / time order. As will be described later, the sorted images are ordered in the sort order on the reference axis that is arranged in the order of file name or shooting date.

“Camera posture information” is information representing the posture of the camera at the time of shooting. There are three types of “camera posture information”: a horizontal position photographing posture, a +90 degree vertical position photographing posture, and a −90 degree vertical position photographing posture.
That is, the horizontal position shooting posture in which the user holds the camera in the horizontal position, the +90 degree vertical position shooting posture in which the user holds the camera at the vertical position of +90 degrees clockwise from the horizontal position, and the clockwise position from the horizontal position. -90 degree vertical position shooting posture when shooting at a vertical position of -90 degrees. As will be described later, the camera posture information is recorded in an image file based on a signal from a posture sensor provided in the camera.

  “Image processing management information” indicates the type of image processing performed on the resized image data and the order in which the processing is performed. No. 4 in FIG. A case of 1 indicates that the tone adjustment has been performed after the gradation conversion is performed on the resized image data. “Image processing data name” is data in which parameters of image processing indicated in the image processing management information are recorded. No. 4 in FIG. In the case of 1, P000019. imp is image processing data. The image processing data is stored in the image processing data folder F3 in the HDD 114.

  “Metadata update date / time” represents information on the date / time when the metadata stored in the header of the image file was updated. The metadata will be described in detail later. “Camera identifier information” is information that identifies the camera that captured the image. Specifically, the camera manufacturer name, camera model name, and camera serial number are included.

Next, a method for generating a resized image file will be described. The resized image file is generated using the following four methods.
(1) Generated when photographing a subject image with an electronic camera (2) Generated with an electronic camera for an image acquired by shooting (3) Generated with an external device such as a personal computer (4) Generated with a viewer

(1) Generation of a resized image file at the time of photographing a subject image by the electronic camera FIG. 6 is a block diagram for explaining a main configuration of the electronic camera 200. The electronic camera 200 includes a photographing optical system 201, an image sensor 202, an analog processing circuit 203, an A / D conversion circuit 204, a timing generator 205, a digital processing circuit 206, a color interpolation processing unit 207, a reduced image generation unit 208, and a compression unit 209. A memory card interface 210, a CPU 211, an LCD drive circuit 212, an LCD 213, an operation unit 214, and an attitude sensor 215.

  The photographing optical system 201 is an optical system that forms a subject image on a light receiving surface of an image sensor 202 described later. The image sensor 202 is a photoelectric conversion element that converts received subject light into an image signal corresponding to its intensity. The imaging element 202 has pixels arranged in a matrix. Among them, for example, about 7 million pixels of 2304 pixels × 3072 pixels are effective imaging pixels. One of R (red), G (green), and B (blue) filters is attached to the light receiving surface of each pixel of the light receiving element of the image sensor 202 in a Bayer array. In a pixel (R pixel) to which an R filter is attached, incident light is separated into red and an image signal having a level corresponding to the brightness related to red is output. Similarly, in a pixel (G pixel) to which a G filter is attached, incident light is color-separated into green and an image signal having a level corresponding to the brightness related to green is output. In a pixel to which a B filter is attached (B pixel), incident light is color-separated into blue, and an image signal having a level corresponding to the brightness related to blue is output.

  The analog processing circuit 203 is a circuit that performs analog processing on the image signal output from the image sensor 202. Analog processing includes amplifier gain control and correlated double sampling. The gain of the amplifier is determined based on the ISO sensitivity set by the CPU 211. The A / D conversion circuit 204 is a circuit that converts the image signal output from the analog processing circuit 203 into digital image data. The timing generator 205 outputs a timing signal to the image sensor 202, the analog processing circuit 203, and the A / D conversion circuit 204 in accordance with a command from the CPU 211, and the image sensor 202, the analog processing circuit 203, and the A / D conversion circuit 204 This is a circuit for controlling the drive timing.

  The CPU 211 is an arithmetic circuit that controls each component of the electronic camera 200 and executes various data processing. That is, the CPU 211 controls the timing generator 205 and also controls a digital processing circuit 206, a color interpolation processing unit 207, a reduced image generation unit 208, a compression unit 209, a memory card interface 210, and an LCD driving circuit 212, which will be described later. The CPU 211 includes a memory (not shown), and stores various user settings input via the operation unit 214 as will be described later.

  The digital processing circuit 206 is a circuit that executes white balance processing and gamma correction processing on the image data output from the A / D conversion circuit 204. A color interpolation processing unit 207 performs color interpolation processing on the image data output from the digital processing circuit 206. By this interpolation processing, image data for each color of R, G, and B is obtained for all pixels. As described above, an image signal relating to red is output from the R pixel of the image sensor 202, but there is no information relating to green and blue. Similarly, red and blue image signals are not output from the G pixel of the image sensor 202. Also, red and green image signals are not output from the B pixel of the image sensor 202. Therefore, for example, for the R pixel, green and blue image data are generated by performing color interpolation processing based on the values of surrounding pixels. By performing the same processing on the G pixel and the B pixel, image data for each color of R, G, and B is obtained for all the pixels.

  The reduced image generation unit 208 is a circuit that generates thumbnail image data, view image data, and resized image data by reducing the image size of the main image data of about 7 million pixels as described above. The size of the thumbnail image data is, for example, vertical 120 pixels × horizontal 160 pixels. The view image data means image data having an appropriate size to be displayed on the LCD 213 described later. The size of the view image data is, for example, 240 vertical pixels × 320 horizontal pixels. The resized image data is, for example, image data of length 1200 × width 1600.

  A compression unit 209 is a circuit that performs JPEG compression processing on the main image data. The CPU 211 generates one image data file from the thumbnail image data, the view image data, the compressed main image data, and the header information of the image data. Note that image data file generation processing by the reduced image generation unit 208, the compression unit 209, and the CPU 211 will be described in detail later.

  The memory card interface 210 is an interface for performing data communication with the above-described memory card 301 mounted on the camera. The memory card interface 210 is an interface circuit that writes an image data file to the memory card 301 or reads an image data file recorded on the memory card 301 under the control of the CPU 211.

  The LCD drive circuit 212 is a circuit that drives the LCD 213 by outputting a drive signal to the LCD 213 based on a command from the CPU 211. The LCD 213 is a liquid crystal display panel having an aspect ratio of 3: 3. The LCD 213 performs display as a liquid crystal viewfinder and displays images based on thumbnail image data and view image data recorded on the memory card 301. The LCD 213 displays various information related to the image data file (shutter speed, aperture value, ISO sensitivity, file name, etc.). The LCD 213 displays various setting menu screens of the electronic camera 200 based on an operation of the operation unit 214 described later.

  The operation unit 214 is a switch that receives a user operation. The operation unit 214 includes a power switch, a release button, a setting menu display changeover switch, a setting menu determination button, and the like. The posture sensor 215 is a sensor that outputs information on the posture of the camera at the time of shooting. The posture sensor 215 is a horizontal position shooting in which the user holds the camera in the horizontal position, a +90 degree vertical position shooting in which the user holds the camera at a vertical position of +90 degrees clockwise from the horizontal position, and a counterclockwise rotation from the horizontal position. A posture signal for identifying photographing at a vertical position of −90 degrees in the direction for identifying photographing at −90 degrees vertical position is output. This attitude signal is written in the image file.

  Next, setting of image data size by the electronic camera 200 will be described. The image data size here means the number of pixels. The user sets the size of the main image data by operating the operation unit 214 in advance. There are two sizes of main image data that can be selected by the user: a first size and a second size. The first size is vertical 2304 pixels × horizontal 3072 pixels, and the second size is vertical 480 pixels × horizontal 640 pixels.

  The CPU 211 stores the size of the main image data input via the operation unit 214 in the internal memory. The CPU 211 refers to the image size table shown in FIG. 7 and performs image processing on the captured image signal based on the size of the input main image data. When the first size is set, an image data file is generated using the image data generated by the color interpolation processing unit 207 as main image data as it is, and is recorded in the memory card 301. When the second size is set, the reduced image generation unit 208 performs thinning processing on the image data generated by the color interpolation processing unit 207 to generate main image data. The CPU 211 generates an image data file based on the generated main image data and records it in the memory card 301.

  The user can select a shooting mode (referred to as a resized image generation shooting mode) in which the above-described resized image reduced to 2 million pixels is generated at the time of shooting by operating the operation unit 214 of the user. When the resized image generation shooting mode is instructed, the CPU 211 also sets the size of the resized image data based on the image size table. When a shooting mode other than the resized image generation shooting mode is instructed by the operation of the user operation unit 214, the CPU 211 does not set the size of the resized image data.

  As shown in the image size table of FIG. 7, the CPU 211 sets the thumbnail image data size to 120 pixels vertically × 160 pixels horizontally regardless of the first and second sizes. Further, the CPU 211 sets the view image data size to 240 vertical pixels × 320 horizontal pixels regardless of the first and second sizes. Note that the thumbnail image data size is the size of the thumbnail image data itself.

  Next, the imaging operation of the electronic camera 200 will be described. When the user operates the operation unit 214 to turn on the power and switch to the still image shooting mode, the CPU 211 sets the still image shooting mode. When the user operates the operation unit 214 in the still image shooting mode setting state and the resized image generation shooting mode is designated, the CPU 211 sets the resized image generation shooting mode. In any of the above-described shooting modes, the CPU 211 controls the timing generator 205, the digital processing circuit 206, the color interpolation processing unit 207, the reduced image generation unit 208, and the LCD driving circuit 212, thereby reducing 1/30 second. The image displayed on the LCD 213 is updated at a cycle. That is, the moving image of the subject is displayed on the LCD 213 functioning as an electronic viewfinder.

  Specifically, the CPU 211 instructs the reduced image generation unit 208 to generate view image data based on the setting. The view image data size is 240 vertical pixels × 320 horizontal pixels. The reduced image generation unit 208 generates view image data at a predetermined timing (cycle of 1/30 seconds) based on an instruction from the CPU 211.

  When the user fully presses the release switch, the CPU 211 sets the shutter speed, the aperture value, and the ISO sensitivity based on the photometric value obtained from the image sensor 202. Then, the CPU 211 sets an aperture value (not shown) to a set aperture value. The CPU 211 controls the timing generator 205 to drive the image sensor 202 so as to accumulate charges for a time corresponding to the set shutter speed. Further, the CPU 211 determines the gain of the amplifier of the analog processing circuit 203 based on the set ISO sensitivity, and sets the gain in the amplifier.

  The image signal output from the image sensor 202 is processed by the color interpolation processing unit 207 from the analog processing circuit 203 described above. The CPU 211 designates the thumbnail image data and the size of the view image data as shown in FIG. Then, the reduced image generation unit 208 generates thumbnail image data and view image data having a size designated by the CPU 211 based on the main image data.

  In the resized image generation shooting mode, the CPU 211 further designates the size of the resized image data to the reduced image generation unit 208. The reduced image generation unit 208 generates resized image data having a size designated by the CPU 211 based on the main image data, in addition to the thumbnail image data and the view image data.

  The CPU 211 generates main image data based on the set size of the main image data. When the first size is large, the CPU 211 uses the image data generated by the color interpolation processing unit 207 as it is as the main image data. When the second size is small, the reduced image generation unit 208 performs thinning processing on the image data generated by the color interpolation processing unit 207 to generate main image data. Next, the CPU 211 causes the compression unit 209 to execute compression processing of the generated main image data. In the resized image generation shooting mode, the CPU 211 also compresses the resized image data.

  The CPU 211 generates an image data file. Specifically, the CPU 211 generates one image data file from the main image data compressed by the compression unit 209, the thumbnail image data generated by the reduced image generation unit 208, and the view image data. At this time, the CPU 211 records information on the thumbnail image display size and the view image display size in the header portion of the image data file. Further, the CPU 211 also records shooting information such as shutter speed, aperture value, ISO sensitivity, file name, shooting date and time in the header portion of the image data file. The CPU 211 also records address information of the data file of each image, that is, information indicating which data file is recorded at which address in the data file in the header portion of the image data file. In the resized image generation shooting mode, the CPU 211 generates a resized image file separately from the above-described image data file.

  The CPU 211 drives the memory card interface 210 to write the generated image data file to the memory card 301. When there is a resized image file, the CPU 211 stores the resized image file in a folder different from the above-described image data file. If the user has selected the setting for creating a resized image file at the time of shooting, the CPU 211 creates a card image management table as shown in FIG. When the card image management table has already been created in the memory card 301, the CPU 211 updates the card image management table. In the card image management table, the file name of the main image in the memory card 301, the file name of the resized image corresponding to the main image file, and the folder name for storing the main image and the resized image are recorded. In addition, camera identifier information that identifies the camera that acquired the image is also recorded in the card image management table. The camera identifier information includes a camera manufacturer name, a camera model name, and a camera serial number.

(2) Resized image generation by electronic camera for captured image In the electronic camera 200 described above, when the user operates the operation unit 214 to turn on the power and switch to the image reproduction mode, the CPU 211 Set the playback mode. In the image reproduction mode, the CPU 211 reads the image file from the memory card 301 by driving the memory card interface 210. Based on the read image file, the CPU 211 displays an image corresponding to the thumbnail image data or view image data on the LCD 213. Note that the resized mark is superimposed on the image for which the resized image data is generated.

  The user can select an image to be resized from the images displayed on the LCD 213 by operating the operation unit 214. In order to designate an image for generating a resized image, the user can perform three instructions, ie, all image designation, one image designation, and all image release, by the operation unit 214.

  The designation of all images is to designate all images displayed on the LCD 213 as images for generating a resized image. In other words, when the user performs an operation for designating all images using the operation unit 214, the CPU 211 changes all images displayed on the LCD 213 except images with a resized mark to images for generating a resized image. Recognize that it was specified. Then, the CPU 211 superimposes and displays a check mark on the image displayed on the LCD 213 via the LCD driving circuit 212. At this time, the check mark is not displayed on the image already having the resized mark.

  One image designation is to individually designate an image displayed on the LCD 213 as an image for generating a resized image. That is, when the user performs an operation of selecting a favorite image using the operation unit 214, the CPU 211 recognizes that the selected image is designated as an image for generating a resized image. Then, the CPU 211 superimposes and displays a check mark on the image selected on the LCD 213 via the LCD drive circuit 212. When the user performs a canceling operation on an image that already has a check mark using the operation unit 214, the CPU 211 cancels the designation of yes-size image generation and erases the display of the check mark.

  The all image designation is to cancel all the designations of the resized image generation designated by the all image designation or the one image designation.

  When the user gives an instruction to create a resized image by operating the operation unit 214, the CPU 211 instructs the reduced image generation unit 208 to generate a resized image for an image with a check mark. The reduced image generation unit 208 generates resized image data based on a command from the CPU 211.

  When the resized image data is generated, the CPU 211 generates a resized image file in the same manner as the processing in the resized image generation shooting mode. The CPU 211 drives the memory card interface 210 to write the generated resized image file to the memory card 301. The CPU 211 stores the resized image file in a folder different from the existing image file in the memory card 301. Then, the CPU 211 generates a card image management table as shown in FIG. 8 and writes it in the memory card 301. When the card image management table has already been created in the memory card 301, the CPU 211 updates the card image management table.

(3) Resized image generation by an external device such as a personal computer-Processing for a memory card in which an image file acquired by an electronic camera is recorded-
FIG. 18 is a schematic control block diagram showing an example of a personal computer (hereinafter referred to as a personal computer) 400. The personal computer 400 has a CPU 401, HDD 402, memory card interface 403, operation unit 404, monitor 405, and external interface 406. When the resized image is generated by the personal computer 400, the image management software is started by the user. This image management software is stored in the HDD 402. When the user operates the operation unit 404 and is instructed to start the image management software, the CPU 401 starts the image management software. When the memory card 301 is attached, the memory card interface 403 outputs an attachment signal indicating that the memory card 301 is attached to the CPU 401. When the mounting signal is input, the CPU 401 establishes communication with the memory card 301 and outputs a signal requesting transmission of the card image management table and the thumbnail image file in the memory card 301.

  When the CPU 401 reads the card image management table and the thumbnail image file, the CPU 401 displays a thumbnail image corresponding to the input thumbnail image file on the monitor 405. When the card image management table does not exist in the memory card 301, the CPU 401 does not read the card image management table. For example, a case where a thumbnail image file acquired by the electronic camera 200 not having the resizing function is read corresponds to this case. Based on the card image management table, the CPU 401 superimposes and displays a mark indicating that the resized image file has been resized.

  When the user operates the operation unit 404 to specify an image for generating a resized image, the CPU 401 generates a resized image file corresponding to the image specified by the user. In order to generate a resized image, the user can use the operation unit 404 to perform three instructions of one image designation, all image designation, and all image designation cancellation, as in the case of the electronic camera 200. The CPU 401 records the generated resized image file on the memory card 301. Further, the CPU 401 updates the card image management table. The updated card image management table is recorded in the memory card 301. When the card image management table does not exist in the memory card 301, the CPU 401 newly creates a card image management table and records it in the memory card 301. Similarly, when the personal computer 400 and the electronic camera 200 are connected via a cable such as USB via the external interface 406, the CPU 401 reads the thumbnail image file and generates the resized image file. It is.

-Resize image generation processing from images stored in the internal drive of a computer-
A case where a resized image file is generated from the image file recorded in the HDD 402 of the personal computer 400 described above will be described. When the user operates the operation unit 404 and is instructed to start the image management software, the CPU 401 starts the image management software. When the image management software is activated, the CPU 401 reads the PC image management table in the HDD 402. In the PC image management table, information regarding the presence / absence of a resized image file for the image file recorded in the HDD 402 is recorded. The PC image management table stores the same information as the card image management table.

  When the user operates the operation unit 404 to designate a folder, the CPU 401 reads thumbnail image data in an image file saved in the designated folder. When reading the thumbnail image data, the CPU 401 displays a thumbnail image corresponding to the read thumbnail image data on the monitor 405. Based on the PC image management table, the CPU 401 superimposes and displays a mark indicating that the resized image file has been resized.

  When the user operates the operation unit 404 to specify an image for generating a resized image, the CPU 401 generates a resized image file corresponding to the image specified by the user. In order to generate a resized image, the user can perform three instructions, that is, one image designation, all image designation, and all image designation cancellation, as described above. The CPU 401 records the generated resized image file in the HDD 402. Furthermore, the CPU 401 updates the PC image management table. If the PC image management table does not exist, the CPU 401 newly creates a PC image management table.

  The resized image file generated by the personal computer 400 is written to the drive designated by the user by the CPU 401. For example, when the memory card 301 is connected and the user designates the memory card 301, the resized image file is written to the memory card 301. Prior to writing to the memory card 301, the CPU 401 requests transmission of the card image management table of the memory card 301. When the card image management table is input, the CPU 401 determines which resized image file among the generated resized image files is not stored in the memory card 301. The determination is made by comparing the PC image management table with the input card image management table.

  At the time of comparison, the CPU 401 calculates the difference between the resized image file name in the PC image management table and the resized image file name in the input card image management table. Even if the resized image file name in the PC image management table and the resized image file name in the card image management table are the same, if the camera identifier information given to these images is different, the image file on the PC side is Judge as difference. In this case, the CPU 401 changes the file name of the image file on the PC side by adding a character such as “_01” at the end. By taking the difference between the resized image file names, the CPU 401 extracts a resized image file (difference image file) having a file name different from the resized image file name in the card image management table of the memory card 301. When the card image management table does not exist in the memory card 301, the CPU 401 recognizes all the resized image files in the PC image management table as difference image files. When the difference image file is extracted, the CPU 401 records a resized image file corresponding to the difference image file on the memory card 301. When the resized image file is recorded, the CPU 401 updates the card image management table and records it in the memory card 301.

(4) Resized image generation by the viewer 100 When the memory card 301 is attached to the viewer 100, the RISC 110 reads an image file stored in the memory card 301. The RISC 110 generates a resized image file using the read image file and stores it in the resized image file folder F1 of the HDD 114. Further, the RISC 110 updates the viewer image management table T1.

  When the memory card 301 is attached, the memory card interface 120 outputs an attachment signal indicating that the memory card 301 is attached to the RISC 110. Upon receiving the mounting signal, the RISC 110 establishes communication with the memory card 301 and outputs a signal requesting transmission of the card image management table in the memory card 301. Further, the RISC 110 displays a warning text such as “Image data is being input. Do not remove the memory card” on the first LCD 103 via the first LCD interface 118.

-When the card image management table exists in the memory card 301-
When the card image management table exists in the memory card 301, the RISC 110 inputs the card image management table. The RISC 110 recognizes the resized image file from the input card image management table. The RISC 110 determines whether the recognized resized image file is a resized image file already recorded in the HDD 114. This determination is made by comparing the viewer image management table T1 with the input card image management table.

  At the time of comparison, the RISC 110 takes the difference between the input resized image file name in the card image management table and the resized image file in the viewer image management table T1. By taking the difference between the resized image file names, the RISC 110 extracts a resized image file (difference image file) having a file name different from the resized image file name in the viewer image management table T1 of the viewer 100. Even if the resized image file name in the card image management table and the resized image file name in the viewer image management table T1 are the same, if the camera identifier information given to these images is different, the memory card 301 side The image file is determined as a difference. In this case, the RISC 110 changes the file name of the image file on the memory card 301 side by adding a character such as “_01” at the end.

  The RISC 110 reads a resized image file corresponding to the difference image file from the memory card 301. The RISC 110 temporarily stores the read resized image file in the SDRAM 111 and then records it in the resized image file folder F 1 of the HDD 114. When the resized image file is recorded, the RISC 110 updates the viewer image management table T1.

  The RISC 110 searches all images in the memory card 301. As a result of the search, an unregistered image file whose file name is not recorded in the card image management table is extracted based on the main image file name and the main image storage folder name recorded in the card image management table. When the unregistered image file is extracted, the RISC 110 reads the unregistered image file and develops it in the SDRAM 111. The RISC 110 displays the read unregistered image file on the first LCD 103. Further, a message prompting selection such as “Do you want to create a resized image?” Is displayed on the second LCD 104.

  When the user has selected the setting for generating a resized image by operating the operation button 106, the RISC 110 generates a resized image file based on the image file developed in the SDRAM 111, and the resized image file folder F1 in the HDD 114. To record. Then, the RISC 110 updates the viewer image management table T1. The RISC 110 adds the file name of the unregistered image to the card image management table of the memory card 301.

Further, the RISC 110 displays a message such as “input of image data has been completed” on the first LCD 103 via the first LCD interface 118 for a predetermined time.

-When the card management table does not exist in the memory card 301-
When the card image management table does not exist in the memory card 301, the RISC 110 inputs the image file in the memory card 301 and develops it in the SDRAM 111. The RISC 110 generates a resized image file based on the image file developed on the SDRAM 111, and records it in the resized image file folder F1 of the HDD 114. Then, the RISC 110 updates the viewer image management table T1. The RISC 110 performs the above-described resize image file generation process for all the image files in the memory card 301. When the resized image file is generated from all the image files in the memory card 301, the RISC 110 sends a message such as “input of image data is completed” to the first LCD 103 via the first LCD interface 118 in a predetermined manner. Display time.

  The RISC 110 compares the first half of the file name of the resized image file, for example DSC0001, in the viewer image management table T1 before the update with the first half of the file name of the resized image file generated by the above-described resized image file generation process. If there is an image file with the same file name as a result of the comparison, the RISC 110 displays images corresponding to both resized image files on the first LCD 103. When two images having the same file name exist, the two images are displayed side by side on the first LCD 103. When there are three or more images having the same file name, thumbnail images are displayed. In this case, the newly read image or the generated image is displayed in reverse video.

  Further, the RISC 110 displays, for example, “1. There was an image with the same file name on the second LCD 104.“ 2. An image with the same file name was deleted. ”,“ 2. There was an image with the same file name. A message prompting selection such as “Change.”, “3. Delete all images with the same file name at once”, and “4. Change the file names of images with the same file name at once” is displayed.

  When the user operates the operation button 106 and selects “1. There was an image with the same file name. Delete the reverse display image”, the RISC 110 deletes the resized image file selected by the user from the HDD 114. To do. The user can designate an image to be deleted by operating the joystick 107 and the operation button 106. The designated image is displayed in reverse on the first LCD 103.

  When the user operates the operation button 106 and selects “2. There was an image with the same file name. Change the file name of the reverse display image”, the RISC 110 selects the newly generated resized image file. Change the file name. Specifically, a character, for example, “_01” is added to the end of the file name based on a predetermined rule. Further, the RISC 110 updates the viewer image management table T1. When the user operates the operation button 106 and selects “3. Delete all images with the same file name”, the RISC 110 deletes, for example, “Deletes the image with the same file name.” On the second LCD 104. "?" Is displayed. When the user operates the operation button 106 and selects “OK”, the RISC 110 deletes the newly generated resized image file from the HDD 114. When the user operates the operation button 106 to select “Cancel”, the RISC 110 displays a message prompting the above-mentioned selection again on the second LCD 104.

When “4. Change the file names of images with the same file name in a batch” is selected, the RISC 110 changes the file names of newly read resized images or newly created resized images. Specifically, as described above, characters are added to the end of the file name based on a predetermined rule so that the file names can be identified.
When the above processing ends, the RISC 110 updates the viewer image management table T1.

(About image display)
Processing for displaying an image on the first LCD 103 or the second LCD 104 of the viewer 100 will be described. The image displayed on the first LCD 103 or the second LCD 104 is a VGA image. Here, a case where no VGA image is created will be described. The user designates an image to be displayed on the first LCD 103 or the second LCD 104 by operating the operation button 106, the joystick 107, the touch panel 122, and the like. As a result, the RISC 110 reads the resized image file corresponding to the designated image from the HDD 114 and develops it in the SDRAM 111. The RISC 110 generates a VGA image file from the resized image file developed on the SDRAM 111. When the VGA image file is generated, the RISC 110 records the VGA image file in the VGA image data folder F2 in the HDD 114. Further, the RISC 110 updates the “VGA image file name” and “VGA image file presence / absence” fields of the viewer image management table T1. Then, the RISC 110 displays an image corresponding to the VGA image file on the first LCD 103 or the second LCD 104.

  The number of images displayed on the first LCD 103 or the second LCD 104 of the viewer 100 is set by the user. The number of displayed images can be set from a menu for setting the number of simultaneously displayed images on the menu screen displayed on the first LCD 103 or the second LCD 104. In addition, it is possible to change the number by touching the touch panel 122 with a finger. When the single image display is set, the RISC 110 displays one enlarged image using the two screens of the first LCD 103 and the second LCD 104 as shown in FIG.

  When the two-sheet display is set, the RISC 110 displays one image on each of the first LCD 103 and the second LCD 104 as shown in FIGS. 9B and 9C. That is, the RISC 110 simultaneously displays a total of two images. In this case, the image display is performed using VGA image data.

  FIG. 9B shows an example of a display screen when the viewer 100 is held in the horizontal position and posture and the two-image display is set in the posture priority mode. FIG. 9C shows an example of a display screen when the viewer 100 is held in the horizontal position and posture and the two-image display is set in the size priority mode.

  When the four-sheet display is set, the RICS 110 simultaneously displays a total of four images, two on each of the first LCD 103 and the second LCD 104, as shown in FIGS. Four images are displayed as reduced image data obtained by reducing VGA image data. FIG. 9D shows an example of a display screen when the viewer 100 is held in the horizontal position and posture and the four-image display is set in the posture priority mode. FIG. 9E shows an example of a display screen when the viewer 100 is held in the horizontal position and posture and the four-image display is set in the size priority mode. FIG. 9F shows an example of a display screen when the viewer 100 is held in the vertical position and the four-image display is set in the posture priority mode.

  When the user selects image display from the top menu on the menu screen shown in FIG. 19, the RISC 110 displays thumbnail images using the first LCD 103 and the second LCD 104 as shown in FIG. When any one of the thumbnail images shown in FIG. 10 is designated by the operation of the operation button 106 and the joystick 107, the RISC 110 displays the image on the first LCD 103 and the second LCD 104 according to the setting of the display number described above. To do.

  Next, the prefetching process performed by the RISC 110 will be described. In the prefetching process, a plurality of images (predicted images) that are likely to be displayed on the viewer 100 by a user's selection operation are predicted in advance by the RISC 110. As will be described later, the prefetch processing is executed based on various data of the resized image file recorded in the resized image file folder F1 of the HDD 114. That is, the RISC 110 selects an image based on the metadata of the resized image file, creates VGA image data, records this VGA image data in the SDRAM 111, and records an image file including the VGA image data in the HDD 114. . A process of prefetching an image in accordance with a predetermined rule based on the resized image file in the HDD 114 and recording VGA image data in the SDRAM 111 is referred to as a prefetch process. Such prefetching processing can speed up image display switching when the user performs an image display designation operation.

  Note that if the VGA image file corresponding to the predicted image has already been recorded in the HDD 114, the RISC 110 records the VGA image file in the HDD 114 in the SDRAM 111. When the VGA image file is not recorded in the HDD 114, the RISC 110 creates VGA image data from the resized image file in the HDD 114 and records it in the SDRAM 111. Further, the RISC 110 generates a VGA image file based on the created VGA image data and records it in the HDD 114. The SDRAM 111 has an area for writing up to 200 VGA image data to be pre-read.

  The viewer 100 of this embodiment has a metadata matching priority mode and a favorite image priority mode as prefetching modes. The pre-reading mode is selected by any one of the operation buttons 106, the joystick 107, and the touch panel 122 by the user while referring to the menu screen displayed on the first LCD 103 or the second LCD 104. The RISC 110 changes the setting method (prefetch rule) of the prefetch order according to the prefetch mode. In the metadata matching priority mode, the RISC 110 prefetches an image file having metadata that matches the metadata of the read image file. In the favorite image priority mode, the RISC 110 preferentially reads an image file having a high display priority based on the display priority of the viewer image management table T1 shown in FIG.

Hereinafter, the metadata matching priority mode and the favorite image priority mode will be described.
-Metadata match priority mode-
A prefetch process by the RISC 110 in the metadata matching priority mode will be described. The RISC 110 determines the order in which image files are prefetched based on the degree of coincidence of metadata. The RISC 110 updates the metadata accumulated value every time the VGA image is displayed on the viewer 100. Based on the updated metadata accumulated value, the RISC 110 changes the prefetch rule.

  The metadata in this embodiment is data that characterizes image data, and is stored in the header of the image file. For example, subject category information or shooting location information is used as metadata. The subject category information is parameter information for identifying a subject such as a person, landscape, flower, or the like. The shooting location information is information classified based on, for example, 1000 area data based on GPS information.

  The metadata can be input on the personal computer by the user when creating the resized image file. For example, the user can input metadata based on the content of the image displayed on the display of the personal computer. If it is a person image, the check box of the person on the metadata setting screen shown in FIG. 11 is checked. When checked, “Re” is displayed in the check box as shown in FIG. There are as many check boxes as there are metadata types, that is, the number of people, landscapes, and flowers. Alternatively, the shooting mode information can be read from the EXIF data of the image file, and metadata can be created based on the shooting mode. For example, if the read shooting mode is the portrait mode, human metadata is created, if it is the close-up mode, flower metadata is created, and if it is the landscape mode, landscape metadata is created.

  With reference to FIG. 12, a method of determining the prefetch order based on the degree of coincidence of metadata will be described. FIG. 12A shows a case in which the VGA image 1 is first displayed on the viewer 100, and thereafter the VGA image 2 and the VGA image 3 are displayed in this order. Hereinafter, the VGA images 1 to 3 are simply images. The image file corresponding to each image includes metadata as shown in FIG. That is, the image 1 file includes person and landscape metadata, the image 2 file includes person, landscape and flower metadata, and the image 3 file includes person metadata.

  When an image 1 having person and landscape metadata is displayed on the viewer 100 by the user's display image instruction operation, the RISC 110 sets the accumulated values of the person and the landscape to 1 as shown in FIG. To do. Then, the RISC 110 searches the resized image file folder F1 in the HDD 114, and uses the shooting date and time of the image 1 file as a reference to transfer the person's metadata from the image file whose shooting time is close to the image file far from the image file. The image data of the image file to be included is prefetched by the following procedure. That is, the RISC 110 records image data to be prefetched in the SDRAM 111. First, the RISC 110 determines whether image data to be pre-read has already been recorded in the SDRAM 111. If the image data to be prefetched is not recorded in the SDRAM 111, the RISC 110 searches and confirms whether an image file including the image data to be prefetched exists in the VGA image data folder F2 in the HDD 114. If there is a VGA image file including image data to be read ahead, the RISC 110 records the image data of the VGA image file in the SDRAM 111. If there is no VGA image file containing image data to be pre-read, the RISC 110 creates VGA image data from the resized image file and records it in the SDRAM 111. Then, the RISC 110 creates a VGA image file from the VGA image data and records it in the VGA image data folder F2.

  In this way, when one image having person metadata is prefetched as the next image, the RISC 110 next similarly uses the date and time of the image 1 file as the reference, and the image with the close time axis of the image and date. An image file including landscape metadata is prefetched toward an image file far from the file. In this way, the RISC 110 repeats the image prefetching of the person → landscape → person → landscape. As a result, pre-read VGA image data is recorded in the SDRAM 111 in the order of person → landscape → person → landscape.

Next, prefetching when image 2 and image 3 are sequentially selected by user operation after image 1 and displayed as a VGA image on viewer 100 will be described.
Since the image 2 file corresponding to the image 2 has the metadata of person, landscape, and flower as shown in FIG. 12A, the RISC 110 stores the accumulated value of metadata as shown in FIG. 12B. To person 2, landscape 2, flower 1. Since the accumulated value of the metadata is updated, the RISC 110 changes the look-ahead order and performs look-ahead in the order of person, landscape, person, landscape, and flower.

When an image 3 having person metadata is displayed as a VGA image on the viewer 100 by the user's display image selection operation, the RISC 110 sets the accumulated value of the metadata to the person 3, as shown in FIG. Update to Landscape 2, Flower 1. Also in this case, since the accumulated value of the metadata is updated, the RISC 110 changes the prefetching order and selects an image file to be prefetched in the order of person, person, landscape, person, landscape, and flower.
Thus, in the viewer 100 of this embodiment, the metadata accumulated value is updated each time the display image is switched, and the prefetching order is changed accordingly.

  If the metadata is weighted, the RISC 110 increases the accumulated value of the metadata by the weighted value. For example, if the RISC 110 sets the weight of the person to 2 based on the user's instruction, the person's metadata is doubled. Therefore, if the metadata of a person in an image file corresponding to image 1 (hereinafter referred to as an image 1 file or an image 2 file) is 2, RISC 110 displays the metadata at the time when image 1 is displayed. Assume that the accumulated value is person 2 and landscape 1.

  When GPS data is used as metadata, the RISC 110 sets a cumulative value of metadata for each region. The RISC 110 executes the prefetching by changing the prefetching order based on the accumulated value in the same manner as described above.

  For example, as shown in FIG. 12C, the metadata of the image 1 file is region 1, the metadata of the image 2 file is region 1, and the metadata of the image 3 file is region 2. When the image 1 is displayed on the viewer 100, the RISC 110 sets the accumulated value of the metadata of the region 1 to 1 as shown in FIG. Then, the RISC 110 uses the shooting date and time of the image 1 file as a reference, and the image data of the image file including the metadata of the region 1 toward the image file far from the image file whose shooting time is close to the time axis is the same as the procedure described above. Read ahead in the procedure.

  When the VGA image 1 of the viewer 100 is switched to the VGA image 2 by the user's image display selection operation, the RISC 110 changes the accumulated value of the metadata of the region 1 to 2 as shown in FIG. To do. Also in this case, the RISC 110 pre-reads the image data of the image file including the metadata of the region 1 toward the image file far from the image file whose time axis of the shooting date is close, with the shooting date of the image 1 file as a reference.

  Further, when the display of the viewer 100 is switched to the VGA image 3 by the user's image display selection operation, the RISC 110 sets the cumulative value of the metadata of region 1 to 2, as shown in FIG. The accumulated value of the metadata of 2 is changed to 1. In this case, at the time when the image of the image file 3 is displayed, the RISC 110 uses the shooting date and time of the image 1 file as a reference, toward the image file far from the image file whose time axis of the shooting date and time is close to the region 1 and the region 1. The prefetching is executed in the order of region 2.

-Favorite image priority mode-
In the favorite image priority mode, the RISC 110 selects an image to be prefetched based on the display priority. As described above, the display priority is recorded in the viewer image management table T1 shown in FIG. The RISC 110 reads ahead in order from the VGA image data of the image with the highest display priority. The RISC 110 pre-reads the VGA image data in descending order of display priority from the image file with the time axis of the image capturing date / time closer to the image file farther from the image file corresponding to the image being displayed on the viewer 100 as a reference. .

  As described above, in the metadata matching priority mode or the favorite image priority mode, the image file prefetching process is performed in the order of the time axis toward the past and the future based on the shooting date and time of the reference image.

  In the viewer 100 described above, the VGA image data is prefetched in the order of closeness on the time axis based on the metadata or the display priority. However, the image file can be prefetched in consideration of the image switching direction determined by the RISC 110.

(Read-ahead processing considering image switching direction)
The RISC 110 also refers to the value of the direction history k calculated based on the image switching operation using the joystick 107 or the touch panel 122, and performs prefetching of the image using metadata and display priority. For example, when the user likes and selects images of the past shooting date and time, the image files arranged along the past time axis are pre-read according to a pre-read rule determined in advance. Alternatively, when the user prefers to select an image with a future shooting date and time, the image file arranged along the future time axis is pre-read according to a pre-read rule determined in advance. Such a prefetch process is called a prefetch process in consideration of the image switching direction.

  The direction history k is a variable for determining the image switching direction. Here, when the images read into the viewer 100 are sorted by shooting date and time, the sort order number in the viewer image management table is a number in which the images are arranged in order of shooting date. When images are sorted on the time axis in this way, the image switching direction is the time when the viewer 100 pre-reads based on the operation history when the user selects the next image to be displayed (next image). The direction of the axis. That is, the image switching directions are two directions, the future direction and the past direction, based on the shooting date and time of the image being displayed by the display image selection operation. In the following description, an image being displayed by a display image selection operation is referred to as a reference image, and the file is referred to as a reference image file.

The direction history k will be described with the shooting date and time before the shooting date and time of the image being displayed on the viewer 100 as the past and the shooting date and time after the reference shooting date as the future.
When the user designates a past image file as an image to be displayed next (next image), the RISC 110 subtracts 1 from the value of k. When a future image file is designated by the user as the next image, the RISC 110 adds 1 to the value of k. The user designates the next image with the joystick 107 or the touch panel 122. For example, in the case of k = 0, the past image file selected as the next image and the future image files selected as the next image are the same number. When k = 3, for example, it indicates that a future image file has been selected as the next image three times in succession. When k = −3, for example, it indicates that a past image file has been selected as the next image in succession three times.

  Note that the prefetching rule that does not consider the image switching direction is referred to as a first determination rule, and the prefetching rule that considers the image switching direction is referred to as a second determination rule. In other words, the direction history k = 0 is referred to as a first determination rule, and k ≠ 0 is referred to as a second determination rule.

Hereinafter, prefetching processing that does not consider the image switching direction and prefetching processing that considers the image switching direction will be described.
(Read-ahead processing that does not consider the image switching direction by metadata matching mode :)
When the direction history k = 0, prefetching in consideration of the image switching direction is not performed. In this case, the image file corresponding to the VGA image data to be prefetched is selected in accordance with the prefetching order, that is, the metadata or the display priority in the order close to the reference image file. When there is an image file to be prefetched at an equal distance from the reference image file, the RISC 110 selects an image file with a high sort order as an image file corresponding to the VGA image data to be prefetched. As described above, the sort order is recorded in the viewer image management table T1.

  Note that immediately after the viewer 100 is turned on, the RISC 110 sets the image file with the highest sort order as the reference image file. For example, if the images are sorted in order of shooting date and time, the last image taken, that is, the image file having the latest shooting date and time is set as the reference image file.

  Selecting an image file corresponding to VGA image data to be pre-read is simply referred to as pre-read image selection. FIG. 13A is a diagram for explaining a selection order of prefetched images that do not consider the image switching direction in the metadata matching mode. In FIG. 13A, the sort order No. Assume that an image corresponding to the image file 5 is displayed as a VGA image on the viewer 100. That is, the sort order No. 5 is the reference image file. Sort order No. The image file 5 has metadata of person and landscape, and the image is prefetched in the order of person → landscape → person → landscape. In FIG. 13A, for example, the sort order No. 1 to sort order No. 1 Assume that up to 9 image files are arranged.

  The RISC 110 displays the sort order No. 5 image files, that is, image files having the metadata of the person are searched in the order from the reference image file. Among the image files having person metadata, the sort order No. Six image files are located closest to the reference image file. Therefore, the RISC 110 uses the sort order No. 6 image files are selected. Subsequently, the RISC 110 searches for an image file having landscape metadata. Among the image files having landscape metadata, the sort order No. 3 is located closest to the reference image file. Therefore, the RISC 110 uses the sort order No. 3 image files are selected.

  The RISC 110 again searches for an image file having the metadata of the person in the order closest to the reference image file. Sort order No. Since the image file No. 6 has already been selected, the RISC 110 determines that the sort order No. 6 is equidistant in time from the reference image file. 2 or sort order no. 8 image files are selected. In this case, the RISC 110 determines an image file to be selected with reference to the sort order. Sort order No. The sort order of the image file 2 is the sort order No. 2. 8 is higher than the sort order of the image file No. 8, the RISC 110 determines the sort order No. Select the second image file.

  Thereafter, similarly, the RISC 110 alternately selects an image file having landscape metadata and an image file having person metadata. That is, the RISC 110 searches the metadata in the order of person → landscape → person → landscape, and sort order No. 1. Sort order No. 1 8. Sort order No. Image files to be prefetched are selected in the order of 9. Sort order No. 4 and no. The image file 7 is not selected as a prefetched image because it does not have person or landscape metadata.

(Prefetch processing that does not consider the image switching direction in the favorite image priority mode :)
FIGS. 14A and 14B show the selection order of prefetched images when image switching is not performed in the favorite image priority mode.
First, prefetching of VGA image data immediately after power-on will be described with reference to FIG. In FIG. 14A, it is assumed that the image files are arranged in order of shooting date and time, as in FIG. That is, the sort order No. The shooting date and time of 1 is the newest. As shown in FIG. Since the display priority of the image file No. 4 is the highest, the RISC 110 uses the sort order No. The prefetch order of the image file 4 is the first. That is, the sort order No. The image file 4 is the reference image file. Thereafter, the RISC 110 selects an image to be prefetched in order of display priority. If the display priority of the image files is the same, the RISC 110 selects an image to be prefetched based on the sort order. For example, in FIG. 1, no. 2, no. 5, no. 7 and no. The display priority of the image file 9 is 1. In this case, the RISC 110 determines the sort order No. based on the sort order. 1, no. 2, no. 5, no. 7, no. The prefetched image is selected in the order of 9.

  Next, the user sort order No. A description will be given of prefetching in a case where image switching is not performed in the favorite image priority mode after 6 images are selected and displayed as VGA images. In FIG. 14B, the sort order No. 6 is displayed in the viewer 100, and the sort order No. 6 is displayed. Six image files are reference image files. Also in FIG. 14B, it is assumed that the image files are arranged in order of shooting date and time.

  The RISC 110 first selects prefetch image files in the order of high display priority. That is, according to the order of high display priority, the sort order No. 4, no. 8, no. The prefetch image is selected in the order of 3. For the remaining image files having the same display priority, the RISC 110 selects the pre-read images in the order of closest to the reference image file. The sort order No. that is equidistant in time from the reference image file. 5 and no. For the image file 7, the RISC 110 selects a pre-read image according to the sort order. Thereafter, the RISC 110 performs sorting order No. in the order from the reference image file. 9, no. 2, no. Images are selected in the order of 1.

Next, prefetching of an image in consideration of the image switching direction will be described.
The image switching direction is determined according to the direction history k. When the direction history k = 0, prefetching in consideration of the image switching direction is not performed. As described above, the image switching direction is the direction of the time axis when the viewer 100 prefetches an image. Therefore, the image switching direction is a direction from the shooting date / time of the reference image toward the past and a direction from the reference shooting date / time toward the future.

  First, the RISC 110 selects a prefetched image from image files existing in the image switching direction based on the prefetching order, that is, metadata and display priority. For example, if the image switching direction is a past direction from the reference shooting date and time, the RISC 110 selects metadata and display priority in order from the reference image file from the image file on the time axis that goes from the reference shooting date and time to the past. A prefetch image is selected based on. When the prefetching processing for all the images arranged in the image switching direction is completed, the RISC 110 also prefetches images for image files arranged in the time axis direction opposite to the image switching direction. That is, when the prefetching of the images for the images arranged on the time axis from the reference shooting date and time to the past ends, the RISC 110 selects the image files arranged on the time axis from the reference shooting date and time to the future in order from the closest to the reference image file. Prefetch images based on metadata and display priority.

(Read-ahead processing considering the image switching direction in the metadata matching mode :)
FIG. 13B is a diagram for describing prefetching of an image in consideration of the image switching direction in the metadata matching mode. In FIG. 13B, the sort order No. 5 VGA images are displayed on the viewer 100. That is, the sort order No. 5 is the reference image file. Sort order No. The image file 5 has person and landscape metadata. In FIG. 13B, for example, the sort order No. 1 to sort order No. 1 It is assumed that nine image files are arranged. The operation history of the joystick 107 or the touch panel 122 is as follows. That is, the user switches the image to the right direction, that is, the past direction, and sets the value of the direction history k to k = −3 (the past image is displayed three times).

  The RISC 110 displays the sort order No. Sort order No. 5 arranged in the right direction from the reference image file of FIG. 6-No. Prefetch processing is performed on the 9 image files. In this example, the sort order No. The image file having the metadata of the person is searched in the order close to the image file 5. Among the image files having person metadata, the sort order No. Six image files are located closest to the reference image file. Therefore, the RISC 110 uses the sort order No. 6 images are selected. Subsequently, the RISC 110 sorts image files having landscape metadata into a sort order No. 7-No. Search among 9 image files. Sort order No. Since the image file 9 has landscape metadata, the RISC 110 uses the sort order No. Select 9 images. Furthermore, the RISC 110 displays the sort order No. 7-No. An image file having person metadata is searched from the eight image files. Sort order No. Since the image file 8 has person metadata, the RISC 110 uses the sort order No. 8 images are selected.

  Sort order No. When an image of 8 is selected, there is no image file having person or landscape metadata on the time axis in the first direction from the reference image file to the right, that is, from the reference shooting date and time to the past. Accordingly, the RISC 110 selects an image to be prefetched from among the image files arranged on the time axis in the left direction from the reference image file, that is, in the second direction from the reference photographing date and time toward the future. The RISC 110 uses the sort order No. having the metadata of the landscape closest to the reference image file. 3 images are selected. Next, the RISC 110 selects a sort order No. having person metadata. Select the second image. Finally, the RISC 110 sorts the sort order No. having landscape metadata. Select one image.

(Pre-fetch processing considering image switching direction in favorite image priority mode :)
FIG. 14C is a diagram for explaining prefetching of an image in consideration of the image switching direction in the favorite image priority mode. Also in FIG. 14C, the image files are arranged in the order of the shooting date and time. One image file has the latest shooting date and time. In FIG. 14C, the sort order No. Assume that four VGA images are displayed on the viewer 100. That is, the sort order No. The image file 4 is the reference image file. Also in FIG. 14C, the user switches the image to the right direction, that is, the past direction, and the value of the direction history k is k = -3 (the past image is displayed three times).

  The RISC 110 displays the sort order No. Sort order No. 4 arranged in the right direction from the reference image file 4, that is, on the time axis from the reference shooting date and time to the past. 5-No. Prefetch processing is performed on the nine images. In this example, the sort order No. 8, no. Images are selected in the order of 6. Sort order No. 5, no. 7 and no. The display priority of the nine image files is the same. The RISC 110 selects the prefetched images in the order from the reference image file. Therefore, the RISC 110 uses the sort order No. 5, no. 7, no. Images are selected in the order of 9. Thus, in the case of image switching in the past direction, the reference image file No. Sort order No. 4 having a shooting date and time later than 4. 1-No. The third image is not selected.

  In the above-described example, the case where the sort order is set as the photographing date / time order has been described, but the same processing can be performed when the sort order is set in the order of the file names. When the sort order is shooting date order, the future direction and the past direction are defined along the time axis. Instead, when the sort order is file name order, the rear direction (Z side direction) and the front direction (A side direction) in alphabetical order according to the rules of the dictionary may be defined.

  As described above, the SDRAM 111 has an area for writing up to 200 VGA image data to be pre-read. The VGA image data written in the SDRAM 111 is managed by the RISC 110 using a total counter m and a read counter n. The total counter m indicates the total number of VGA image data written in the SDRAM 111. When the total counter m reaches 200, VGA image data for prefetching cannot be written to the SDRAM 111 any more. Therefore, when the total counter m reaches 200, when new VGA image data is recorded in the RISC 110 by the subsequent prefetching process, the VGA image data having the lowest prefetching order is deleted from the SDRAM 111.

  The read counter n is a numerical value indicating how many VGA image data items in the pre-read order determined in advance are written in the SDRAM 111 in the pre-read process. The read counter n is counted up when VGA image data is recorded in the SDRAM 111. Each time an image is displayed on the viewer 100 by the user's display image selection operation, the RISC 110 discards the prefetching order so far and newly resets the prefetching order. Therefore, for example, even when five prefetch VGA image data are already recorded and the total counter m = 5 and the read counter n = 5, one image is selected from the thumbnail images and displayed. Each time, that is, every time the user gives a display image selection instruction, the RISC 110 sets the reading counter n = 0.

  In the case where thumbnail images are forwarded or reversely displayed as an image by operating the operation button 106 or the like instead of selecting an image from the thumbnail image, the RISC 110 discards the prefetching order so far and newly Reset the prefetch order to.

  If the maximum value of the prefetched VGA image data number is represented by Nmax, the RISC 110 sets Nmax = 200 when there are 200 or more resized image files recorded in the HDD 114. If there are less than 200 resized image files recorded in the HDD 114, the RISC 110 sets Nmax = number of resized image files.

  The prefetching process of the image by the above-described RISC 110 will be described using the flowcharts shown in FIGS. Programs for performing the processes shown in FIGS. 15 to 16 are stored in a memory (not shown) in the RISC 110. This program is activated when an ON signal is input by the battery 105 and executed by the RISC 110. Each step in FIGS. 15 to 16 is a process executed based on a command from RISC 110.

  In step S1, initialization processing of each unit in the viewer 100 is performed, and the process proceeds to step S2. In step S2, the viewer image management table T1 is read from the HDD 114, and the process proceeds to step S3. In step S3, a menu screen is displayed on second LCD 104, and the process proceeds to step S4. In step S4, the read counter is set to n = 0, the grand total counter is set to m = 0, and the direction history is set to k = 0, and the process proceeds to step S5.

  In step S5, the maximum value Nmax of the VGA image file to be pre-read (referred to as pre-read image file) is set, and the process proceeds to step S6. However, Nmax ≦ 200. In step S6, correlation calculation is performed using the metadata (feature data) attached to the resized image file of the HDD 114, the prefetching order and the prefetched image are determined, and the process proceeds to step S8. In this correlation calculation, as described above, the image selection rule is determined from the metadata accumulated value, and the prefetching order is determined in accordance with the image selection rule. That is, as described above, metadata attached to each image file of sequentially displayed images is accumulated to determine an image selection rule. Then, the prefetch order is determined by referring to the metadata attached to the prefetch target image (the resized image file of the HDD 114) according to the determined rule. Then, an image file having a prefetch order of 1 to Nmax is set as a prefetch image file.

Here, the correlation calculation is an operation including the following processing 1 to processing 2.
(1) Process 1: The degree of correlation between feature data of an image to be displayed first and feature data of a plurality of images recorded in the HDD 114 is determined.
(2) Process 2: As described above, the order of images to be prefetched is determined in descending order of correlation.

  In step S8, one resized image file is selected from the prefetched image files set in step S6, and the process proceeds to step S9. In step S9, it is determined whether or not the VGA image data corresponding to the resized image file selected in step S8 has not been written to the SDRAM 111 yet. If the VGA image data corresponding to the selected resized image file has not been written in the SDRAM 111, the process proceeds to step S10. If already written, the process proceeds to step S11. In step S11, 1 is added to the reading counter n to set it to n + 1, and the process returns to step S8.

  In step S10, it is determined whether or not a VGA image file corresponding to the resized image file selected in step S8 is stored in the HDD 114. If the VGA image file is stored in the HDD 114, the process proceeds to step S12. In step S12, the VGA image data of the VGA image file in the HDD 114 is read into the SDRAM 111, and the process proceeds to step S17. If the VGA image file is not stored in the HDD 114, the process proceeds to step S13.

  In step S13, the image data of the resized image file selected in step S8 is developed on the SDRAM 111, and the process proceeds to step S14. In step S14, VGA image data is generated from the image data of the resized image file developed in step S13, written in the SDRAM 111, and the process proceeds to step S15. In step S15, the VGA image data generated in step S14 is stored in the VGA image data folder F2 in the HDD 114 as a luminance color difference format file, and the process proceeds to step S16.

  In step S16, the VGA image file name and VGA image file presence / absence columns in the viewer image management table T1 in the HDD 114 are updated, and the process proceeds to step S17 shown in FIG. In step S17, 1 is added to read counter n to n + 1, 1 is added to total counter m to m + 1, and the process proceeds to step S18. In step S18, it is determined whether the total counter m is less than 200. If the total counter m is less than 200, the process proceeds to step S20. If the total counter m is 200 or more, the process proceeds to step S19. In step S19, the VGA image data having the lowest prefetch order is deleted from the SDRAM 111, and the process proceeds to step S20.

  In step S20, it is determined whether or not there is an image that has not been read out to the SDRAM 111 among the pre-read designated images, that is, whether or not the number of images read into the SDRAM 111 is less than Nmax. When the number of images read to the SDRAM 111 reaches Nmax (n = Nmax), step S20 is denied and the prefetching process is terminated. If the number of images read to the SDRAM 111 is less than Nmax, that is, if n ≠ Nmax, an affirmative determination is made in step S20 and the process proceeds to step S21.

  In step S21, it is determined whether or not the viewer 100 has been operated by the user. That is, when an operation signal is input from any one of the joystick 107, the operation button 106, and the touch panel 122, the process proceeds to step S22. If no operation signal is input, the process returns to step S8 to continue the prefetching process.

  In step S22, it is determined whether or not the operation signal input in step S21 is an image display instruction for displaying a VGA image on the first LCD 103 or the second LCD 104. Alternatively, it is determined whether the operation is an image switching operation by operating the joystick 107 or the touch panel 122. If it is determined that the input operation signal is a signal representing an image display instruction, the process proceeds to step S23. In step S23, the value of the direction history k and the accumulated value of the metadata are updated. If the shooting date and time of the image file corresponding to the image instructed to be displayed in step S22 is past with respect to the shooting date and time of the reference image file, 1 is subtracted from the value of the direction history k. Add 1 to the value. Further, based on the metadata included in the image file of the image instructed to be displayed in step S22, the accumulated value of the metadata is updated, and the process proceeds to step S24.

  If it is determined in step 22 that the operation signal input is not a signal representing an image display instruction, a negative determination is made in step S22 and the process proceeds to step S25. In step S25, processing corresponding to the operation signal input in step S22 is performed, and the process returns to step S8.

  In step S24, it is determined whether or not the value of the direction history k is zero. If k = 0, the process proceeds to step S28, and if k ≠ 0, the process proceeds to step S26. In step S28, the read counter n is set to 0 and the process proceeds to step S29. In step S29, the image file corresponding to the image selected in step S22 is set as a reference image file, the prefetch order is determined based on the first determination rule not considering the image switching direction, and the image file to be prefetched is determined according to the prefetch order. Then, the process returns to step S8.

  In step S26, the read counter n is set to 0, and the process proceeds to step S27. In step S27, prefetching is performed based on the second determination rule considering the image switching direction, an image file to be prefetched is determined, and the process returns to step S8.

According to the embodiment described above, the following operational effects can be obtained.
(1) When displaying an image corresponding to the image data recorded in the HDD 114, the RISC 110 predicts a plurality of images that are likely to be designated to be displayed next or later based on metadata or display priority. . Next, the RISC 110 reads the image data of the predicted image from the HDD 114 and records it in the SDRAM 111. Therefore, even when the image display history is not accumulated, a plurality of images can be selected based on the feature data, so that it is possible to prefetch an image that is likely to be displayed next. Since the SDRAM 111 can read data at a higher speed than the HDD 114, the image instructed to display the image is displayed quickly.

(2) When the RISC 110 performs the prefetching process, image data having a high cumulative value of metadata items, that is, having feature data highly correlated with the feature data of the reference image data is selected. The cumulative value of metadata is added to a higher value by the RISC 110 as the frequency of display designation on the first LCD 103 or the second LCD 104 is higher. Therefore, since the prefetch order is given priority to the image data corresponding to the image whose display is designated more frequently by the user, the accuracy of the prefetch processing by the RISC 110 is improved.

(3) In addition, each metadata item is weighted, and the cumulative value of metadata is increased by the weighting value. Accordingly, since the ratio of image data corresponding to the image that the user regards as important is prefetched by the RISC 110, the RISC 110 can prefetch the image data that the user desires to view.

(4) The RISC 110 reads the shooting mode at the time of image data acquisition from the EXIF data, and adds metadata corresponding to the shooting mode to the image data. Therefore, it is not necessary for the user to perform an operation of designating metadata, and convenience is improved.

(5) The RISC 110 selects the image data to be pre-read based on the display priority assigned to the image data. The display priority is determined by the shooting date / time data from which the image data was acquired and data representing the number of times the user specified display. The RISC 110 assigns a higher display priority as the shooting date / time data is newer and the number of display designations (frequency) is higher. Therefore, the RISC 110 prefetches image data with the latest acquisition date and time or image data with a high frequency of display designation. Therefore, the RISC 110 can prefetch image data that is likely to be displayed and viewed by the user.

(6) When a user selects an image sorted and arranged along a reference axis such as a shooting date and time, a rule for determining a predicted image is determined in consideration of the arrangement direction of the sequentially selected images. . Therefore, when the user has a tendency to select an image in the past direction rather than in the future direction, the predicted image is determined by a selection rule that also considers the tendency. Therefore, an image more suited to the user's preference can be recorded in the SDRAM as a pre-read image. As a result, an image can be displayed in response to a user's display image selection operation quickly.

The embodiment described above can be modified as follows.
(1) As shown in FIG. 17, the viewer 10 may be a monitor coupling type in which no gap is provided between the first LCD 103 and the second LCD 104.

(2) The image switching direction may be weighted according to the value of the direction history k. For example, after the display designation of the image is performed three times, if k = 1, the past image is designated once and the future image is designated twice with respect to the shooting date and time of the reference image. . In this case, the RISC 110 prefetches two pieces of image data from image data existing in the future direction with respect to the reference image data. Thereafter, the RISC 110 prefetches one piece of image data from image data existing in the past direction with respect to the reference image data.

(3) In the above embodiment, the image switching direction is determined according to the value of the direction history k. That is, when k ≠ 0, a pre-read image is selected for all of the plurality of image files arranged in the first direction in the future direction or the past direction, and then the plurality of images arranged in the second direction which is the reverse direction. A prefetched image was selected for all of the files. However, prefetching may be performed in consideration of the image switching direction when the user's display image selection operation is continuously designated a predetermined number of times in the same direction in the future direction or the past direction. In other words, for example, when the direction history k = 5 or more or k = −5 or less, prefetching is performed in consideration of the image switching direction. However, when the direction history k = 4 or less or k = −5 or more, the image switching direction is considered. The prefetching may not be performed.

  As described above, when the user's image selection operation direction has a low relationship with the image arrangement direction, a pre-read rule based on metadata or display priority selected in advance by the user is adopted. Further, when there is a tendency that image selection operations are continuously performed in one direction more than a predetermined number of times, a rule for selecting a prefetch image in consideration of the direction is adopted. As a result, the image intended by the user is easily prefetched.

(4) It is possible to enhance the functions for existing users via the Internet or via a portable recording medium when the program is upgraded. Therefore, the programs of FIGS. 15 to 16 can be applied to such software for upgrading. For example, this program includes a display process for displaying a designated image, a designation process for designating an image to be displayed in the display process, and a feature that characterizes the image for a plurality of images recorded on the first recording medium. Based on the data, a determination process for determining a plurality of predicted images that are likely to be specified next by the specifying process, a predicted image determined from the first recording medium is read, and the read predicted image is An image browsing program for executing, on a computer, a recording process for recording on a second recording medium capable of reading an image at a higher speed than the first recording medium.

  In addition, the present invention is not limited to the above-described embodiment as long as the characteristics of the present invention are not impaired, and other forms conceivable within the scope of the technical idea of the present invention are also within the scope of the present invention. included.

It is a figure explaining the external appearance of the viewer in embodiment of this invention. It is a block diagram explaining the principal part structure of the viewer in embodiment. It is a conceptual diagram explaining the data management in HDD of a viewer. It is a figure explaining an example of the contents of a viewer image management table. It is a figure explaining an example of the content of a display priority table. It is a block diagram explaining the principal part structure of an electronic camera. It is a figure explaining an example of the relationship between the image data produced | generated with an electronic camera, and size. It is a figure explaining an example of the card management table which manages the image in a memory card. It is a figure explaining the mode of the image display in a viewer. It is a figure explaining the mode of the thumbnail image display in a viewer. It is a figure explaining an example of the setting screen of metadata. It is a figure explaining the determination method of a prefetch order. It is a figure explaining the prefetch order in metadata matching priority mode. It is a figure explaining the prefetch order in favorite image priority mode. It is a flowchart explaining the prefetch process in a viewer. It is a flowchart explaining the prefetch process in a viewer. It is a figure explaining the external appearance of the viewer in a modification. It is a figure explaining the structural example of the personal computer which can produce a resized image. It is a figure explaining the menu structure of a viewer.

Explanation of symbols

100 viewer 103 first LCD 104 second LCD
106 Operation buttons 107 Joystick 110 RISC
111 SDRAM 114 HDD 122 Touch panel

Claims (6)

Sorting means for arranging a plurality of images recorded on the first recording medium in order along a predetermined reference axis;
Designation means for designating an image from the plurality of images;
Display means for displaying the designated image;
A selection recording unit that executes a selection process for selecting an image that is highly likely to be designated as the next image by the designation unit, and records the selected image on a second recording medium that is faster in reading speed than the first recording medium;
The designation order designated by the designation means for the plurality of images is a designation order of any of a first direction on the reference axis and a second direction opposite to the first direction. Direction determining means for determining whether there is,
Selection rule determining means for determining a rule of selection processing executed by the selection recording means based on the determination of the direction determining means ,
The direction determining means is unspecified when the designation order designated by the designated image for the plurality of images does not apply to either the first orientation or the second orientation. And
The selection rule determining means is
In accordance with the unspecified determination by the direction determining means, the selection processing rule is a first determination rule that is determined based on feature data that characterizes the image,
In accordance with the determination of the first direction or the determination of the second direction by the direction determination unit, the selection processing rule is determined based on the feature data and the direction determined by the direction determination unit. An image browsing apparatus characterized in that the second determination rule is adopted. The image browsing device according to claim 1,
The second determination rule selects an image based on the feature data with respect to an image existing in a direction determined by the direction determination unit from a position on the reference axis of the image displayed on the display unit. Then, an image is selected based on the feature data for an image that exists in a direction opposite to the direction determined by the direction determination unit from the position on the reference axis of the image displayed on the display unit. An image browsing apparatus characterized in that it is a rule to perform. In the image browsing device according to claim 1 or 2,
The selection rule determining unit includes a correlation determining unit that determines the degree of correlation between the feature data related to a reference image and the feature data of the plurality of images.
The first determination rule is a rule for first selecting an image determined to have high correlation as compared to an image determined to have low correlation by the correlation determination unit. . In the image browsing device according to claim 1 or 2,
The image browsing apparatus, wherein the feature data is priority designation data representing a priority order of displaying the images. Sorting means for arranging a plurality of images recorded on the first recording medium in order along a predetermined reference axis;
Designation means for designating an image from the plurality of images;
Display means for displaying the designated image;
A selection recording unit that executes a selection process for selecting an image that is highly likely to be designated as the next image by the designation unit, and records the selected image on a second recording medium that is faster in reading speed than the first recording medium;
The designation order designated by the designation means for the plurality of images is a designation order of any of a first direction on the reference axis and a second direction opposite to the first direction. Direction determining means for determining whether there is,
Selection rule determining means for determining a rule of selection processing executed by the selection recording means based on the determination of the direction determining means,
The direction determination unit determines the first direction or the second direction based on the designation that the designation unit performs in the same direction with respect to a plurality of images more than a predetermined number of times,
Based on the fact that the designation made in the same direction with respect to the plurality of images was less than a predetermined number of times, it was determined that the direction is unspecified,
The selection rule determining means is
In accordance with the determination of the first direction or the second direction by the direction determination unit, the rule of the selection process is a third determination rule that takes into account the determination result of the direction determination unit,
The image browsing apparatus according to claim 1, wherein the rule for the selection process is a fourth determination rule that does not take into account the determination result of the direction determination unit in response to the unspecified determination by the direction determination unit. Sorting means for arranging a plurality of images recorded on the first recording medium in order along a predetermined reference axis;
Designation means for designating an image from the plurality of images;
Display means for displaying the designated image;
A selection recording unit that executes a selection process for selecting an image that is highly likely to be designated as the next image by the designation unit, and records the selected image on a second recording medium that is faster in reading speed than the first recording medium;
The designation order designated by the designation means for the plurality of images is a designation order of any of a first direction on the reference axis and a second direction opposite to the first direction. Direction determining means for determining whether there is,
Selection rule determining means for determining a rule of selection processing executed by the selection recording means based on the determination of the direction determining means,
The designation unit includes an operation member that switches the image displayed on the display unit to the first direction of the reference axis or the second direction of the reference axis to designate the next image,
The image browsing device according to claim 1, wherein the selection rule determining means determines the rule of the selection process based on an operation direction of the operation member when the operation member is operated.

Images