JP5019577B2 - Information processing apparatus, edit reproduction method, and program - Google Patents

Description

  The present invention relates to an information processing apparatus such as a personal computer, and an editing / playback method and program using the same.

In recent years, image editing software for editing image data (digital images) taken with a digital camera or the like on a personal computer or the like has been used. When editing image data with this editing software, there is an editing function related to captured image data itself such as video correction and a function of adding user data to the image data, such as a photo retouch function. As image data editing software, there is editing software having an Exif (Exchangeable Image File Format) information display and an Exif information editing function. Exif information editing function is mainly used enhancement of search function. Items that allow the user to edit image data captured by a digital camera using editing software are items related to image data printout and information organization such as search. The Exif format used in digital cameras can store data including camera information that was taken, but most of the stored data cannot be used by general users. Is used as information to be left as shooting data. Further, a technique of embedding an executable image viewer program in an area for storing the manufacturer's unique data is disclosed (see Patent Document 1).
JP 2006-107090 A

  However, with the technique of Patent Literature 1, the user cannot freely store and reproduce data prepared by the user himself.

The present invention has been made in view of the above-described circumstances, and an object thereof is to provide an information processing apparatus, an editing / playback method, and a program that allow a user himself / herself to freely add data to be stored and played back. To do.

According to the embodiment, the information processing apparatus secures an area next to the last application marker among the detected marker information and means for detecting the marker information of the image data, and user marker information in this area It means for additionally written, based on the user marker information, and means for writing the user editing information associated with the image data, based on the user marker information, and means for reading the user editing information .

  According to the present invention, the user himself / herself can freely add predetermined data to the image data, store it, and reproduce it.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a perspective view of an information processing apparatus according to an embodiment of the present invention. This information processing apparatus is realized as a battery-driven notebook computer 10. In the present invention, a user directory entry in the Exif format is newly added to image data photographed by a digital camera or the like so that the user can store and reproduce additional data.

  As shown in FIG. 1, the main body side of the computer 10 has a thin box-shaped housing. On the top surface thereof, there is a keyboard (KB) 13, a touch pad 14 on the palm rest, and two buttons on the left and right. A power button 24, a speaker, and the like are arranged. Further, an optical drive or the like is provided on the side surface of the main body.

  FIG. 2 is a block diagram showing the configuration of the computer 10.

  As shown, the personal computer 10 includes a CPU (Central Processing Unit) 11, a north bridge 12, a main memory 13, a graphics controller 17, a display device (LCD) 15, a south bridge 16, a hard disk drive (HDD) 20, a BIOS. A ROM 21, an embedded controller / keyboard controller IC (EC / KBC) 22, a power supply controller (PSC) 23, a keyboard (KB) 13, a touch pad 14 and the like are provided.

  Each of the north bridge 12, the graphics controller 17, and the south bridge 16 is a device (component) compliant with the PCI EXPRESS standard. Communication between the north bridge 12 and the graphics controller 17 is executed via a PCI EXPRESS link 21 disposed between the north bridge 12 and the graphics controller 17. Each PCI EXPRESS link is a communication path composed of a serial interface, and includes an upstream lane and a downstream lane.

  The CPU 11 is a processor that controls the operation of the computer, and executes various programs (operating system, various application programs, image editing software, etc.) loaded from the HDD 20 to the main memory 13. The CPU 11 also executes a basic input / output system (BIOS) stored in the BIOS-ROM 21. The BIOS is a program for controlling hardware. The BIOS also has an SMI (System Management Interrupt) routine for dynamically permitting or prohibiting execution of the Active State Power Management (ASPM) function defined by the PCI Express standard according to the operation mode of the computer. ing.

  The north bridge 12 is a bridge device that connects the local bus of the CPU 11 and the south bridge 16. The north bridge 12 also includes a memory controller that controls access to the main memory 13. The north bridge 12 also has a function of executing communication with the graphics controller 114 via the PCI EXPRESS link 21.

  The graphics controller 17 is a display controller that controls the LCD 15 used as a display monitor of the computer. The south bridge 16 has a function of executing communication with a connected PCI Express device (not shown) via the PCI EXPRESS link 22. The south bridge 16 also controls each device on an LPC (Low Pin Count) bus 30.

  The embedded controller / keyboard controller IC (EC / KBC) 22 is a one-chip microcomputer in which an embedded controller for power management and a keyboard controller for controlling the keyboard (KB) 25 and the touch pad 26 are integrated. . The embedded controller / keyboard controller IC (EC / KBC) 22 has a function of powering on / off the computer 10 in cooperation with the power controller (PSC) 23 in accordance with the operation of the power button 24 by the user. doing. Further, the embedded controller / keyboard controller IC (EC / KBC) 22 also has a function of detecting connection and removal of the AC adapter 28 with respect to the computer. When an event of connection or disconnection of the AC adapter 28 occurs, the embedded controller / keyboard controller IC (EC / KBC) 22 generates an interrupt signal (INTR) to notify the BIOS of the occurrence of a power management event. In response to the generation of the interrupt signal (INTR), the south bridge 16 generates an interrupt signal (SMI) to the CPU 11. In response to the SMI, the CPU 11 executes a BIOS SMI routine. Note that the SMI may be directly supplied from the EC / KBC 22 to the CPU 11.

  FIG. 3 is a schematic diagram showing the configuration of image data stored in the Exif format.

  The image data includes a TIFF header (SOI: Start of Image marker) 100, an application user marker (user marker information) 101, JPEG data 102, user data link information 103, an EOI (End of Image) marker 104, and a user who performs post-operation. It consists of data (see FIG. 4).

The TIFF header 100 is image data definition data stored in the Exif format. The application user marker 101 is newly used and used in the present invention. In the area next to the last application marker of various application markers (APP1 Maker, APP2 Maker, etc.) (not shown) arranged next to the TIFF header 100. User marker information to be set ( described later ). The application user marker 101 is data indicating an area for user data storage editing.

  The JPEG data 102 is main data of image data and is image stream data. The user data link information 103 is newly established and used in the present invention, and is data indicating a link to user data. That is, the user data is managed as a file different from the JPEG data 102 and the like, and can be accessed based on the user data link information 103. The EOI marker 104 is an end marker and is data indicating the end of image data.

  For example, user data is managed in a directory as shown in FIG. In the subdirectory of the parent directory “DCIM”, for example, a directory is created and managed for each type of data. For example, in the case of audio data such as music files and audio files to be added to image data, various music files and audio files are arranged under the directory name “audio”. For example, in the case of comment data to be added to image data, a comment text file or the like is arranged under the directory name “comments”. Further, for example, in the case of URL data to be added to image data, URL link information is arranged under a directory name “URL”.

  As described above, the user data is linked to the storage area arranged as separate data by the user data link information 103, and the user data is accessed by accessing the user data link information 103. Can be done.

  Next, FIG. 5 is a schematic diagram showing the configuration of the application user marker 101.

  The file size, the manufacturer's original editing area ("ABC" is the name of the manufacturer, for example), and "ABC" Maker Note IFD.

  Next, FIG. 6 is a schematic diagram showing the configuration of user data link information (Maker Note directory) 103.

  The structure of IFD (Image file directory) of user data link information is shown. Multiplying the number of bytes per data by the number of data per 12 bytes, the total data length of the directory entry is obtained. If the total data length is 4 bytes or less, the data value itself exceeds 4 bytes, and an offset value to the data is stored. That is, an immediate value is stored for a character string of 4 characters or less, a 2 or less Short Integer, and the like. In the data area as a data array of 12 bytes each of the newly created user edit information IFD, the data value itself exceeds 4 bytes, so the total data length becomes 4 bytes or more, and an offset value to the data is stored.

  Next, FIG. 7 is a schematic diagram showing the configuration of linked user data (“ABC” Maker Note IFD: marker note tag) 103. Hereinafter, various tags will be described.

(1) Tag number: 0001 Software Release Version
The software version of the PC program used for adding user edit information is stored. The storage format is ASCII. The user edit information program installed in the PC determines whether the corresponding image data can be edited by the user based on the version information.

(2) Tag number: 0002 Character code
A character code used by the user is stored so that user comments can be input in Japanese into the corresponding image data by user editing. The character code indicates a character code used by a numerical value such as EUC = 1 with Shift-JIS = 0 as default.

(3) Tag number: 0010 Place Data
The location where the photo was taken is stored in the comment format. Example: Nara Todaiji Five-storied pagoda on the right (4) Tag number: 0011 ~ 0013 Place URL
Stores URL information about the shooting location. The URL to be stored may be the URL of a publicly available website or the unique URL of a server operated by an individual. In particular, URLs do not stipulate public or private websites. The URL is analyzed by the program proposed in this patent, and information is displayed on the URL set by the user operation.

(5) Tag number: 0020 User Comment (1)
Information that a user inputs a comment on the corresponding image data is stored. Japanese input is possible by setting the character code. Example: I traveled in Nara and Kyoto. The weather was very nice on this day. Taro has also grown.

(6) Tag number: 0021 Related Sound file (1)
An audio or audio file associated with the comment. At a later date, the user can operate the user editing information program to store the audio data explaining the scene at the time while viewing the photo as an audio file.

(7) Tag number: 0022/0023 Related URL (1-1) (1-2)
Memorize URLs related to comments. Stores the URI or URL of a music distribution server or a server operated by an individual. When connected to the network, it connects to the server and displays related information and music / related video by user operation.

(8) Tag number: 0024 Related draw data
Information such as retouch newly added by the editor on the corresponding image data is stored. In accordance with the instruction of the user who is viewing, the image data is overlaid such as retouching.

(9) Tag number: 0030 User Comment (2)
Information that a user inputs a comment on the corresponding image data is stored. Japanese input is possible by setting the character code. For example, “Daddy. The garden pine was very well maintained. How about going to see? Please refer to the URL for the inn”.

(10) Tag number: 0031 Related Sound file (2)
An audio or audio file associated with the comment. At a later date, the user can operate the user editing information program to store the audio data explaining the scene at the time while viewing the photo as an audio file.

(11) Tag number: 0032/0033 Related URL (2-1) (2-2)
Memorize URLs related to comments. Stores the URI or URL of a music distribution server or a server operated by an individual. When connected to the network, it connects to the server and displays related information and music / related video by user operation.

(12) Tag number: 0034 Related draw data
Information such as retouch newly added by the editor on the corresponding image data is stored. In accordance with the instruction of the user who is viewing, the image data is overlaid such as retouching.

(13) Tag number: 0040 User Comment (3)
Information that a user inputs a comment on the corresponding image data is stored. Japanese input is possible by setting the character code. For example, “I ’m an uncle. I ’ve put in my impressions of the photos.

(14) Tag number: 0041 Related Sound file (3)
An audio or audio file associated with the comment. At a later date, the user can operate the user editing information program to store the audio data explaining the scene at the time while viewing the photo as an audio file.

(15) Tag number: 0042/0043 Related URL (3-1) (3-2)
Memorize URLs related to comments. Stores the URI or URL of a music distribution server or a server operated by an individual. When connected to the network, it connects to the server and displays related information and music / related video by user operation.

(16) Tag number: 0044 Related draw data
Information such as retouch newly added by the editor on the corresponding image data is stored. In accordance with the instruction of the user who is viewing, the image data is overlaid such as retouching.

(17) Tag number: 0050-0052: Related Phone LINK (1) (2) (3)
Memorize the path to related photos in the same media. When a function is selected by the user, the program follows the stored path, searches for the corresponding image data, and displays it.

  Next, an editing method and program to which the information processing apparatus of the present invention is applied will be described with reference to the flowchart of FIG.

<Create (write) user data>
When the image editing software is loaded from the HDD 20 to the main memory 13, the CPU 11 selects image data (digital photograph) to which user data is added, for example, in accordance with an instruction of GUI (Graphical User Interface) of the software. The image data is assumed to be Exif format image data stored in advance in the HDD 20 of the computer 10.

When the image data is selected (step S101), the CPU 11 reads the Exif data of the selected image data. The image editing software analyzes the read Exif information, searches for the Exif marker from APP1 (step S102), sequentially searches for the next APP, APPx (step S103), Analyze the contents.

  Next, based on the result of analyzing the Exif marker, the CPU 11 performs a write determination process to write the ““ ABC ”User APP” marker, which is an application user marker (step S104). If the CPU 11 determines that the existing Exif data internal information (such as the offset address) does not need to be changed as a result of the determination process, the CPU 11 secures an area of ““ ABC ”User APP” marker information, “User APP” marker information is added and writing is performed (step S106). On the other hand, if it is determined that the existing Exif data internal information (Offset address or the like) needs to be changed as a result of the determination process, the CPU 11 analyzes and changes the internal information of the existing Exif data, and then "" The area of the ABC “User APP” marker information is secured, and the ““ ABC ”User APP” marker information is added and written (step S105).

  The CPU 11 causes the image editing software to wait for the function selected by the user according to the GUI instruction according to the tag classification shown in FIG. 7 (step S107), and then writes the user data (user editing information). (Step S108). When the CPU 11 determines that there is no next digital photograph (image data) (NO in step S109), the process proceeds to step S101.

The user data is, for example, graphic information such as hearts and stars linked with image data, text information such as comments, audio information such as BGM and voice messages, link destination information such as URLs, etc. ( See FIGS. 10 to 13 described later ).

  Next, a playback method and program to which the information processing apparatus of the present invention is applied will be described with reference to the flowchart of FIG.

<Reproduction (reading) of user data>
When the image editing software is loaded from the HDD 20 to the main memory 13, the CPU 11 selects image data (digital photograph) in accordance with, for example, a GUI (Graphical User Interface) instruction of the software. The image data is assumed to be Exif format image data stored in advance in the HDD 20 of the computer 10.

When image data is selected, the image editing software reads the Exif data of the selected digital photograph (step S201). The image editing software analyzes the read Exif information and searches for Exif markers. According to the Exif marker search, the contents in each marker are analyzed (step S202).

The image editing software searches the manufacturer name “ABC” from the Exif header information using ASCII characters (step S203). When the character string ““ ABC ”” is found in the searched Exif header, it indicates that user data (user edit information) is stored added to the image data.

The image editing software determines that user data is stored (step S204). If it is determined that the user data is stored, the user data is read (step S206) and notified, for example, on the image editing software. By operating according to the GUI instruction of the image editing software, it is possible to use the editing information of the user storing the user data. Next, the process waits for a command input by the user (step S207). If the next digital photograph (image data) is selected by the user (step S208), the process proceeds to step S201. When the user has finished the image editing software program (step S209), the process ends. Further, when the tag information processing is selected by the user (step S210), for example, when the tag information is as shown in FIG. 10, the comment written by the grandchild is shown in FIG. When viewing it, select “Comment” with a mouse or the like and select “Grandchild 1”, and the comment “How are you?” Is displayed. Further, as shown in FIG. 12, when “comment” is selected with a mouse or the like and “grandchild 2” is selected, “stars and heart marks” as written graphic information are displayed. As shown in FIG. 13, when “URL” is selected with a mouse or the like, the URL “http://www.ABC.co.jp”, which is the written link information, is displayed. In addition, when BGM is selected, the written BGM can be played back.

  On the other hand, if it is determined that the user data is not stored, the user data is not stored (step S205).

  Thus, for example, the present embodiment can be used in the following usage scenes.

  For example, when a user has an event such as a trip or a children's athletic meet, the user takes a picture with a digital camera, and the taken digital photograph is stored and stored in a medium such as an HDD or a CD-ROM of a PC. The stored digital photograph (image data) is edited by starting image editing software. For each digital photo, the editing user adds items related to the photo, comments, audio data, audio data, and the like. The added user data is stored and saved as additional information of the digital photograph by the image editing software. A digital photograph containing user data is copied to a medium such as a CD-ROM and sent to a grandparent who is far away. A user who has received a digital photograph containing user data can read and reproduce information stored as user data by using image editing software. A user who uses the image editing software can hear a commentary on a photograph by voice, and can share a sense of reality with an associated BGM. If it is a PC connected to the network, it is possible to obtain information on the location and surroundings taken by the related URL information.

  As described above, by using this embodiment, user-specific information can be attached to a digital photograph. This makes it possible to attach user-specific information that is not present in digital photographs. With this information, the user can add information other than video to the captured digital photograph. In addition, the conventional digital photo browsing program can also browse digital photos as usual, and the user can record more user-specific information in the digital photos. In addition to the pleasure of watching digital pictures, you can use new functions such as listening, telling messages, and adding explanations. Furthermore, since image data such as JPEG and user data are managed separately, the user data and the image data can be displayed in a superimposed manner without changing the original image data.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

The perspective view showing the information processor concerning one embodiment of the present invention. 1 is a block diagram showing a system configuration of an information processing apparatus according to an embodiment of the present invention. FIG. 3 is a schematic diagram showing a configuration of image data handled by image editing software of the information processing apparatus of the embodiment. The schematic diagram which showed the structure of user data. The schematic diagram which showed the structure of the application user marker. The schematic diagram which showed the structure of user data link information. The schematic diagram which showed the structure of the user data of a link destination. The flowchart explaining the edit method and program which applied the information processing apparatus of this invention. The flowchart explaining the reproduction | regeneration method and program which applied the information processing apparatus of this invention. The schematic diagram which showed the case where predetermined tag information was displayed. The schematic diagram which showed the case where predetermined tag information was displayed. The schematic diagram which showed the case where predetermined tag information was displayed. The schematic diagram which showed the case where predetermined tag information was displayed.

Explanation of symbols

  11 ... CPU, 17 ... graphics controller, 16 ... south bridge, 20 ... hard disk, 22 ... EC / KBC

Claims (10)

Means for detecting marker information of image data;
Of the detected marker information, means for securing an area next to the last application marker, and adding and writing user marker information in this area ;
Based on the user marker information, and means for writing the user editing information associated with the image data,
Based on the user marker information, and means for reading the user editing information,
An information processing apparatus comprising: The information processing apparatus according to claim 1,
Wherein the user editing information, graphic information, text information, audio information, among the link information, the information processing apparatus including at least one. The information processing apparatus according to claim 1,
An information processing apparatus that allows the user edit information to be displayed superimposed on the image data. The information processing apparatus according to claim 1,
An information processing apparatus capable of selecting the user editing information to be displayed in a superimposed manner with the image data when there are a plurality of the user editing information. An edit reproduction method executed by an information processing apparatus,
Detecting marker information of image data;
Of the detected marker information, a step of securing an area next to the last application marker and adding and writing user marker information in this area ;
Based on the user marker information, a step of writing the user editing information associated with the image data,
A step of based on said user marker information, read the user editing information,
An editing / playback method comprising: In the edit reproduction method of Claim 5,
The editing / playback method , wherein the user edit information includes at least one of graphic information , text information, audio information, and link destination information. In the edit reproduction method of Claim 5,
An editing / playback method in which the user editing information can be displayed superimposed on the image data. In the edit reproduction method of Claim 5,
An editing / playback method in which, when there are a plurality of pieces of user editing information, the user editing information to be displayed superimposed on the image data can be selected. A program for causing a computer to execute data processing,
A procedure for detecting marker information in image data;
Of the detected marker information, secure an area next to the last application marker, add user marker information to this area and write it,
A procedure based on said user marker information, writes the user editing information associated with the image data,
And procedures based on the user marker information, read the user editing information,
A program that causes a computer to execute. The program according to claim 9 ,
The user edit information is a program including at least one of graphic information , text information, audio information, and link destination information.

Images