JP6424945B2 - Imaging device, imaging method, and imaging program - Google Patents

Description

  The present invention relates to an imaging device, an imaging method, and an imaging program.

  When imaging a moving image or a still image using an imaging device such as a video camera, a technique for allowing a user to automatically or manually add a tag for identifying or searching the captured image data to the captured image data It has been known. By using these tags, the user can easily organize and search captured image data.

  For example, Patent Document 1 discloses a digital image management search system capable of adding and displaying a moving image index corresponding to time axis data indicating the start position of the top image of each scene in a moving image file. ing.

Unexamined-Japanese-Patent No. 10-13773

  However, when one event (game, game, etc.) is recorded over a plurality of moving image files, when managing the moving image of the event, the user starts the event time zone (for example, start of the event) from the plurality of moving image files. It is necessary to find out and understand the position and end position). Therefore, there is a problem that it takes time to manage moving picture files.

  The technique described in Patent Document 1 adds an index to the leading image of each scene in one moving image file. Therefore, there is no disclosure of index management in the case where one event spans a plurality of moving image files.

  The present invention has been made in view of the above problems, and an imaging apparatus, an imaging method, and an imaging method capable of easily managing a moving image file even when one event is recorded over a plurality of moving image files. An object of the present invention is to provide an imaging program.

An imaging apparatus according to an aspect of the present invention includes an imaging unit (100) that generates imaging data of a moving image by imaging an event, and a marker input unit that inputs a marker indicating the status of the event to the moving image. A first codec (2011) for generating a first moving image file by superimposing image data corresponding to the marker input by the (operation unit 306) and the marker input unit on the imaging data and encoding the image data. And a second codec (2012) that generates a second moving image file by encoding the imaging data, a storage unit (card type recording medium 302) that stores the second moving image file, and Marker data is generated by correlating the marker input by the marker input unit with the time when the marker is input; Control unit to be stored in the storage unit in association with data in the second moving image file (the marker data management unit 402), but with a.
  An imaging method according to an aspect of the present invention includes the steps of: generating imaging data of a moving image by imaging an event; inputting a marker indicating the status of the event with respect to the moving image; Generating a first moving image file by superimposing and encoding image data corresponding to a marker on the imaging data; and generating a second moving image file by encoding the imaging data And storing the second moving image file in the storage unit (card type recording medium 302), generating the marker data in association with the input marker and the time when the marker is input. And storing marker data in the storage unit in association with the second moving image file.

  According to the present invention, it is possible to provide an imaging device, an imaging method, and an imaging program capable of easily managing a moving image file even when one event is recorded across a plurality of moving image files.

FIG. 1 is an external perspective view of an imaging device according to a first embodiment. FIG. 1 is a block diagram showing a configuration of an imaging device according to a first embodiment. FIG. 1 is a block diagram showing a configuration of a card-type recording medium according to a first embodiment. 7 is a marker type table according to the first embodiment. 7 is a team table according to the first embodiment. It is a marker data file concerning Embodiment 1. FIG. It is a game data file concerning Embodiment 1. FIG. FIG. 2 is a block diagram showing the configuration of a central control unit according to the first embodiment. FIG. 6 is a diagram for explaining an interface image according to the first embodiment. FIG. 6 is a diagram for explaining an interface image according to the first embodiment. FIG. 6 is a diagram for explaining an interface image according to the first embodiment. FIG. 6 is a diagram for explaining an interface image according to the first embodiment. 7 is a flowchart showing a media mounting operation according to the first embodiment. 5 is a flowchart showing a recording operation according to the first embodiment. 5 is a flowchart showing a reproduction operation according to the first embodiment. 5 is a flowchart showing a copy operation according to the first embodiment. 7 is a flowchart showing a deletion operation according to the first embodiment. 5 is a flowchart showing a trimming operation according to the first embodiment. FIG. 7 is a block diagram showing a configuration of a mobile terminal device according to a second embodiment. FIG. 7 is a diagram for explaining an interface image according to a second embodiment. 7 is a flowchart showing the operation of the mobile terminal device according to the second embodiment. FIG. 14 is a diagram for explaining an interface image according to a third embodiment. FIG. 14 is a diagram for explaining a marker input operation according to a third embodiment. It is a marker data file concerning Embodiment 3. FIG. FIG. 14 is a diagram for explaining the reproduction operation according to the third embodiment. FIG. 14 is a diagram for explaining the reproduction operation according to the third embodiment. FIG. 16 is a block diagram showing the configuration of an imaging device according to a fourth embodiment. FIG. 16 is a flowchart showing an operation of the first codec according to the fourth embodiment. FIG. 16 is a flowchart showing an operation of a second codec according to a fourth embodiment.

Embodiment 1
Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is an external view of an imaging device 1 according to the present embodiment. As shown in FIG. 1, the imaging device 1 includes a main body 11, a monitor 12, a hinge 13, and a lens 14. A lens 14 is provided at the front end of the main body 11. FIG. 1 is a perspective view showing a state in which the monitor unit 12 is opened.

<Appearance Configuration of Imaging Device 1>
The main body 11 is a housing that stores a lens unit having a plurality of lenses, an imaging device, a battery, a Wi-Fi module, and the like (not shown). The imaging device 1 can capture a still image and a moving image using a lens unit and an imaging element for capturing an image.

Further, a monitor unit 12 is provided on the left side surface of the main body unit 11. The monitor unit 12 is connected to the main body unit 11 via a hinge 13. The monitor unit 12 has a liquid crystal monitor or the like that displays an object, stored image data, setting information, and other information. For example, when the user opens the monitor unit 12 to perform imaging, the power is turned on. When the monitor unit 12 has a touch panel function, the liquid crystal monitor of the monitor unit 12 becomes a part of the operation unit.

  When the monitor unit 12 is open, the liquid crystal monitor of the monitor unit 12 is disposed on the rear side, that is, in the direction opposite to the opening direction of the lens barrel. The monitor unit 12 is rotatably connected to the main body unit 11 in a state where the monitor unit 12 is opened. By rotating the monitor unit 12, the direction of the liquid crystal monitor is changed from the rear side to the front side (the opening direction of the lens barrel).

  In addition, if the imaging device 1 which concerns on this invention can image a still image or a moving image and has display parts, such as a liquid crystal monitor, the shape and structure will not be specifically limited. That is, the imaging device 1 is not limited to a video camera, and may be an electronic device (for example, a mobile terminal device such as a smartphone) having an imaging unit and a display unit.

<Internal Configuration of Imaging Device 1>
Next, the configuration of the imaging device 1 will be described with reference to FIG. FIG. 2 is a block diagram showing an internal configuration of the imaging device 1 according to the present embodiment.

  The central control unit 400 is constituted by a semiconductor integrated circuit including a central processing unit (CPU), a read only memory (ROM) storing various programs, and a random access memory (RAM) as a work area. Images related to a graphic user interface (GUI) in which icon images corresponding to types of markers used according to imaging conditions are appropriately arranged in order to display markers and to input markers to captured image data by the user , And “interface image”. The internal configuration of the central control unit 400 will be described later with reference to FIG.

  The imaging device 1 includes an imaging unit 100 configured of a zoom lens 101, a focus lens 102, an aperture 103, and an imaging element 104. The zoom lens 101 is moved along the optical axis LA by a zoom actuator (not shown). Similarly, the focus lens 102 is moved along the optical axis LA by a focus actuator (not shown). The diaphragm 103 is driven by a diaphragm actuator (not shown) to operate. The imaging device 104 is configured of a charge coupled device (CCD), a complementary metal oxide semiconductor (CMOS), or the like.

  Imaging using the imaging unit 100 is performed in the following procedure. An image sensor 104 photoelectrically converts light passing through the zoom lens 101, the focus lens 102, and the diaphragm 103 to generate an analog image signal of an object. After the analog image signal processing unit 105 amplifies this analog image signal, the image A / D conversion unit 106 converts the amplified signal into digital image data. The image input controller 107 captures digital image data output from the image A / D converter 106 as imaging data, and stores the digital image data in the main memory 205 via the bus 200.

  The digital signal processing unit 108 takes in the imaging data stored in the main memory 205 based on an instruction from the central control unit 400 via the bus 200, performs predetermined signal processing, and is data comprising a luminance signal and a color difference signal. Generate The digital signal processing unit 108 also performs various digital corrections such as offset processing, white balance adjustment processing, gamma correction processing, RGB complement processing, noise reduction processing, contour correction processing, color tone correction processing, and light source type determination processing.

  The microphone 109 circulates the surrounding sound at the time of imaging to generate an analog sound signal. After the analog audio signal processor 110 amplifies the analog audio signal, the audio A / D converter 111 converts the amplified signal into digital audio data. The voice input controller 112 stores the digital voice data output from the voice A / D converter 111 in the main memory 205 together with the imaging data.

  The multiplexing unit 113 multiplexes the compressed data of the imaging data and the digital audio data stored in the main memory 205 to generate stream data. Further, the multiplexing unit 113 performs demultiplexing processing on the stream data stored in the card type recording medium 302, and separates and generates compressed video data and compressed audio data.

  The compression / decompression processing unit 201 performs predetermined compression processing on the imaging data and digital audio data stored in the main memory 205 in accordance with an instruction from the central control unit 400 via the bus 200, and generates compressed data. In addition, the compression / decompression processing unit 201 performs decompression processing of the compressed data of the video and the compressed data of the audio stored in the card type recording medium 302 or the like according to a command from the central control unit 400, and decompresses the compressed data. Generate In the image pickup apparatus 1 of the present embodiment, a compression method conforming to the JPEG standard is applied to still images, and an MPEG2 standard or AVC / H. A compression method conforming to the H.264 standard is adopted.

  The audio / image processing unit 202 performs predetermined image processing on digital data read from the main memory 205 in accordance with an instruction from the central control unit 400 via the bus 200. For example, image data for various processes such as a menu image and an OSD image are generated, and the image data is superimposed on original imaging data read from the main memory 205 and output to the liquid crystal monitor 304. As a result of this output, the image displayed on the liquid crystal monitor 304 is a combination or superposition of various image data. Note that, instead of the liquid crystal monitor 304, another monitor such as an organic EL (Electro-Luminescence) monitor can be used.

  The ROM 203 is connected to the central control unit 400 via the bus 200, and stores control programs executed by the central control unit 400 and various data required for control. The flash ROM 204 stores various setting information related to the operation of the imaging device 1 such as user setting information.

  The main memory 205 is used as a temporary storage area for imaging data (moving images and still images). The main memory 205 stores the held multiplexed stream data (moving image file) in the card type recording medium 302 or the built-in type recording medium 209 in accordance with an instruction from the central control unit 400. At this time, the user may select whether to store the stream data in the card type recording medium 302 or in the built-in type recording medium 209. The main memory 205 is also used as an operation work area of the central control unit 400.

  The media control unit 206 controls writing and reading of data to the card type recording medium 302 or the built-in type recording medium 209 through the card I / F 301 in accordance with an instruction from the central control unit 400. The card type recording medium 302 is an external memory such as a (storage unit) SD card or Compact Flash (registered trademark), and is provided detachably to the imaging apparatus 1. The card-type recording medium 302 also stores a marker data file, a game data file, a marker type table, and a team table, which will be described later.

  The gyro sensor 207 detects changes in acceleration and angular velocity of the three axes. Then, in accordance with the detection result of the gyro sensor 207, the display orientation of the liquid crystal monitor 304 is changed. The clock 208 generates information of acquisition date and time of captured image data, and input time information indicating date and time when the marker is input and the like. The built-in recording medium 209 is a memory such as a RAM built in the imaging device 1 in advance.

  The liquid crystal monitor 304, the speaker 305, the operation unit 306, and the input / output terminal 307 are connected to the input / output I / F 303. The liquid crystal monitor 304 displays, for example, images generated from various image data such as imaging data temporarily recorded in the VRAM 205 or the main memory 205, interface image data, various menu image data, and the like. Here, the imaging data output to the liquid crystal monitor 304 is not limited to one in which the user turns on a recording button (not shown) of the operation unit 306 and records it on a recording medium (not shown) such as a card type recording medium. Of course, data related to a so-called through image displayed on the liquid crystal monitor 304 in order to confirm the content is also included. The speaker 305 outputs, for example, audio temporarily recorded in the main memory 205.

  The operation unit 306 (marker input unit) includes an operation button or a touch panel provided on the liquid crystal monitor 304, and receives an operation input to the imaging device 1 by the user. For example, the user operates the operation unit 306 at a timing at which the user wishes to add a marker, and inputs the marker for the moving image. The input / output terminal 307 is connected to a television monitor (not shown), a PC (Personal Computer) or the like.

  The wireless module 309 transmits / receives each data to / from other devices via the bus 200 and the wireless I / F 308. Wireless communication such as various information and captured image data is performed by a method based on the IEEE 802.11 standard. More specifically, the wireless module 309 performs communication processing conforming to a wireless LAN standard such as Wi-Fi.

<Details of Card Type Recording Medium 302>
Here, various data stored in the card-type recording medium 302 will be described in detail with reference to FIG. As shown in FIG. 3, the card type recording medium 302 stores a moving image file 51, a marker type table 52, a marker data file 54, a game data file 55, and a team table 53. The card-type recording medium 302 can store data other than the data shown in FIG. 3, but the description of data not directly related to the present invention will be omitted.

  The moving image file 51 is the above-described stream data, and is data of a moving image in which imaging data and audio data are multiplexed. The card type recording medium 302 stores a plurality of moving image files 51. The moving image file 51 contains a moving image including an event. One event may be recorded across a plurality of moving image files 51, or a plurality of events may be recorded in one moving image file 51.

  Here, the event is defined as the start and the end, and means that the participant exists. The participants of the event may be individuals (persons) or may be teams, groups or pairs of people. The event is, for example, a sport game, live music, theater, etc. In live music and theater, the participants are singers and performers. In the present embodiment, a basketball game is described as an event.

  The marker type table 52 is a table in which a marker ID (identification information) and a marker corresponding to the marker ID are stored in association with each other. In addition, a marker means the label | marker which shows arbitrary time of a moving image. For example, the marker is a text or an image different from the moving image being played back and displayed on the moving image. The marker is input according to the operation of the operation unit 306 of the user, or is automatically input by the imaging device 1 according to a predetermined condition.

An example of the marker type table 52 is shown in FIG. Six types of marker IDs and markers are stored in the marker type table 52 shown in FIG. The marker corresponding to the marker ID 10 is a game start marker (start marker) for specifying the start of the game. The marker corresponding to the marker ID 20 is a game end marker (end marker) for specifying the end of the game. The marker corresponding to the marker ID 30 is a score marker (score marker) indicating that a score has been entered. The marker corresponding to the marker ID 40 is a check marker indicating the time to be confirmed. A marker corresponding to the marker ID 50 is a smile marker indicating that a smile is captured, and a marker corresponding to the marker ID 60 is a good marker indicating good play.
The type of marker is not limited to that shown in FIG. Also, the marker may be an image instead of text.

  The team table 53 (participant table) is a table in which a team ID and a team name or the like of a team corresponding to the team ID are stored in association with each other. That is, the data stored in the team table 53 may be input in advance by the user, or the imaging device 1 may read the data from another memory or a server.

  An example of the team table 53 is shown in FIG. The team table 53 shown in FIG. 5 stores three team data. Team data is associated with a team name and a team ID. In addition, team colors and team player names are also associated with team IDs. For example, a team name “○○ Stars”, a team color “blue”, and player names “Suzuki, Tanaka, etc.” are associated with team ID 1. In addition, the information contained in team data is not restricted to what was shown in FIG.

  The marker data file 54 is a file including one or more marker data. Here, the marker data includes at least a marker ID for specifying the input marker and an input time indicating a time when the marker is input. The marker data file 54 is stored in the card type recording medium 302 in association with the moving image file 51. For example, the plurality of marker data files 54 are associated one-to-one with the plurality of moving image files 51.

  An example of the marker data file 54 is shown in FIG. The marker data file 54 shown in FIG. 6 stores six marker data. In the marker data file 54 shown in FIG. 6, the input time is displayed in milliseconds (ms). For example, the topmost marker data has a marker ID of “10” and an input time of “8521 ms”. As shown in FIG. 4, the marker of the marker ID 10 is a match start marker. That is, the marker data at the top of the marker data file 54 means that the game start marker is input at time 8521 ms. The time at this time means an elapsed time (hereinafter referred to as a time in the medium) when the time at the beginning of the moving image file is 0.

  In addition, when the game start marker data of marker ID10 is input by the user, team ID of the team which plays a game is also input. The topmost marker data of the marker data file shown in FIG. 6 is match start marker data of a match where the team with team ID 1 and the team with team ID 2 play a match.

  When the user inputs a score marker of marker ID 30, the team ID and the score of the team that scored are also input. The second marker data of the marker data file shown in FIG. 6 is marker data of a score marker indicating that the team with team ID 1 has taken two points. Similarly, the third marker data of the marker data file shown in FIG. 6 is score marker data indicating that the team with team ID 1 has taken three points.

  At this time, the score stored in the marker data file is not a total score but a score to be added as a result of scoring. In the above example, in the third marker data, the item of the score is not 2 + 3 = “5” but “3” to be added at that time is stored.

  As described above, when it is desired to correct the score of the marker data input before by storing the score for the addition in the marker data, it is sufficient to correct only the score that is desired to be corrected. Then, the total points after the correction can be easily calculated by resuming the points stored in the respective point marker data.

  On the other hand, when the total points at that time are stored in the item of the points of marker data, even if the points of the marker data to be corrected are corrected, they are then stored in each score marker data to calculate the corrected total points. It is not possible to use the sum of scores. Therefore, it is necessary to correct all the score marker data input after the corrected marker data. That is, storing the total score in the item of the score of the marker data requires much time and effort to correct the score.

  The game data file (event data file) 55 is a file including one or more game data. The game data is associated with the moving image file in which the game is recorded.

  An example of the game data file 55 is shown in FIG. The game data file 55 shown in FIG. 7 includes three game data. In the example shown in FIG. 7, the game data includes the game name, the game date and time, the team ID indicating the team participating in the game, and the file name of the moving image file. The file name of the moving image file is information for identifying the moving image file, and includes, for example, a 5-digit ID and an extension. By storing the file name of the moving image file, the imaging device 1 can easily access the moving image file.

  For example, the game data at the top of the game data file shown in FIG. 7 is the game name "new face game", the game date and time "April 15, 2012 10:00-13:30", the team of the game team It is game data which shows ID "1, 2" and file name "00000. MTS".

At this time, information on the game such as the team name, the game date and time, and the score can be obtained by referring to the team table and the marker data file. However, the marker data file is stored for each moving image file. In addition, one marker data file may include information on a plurality of games, or a plurality of marker data files may include information on a single game. Therefore, it takes time and effort for the user to manually search for information on the game.

  On the other hand, the imaging device 1 of the present embodiment can create a table (a game data file 55) in which information on the game is stored for each game by creating the game data. That is, the index of the game stored in the card type recording medium 302 can be created. For example, the imaging device 1 displays on the liquid crystal monitor 304 an index in which a match name and match date and time are listed (the table shown in FIG. 7 may be displayed as it is). This allows the user to easily select the game he wants to watch. The data included in the match data is not limited to that shown in FIG. For example, if a part of the video file includes a game scene, that is, if the game is started or ended in the middle of the video file, then the time from the beginning of the video file to the game start or end is used as the game data May be included. Thereby, when a game to be watched is selected from the game index, the imaging device 1 can easily recognize the start position and the end position of the game included in the moving image file.

<Details of Central Control Unit 400>
Subsequently, an internal configuration of the central control unit 400 will be described with reference to FIG. The central control unit 400 has a moving image file management unit 401, a marker data management unit 402, a team table management unit 403, a game data management unit 404, and a display image data generation unit 405.

  The moving image file management unit 401 executes processing such as recording, reproduction, copying, and deletion of the moving image file based on the user's operation.

  The marker data management unit 402 executes copying, deletion, and the like of the marker data file associated with the moving image file in accordance with the copying, deletion, and the like of the moving image file.

  The team table management unit 403 executes generation, editing, copying, and deletion of a team table. Specifically, the team table management unit 403 generates or edits team data based on the user's input. In addition, the team table management unit 403 updates the team table based on team data transmitted from another device.

  The game data management unit 404 executes generation, editing, copying, deletion and the like of the game data file. The game data management unit 404 generates game data based on the contents such as game start marker data and score marker data.

  The display image data generation unit 405 generates display image data for displaying a moving image together with the interface image and the marker. That is, the display image data generation unit 405 superimposes interface image data and marker image data on a moving image file. The display image data generation unit 405 outputs the generated display image data to the liquid crystal monitor 304.

  The interface image data for displaying the interface image may be stored in advance in, for example, the card-type recording medium 302, and may be from an arbitrary storage device (so-called USB memory or the like) detachable from the server or the imaging device 1 not shown. You may get it.

  The display image data generated by the display image data generation unit 405 is output from the input / output I / F 303 to the liquid crystal monitor 304. The liquid crystal monitor 304 displays a display image related to the supplied display image data. FIG. 9 is a view showing an example of a display image displayed on the liquid crystal monitor 304. As shown in FIG. 9, on the liquid crystal monitor 304, a display image obtained by combining the interface image associated with the moving image currently being captured is displayed. The user uses the interface image (marker icon) for marker input while checking the moving image, and inputs the marker appropriately while viewing the moving image or the actual game.

  In the display image shown in FIG. 9, an interface image for inputting a marker is superimposed and displayed on a captured image of a basketball game. As illustrated, the interface image is a marker icon, and is a game start marker icon 901 (GAME START), a good marker icon 902 (GOOD), a check marker icon 903 (CHECK), a free marker icon 904 (FREE), and a score marker An icon 905 (GOAL) and a player change marker icon 906 (SUBST) are provided, and each marker can be input. The free marker means a marker that can be freely set by the user. Also, the interface image has a marker cancel icon 907 (UNDO), and can cancel the last input marker. In the upper part of the display screen, a score window 908 indicating a score updated according to the operation of the score marker icon 905 is displayed on the moving image as one of the interface images.

  For example, when the user touches the game start marker icon 901, the time information (input time information) is associated with the marker ID of the game start marker, and is stored in the card type recording medium 302 as marker data. At this time, the user also selects a team performing a game from a team selection screen (not shown). The team data stored in the team table is previously input by the user. Thereby, the marker ID, the time information, and the match team (team ID) are associated with the match start marker data (see FIG. 6). The same applies to the good marker icon 902, the check marker icon 903, the free marker icon 904, and the player change marker icon 906.

  When the match start marker icon 901 is touched, the match start marker icon 901 changes to the match end marker icon 909 (GAME FINAL) (see FIG. 10). When the game is over, the user touches the match end marker icon and inputs the match end marker to the video. Thereby, the game end marker data in which the game end marker and the input time are associated with each other is stored in the marker data file.

  Similarly, when a score is entered, the user touches the score marker icon 905. Then, the input time and the score marker are associated and stored in the marker data file as score marker data. Then, as shown in FIG. 11, a score marker 910 is displayed on the moving image displayed on the liquid crystal monitor 304.

  Thereafter, as shown in FIG. 12, an interface image is displayed on which the team that has scored and the obtained score can be selected. The interface image shown in FIG. 12 includes a one-point marker icon 91 1 to 5 point marker icon 915, team icons 916 and 917, a cancel icon 918 for canceling the operation, and a return icon 919 for returning one screen forward. And. The user touches one of the one-point marker icons 911 to 5 point marker icons 915 displayed on the left half of the screen when “Team A” displayed on the team icon 916 scored. . On the other hand, when “Team B” displayed on the team icon 917 takes a point, one of the one-point marker icons 911 to 5 point marker icons 915 displayed on the right half of the screen is touched. As a result, the score marker ID is associated with the team ID of the team that took the score and the obtained score, and is stored as marker data in the marker data file. The arrangement and size of the interface image (marker icon) are not limited to those shown in FIGS. Also, the number and type of marker icons may be customized by the user as appropriate.

A plurality of interface images may be prepared to input markers of different types and contents for the same sport. For example, the interface image for the game and the interface image for practice may have different configurations. Furthermore, it is a matter of course that interface images for capturing not only sports but also theaters and music concerts may be present.

<Operation of Imaging Device 1>
Subsequently, various operations of the imaging device 1 according to the present embodiment will be described with reference to flowcharts shown in FIGS. 13 to 18.

<Mounting of media>
First, the media mounting process will be described. FIG. 13 is a flowchart showing the media mounting process. First, the marker data management unit 402 determines whether a default marker type table is stored in the card type recording medium 302 (step S101).

  When the marker type table is not stored in the card type recording medium 302 (step S101: No), the marker data management unit 402 creates a default marker type table (step S102). Specifically, information on a default marker type table is written in advance in a program to be referred to when the marker data management unit 402 performs processing. Then, when creating the default marker type table, the marker data management unit 402 reads the above program and creates the default marker type table in the card type recording medium 302. On the other hand, when the marker type table is stored in the card type recording medium 302 (step S101: Yes), the marker type table is not created, and the process proceeds to the next process.

  Next, the game data management unit 404 determines whether a game data file is stored in the card type recording medium 302 (step S103). When the game data file is not stored in the card type recording medium 302 (step S103: No), the game data management unit 404 analyzes all marker data of the marker data file stored in the card type recording medium 302. Then, the game data management unit 404 creates a game data file based on the marker data (step S104).

  Specifically, the game data management unit 404 refers to the creation date of the moving image file, and creates the match date in the match data. Further, the game data management unit 404 refers to the game start marker data in the marker data file, and specifies the game team (team ID). Then, the game data management unit 404 creates a team ID in the game data. On the other hand, when the game data file is stored in the card type recording medium 302 (step S103: Yes), the game data file is not created, and the process proceeds to the next process.

  Next, the marker data management unit 402 analyzes the marker data file and determines whether or not it is necessary to input a match end marker (step S105). Specifically, the marker data management unit 402 (a) does not input the game end marker after the game start marker is input last, (b) the clock of the imaging device 1 is not set, and finally Among the conditions that the creation date of the moving image file where the game start marker was input is unknown or the elapsed time from the time when the last game start marker was input exceeds 12 hours (a), (b) If both conditions are met, it is determined that the match end marker is required.

  When it is necessary to input a match end marker (step BR> r105: Yes), the marker data management unit 402 determines the end position of the moving image file recorded last, that is, the end position of the moving image file with the latest creation date (marker data file The game end marker is input at the end) (step S106). When it is not necessary to input the game end marker (step S105: No), the media mounting process is ended.

<Video recording>
Subsequently, the processing operation of moving image recording will be described. FIG. 13 is a flowchart showing a moving image recording process. First, when the user performs a recording operation using the operation unit 306, the imaging device 1 starts a recording operation (step S201). The marker data management unit 402 analyzes the marker data file and determines whether it is necessary to input a match end marker (step S202).

  At this time, if all the conditions of the conditions (a) and (b) described in step S105 of FIG. 13 are satisfied, the marker data management unit 402 determines that it is necessary to input the game end marker. Then, when it is necessary to input the game end marker (step S202: Yes), the marker data management unit 402 inputs the game end marker at the end position of the moving image file before the recording start (step S203). That is, the marker data management unit 402 inputs (adds) the game end marker at the end of the marker data file corresponding to the moving image file. When it is not necessary to input the game end marker (step S202: No), the game end marker is not input, and the process proceeds to the next process.

  Next, the imaging device 1 stores a clock at the start of recording (step S204). For example, the moving image file management unit 401 stores the clock at the start of recording in the memory of the card type recording medium 302 or the like. The clock is an operation clock of the CPU of the central control unit 400. Then, the moving image file management unit 401 stores the imaging data in the card type recording medium 302. That is, the moving image file management unit 401 starts recording (step S205).

  Then, the marker data management unit 402 determines whether the user has input a marker (step S206). When a marker is input, the marker data management unit 402 creates marker data according to the input marker (step S207). Specifically, the marker data management unit 402 calculates the time in the medium (the time from the start of moving image recording) from the difference between the clock at which the marker is input and the clock at the start of recording stored in step S204. . Then, the marker data management unit 402 creates marker data by associating the in-media time with the marker ID of the input marker (step S207).

  Next, the moving image file management unit 401 determines whether the user has performed an operation to end recording using the operation unit 306 (step S208). When the recording end operation is performed (step S208: Yes), the moving image file management unit 401 stops the process of storing the imaging data in the card type recording medium 302, and ends the recording. Also, the moving image file management unit 401 stores the time in the medium at the end of the recording in the card type recording medium 302 or the like. Furthermore, the marker data management unit 402 stores the created marker data in the marker data file (step S209).

  Next, the moving picture file management unit 401 determines whether or not moving picture recording is newly started (step S210). Specifically, the moving image file management unit 401 determines whether or not new moving image recording has been started by dividing the moving image file with a 4 GB restriction. When new moving image recording is not started (step S210: No), the moving image recording operation is ended. Note that the division of a moving image file by 4 GB means that imaging data is divided into a plurality of moving image files because the upper limit of the capacity that can be stored as one moving image file is 4 GB.

  On the other hand, when new moving image recording is started (step S210: Yes), the moving image file management unit 401 converts the time in the medium at the end of recording into a clock (operating clock of CPU). Then, the moving image file management unit 401 adds the converted clock to the clock at the start of recording stored in the card type recording medium 302 in step S204 (step S211). As a result, even when recording of a new moving image file is started by division of the moving image file due to the 4 GB limitation, it is possible to accurately grasp the clock at the start of recording of the moving image file. The subsequent processing (steps S <b> 204 to S <b> 210) is the same as the above-described operation, and thus the description will be omitted.

  If an undo process (a process of deleting the marker input immediately before) is performed before a new marker is input after the start of the new moving image recording, the marker data management unit 402 deletes it. A marker data file including marker data to be read is read out from the card type recording medium 302. Then, the marker data management unit 402 deletes the last marker data of the read marker data file, and stores the marker data file in the card type recording medium 302 again.

<Video playback>
Subsequently, the processing operation of moving image reproduction will be described. FIG. 15 is a flowchart showing a moving image reproduction process. First, when the user performs a reproduction operation using the operation unit 306, the imaging device 1 starts a moving image reproduction operation (step S301).

  Next, the marker data management unit 402 reads the marker data file associated with the moving image file for starting reproduction from the card type recording medium 302 (step S302).

  Next, the moving picture file management unit 401 determines whether the reproduction of the moving picture file has ended (step S303). If the reproduction has not ended (step S303), the marker data management unit 402 updates the marker related information (step S304). Specifically, the marker data management unit 402 acquires the time of the moving image file, and updates the marker related information to be updated at the time.

  At this time, marker related information includes, for example, “marker type to be displayed as icon”, “whether or not a marker can be input”, “whether or not a marker can be deleted”, “whether or not a game is in progress”, “a game Information on the current team's score of the game and the like. The marker data management unit 402 updates the marker related information, and updates the display of the moving image if there is a marker to be displayed, changed or deleted in the moving image being reproduced (step S305).

  For example, if there is a marker to be displayed at the time of the moving image file due to the update of the marker related information, the display image data generation unit 405 displays the display image in which the image data of the marker to be displayed is superimposed on the moving image data Generate data. Then, for example, as illustrated in FIG. 11, the moving image file management unit 401 causes the moving image being reproduced to display a marker. Further, when the score is changed due to the update of the marker related information, the display image data generation unit 405 generates display image data displaying the changed score (for example, as shown in FIG. 11, the score window) To generate display image data in which the display of has been changed).

  Thereafter, the moving image file management unit 401 determines again whether or not the reproduction has ended (step S303). If the reproduction has not ended yet (step S303: No), the marker data management unit 402 updates the marker related information again (step S304). That is, the update of the marker related information (step S304) and the display update (step S305) are performed periodically (for example, in a cycle of 500 ms) until the end of the reproduction.

  On the other hand, when the reproduction is completed (step S303: Yes), the marker data management unit 402 determines whether the marker data file corresponding to the moving image file is updated (added, deleted, or changed) during the reproduction of the moving image file. Is determined (step S306). When the marker data file is not updated (step S306: No), the operation of moving image reproduction ends.

  On the other hand, when the marker data file is updated (step S306: Yes), the marker data management unit 402 stores the updated marker data file in the card type recording medium 302 in association with the moving image file (step S307). ).

  Note that the above-described reproduction start of the moving image file also includes the case where the next moving image file is reproduced by switching the file in the divided moving image file. The end of reproduction of the moving image file also includes the end of reproduction of the previous moving image file due to the switching of the file in the divided moving image file.

  Also, the moving image file management unit 401 can also perform digest reproduction. The digest reproduction means that, among the moving image files to be subjected to digest reproduction, only the moving image around the input time of each marker data included in the marker data file associated with the moving image file is reproduced. The moving image around the input time is, for example, a moving image of 3 seconds before and after the input time of the marker. This allows the user to watch the game digest. Note that the user may be able to appropriately set a marker to be a target of digest reproduction. For example, when it is desired to view a digest of only a score scene, the user sets a marker to be a target of digest reproduction as a score marker. Thereby, the moving image file management unit 401 reproduces only the moving image around the input time of the score marker.

<Video Copy>
Subsequently, a moving image copy processing operation will be described. Moving picture copying means copying a moving picture file stored in the built-in recording medium 209 of the imaging device 1 to the card type recording medium 302. If there are a plurality of recording media to be recording destinations (copying destinations) of the copied moving image file, the user may select the recording destination. FIG. 16 is a flowchart showing a moving image copying process. First, the user uses the operation unit 306 to select a moving image file to be copied, and performs copy operation. Thereby, the moving image file management unit 401 copies the selected moving image file and transmits it to the copy destination (step S401).

  Next, the marker data management unit 402 analyzes a marker data file (hereinafter referred to as a copy target marker data file) associated with the copied moving image (step S402). Specifically, the marker data management unit 402 searches whether or not the match start marker and the match end marker are included in the copy target marker data file and the marker data files before and after the copy target marker data file.

  Next, the team table management unit 403 copies the team data included in the team table to the team table of the copy destination for the match team of the match start marker included in the copy target marker data file (step S403). At this time, the team table management unit 403 assigns a new ID to the copied team data in the copy destination team table.

  The marker data management unit 402 analyzes the existing marker data of the copy destination (step S404). When the match start marker is present and the match end marker is not present (in the match), the marker data management unit 402 inputs the match end marker at the end of the last marker data file.

  The marker data management unit 402 copies the copy target marker data file (step S405). That is, the marker data management unit 402 creates a copy target marker data file at the copy destination.

  Next, the marker data management unit 402 determines whether or not the copied marker data file (the marker data file copied to another memory in the imaging device 1) includes the match start marker data (step S406). If the match start marker data is a copy target (step S406: Yes), the team table management unit 403 changes the team ID included in the match start marker data to the team ID newly assigned at the copy destination in step S403. (Step S407).

  Thereafter, the marker data management unit 402 determines whether or not the match end marker data corresponding to the match start marker data detected in step S406 is a copy target (step S408).

  When the match end marker data is not a copy target (Step S408: No), the marker data management unit 402 inputs a match end marker at the end position of the moving image file to be copied (the end of the copy target marker data file) ( Step S409). If the game end marker data is to be copied (step S408: Yes), the game end marker input process is not performed, and the process proceeds to the next process.

  Finally, the game data management unit 404 creates game data based on the game information (team, scores, etc.) included in the copied marker data file, and adds it to the copy destination game data file (step S411). ).

  On the other hand, when the game start marker data is not a copy target (step S406: No), the marker data management unit 402 deletes the game related marker data (game end marker, score marker) from the copied marker data file ( Step S410).

  When one game is recorded over a plurality of moving image files, and those moving image files are copied separately, it is also conceivable to copy the marker data file corresponding to each moving image file as it is. In this case, the game related markers included in each marker data file are also copied. For this reason, based on the match related markers included in each marker data file, a plurality of match data regarding the same match will be created. Therefore, a plurality of match data of the same match played in the same team is stored in the match data file, and the index of the match is complicated and difficult to understand.

  On the other hand, according to the configuration of the imaging device 1, as described above, the marker data management unit 402 does not copy the game-related marker data when the game start marker data is not the copy target marker data in step S410. For this reason, the game data management unit 404 can not obtain the information on the game for the copied moving image file at the copy destination. That is, the game data corresponding to the copied moving image file can not be generated. Therefore, even if one game is recorded over a plurality of moving image files and those moving image files are copied separately, the fact that the game data is copied is associated with the marker data file including the game start marker data Only if the animated video file is copied. Therefore, one match data is created for one match. Therefore, it is possible to prevent multiple match data of the same match from being created.

<Delete video>
Subsequently, the processing operation of the moving image deletion will be described. The moving image deletion means deleting the moving image file stored in the card type recording medium 302. FIG. 17 is a flowchart showing the moving image deletion process. First, the user uses the operation unit 306 to select a moving image file to be deleted, and performs deletion operation. Thereby, the imaging device 1 starts the deletion operation of the selected moving image file (step S501).

  Next, the marker data management unit 402 analyzes a marker data file (hereinafter referred to as a deletion target marker data file) associated with the moving image file to be deleted (step S502). Specifically, the marker data management unit 402 searches whether the deletion target marker data file includes the match start marker data and the match end marker data.

  When match start marker data is included in the deletion target marker data file (step S503: Yes), the match data management unit 404 deletes the match data related to the match to be deleted from the match data file (step S504).

  Next, the team table management unit 403 determines whether or not the team ID to which the deleted game data has been referred is referred to by other non-deleted game data (step S505).

  If the team ID referred to by the deleted game data is not referred to in the other non-deleted game data (step S505: No), the team table management unit 403 selects team data corresponding to the team ID not referred to. Is deleted from the team table (step S506). When the team ID referred to by the deleted game data is referred to by other non-deleted game data (step S505: Yes), the team data is not deleted, and the process proceeds to the next process.

  Next, the marker data management unit 402 determines whether or not there is a marker data file that is not a deletion target marker data file up to the game end marker corresponding to the game start marker (step S507). If there is a marker data file that is not a deletion target marker data file (step S507: Yes), the marker data management unit 402 deletes a game related marker (a game end marker and a score marker) from a marker data file that is not a deletion target. (Step S508). If there is no marker data file that is not a deletion target marker data file (step S507: No), the game related marker is not deleted.

  Then, the marker data management unit 402 deletes the deletion target marker data file (step S511). Finally, the moving picture file management unit 401 deletes the moving picture file to be deleted (step S512).

  On the other hand, when match start marker data is not included in the deletion target marker data file (step S503: No), the marker data management unit 402 determines whether match end marker data is included in the deletion target marker data file. (Step S509).

  When the match end marker data file includes the match end marker data (step S509: Yes), the marker data management unit 402 determines the end position of the moving image file not to be removed including the match (the marker data file corresponding to the moving image file The game end marker is input at the end) (step S510). Then, the marker data management unit 402 deletes the deletion target marker data file (step S511). Finally, the moving picture file management unit 401 deletes the moving picture file to be deleted (step S512). When the match end marker data is not included in the deletion target marker data file (step S509: No), the match end marker is not input.

  Note that moving the moving image (copying the moving image file to the copy destination without leaving the moving image file in the copy source) can also be realized by combining the above-described copy processing and deletion processing.

  When the marker data management unit 402 creates a marker data file when one game spans a plurality of moving image files, a total point (total score) in the marker data file immediately before the marker data file is created. May be stored. Thus, even if a plurality of moving image files in which one game is recorded and a part of the marker data file are deleted, the other marker data files store the total points of each team until then. There is. Thereby, the marker data management unit 402 can refer to the total score of each team at the time of creation of the marker data file.

  Furthermore, the marker data file also stores the addition of the score for the total point of the previous marker data file. In other words, the addition of the score is the sum of the scores acquired by each team in the marker data file.

  For example, it is assumed that the total score of team A in the immediately preceding marker data file is 35 and the total score of team B is 41. Then, it is assumed that the team A acquires 11 points and the team B acquires 15 points in the current marker data file. In this case, the current marker data file includes information (total point up to the marker data file immediately before the marker data file) with the total points “35 points for team A” and “41 points for team B” in the marker data file immediately before Stores “11 points acquired” and “B team acquires 15 points” (the amount of addition of the score with respect to the total point of the marker data file immediately before). Thereby, when recalculating the total points after a part of the plurality of moving image files recording one game is deleted, the total points are calculated using only the addition and the total points of the points in each marker data file it can. As a result, it is not necessary to perform calculation with reference to the addition of all the scores, and the load of the arithmetic processing of the imaging device 1 can be reduced.

<Video trimming>
Subsequently, the processing operation of moving image trimming will be described. Moving image trimming means deleting moving image data before and after a range designated by the user (for example, from the start to the end of the game) of the moving image file. Thereby, moving image data before the game start marker and moving image data after the game end marker are deleted, and a moving image file from the start to the end of the game is extracted. FIG. 18 is a flowchart showing the video trimming process. First, the user uses the operation unit 306 to specify a moving image file and an extraction range to be trimmed. Thus, the imaging device 1 starts the trimming operation for the specified extraction range of the moving image file (step S601). At this time, the moving image file management unit 401 extracts moving image data in a specified range of the specified moving image file, as a extraction destination (a place where the trimmed moving image file is stored, for example, another memory or a specified moving image file). Copy to the end etc.)

  Next, the marker data management unit 402 analyzes marker data associated with the extracted moving image data and marker data before and after the marker data (step S602). Specifically, the marker data management unit 402 searches whether or not the marker data includes the match start marker data or the match end marker data.

  Also, the marker data management unit 402 analyzes marker data (existing marker data) already stored in the extraction destination. Specifically, the marker data management unit 402 determines whether the existing marker data of the extraction destination is in the game (step S603). More specifically, the marker data management unit 402 determines that the existing marker data file of the extraction destination includes game start marker data and does not include game end marker data.

  When the existing marker data file of the extraction destination is in the game (step S603: Yes), the marker data management unit 402 inputs a game end marker at the end of the existing marker data file (step S604). When the existing marker data file of the extraction destination is not in the game (step S603: No), the input of the game end marker is not performed, and the process proceeds to the next process.

  Next, the marker data management unit 402 copies marker data of the extracted part (step S605). Then, the marker data management unit 402 changes each time information of the copied marker data (step S606). More specifically, the marker data management unit 402 changes the relative time from the beginning of the moving image (the time in the medium) to the relative time from the extraction start time (the time when the extraction start time is counted as 0). For the marker data of.

  Then, the marker data management unit 402 determines whether the marker data of the extracted part includes the match start marker data (step S 607). When match start marker data is included in the marker data of the extracted part (step S 607: Yes), the marker data management unit 402 determines whether or not match end marker data is included in the marker data of the extracted part. (Step S608).

  If the marker data of the extracted portion does not include the match end marker data (step S608: No), the marker data management unit 402 inputs the match end marker at the end of the marker data of the extracted portion (step S609). ). When the game end marker data is included in the marker data of the extracted part (step S609: Yes), the game end marker input process is not performed, and the process proceeds to the next process.

  Finally, the game data management unit 404 generates game data based on the game start marker data included in the extracted marker data of the extracted part, and adds it to the game data file (step S610). That is, the game data of the trimmed game is added to the game data file.

  On the other hand, when the marker data of the extracted part does not include the match start marker data (step S 607: No), the marker data management unit 402 determines the match related marker data included in the marker data of the extracted part (match end Marker data and score marker data) are deleted (step S611).

  As described above, according to the configuration of the imaging device 1 according to the present embodiment, the card-type recording medium 302 divides imaging data of one game (event) and stores it as a plurality of moving image files. For this reason, one game is recorded over a plurality of moving image files. Further, the marker data management unit 402 stores marker data including the inputted game start marker and game end marker in the card type recording medium 302 as a plurality of marker data files in association with a plurality of moving image files. Therefore, the start and end of the game recorded over a plurality of moving image files can be easily searched with reference to the game start marker and the game end marker, and the moving image file can be easily managed.

Second Embodiment
Second Embodiment A second embodiment of the present invention will be described. In the imaging device 2 according to the present embodiment, various markers can be input using the mobile terminal device 3 connected to the imaging device 2. The configuration of the imaging device 2 is the same as that of the imaging device 1 described above, and thus the description will be appropriately omitted.

  The configuration of the mobile terminal device 3 according to the present embodiment will be described. The block diagram of the portable terminal device 3 is shown in FIG. The mobile terminal device 3 includes at least a display unit 31, an input unit 32, a control unit 33, a communication unit 34, and a memory 35.

  It is assumed that an application for marker input is downloaded to the mobile terminal device 3 in advance. The application includes a UI (User Interface) image or the like used for marker input. An example of the UI image displayed on the display unit 31 of the mobile terminal device 3 is shown in FIG. The mobile terminal device 3 includes a tele icon 931, a wide icon 932, a recording start / recording stop icon 933, a match start marker icon 934, a good marker icon 935, a check marker icon 936, a free marker icon 937, and a score marker icon as UI images. 938 and a player change marker icon 939.

  Subsequently, marker input processing using the mobile terminal device 3 will be described. FIG. 21 is a flowchart showing marker input processing using the mobile terminal device 3. First, the mobile terminal device 3 connects to the imaging device 2 using the communication unit 34 (step S701). Note that wireless communication such as Bluetooth (registered trademark) or Wi-Fi Direct can be used to connect the imaging device 2 and the portable terminal device 3, for example. Of course, the connection between the imaging device 2 and the portable terminal device 3 may be wired communication.

  Next, the control unit 33 acquires specification data from the imaging device 2 (step S702). Then, the control unit 33 stores the acquired specification data in the memory 35. Here, the specification data is, for example, information on specifications of a marker input application such as a URI (Uniform Resource Identifier) of a default marker type table, a URI of a default team table, and a marker input interval. The marker input interval is the minimum time taken to input the next marker after inputting a certain marker.

  The control unit 33 acquires a marker type table and a team table from the imaging device 2 with reference to the URI included in the specification data (step S703). When the type of marker is fixed, the marker type table may be included in the application downloaded by the mobile terminal device 3.

  Next, the control unit 33 acquires state data (step S704). Here, the state data is information indicating a state regarding an interface image and a marker in the imaging device 2. The state data is, for example, "whether the game is in progress or not", "team name", "team color", "score display", "enable / disable marker input button", "enable / disable match start marker input button" , “Effective / ineffective match marker input button”, “effective / ineffective score marker input button”, “effective / ineffective UNDO button”, and the like. When acquiring the state data, the control unit 33 stores the state data in the memory 35.

  Then, the control unit 33 updates the display unit 31 and the input unit 32 based on the acquired state data (step S705). For example, the score on the display screen is updated, or the score button of the input unit 32 is changed from enabled to disabled. That is, the UI image of the mobile terminal device 3 is updated.

  When the update is completed, the control unit 33 determines whether the imaging device 2 and the portable terminal device 3 are still connected (step S706). When the connection between the imaging device 2 and the mobile terminal device 3 has already been completed (step S706: No), the mobile terminal device 3 ends the marker input operation.

  On the other hand, when the connection between the imaging device 2 and the portable terminal device 3 continues (step S706: Yes), the control unit 33 causes the user to input a marker using the input unit 32 (UI image shown in FIG. 20). It is determined whether it has been done (step S 707).

  When the marker input operation is not performed (step S707: No), the control unit 33 acquires state data from the imaging device 2 again (step S704). That is, the control unit 33 updates the state data. If there is any change in the state data, the change of the state data is reflected on the portable terminal device 3 in the update of the UI image (step S705). The control unit 33 performs acquisition (update) of the state data in step S704, for example, at a frequency of once every five seconds.

  On the other hand, when a marker input operation is performed (step S707: Yes), the control unit 33 transmits, to the imaging device 2, marker input information indicating that a marker has been input for the input marker (step S708). .

  When the imaging device 2 receives marker input information, the imaging device 2 performs input of a marker corresponding to the marker input information. Then, the imaging device 2 updates the state data.

  The control unit 33 acquires the state data changed according to the transmission of the marker input information (step S704). Then, the control unit 33 updates the UI (step S 705), and reflects the change of the state data on the mobile terminal device 3. The portable terminal device 3 repeats the above operation until the connection with the imaging device 2 is ended.

  As described above, according to the configuration of the imaging device 2 according to the present embodiment, a marker can be input using the mobile terminal device 3. Therefore, the user can input the marker even at a place away from the imaging device 2. As a result, the position of the user is not constrained, and convenience is improved.

Embodiment 3
A third embodiment of the present invention will be described. In the present embodiment, as in the above-described second embodiment, the user operates the mobile terminal device to perform the operation of the imaging device and the input of the marker. The configuration of the imaging apparatus is the same as that of the second embodiment described above, and thus the description will be appropriately omitted.

  The configuration of the mobile terminal device 4 according to the present embodiment is the same as the block diagram of the mobile terminal device 3 shown in FIG. However, in the mobile terminal device 4 according to the present embodiment, the UI image is different from the mobile terminal device 3. Moreover, the portable terminal device 4 has a measurement part (for example, stop watch function part) for measuring time. The portable terminal device 4 is connected to the imaging device via a wireless communication line or a wired communication line.

  An example of the UI image displayed on the display unit 31 of the mobile terminal device 4 is shown in FIG. In addition to the tele icon 931, the wide icon 932, and the recording start / recording stop icon 933 as the UI image, the portable terminal device 4 has a measurement start marker icon 951, a measurement end marker icon 952, a wrap marker icon 953, and It has a reset icon 954. Also, on the display unit 31, a recording time 940, a split time 941 and a lap time 942 are displayed.

  The UI of the portable terminal device 4 according to the present embodiment is specialized in race sports (long-distance running, motor sports, etc.) traveling around the course. Specifically, the UI of the portable terminal device 4 has a stopwatch function, and can measure a split time indicating a time from the start and a lap time indicating a time of one course of the course.

  The recording time 940 indicates the time elapsed from the start of recording. That is, the recording time 940 is a time elapsed after the recording start / recording stop icon 933 is touched. In the example shown in FIG. 22, the recording time 940 indicates that 2 hours and 29 minutes and 1 second have elapsed since the start of recording.

  The split time 941 indicates the time elapsed from when the measurement start marker icon 951 is touched (after the start of the race). In the example shown in FIG. 22, the split time 941 indicates that 1 hour, 2 minutes, 55 seconds, and 91 have elapsed from the start of the race.

  The lap time 942 indicates the time elapsed since the lap marker icon 953 was touched immediately before. That is, the lap time 942 is the time elapsed since the start of the lap, and means the time of one course of the course. In the example shown in FIG. 22, the lap time 942 indicates that 10 minutes 0 seconds 43 have elapsed. In the case of the first round, a lap time 942 is elapsed from when the measurement start marker icon 951 is touched. That is, in the case of the first lap, the split time 941 and the lap time 942 are the same time.

  The measurement start marker icon 951 is an icon for starting measurement of a race. When the measurement start marker icon 951 is touched, measurement of the split time 941 and the lap time 942 is started. The measurement start marker icon 951 corresponds to the match start marker icon in the above-described first and second embodiments. When the measurement start marker icon 951 is touched, the communication unit 34 (transmission unit) of the mobile terminal device 4 transmits, to the imaging device, an instruction to input a marker indicating that the marker has been input. When receiving the marker input instruction, the wireless module 309 (reception unit) of the imaging device performs marker input corresponding to the marker input instruction. That is, the imaging device creates marker data by associating the time in the medium (the time from the start of the moving image recording start) where the measurement start marker (start marker) is input with the marker ID of the measurement start marker.

  The measurement end marker icon 952 is an icon for ending the measurement of the race. When the measurement end marker icon 952 is touched, the measurement of the split time 941 and the lap time 942 ends.

  The wrap marker icon 953 is an icon for measuring the lap time. When the lap marker icon 953 is touched, the lap time 942 during measurement is stopped, and the time taken by the player or the like for one lap is displayed on the lap time 942. When the lap marker icon 953 is touched, the lap time 942 being measured is stopped, and the measurement of the lap time of the next round is started. Also, when the lap time icon 953 is touched, the split time 941 during measurement is displayed. That is, when the lap marker icon 953 is touched, the split time (time from the start of each lap) and the lap time (time from the previous lap of each lap) are displayed. At this time, the split time 941 and the lap time 942 may display the time during measurement of the current circulation after a predetermined time after displaying the measured time. Alternatively, the portable terminal device 4 may display the history of the past split times 941 and lap times 942 as a list in an arbitrary area of the display unit 31 without stopping the display of the measured time.

When the measurement end marker icon 952 or the wrap marker icon 953 is touched, a marker is input in the same manner as the measurement start marker icon 951. Specifically, the portable terminal device 4 transmits the split time and the lap time at that time to the imaging device together with the input instruction of the measurement end marker or the lap marker. Then, the imaging apparatus associates the measurement end marker or the lap marker (marker ID), the split time, the lap time, and the time in the medium (the time from the start of moving image recording) at which the marker is input, Create data The measurement end marker is a marker indicating that the competitor has passed the goal point. The lap marker is a marker that indicates that the competitor has passed a predetermined point (in the case of a lap race, a goal (start) position).

  The reset icon 954 is an icon for resetting the display of the split time 941 and the lap time 942.

  Subsequently, operations of the imaging device and the mobile terminal device 4 according to the present embodiment will be described. First, the marker input operation will be described. FIG. 23 is a diagram showing marker input timing in time series. FIG. 24 is a view showing a marker data file of the marker input at the timing shown in FIG. The marker data file is stored, for example, in the card type recording medium 302 (storage unit), as in the above-described embodiment.

  As shown in FIG. 23, first, the user touches the recording start / recording stop icon 933 of the portable terminal device 4 to instruct the imaging device to start recording. Thereby, the imaging device starts recording (time t0).

Next, when preparation for the race is completed, the user touches the measurement start marker icon 951 of the portable terminal device 4 at the start of the race (time t1). Thereby, measurement of the split time 941 and the lap time 942 is started. Further, when the measurement start marker icon 951 is touched, the mobile terminal device 4 transmits an input instruction of the measurement start marker to the imaging device. Then, the imaging device associates the measurement start marker with the input time t1, creates marker data, and stores the marker data in the marker data file. In FIG. 24, the measurement start marker corresponds to the marker ID10. The input time of the marker may be the internal time of the mobile terminal device 4 when the marker icon is touched, or the internal time of the imaging device when the imaging device receives the marker input instruction.

  Next, when the player makes a round on the course, the user touches the lap marker icon 953 (time t2). As a result, the first round time is displayed on the portable terminal device 4 as the split time 941 and the lap time 942. Further, when the wrap marker icon 953 is touched, the portable terminal device 4 transmits an input instruction of the wrap marker to the imaging device. Furthermore, the portable terminal device 4 transmits the measured split time and lap time to the imaging device together with the input instruction of the lap marker.

  The imaging apparatus associates marker data with the lap marker, the time t2, the split time, and the lap time, and stores the marker data in the marker data file. In FIG. 24, the wrap marker corresponds to the marker ID11.

  After that, also at time t3 and t4, similarly to time t2, the imaging device associates marker input time, split time, lap time and lap marker, creates marker data, and stores it in a marker data file.

  Then, when the player has finished the final round of the race (when the goal is reached), the user touches the measurement end marker icon 952 (time t5). As a result, the time from the start to the goal is displayed on the portable terminal device 4 as the split time 941. The time of the last lap is displayed on the portable terminal device 4 as a lap time 942. Further, when the measurement end marker icon 952 is touched, the imaging device is instructed to input the measurement end marker. Furthermore, the portable terminal device 4 transmits the measured split time and lap time to the imaging device together with the input instruction of the measurement end marker.

  The imaging device associates marker end time, time t5, split time, and lap time with each other to create marker data, and stores the marker data in the marker data file. In FIG. 24, the measurement end marker corresponds to the marker ID 20.

  Thereafter, a break is entered until time t6, and at time t6, the user touches the measurement start marker icon 951 of the portable terminal device 4 at the start of the second race (time t6). Thereby, measurement of the split time 941 and the lap time 942 is started. Thereafter, the user operates the mobile terminal device 4 in the same manner as the above-described time t2 to t5, and the imaging device creates a marker data file according to the operation. By such processing, the marker data file of FIG. 24 is created.

  Next, the reproduction operation of the imaging apparatus will be described with reference to FIGS. 25 and 26. The imaging apparatus displays a list of “LAP TIME” fields of the marker data file shown in FIG. 24 on the liquid crystal monitor 304. Then, the user uses the operation unit 306 to select a lap time to be reproduced.

  The imaging device reproduces the moving image based on the time when the lap marker or the measurement end marker associated with the selected lap time is input. For example, as shown in FIG. 25, when the lap time "0: 10'07" 42 "of" LAP TIME "is selected, the moving image file management unit 401 (reproduction unit) determines that the lap marker associated with the lap time is The moving image is played back not from the input time t4 but from the time point that is backward from the time t4 by the lap time (Lt). That is, the moving image is reproduced from the time obtained by subtracting the lap time (607420 ms) from t4 (1908675 ms). As a result, the moving image is played from the beginning of the lap when the selected lap time is taken.

  Similarly, the imaging apparatus lists the “SPLIT TIME” field on the liquid crystal monitor 304 on the same screen as the “LAP TIME” field or a different screen. Then, the user selects a split time to be reproduced.

  The imaging device reproduces the moving image based on the time when the lap marker or the measurement end marker associated with the selected split time is input. For example, as shown in FIG. 26, the moving image file management unit 401 does not point to the time t5 when the measurement end marker associated with the selected split time is input, but back to the time t5 by the split time (St) Play the video from That is, the moving image is reproduced from the time obtained by subtracting the split time (2410950 ms) from t5 (2513147 ms). This causes the video to be played from the beginning of the race that gave the selected split time.

  In addition, although time measurement was performed from the race start time, when video recording is started from the middle of a race, the case where a moving image does not exist in the position which went back only by split time can be considered. In such a case, the moving image file management unit 401 reproduces the moving image from the recording start position (the beginning of the moving image).

  As described above, according to the configuration of the imaging apparatus according to the present embodiment, when the moving image file management unit 401 receives a marker reproduction instruction, time information associated with the marker is Play the video from the position going back by lap time or split time). For this reason, if a time is selected, it is possible to reproduce a moving image from the start position of the race from which the time was given and the start position of the lap. In addition, even when the marker is not input at the start of the race or at the start of the lap, it is possible to reproduce from an appropriate position that goes back by the split time or the lap time.

Fourth Preferred Embodiment
Fourth Embodiment A fourth embodiment of the present invention will be described. A block diagram of the imaging device 5 according to the present embodiment is shown in FIG. In the imaging device 5 illustrated in FIG. 27, the compression / decompression processing unit 201 includes a first codec 2011 and a second codec 2012. That is, the compression / decompression processing unit 201 according to the present embodiment has a dual codec. The other configuration is the same as that of the imaging device 1 shown in FIG.

  In addition, the imaging device 5 according to the present embodiment transmits the captured video to the live distribution system. Specifically, the imaging device 5 encodes the video for live distribution using the first codec 2011, and encodes the video for recording using the second codec. That is, the imaging device 5 performs video distribution while recording.

  The first codec 2011 is based on the MPEG2 standard or AVC / H. The image data and digital audio data stored in the main memory 205 are compressed based on a compression method compliant with the H.264 standard to generate compressed data. At this time, the first codec 2011 superimposes the image data of the marker input using the imaging device 5 or the mobile terminal device on the imaging data and encodes the image data for transmission (first moving image file) Generate Then, the first codec 2011 transmits the generated video for transmission to the external live distribution system (external server) (not shown) via the wireless module 309. In addition, the kind of marker concerning this Embodiment is not specifically limited, It is a marker which shows the specific state of the event used as imaging object. For example, markers (game start marker, game end marker, measurement start marker, measurement end marker, good marker, check marker, score marker, etc.) in the above-described embodiment can be used as a marker.

  Similar to the first codec 2011, the second codec 2012 includes the MPEG2 standard, AVC / H. The image data and digital audio data stored in the main memory 205 are compressed based on a compression method compliant with the H.264 standard to generate compressed data. However, the second codec 2012 does not superimpose the image data of the marker input using the imaging device 5 or the mobile terminal device on the imaging data. That is, the second codec 2012 generates a moving image file (second moving image file) by encoding only imaging data and digital audio data. The marker data management unit 402 (control unit) creates marker data by correlating the time in the medium at the time of marker input with the marker ID of the input marker. Then, the marker data management unit 402 associates the created marker data with the moving image file (second moving image file) and stores the created marker data as a marker data file in the card type recording medium 302.

  The type of marker according to the present embodiment is not particularly limited, and the specific situation of the event to be imaged (game start, game end, measurement start, measurement end, good play, at the time of confirmation, It is a marker which shows a point of time etc.). For example, markers (game start marker, game end marker, measurement start marker, measurement end marker, good marker, check marker, score marker, etc.) in the above-described embodiment can be used as a marker.

  Subsequently, the operation of the imaging device 5 according to the present embodiment will be described with reference to the flowcharts shown in FIG. 28 and FIG. The flowchart shown in FIG. 28 shows the operation of the first codec 2011. The flowchart shown in FIG. 29 shows the operation of the second codec 2012.

  First, the operation of the first codec 2011 will be described. First, the imaging unit 100 performs an imaging process (step S801). Thereby, imaging data is generated.

  Next, the marker data management unit 402 determines whether a marker is input using the operation unit 306 of the imaging device 5 or the mobile terminal device (step S802). When a marker is input (step S802: Yes), the marker data management unit 402 transmits the image data of the marker corresponding to the input marker to the first codec 2011. The image data of the marker is stored, for example, in the flash ROM 204 in advance.

  Then, the first codec 2011 superimposes the image data of the marker on the imaging data to generate compressed data (step S803). On the other hand, when the marker is not input (step S804), the first codec 2011 generates compressed data using only the imaging data and the digital audio data (step S805). That is, the first codec 2011 performs normal encoding processing.

  Next, the first codec 2011 transmits the compressed data (first moving image file) to the live distribution system. Thereby, the video which the imaging device 5 imaged is distributed (step S805). At this time, when the marker is input, the video on which the image data of the marker is superimposed is distributed.

  Then, the central control unit 400 determines whether the user has performed a shooting stop operation (step S806). When the imaging stop operation has been performed (step S806: Yes), the imaging device 5 ends the imaging. On the other hand, when the photographing stop operation has not been performed (step S806: No), the process returns to step S801, and the above operation is repeated.

  Subsequently, the operation of the second codec 2012 will be described. First, the imaging unit 100 performs an imaging process (step S901). Thereby, imaging data is generated.

  Next, the second codec 2012 compresses only imaging data and digital audio data, and generates compressed data (second moving image file) (step S902). That is, the second codec 2012 performs the normal encoding process regardless of the presence or absence of the input of the marker. Then, the second codec 2012 stores the generated compressed data as a moving image file in the card type recording medium 302 (step S903).

  Further, the marker data management unit 402 determines whether a marker is input using the operation unit 306 of the imaging device 5 or the mobile terminal device (step S904). When a marker is input (step S904: Yes), the marker data management unit 402 associates marker input time with the marker ID to create marker data, and the created marker data is compressed by the second codec 2012. It is stored in the card type recording medium 302 as a marker data file in association with the moving image file (step S905). On the other hand, when the marker is not input (step S904: No), the marker data is not created, and the process proceeds to step S906.

  Then, the central control unit 400 determines whether the user has performed a shooting stop operation (step S906). When the imaging stop operation has been performed (step S906: Yes), the imaging device 5 ends the imaging. On the other hand, when the photographing stop operation is not performed (step S906: No), the process returns to step S901, and the above operation is repeated.

  Although the operation of the first codec 2011 and the operation of the second codec 2012 have been described using another flowchart (FIGS. 28 and 29) for convenience of explanation, the flows shown in FIGS. 28 and 29 are parallel. Is done. That is, the compression / decompression processing unit 201 performs parallel processing of the compression in the first codec 2011 and the compression in the second codec 2012.

  As described above, according to the configuration of the imaging device 5 according to the present embodiment, the first codec 2011 superimposes the input image data of the marker on the imaging data to generate compressed data. Then, the first codec 2011 transmits the video on which the image data of the marker is superimposed to the distribution system. On the other hand, the second codec 2012 does not superimpose the marker image data, generates compressed data using imaging data, and stores the compressed data in the card type recording medium 302. Therefore, even if the distribution system does not have the function of superimposing the marker image data, it is possible to distribute the video on which the marker image data is superimposed. Furthermore, since a normal video on which the image data of the marker is not superimposed is stored in the card type recording medium 302, it is possible to view the video on which the image data of the marker is not displayed or to edit the video. it can.

  In the above example, the video on which the marker image is superimposed is transmitted to the distribution system without being stored in the memory or the like, but the superimposed video is stored, for example, in the card type recording medium 302 It is also good. As a result, the video after the image superposition can be reproduced even in the reproduction apparatus having no function of superimposing the image.

  Also, the marker data management unit 402 may detect whether or not the marker data file stored in association with the moving image file generated by the second codec 2012 has been edited. When marker data is edited, the marker data management unit 402 transmits the marker data after editing to the first codec 2011. The first codec 2011 superimposes the image data of the edited marker on the moving image file (without marker superposition) stored in the card type recording medium 302. Thereby, the imaging device 5 can generate an image in which the image of the marker after editing is superimposed.

  As mentioned above, although the present invention was explained according to the above-mentioned embodiment, it is not limited only to composition of the above-mentioned embodiment, and includes various modification, correction, and combination which can be made by one skilled in the art within the scope of the present invention. Of course.

  For example, it goes without saying that part of the information stored in the card type recording medium 302 may be stored in a storage device (for example, a USB memory) which can be attached to and detached from the imaging device 1. Further, the imaging device 1 may download information to be held in the memory card type recording medium 302 from the network as appropriate. Further, at least a part of the information stored in the card type recording medium 302 may be stored in a storage unit (not shown) in the central control unit 400.

  In addition, arbitrary processing of the above-described imaging device and portable terminal device can also be realized by causing a CPU (Central Processing Unit) to execute a computer program. In this case, the computer program can be stored using various types of non-transitory computer readable medium and supplied to the computer. Non-transitory computer readable media include tangible storage media of various types. Examples of non-transitory computer readable media are magnetic recording media (eg flexible disk, magnetic tape, hard disk drive), magneto-optical recording media (eg magneto-optical disk), CD-ROM (Read Only Memory), CD-R, CD-R / W, semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (random access memory)) are included. Also, the programs may be supplied to the computer by various types of transitory computer readable media. Examples of temporary computer readable media include electrical signals, light signals, and electromagnetic waves. The temporary computer readable medium can provide the program to the computer via a wired communication path such as electric wire and optical fiber, or a wireless communication path.

  In addition to the case where the functions of the above-described embodiment are realized by the computer executing the program for realizing the functions of the above-described embodiments, an OS (a program running on the computer) Implementation of the functions of the above-described embodiments in cooperation with Operating System or application software is also included in the embodiments of the present invention. Furthermore, even if all or part of the processing of this program is performed by a function expansion board inserted into the computer or a function expansion unit connected to the computer, the functions of the above-described embodiment can be realized. Are included in the embodiments of the invention.

1, 2, 5 imaging device 3, 4 portable terminal device 11 body 12 monitor 13 hinge 14 lens 31 display 31 input 32 control 34 communication 51 memory 51 movie file 52 marker type table 53 team table 54 marker data File 55 game data file 100 imaging unit 101 zoom lens 102 focus lens 103 aperture 104 imaging device 105 analog image signal processing unit 106 image A / D conversion unit 107 image input controller 108 digital signal processing unit 109 microphone 110 analog audio signal processing unit 111 Audio A / D converter 112 Audio input controller 113 Multiplexer 200 Bus 201 Compression / decompression processor 202 Audio / image processor 203 ROM
204 Flash ROM
205 main memory 206 media control unit 207 gyro sensor 208 clock 209 internal recording medium 301 card I / F
302 card type recording medium 303 input / output I / F
304 LCD monitor 305 speaker 306 operation unit 307 input / output terminal 308 wireless I / F
309 wireless module 400 central control unit 401 video file management unit 402 marker data management unit 403 team table management unit 404 game data management unit 405 display image data generation unit

Claims (4)

An imaging unit that generates imaging data of a moving image by imaging an event;
  A marker input unit for inputting a marker indicating the status of the event to the moving image;
  A first codec that generates a first moving image file by superimposing image data corresponding to the marker input by the marker input unit on the imaging data; and
  A second codec that generates a second moving image file by encoding the imaging data;
  A storage unit for storing the second moving image file;
  Marker data is generated by associating the marker input by the marker input unit with the time when the marker is input, and the marker data is stored in the storage unit in association with the second moving image file. Control unit, and
  An imaging device comprising: The imaging device according to claim 1, further comprising a transmission unit that transmits the first moving image file to an external server. The second codec generates the second moving image file by encoding the imaging data without superimposing the image data of the marker input by the marker input unit on the imaging data. The imaging device according to claim 1. Generating imaging data of a moving image by imaging an event;
  Inputting a marker indicating the status of the event in the moving image;
  Generating a first moving image file by encoding image data corresponding to the input marker superimposed on the imaging data;
  Generating a second moving image file by encoding the imaging data;
  Storing the second moving image file in a storage unit;
  Generating marker data by associating the input marker with a time when the marker is input, and storing the marker data in the storage unit in association with the second moving image file;
  An imaging method comprising:

Images