JP6304963B2 - VIDEO OUTPUT DEVICE, ITS CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM - Google Patents

Description

  The present invention relates to a video output technique for superimposing and outputting screen information such as characters and icons and video.

  In recent digital video cameras and the like, GUI (screen information) such as characters and icons and video can be superimposed and output as OSD. On the OSD screen, GUI data such as characters and icons drawn in VRAM can be superimposed on the subject video captured by the video camera and output simultaneously to the display (liquid crystal panel) mounted on the camera body and to the external monitor. It is. In a normal video camera, the same subject image, GUI, and other information are displayed on the liquid crystal panel and the external monitor, and the user browses either the viewfinder or the external monitor depending on the situation or preference. Shooting and playback can be performed. For example, Patent Document 1 describes a technique for synthesizing a video and a GUI so that a restricted area that does not display an image is provided in the peripheral area of the LCD screen and a GUI can be displayed in the restricted area. Japanese Patent Application Laid-Open No. 2005-228561 describes a technique that enables the same or different contents to be displayed on a plurality of display units (LCD screen, viewfinder, etc.) provided in the camera.

JP 2006-030914 A JP 2006-166133 A

  By the way, when the OSD is simultaneously output to the two systems of the liquid crystal panel and the external monitor, the display quality of characters and icons on the liquid crystal panel may deteriorate. That is, since the screen size of the liquid crystal panel is small, the displayed characters and icons may be too small to be visually recognized, or the displayed characters and icons may be crushed because the resolution is low.

  Further, it is desirable that the OSD display range on the external monitor be within about 90% of the effective area of the monitor screen. However, the screen margin required for OSD display is a useless margin in the liquid crystal panel. This is an unnecessary restriction when laying out the GUI.

  Therefore, although drawing can be performed individually for the OSD output to the two systems of the liquid crystal panel and the external monitor, the layout management becomes difficult, and the drawing processing is doubled when outputting to the two systems simultaneously. Therefore, real-time display becomes difficult.

  Although the video area can be trimmed as in Patent Documents 1 and 2, it is desirable that the subject video is displayed on the entire screen without being trimmed.

  The present invention has been made in view of the above problems, and its purpose is to improve the visibility of the OSD both when displaying on the display unit and when outputting to the outside, and the video output that does not increase the load related to the drawing process It is to realize technology.

In order to solve the above problems and achieve the object, the video output apparatus of the present invention includes a first acquisition unit that acquires a video and a second acquisition unit that acquires a superimposition screen for superimposing the video. And an external first display means, an output means capable of outputting to the second display means, and when outputting to the first display means, the output is obtained by the first acquisition means. When the first process of outputting a superimposed image in which the entire area of the superimposition screen is superimposed on the image is executed and output to the second display means, the first acquisition means For the acquired video, a partial screen is cut out from the entire area of the superimposition screen so as to exclude peripheral areas in the outer periphery of all display items that are not completely transmitted when superimposed on the video, and the second display by superimposing the partial screen resized to fit the means Having an output control means for controlling to execute a second process for outputting a tatami image, a.

  According to the present invention, the visibility of the OSD is improved both in the case of displaying on the display unit and in the case of outputting to the outside, and the load related to the drawing process is not increased, so that the optimum display can be performed in real time. it can.

The block diagram which shows the apparatus structure of this embodiment. The figure explaining the drawing process of OSD by this embodiment. 6 is a flowchart illustrating OSD drawing processing according to the present embodiment. The figure which illustrates the OSD screen during the moving image reproduction of this embodiment. The figure which illustrates the OSD screen during still picture reproduction of this embodiment. The figure which illustrates the OSD screen in the moving image list display of this embodiment. The figure which illustrates the OSD screen in the keyboard display of this embodiment. The figure which illustrates the OSD screen in the video editing mode of this embodiment.

  Hereinafter, embodiments in which the video output device of the present invention is applied to an imaging device such as a digital video camera will be described in detail with reference to the drawings.

  <Device Configuration> The configuration and functions of a digital video camera to which the video output device of the present invention is applied will be described with reference to FIG.

  In FIG. 1, an imaging unit 101 includes a lens group including a zoom lens and a focus lens, and a shutter having a diaphragm function. In addition, the imaging unit 101 includes an imaging element configured with a CCD or CMOS element that converts a subject image into an electrical signal, and an A / D converter that converts an analog image signal output from the imaging element into a digital signal.

  The video processing unit 102 performs resize processing and color conversion processing such as predetermined pixel interpolation and reduction on the video data from the imaging unit 101 or the video data from the memory control unit 108, and stores the memory control unit 108 as VRAM data. To the memory 109. The video processing unit 102 performs predetermined calculation processing using the video data, and the system control unit 110 performs exposure control and distance measurement control based on the obtained calculation result. Thereby, AF (autofocus) processing and AE (automatic exposure) processing are performed. The video processing unit 102 further performs predetermined arithmetic processing using the captured video data, and also performs AWB (auto white balance) processing based on the obtained arithmetic result. Further, the video processing unit 102 decodes the compressed / encoded video data by the codec 103, performs resizing processing and color conversion processing on the decoded video data, and performs processing for generating new video data.

  The codec 103 converts the video data generated by the video processing unit 102 into MPEG2 or H.264. It is encoded by a moving image compression method such as H.264. The codec 103 also decodes the encoded file read by the memory control unit 108 and sends it to the memory control unit 108.

  The video output control unit 104 reads the video data and GUI data (superimposition screen) held as VRAM data in the memory 109 and superimposes them to generate OSD screen data. The video output unit 105, the display unit 106, Output to the codec 103. Further, by outputting the OSD screen data to the codec 103, it is possible to perform compression encoding and record it on the recording medium 119 or the like. If the video camera 100 includes an electronic viewfinder (EVF), the OSD screen data is output to the EVF. You may do it. The video output control unit 104 outputs at least the OSD screen data to the codec 103 and the video output unit 105 at the same time, or outputs the OSD screen data to the codec 103 and the display unit 106 at the same time. The OSD screen data can be simultaneously output to the three systems of the unit 105 and the display unit 106.

  The video output unit 105 includes external output terminals such as an HDMI (registered trademark) terminal, an SDI terminal, and a composite video terminal, and can be connected to a digital television or a display device (external monitor) as an external device. The video output control unit 104 can output video data generated by the video processing unit 102, the codec 103, and the GPU 107 to an external monitor via the video output unit 105. Depending on the performance of the digital television or external monitor connected to the video output unit 105, the entire video is displayed (full scan), or the central portion of the video is cut out and displayed (overscan). However, it is not usually possible to control the range displayed on a digital television or an external monitor from the video camera 100. For this reason, the video data output from the video output control unit 104 to the video output unit 105 is provided with a sufficient margin in the peripheral area of the video so that the OSD can be displayed without loss on an ordinary digital television or an external monitor. Is output.

  The display unit 106 is a display device such as a liquid crystal panel or an organic EL panel that displays a video corresponding to the video data output from the video output control unit 104. The display unit 106 may be integrated with the video camera 100 or may be an external device connected to the video camera 100. The display unit 106 may be a relatively small screen or a liquid crystal panel with a low resolution due to the physical size and cost of the entire video camera 100. Even in this case, according to the present embodiment, a GUI such as a character or an icon can be displayed as large as possible. Note that there is no particular need to provide a sufficient margin in the peripheral area of the video displayed on the display unit 106.

  A GPU (graphics processing unit) 107 renders GUI components such as characters and icons representing the state and settings of the video camera 100 in the VRAM of the memory 109. Information such as characters and icons is stored in the nonvolatile memory 115 in a compressed bitmap format or a vector format. The system control unit 110 reads out these pieces of information from the nonvolatile memory 115 and writes them into the memory 109, and the GPU 107 reads out and renders them in the VRAM. The GPU 107 also has a mixer function for trimming VRAM data, superimposing a plurality of VRAM data, and resizing to VRAM data having different resolutions. When resizing the VRAM data, the vertical and horizontal reduction ratios can be individually set. The mixer function also includes a color conversion function that converts the color space of the rendered VRAM data into the color space required by the video output control unit 104.

  The memory control unit 108 has a function of arbitrating access requests from each block to the memory 109.

  The memory 109 stores VRAM data processed by each of the video processing unit 102, the codec 103, the video output control unit 104, and the GPU 107. In addition, it has a function of temporarily storing the encoded video data output from the codec 103 and the encoded video data read from the recording medium 119. The memory 109 has a recording capacity sufficient to store moving images and audio for a predetermined time.

  The nonvolatile memory 115 is an electrically erasable / recordable memory, and for example, an EEPROM or the like is used. In the non-volatile memory 115, constants, programs and the like for operating the system control unit 110 are recorded. Here, the program is a program for executing various flowcharts described later in the present embodiment. Screen information such as image data and character data used for rendering in the GPU 107 is also stored in the nonvolatile memory 115.

  The system control unit 110 is an arithmetic processing unit that controls the video camera 100 as a whole. The system control unit 110 executes programs stored in the non-volatile memory 115 to realize each process of the flowchart described below.

  The system memory 116 is a RAM or the like, and is also used as a work memory for developing constants and variables for operation of the system control unit 110, programs read from the nonvolatile memory 115, and the like. The system control unit 110 also performs display control by controlling the video output control unit 104, the GPU 107, and the memory control unit 108. The system memory 116 may be shared with the memory 109. In this case, since access is arbitrated by the memory control unit 108, a small-capacity memory that can be accessed at high speed is directly connected to the system control unit 110 and mounted. Sometimes.

  The system timer 117 is a time measuring unit that measures the time used for various controls and the time of the built-in clock.

  The system control unit 110 includes one or a plurality of CPU cores. When the system control unit 110 includes a plurality of CPU cores, a task described in the program can be shared and processed by the plurality of CPU cores.

  The touch panel 111 is a touch sensor that can detect a touch operation on the display unit 106. The touch panel 111 and the display unit 106 can be configured integrally. For example, the touch panel 111 is attached to the upper layer of the display surface of the display unit 106 so that the light transmittance does not hinder the display of the display unit 106. Then, the input coordinates on the touch panel 111 are associated with the display coordinates on the display unit 106. Thereby, it is possible to configure a GUI as if the user can directly operate the OSD screen displayed on the display unit 106.

  The power switch 112 sends an operation signal for switching the power of the video camera 100 on and off to the system control unit 110.

  The power control unit 113 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like, and detects whether or not a battery is mounted, the type of battery, and the remaining battery level. Further, the power control unit 113 controls the DC-DC converter based on the detection result and an instruction from the system control unit 110, and supplies a necessary voltage to each unit including the recording medium 119 for a necessary period.

  The power supply unit 114 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, or the like.

  The recording medium I / F 118 is an interface with a recording medium 119 such as a memory card or a hard disk.

  In the recording medium 119, the encoded video data held in the memory 109 is recorded by the recording medium I / F 118, and the already recorded encoded video data and additional information are read out. The recording medium 119 may be a memory card or a hard disk drive mounted on the video camera 100, or may be a flash memory or a hard disk drive built in the video camera 100.

  <OSD Drawing Process> Next, the OSD drawing process according to this embodiment will be described with reference to FIG.

  In FIG. 2, reference numerals 200, 210 (220), and 230 indicate VRAM data generated by the video processing unit 102, the GPU 107, and the video output control unit 104 and drawn in the memory 109.

  Reference numeral 200 denotes VRAM data generated by the video processing unit 102. The video data captured by the imaging unit 101 or the encoded video data read from the recording medium 119 and temporarily stored in the memory 109. Is decoded by the codec 103. Note that the video data may be obtained from an external device such as a PC. FIG. 2 illustrates an image in which three subjects are arranged.

  Reference numerals 201 and 202 denote VRAM data output from the video output unit 105 and VRAM data encoded by the codec 103, output from the video processing unit 102, and rendered in the memory 109 via the memory control unit 108. The VRAM data 201 and 202 are obtained by resizing the video data generated by the imaging unit 101 to a resolution suitable for output from the video output unit 105 or drawing on the memory 109.

  The VRAM data 203 and 204 are video data output from the video output control unit 104 to the display unit 106, output from the video processing unit 102, and rendered in the memory 109 via the memory control unit 108. The VRAM data 203 and 204 are resized VRAM data 201 and 202 to a resolution suitable for display on the display unit 106.

  Each of the VRAM data 201 and 202 and the VRAM data 203 and 204 constitutes a bank, and writing of video data from the video processing unit 102 and reading of video data to the video output control unit 104 are alternately performed. The writing process and the reading process are controlled so as not to collide.

  Reference numeral 210 denotes VRAM data of a GUI screen (superimposition screen) generated by the renderer of the GPU 107. Reference numeral 211 denotes a GUI screen drawn on the memory 109 from the renderer. FIG. 2 illustrates a GUI screen on which eight buttons are arranged. When this GUI is displayed on the display unit 106 by control to be described later, when a touch operation on a button by the user is detected by the touch panel 111 and an event is notified to the system control unit 110, various types of video camera 100 are notified. Instructions are given. Note that the rectangle 211a in the peripheral area of the GUI data 211 is shown for convenience of explanation, and is not actually drawn.

  Reference numeral 220 denotes VRAM data generated by the mixer of the GPU 107. The mixer receives the GUI screen data 211 from the memory control unit 108 and outputs VRAM data 221, 222, 223, and 224.

  Reference numerals 221 and 222 denote video data output from the video output unit 105 and VRAM data for compression encoding by the codec 103, and are written into the memory 109 via the memory control unit 108. The VRAM data 221 and 222 represent the same contents as the VRAM data 211, but color conversion processing suitable for output to the video output unit 105 is performed. If the renderer draws two pieces of VRAM data, the result of superimposing the two pieces as a layer can be output as VRAM data 221 and 222.

  Reference numerals 223 and 224 denote VRAM data output to the display unit 106 and are drawn in the memory 109 via the memory control unit 108. The VRAM data 223 and 224 are obtained by trimming the peripheral area of the rectangle 211 a of the VRAM data 211, and resizing processing and color conversion processing suitable for display on the display unit 106 are performed. When two VRAM data are drawn by the renderer, the result of superimposing these two as a layer can be output as VRAM data 223 and 224. Depending on the aspect and resolution of the screen to be displayed and the operation mode of the video camera 100, the VRAM data 211 may be resized without being trimmed. In this case, the VRAM data is 225. The characters and icons of the VRAM data 223 and 224 are displayed larger than the VRAM data 225.

  The VRAM data 221 and 222 and the VRAM data 223 and 224 respectively constitute banks, and writing by the mixer of the GPU 107 and reading by the video output control unit 104 are alternately performed so that the writing process and the reading process do not collide. Be controlled.

  The VRAM data 221, 222, 223, 224, and 225 each include transparency information (α channel) for each pixel constituting the GUI. In the example of FIG. 2, the area enclosed as a button is opaque, and the other areas are totally transparent.

  Reference numeral 230 denotes a superimposed video output from the video output control unit 104. The video output control unit 104 superimposes the VRAM data 201 or 202 and the VRAM data 221 or 222 via the memory control unit 108, but outputs video data 231 for external output. Similarly, video data 232 for display in which VRAM data 203 or 204 and VRAM data 223 or 224 are superimposed is output via the memory control unit 108.

231 shows a superposition image that will be output from the video output unit 105, and is generated by superimposing the VRAM data 221 or 222 to the VRAM data 201 or 202. The superimposed video 231 is configured by superimposing the entire area of the VRAM data (GUI screen) 221 or 222 on the VRAM data (video) 201 or 202. The contents of the VRAM data 201 or 202 can be seen in the totally transparent area of the VRAM data 221 or 222.

  Reference numeral 232 denotes a superimposed image that is output and displayed on the display unit 106, and is generated by superimposing the VRAM data 223 or 224 on the VRAM data 203 or 204. The superimposed image 232 is obtained by resizing and superimposing a partial area smaller than the entire area of the VRAM data (GUI screen) 223 or 224 on the VRAM data (video) 203 or 204. The contents of the VRAM data 203 or 204 can be seen in the totally transparent area of the VRAM data 223 or 224.

  Reference numeral 233 denotes a superimposed image in which letterbox (black band) 233a is applied above and below the superimposed image 232. When the aspect of the screen of the display unit 106 is different from the superimposed video 232, the video output control unit 104 outputs video data 233 with the matched aspect by applying a letterbox. In this case, since the effective display range of the superimposed image 233 cannot use all of the display capability of the display unit 106, the displayed characters and icons are more likely to be crushed.

  As described above, the video output control unit 104 generates a superimposed video in which the entire area of the VRAM data (GUI screen) 221 or 222 is superimposed on the VRAM data (video) 201 or 202 and outputs the superimposed video to the video output unit 105. . In addition, the video output control unit 104 generates and displays a superimposed video in which the VRAM data (video) 203 or 204 is resized and superimposed on a partial area narrower than the entire area of the VRAM data (GUI screen) 223 or 224. To the unit 106.

  The OSD drawing process described with reference to FIG. 2 executed by the video camera 100 of the present embodiment will be described below with reference to FIG. 3 is realized by developing a program stored in the nonvolatile memory 115 in the system memory 116 and executing it by the system control unit 110. In addition, the system control unit 110 performs three tasks in parallel by the function of the OS included in the program stored in the nonvolatile memory 115. 3A to 3C show processing corresponding to each task.

  First, the video data drawing process of FIG. FIG. 3A shows a task of sequentially creating VRAM data 201 and 202 and VRAM data 203 and 204 and notifying the subsequent control of the addresses.

  In step S3001, the system control unit 110 determines whether or not the video frame synchronization period has elapsed. The synchronization period is determined based on the operation period of the video processing unit 102, and is notified from the system timer 117 to the system control unit 110 by interruption.

  In step S3002, the system control unit 110 determines a VRAM address where a new video frame is to be written. There are two VRAM addresses, that is, the address of the VRAM data 201 or 202 and the address of the VRAM data 203 or 204, and a VRAM address for which video data is not output from the video output control unit 104 is selected.

  In step S3003, the system control unit 110 controls the memory control unit 108 to write the video data processed by the video processing unit 102 to the write destination VRAM address determined in step S3002. The video data input to the video processing unit 102 is video data captured by the imaging unit 101 during the shooting mode, and is video data decoded by the codec 103 during the playback mode.

  In step S3004, the system control unit 110 completes the writing of the video data in step S3003 and notifies the video output control unit 104 of the VRAM address that can be read.

  Next, the GUI data drawing process of FIG. 3B will be described. In FIG. 3B, the renderer of the GPU 107 draws the VRAM data 211, the mixer sequentially generates VRAM data 221 and 222 and VRAM data 223 and 224 from the VRAM data 211, and writes the VRAM address of the write destination to the subsequent control. Indicates the task to be notified.

  In step S3101, the system control unit 110 determines the state of the GUI screen to be displayed. The GUI screen state includes a screen layout, the color and shape of each display element in the screen, the expression content, a display / non-display state, and a state including a drawing order.

  In step S3102, the system control unit 110 controls the renderer of the GPU 107 so as to draw the GUI screen state determined in step S3101 in the VRAM data 211. Depending on the GUI screen state, the VRAM data 211 is composed of a plurality of VRAM data. In this embodiment, although the video output control unit 104 outputs the superimposed video data to the two systems of the video output unit 105 and the display unit 106, the GUI screen state determination process in step S3101 and the step 3102 The drawing process need only be performed once. Therefore, the resources required for processing by the renderer of the system control unit 110 and the GPU 107 can be efficiently used.

  In step S3103, the system control unit 110 determines a write destination VRAM address for outputting the contents of the VRAM data drawn in step S3102 to the video output control unit 104. The VRAM address is the address of the VRAM data 221 or 222 and the address of the VRAM data 223 or 224, and a VRAM address for which video data is not output from the video output control unit 104 is selected.

  In step S3104, the system control unit 110 controls the memory control unit 108 to write the VRAM data generated by the mixer of the GPU 107 to the write destination VRAM address of the VRAM data 221 or 222 determined in step S3103. The VRAM data input to the mixer of the GPU 107 is the VRAM data 211 drawn by the renderer of the GPU 107 in step 3103.

  In step S3105, the system control unit 110 determines whether to perform trimming processing when the VRAM data 223 or 224 is generated by the mixer of the GPU 107. If so, the system control unit 110 proceeds to step S3106. The process proceeds to S3107. Here, when it is known that the field of view is 100% as in the display unit 106, it is determined that trimming is performed, and trimming is performed so as to delete the peripheral region 211a of the VRAM data 211. A GUI screen resized (enlarged) to fit the screen is displayed. As a result, characters, icons, etc. can be displayed in large size using the entire screen of the display unit 106. On the other hand, when the field of view is unknown, as in the case of an external monitor, when the field of view is less than 100% and the surrounding area may not be visible, or when it is desired to output the exact same image as the display unit 106 to the external monitor, The GUI screen is output without trimming the peripheral area 211a of the VRAM data 211. As a result, even if the peripheral area becomes invisible when displayed on the external monitor, the GUI components are not lost.

  In step S3106, the system control unit 110 performs trimming processing and resizing processing on the VRAM data 211 by the mixer of the GPU 107. In addition, the system control unit 110 controls the memory control unit 108 to write the processed VRAM data 223 or 224 to the write destination VRAM address of the VRAM data 223 or 224 determined in step S3103.

  In step S3107, the system control unit 110 performs resizing processing without performing trimming processing on the VRAM data 211 by the mixer of the GPU 107. In addition, the system control unit 110 controls the memory control unit 108 to write the processed VRAM data 221 or 222 to the write destination VRAM address of the VRAM data 221 or 222 determined in step S3103.

  In step S3108, the system control unit 110 notifies the video output control unit 104 of the VRAM address that has been processed in steps S3104 and S3106 or S3107 and can be read out.

  Next, the drawing process of the OSD screen in FIG. FIG. 3C shows a task for outputting the VRAM data generated by each processing in FIGS. 3A and 3B by the video output control unit 104.

  In step S3201, the system control unit 110 determines whether or not the video frame synchronization period has elapsed. The synchronization period is determined based on the standard of video data output from the video output control unit 104 to the video output unit 105, the display unit 106, and the codec 103. The synchronization period is notified from the system timer 117 to the system control unit 110 by an interrupt.

  In step S3202, the system control unit 110 acquires the address of the VRAM read by the video output control unit 104. This VRAM address is the address notified in steps S3004 and S3108.

  In step S3203, the system control unit 110 controls the video output control unit 104 to read VRAM data from the VRAM address acquired in step S3202.

  In step S3204, the system control unit 110 performs video output control so that the superimposed video data 213 or 232 on which the VRAM data read in step S3203 is superimposed is output (simultaneously) to the video output unit 105, the display unit 106, and the codec 103. The unit 104 is controlled. If the aspect of the external monitor or display unit 106 is different from the aspect of the VRAM data read out in step S3203, the system control unit 110 displays the superimposed video data 233 to which letterbox or side black is applied in this step. The process to generate is also performed.

  <OSD Screen> Next, the OSD screen displayed on the display unit 106 and the external monitor in various operating states of the video camera 100 will be described with reference to FIGS.

  Depending on the OSD screen state determined in step S3101, the image data, GUI data, and OSD screen data generated in FIG. 3 are trimmed and resized to be applied to the following various screens: can do. In the following, the case where the aspect of the display unit 106 is 4: 3 and the aspect of the external monitor is 16: 9 is illustrated, but the present invention is not limited to this and can be applied to other aspect combinations. is there.

  FIG. 4A illustrates an OSD screen displayed on the display unit 106 during moving image reproduction in the moving image reproduction mode. 4101a to 4114a are all components of the GUI represented by the VRAM data 223 or 224. Reference numerals 4101a to 4111a denote buttons, which display an area for accepting a touch operation by the user and functions assigned to the buttons. Reference numerals 4112a to 4114a are GUI components indicating the information and the playback state of the moving image being played back.

  Reference numeral 4115a denotes a subject video corresponding to the VRAM data 203 or the VRAM data 204. Since the aspect of the subject video 4115a is 16: 9, the subject video 4115a is arranged in the center 16: 9 area of the display unit 106 in the video output control unit 104, and letterbox (black band) is applied to the upper and lower margins. Has been. In the GUI components 4101 a to 4114 a, the peripheral area of the VRAM data 223 or 224 is trimmed by the mixer of the GPU 107.

  FIG. 4B illustrates an OSD screen displayed on the external monitor during moving image reproduction in the moving image reproduction mode. Reference numerals 4101b to 4114b are GUI components represented by the VRAM data 221 or 222, and the same contents as 4101a to 4114a are respectively displayed.

  4115b is a subject image corresponding to the VRAM data 201 or 202, and the same content as 4115a is displayed on the entire screen. Since the image is not trimmed, the size of the GUI components 4101b to 4114b for the subject video 4115b is displayed slightly smaller than that in FIG. 4A. In addition, margins are secured in the peripheral area of the OSD screen so that GUI components are not lost even when overscanned by an external monitor.

  FIG. 5A illustrates an OSD screen displayed on the display unit 106 during still image display in the still image reproduction mode. 5201a to 5208a are all components of the GUI represented by the VRAM data 223 or 224. Reference numerals 5201a to 5205a denote buttons, which display an area for accepting a touch operation by the user, and functions assigned to the buttons. Reference numerals 5206a to 5208a are GUI components indicating information of still images being reproduced. Reference numeral 5209a denotes a subject video corresponding to the VRAM data 203 or 204.

  Since the aspect of the still image is 4: 3, the subject video 5209a is arranged on the entire screen of the display unit 106. Similarly, the GUI components 5201a to 5208a are displayed on the entire screen of the display unit 106, and the width of the VRAM data 211 is reduced to match the aspect ratio of 4: 3. I'm drawing. The resizing process performed by the mixer of the GPU 107 has a reduced reduction rate compared to FIG. 4A, so that the components of the GUI can be displayed larger without performing trimming.

  FIG. 5B illustrates an OSD screen displayed on the external monitor during still image display in the still image playback mode. 5201b to 5208b are GUI components represented by the VRAM data 221 or 222, and the same contents as those of 5201a to 5208a are displayed.

  Reference numeral 5209b denotes a subject video corresponding to the VRAM data 201 or 202, which displays the same content as 5209a.

  The subject video 5209b and the GUI components 5201b to 5208b are arranged in the center 4: 3 area of the external monitor by the video output control unit 104, and side black (black belt) is applied to the left and right margins. In addition, margins are secured in the peripheral area of the OSD screen so that GUI components are not lost even when overscanned by an external monitor.

  FIG. 6A illustrates an OSD screen displayed on the display unit 106 during the moving image list display in the moving image reproduction mode. 6301a to 6312a are all components of the GUI represented by the VRAM data 223 or 224. Reference numerals 6301a to 6305a denote buttons, which display an area for accepting a touch operation by the user and functions assigned to the buttons. Reference numerals 6306a to 6311a each denote a thumbnail representing one scene of the moving image, and are GUI components for receiving a touch operation by the user and reproducing the selected scene. 6312a is a component of the GUI that displays a directory of the recording medium 119 in which the data of the moving image scene indicated by the thumbnails 6306a to 6311a being displayed is stored. In this moving image list screen, since the GUI components 6301a to 6312a cover the entire screen, the subject video is not exposed.

  In order to display thumbnails as large as possible, GUI components 6301 a to 6312 a are arranged on the entire display unit 106. The components of the GUI are drawn by the renderer of the GPU 107 with respect to the VRAM data 211 in which the vertical length is enlarged and matched with the aspect ratio of 4: 3. The components of the GUI are displayed by trimming the peripheral area of the VRAM data by the GPU 107 mixer.

  FIG. 6B illustrates an OSD screen displayed on the external monitor during the moving image list display in the moving image reproduction mode. 6301b to 6311b are GUI components represented by VRAM data 221 or 222, and display the same contents as 6301a to 6311a, respectively. The components of the GUI are arranged in the center 4: 3 area of the external monitor by the video output control unit 104, and side black (black belt) is applied to the left and right margins. A margin is secured in the peripheral area of the OSD screen so that GUI components are not lost even when overscanned by an external monitor.

  FIG. 7A illustrates an OSD screen displayed on the display unit 106 during keyboard display for inputting characters. 7401a to 7404a are all components of the GUI represented by the VRAM data 223 or 224. Reference numerals 7401a to 7402a are buttons that display an area for accepting a touch operation by the user and a function assigned to the button. Each button surrounded by 7403a is a key button of the keyboard, and is a component of a GUI for receiving a touch operation by the user and executing an operation on a character string being input. 7404a is a component of the GUI indicating the character string being input. In this keyboard screen, the GUI components 7401a to 7404a cover and cover the entire screen, so the subject video is not exposed.

  The keyboard screen has many components of the GUI, and importance is placed on the visibility of characters. For this reason, the GUI components 7401a to 7404a are drawn on the 16: 9 VRAM data 211, and are vertically enlarged and the peripheral area is trimmed by the mixer of the GPU 107, and displayed on the entire screen of the display unit 106. Has been. In this case, the aspect ratio of the GUI components is displayed differently between rendering and display, but the keyboard screen does not include images or figures whose aspect ratio greatly affects the display quality. Characters can be displayed large without any particular inconvenience.

  FIG. 7B illustrates an OSD screen displayed on the external monitor during keyboard display for inputting characters. 7401b to 7404b are GUI components represented by the VRAM data 221 or 222, and the same contents as 7401a to 7404a are respectively displayed. The components of the GUI are arranged on the entire screen of the external monitor by the video output control unit 104. In FIG. 7B, the vertical and horizontal ratios of the components of the GUI match at the time of rendering and at the time of display. Further, since the trimming process is not performed, the size of the GUI component for the video is displayed slightly smaller than that in FIG. In addition, a margin is secured in the peripheral area of the OSD screen so that the components of the GUI are not lost even when overscanned by an external monitor.

FIG. 8A illustrates an OSD screen displayed on the display unit 106 in a decoration editing mode in which a trajectory (canvas) dragged on the touch panel 111 is recorded on a moving image. 8501a is a pattern drawn on the canvas. Although 8501a is not a component of the GUI, it is drawn with respect to the VRAM data 211 by the renderer of the GPU 107 and displayed by the VRAM data 223 or 224, similarly to 8502a to 8508a. 8502a to 8508a are components of the GUI displayed by the VRAM data 223 or 224. Reference numerals 8502a to 8506a denote buttons, which display an area for accepting a touch operation by the user and functions assigned to the buttons. 8507a is a component of the GUI indicating the recording state of the moving image. Reference numeral 8508a denotes a component of the GUI for indicating an area for accepting a drag operation as a canvas. 8 5 09 a is a subject video corresponding to the VRAM data 203 or 204.

On the decoration editing screen, it is necessary to display so that the overlapping position of the subject image and the canvas can be seen equally on both the display unit 106 and the external monitor. For this reason, the mixer of the GPU 107 does not perform trimming. The subject image 850 9 a, the GUI components 8502 a to 850 7 a, and the design 8501 a drawn on the canvas are arranged by the video output control unit 104 so as to be superimposed on the center 16: 9 area of the display unit 106. Letterbox (black belt) is applied to the margin.

  FIG. 8B illustrates an OSD screen displayed on the external monitor in the decoration editing mode. Reference numeral 8501b denotes a canvas represented by VRAM data 221 or 222, which displays the same content as 8501a. Reference numeral 8509b denotes a subject video corresponding to the VRAM data 201 or 202, which displays the same content as 8509a.

  The decoration editing screen is based on the premise that the user operates the touch panel 111 while viewing the video being displayed on the display unit 106, and the external monitor can be specified for viewing by a third party. For this reason, GUI components are not superimposed on the external monitor, and only the subject video and the canvas are superimposed and displayed. The subject video and the canvas are arranged so as to overlap the entire screen of the external monitor, and the display by the display unit 106 is controlled so that the overlapping position of the subject video and the canvas can be seen equally.

  In addition to the above-described decoration editing screen, a similar effect can be obtained by not performing trimming even when the relative position with respect to the subject video is important, such as in the face frame display mode.

  As described above, according to the present embodiment, the field of view of the subject image satisfies 100% in both the display unit (liquid crystal panel) and the external monitor, and the GUI components are displayed relatively large. Can do. Specifically, when the OSD screen is output to the display unit and the external monitor at the same time, the GUI screen of the display unit can be enlarged by about 10% in the vertical and horizontal directions. Accordingly, even a small video camera or a video camera equipped with a liquid crystal panel with a small number of pixels can easily recognize characters and icons, and can improve the collapse due to the insufficient number of pixels.

  In addition, even when the aspect of the image is different from that of the display unit, it is possible to display characters and icons by utilizing the pixels of the liquid crystal panel as effectively as possible. In addition, while the margin of the peripheral area of the screen necessary for the external monitor is ensured, the display unit can display the entire screen, thereby avoiding restrictions on the GUI layout design.

  Furthermore, since the OSD for the display unit and the OSD for the external monitor can be drawn by a single drawing process, the drawing process can be performed efficiently, and real-time display such as time codes can be easily realized.

  The control of the system control unit 110 may be performed by a single piece of hardware, or the entire apparatus may be controlled by a plurality of pieces of hardware sharing the processing.

  Although the present invention has been described in detail based on the preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms without departing from the gist of the present invention are also included in the present invention. included. Furthermore, each embodiment mentioned above shows only one embodiment of this invention, and it is also possible to combine each embodiment suitably.

  In the above-described embodiment, the case where the present invention is applied to an imaging apparatus such as a digital video camera has been described as an example. However, the present invention is not limited to this example, and for example, a video and a GUI are superimposed. Any device that can synthesize and display an OSD screen is applicable. That is, the present invention can be applied to a personal computer, a PDA, a mobile phone terminal, a portable image viewer, a printer device including a display, a digital photo frame, a music player, a game machine, an electronic book reader, and the like.

  [Other Embodiments] The present invention is also realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, etc.) of the system or apparatus reads and executes the program code. It is processing to do. In this case, the program and the storage medium storing the program constitute the present invention.

Claims (11)

First acquisition means for acquiring a video;
Second acquisition means for acquiring a screen for superimposition for superimposing on the video;
An external first display means, an output means capable of outputting to the second display means,
When outputting to the first display unit, a first process of outputting a superimposed video in which the entire area of the superimposition screen is superimposed on the video acquired by the first acquisition unit is executed. When outputting to the second display means, the video acquired by the first acquisition means is not completely transmitted from the entire area of the superimposition screen when superimposed on the video. to perform a second process of cutting out a partial screen to exclude peripheral region, and outputs the superimposed image obtained by superimposing the partial screen resized to fit the second display means in all of the periphery of the display item And an output control means for controlling the video output device.   The predetermined display item for the video on the second display means is displayed larger than the predetermined display item for the video on the superimposing screen for the video on the first display means. Item 2. The video output device according to Item 1.   3. The video output apparatus according to claim 1, wherein, when outputting to the first display unit, the superimposed video is output while leaving the peripheral area in the superimposing screen. 4. .   When the output control means outputs a superimposed video in which a superimposition screen on which a superimposition corresponding to a trajectory input by a user is drawn is superimposed on the video acquired by the first acquisition means is output to the second display means. The control is performed so that the superimposition screen on which the superimposed object is drawn is not cut out so that the overlapping position of the superimposed image and the image acquired by the first acquisition unit can be seen equally. Item 4. The video output device according to any one of Items 1 to 3. A recording means to record the encoded said superimposed image,
Said output control means, said first display means the superimposed image, any one of claims 1 to 4, wherein the controller controls so as to output simultaneously to the second display means and said recording means The video output device described in 1. The output control means performs a process of providing a margin in the superimposed video when the screen aspect of the first display means and the second display means is different from the superimposed video. The video output device according to claim 1 . In the case where the output control means superimposes the superimposition corresponding to the trajectory input by the user on the video acquired by the first acquisition means , the first display means displays the video on the video. video output device according to any one of claims 1 to 6, wherein the controller controls so as not to output the superimposing the superimposed screen. The video output device, video output apparatus according to any one of claims 1 to 7, characterized in that captures a subject image which is an image pickup apparatus that generates image data. A first acquisition step of acquiring a video;
A second acquisition step of acquiring a screen for superimposition for superimposing on the video;
An external first display means and an output step capable of outputting to the second display means;
When outputting to the first display means, a first process is performed to output a superimposed video in which the entire area of the superimposition screen is superimposed on the video acquired in the first acquisition step. When outputting to the second display means, the image acquired in the first acquisition step is not completely transmitted from the entire area of the superimposition screen when superimposed on the image. to perform a second process of cutting out a partial screen to exclude peripheral region, and outputs the superimposed image obtained by superimposing the partial screen resized to fit the second display means in all of the periphery of the display item An output control step for controlling the video output device. The computer program to function as each unit of the video output device according to any one of claims 1 to 8. Computer, storage medium storing a program to function as each means of the image output device according to any one of claims 1 to 8.

Images