JP5624658B2 - Data processing apparatus, method, and control program - Google Patents

Description

  The present invention relates to a data processing apparatus, and more particularly to a data processing apparatus, method and control program for encoding information data and outputting the data to the outside.

  Conventionally, an MP4 file format is known as a file format for recording moving image signals and audio signals on a recording medium (see Patent Document 1). In the MP4 format, an area for storing management information necessary for reproducing and decoding moving pictures and audio is provided in addition to an area for storing encoded moving picture signals and audio signals.

  The management information includes data size information. The size of the data is not fixed until the recording of the moving image or sound is actually stopped. Therefore, for example, it is conceivable to create management information during recording of a moving image, store it in a buffer memory or the like inside the apparatus, and record the management information on a recording medium after stopping the recording of the moving image.

JP 2006-074531 A

  It is also possible to convert a moving image or sound into an MP4 file format while encoding it and send it to the outside via a network or the like. A configuration in which the apparatus that receives the MP4 file transmitted in this way sequentially decodes the data of the MP4 file is conceivable.

  However, as described above, in the configuration in which the management information is generated and transmitted after the instruction to stop recording (encoding) the moving image, the receiving device receives the previously received moving image or sound until the management information is received. There was a problem that it could not be decrypted.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to enable a receiving side to quickly reproduce information data when an information data file including management information is transmitted to the outside.

In order to solve the above-described problems of the prior art, the data processing apparatus of the present invention has a plurality of storage units each including size information, and the plurality of storage units are used to store encoded information data. Information generated by generating one or more first storage units and one or more second storage units for storing management information related to information data stored in the first storage units In a transmission mode in which a file is transmitted by a transmission unit, a first storage unit is generated for each predetermined amount of encoded information data, and a second storage unit corresponding to the generated first storage unit is generated. Create one information file.

  According to the present invention, when an information data file including management information is transmitted to the outside, the received information data can be quickly decoded.

It is a block diagram which shows one structural example of the data processor which concerns on embodiment of this invention. It is a figure which shows the structure of MP4 file. It is a figure which shows the flowchart of the operation example in one structural example of the data processor concerning embodiment of this invention. It is a figure which shows the flowchart of the process of the 1st mode concerning embodiment of this invention. It is a figure which shows the structure of the moving image file in 1st mode. It is a figure which shows the flowchart of the process of the 2nd mode concerning embodiment of this invention. It is a figure which shows the structure of the moving image file in 2nd mode. It is a block diagram which shows the other structural example of the data processor which concerns on embodiment of this invention. It is a figure which shows the flowchart of the operation example in the other structural example of the data processor concerning embodiment of this invention. It is a figure which shows the flowchart of the other operation example in the other structural example of the data processor concerning embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

First Embodiment FIG. 1 is a block diagram illustrating a configuration example of a data processing apparatus 100 according to an embodiment of the present invention.
In FIG. 1, an input unit 101 acquires and outputs moving image data and audio data. In the present embodiment, the input unit 101 inputs moving image data and audio data supplied from the outside of the data processing apparatus 100. However, the input unit 101 may include an image capturing unit and a microphone, and a moving image captured by the image capturing unit and a sound collected by a microphone may be acquired as data.

  At the time of recording, the signal processing unit 102 converts the moving image data and audio data input by the input unit 101 to H.264. It is encoded according to a known encoding format such as H.264 (MPEG4 AVC) and the amount of information is compressed. Also, processing necessary for recording moving image data and audio data is performed. Further, at the time of reproduction, the signal processing unit 102 decodes the reproduced moving image data and audio data, and expands the information amount. In addition, the signal processing unit 102 outputs information on the amount of encoded moving image data and audio data (data amount) to the control unit 102 during recording.

  The memory 103 stores moving image data and audio data. Each block of the data processing apparatus 100 processes the necessary moving image data and audio data by accessing the memory 103. In addition to moving image data and audio data, the memory 103 stores various information such as file system information and moving image file management information, and further functions as a work memory for control by the control unit 106. Fulfill.

  As will be described later, the file data processing unit 104 generates various management information defined in the MP4 file at the time of recording. At the time of reproduction, the file data processing unit 104 processes the reproduced management information, and the contents are processed by the control unit 106. To inform. The display unit 105 displays various information such as input or played video or menu information.

  The control unit 106 controls the entire operation of the data processing apparatus 100 according to the input from the operation input unit 107. The control unit 106 includes a microcomputer, a memory, and the like, and controls the data processing apparatus 100 according to a program stored in a memory (not shown). The operation input unit 107 includes various switches that can be operated by the user, receives various instructions from the user, and notifies the control unit 106 of them. The operation input unit 107 includes a power switch, a switch for instructing start and stop of recording, a switch for switching the mode of the data processing apparatus 100, and the like.

  The recording / reproducing unit 108 records moving image data, audio data, or various types of information on the recording medium 109 and reproduces these data from the recording medium 109. At the time of recording, the recording / playback unit 108 records management information, moving image data, or audio data stored in the memory 103 in a file format in a file format as will be described later. The recording / reproducing unit 106 reproduces the management information, moving image data, and audio data of the moving image file from the recording medium 109 and stores them in the memory 103 during reproduction. In the present embodiment, the recording medium 109 is a randomly accessible recording medium such as a hard disk (HDD) or a flash memory card.

  The recording / playback unit 108 manages the moving image file to be recorded on the recording medium 109 and various types of information as files according to a file system such as FAT (File Allocation Table). Further, the recording medium 109 is configured to be easily mounted and ejected from the data processing apparatus 100 by an unillustrated mounting / discharging mechanism, but the recording medium 109 is built in the data processing apparatus 100. But you can.

  When writing and reading a moving image file to / from the recording medium 109, the control unit 106 controls the recording / reproducing unit 108 to reproduce file system data (management data) from the recording medium 109 and store it in the memory 103. The file system data is data indicating the file name, file size, data recording address, and the like of data recorded on the recording medium 109, and is management information for managing the file. Then, the control unit 106 controls file writing and reading according to the read file system data. The control unit 106 updates the file system data stored in the memory 103 in accordance with the writing of the file to the recording medium 109. The updated file system data is recorded on the recording medium 109 by the recording / playback unit 108.

  The external interface (IF) 110 receives a moving image file generated by a user's recording instruction and transmits the moving image file to the external device 113 via the network 112 when the data processing apparatus 100 is set to the external transmission mode. To do.

  Next, information files handled in this embodiment will be described. In the present embodiment, moving image data and audio data are recorded or transmitted according to the MP4 file format. An MP4 file is composed of units called boxes. FIG. 2 shows the configuration of one box 201. One box 201 includes areas of box-size, box-type, and box-data. The box-size stores information (size information) on the data length (bytes) of the box. Information indicating the data type stored in box-data is stored in box-type, and actual data is stored in box-data. Box-type is a 32-bit fixed-length data area, and box-data is a variable-length area. Since box-size is 32 bits, the size of one box is usually 0xFFFFFFFF bytes or less.

  202 and 203 in FIG. 2 are diagrams showing an example of the configuration of an MP4 file (information file) handled in this embodiment. The files 202 and 203 are composed of a plurality of boxes 201. The file 202 is composed of three storage units: FileTypeBox (ftyp-box), MovieBox (moov-box), and MediaDataBox (mdat-box).

  ftyp is a box in which box-type is ftyp and information on file compatibility is stored. Based on the box-data described in ftyp, it is possible to determine the encoding method of moving image data and audio data stored in the MP4 file.

  moov is a box in which box-type is moov and management information regarding moving image data and audio data is stored. The moov box-data stores information such as a chunk offset indicating an offset from the beginning of a chunk of moving image data or audio data, the number of samples of each chunk, and the sample size. The state of the moov box is shown at 204 in FIG. moov contains mvhd and one or more traks. The trak box is information that defines one or more video tracks, video, and audio tracks. trak includes tkhd and mdia. mdia is information describing the media type of each track. mdia includes mdhd and stbl. stbl stores information such as a chunk offset indicating an offset from the beginning of a chunk of moving image data or audio data, the number of samples of each chunk, the display time of the sample, and the sample size. Here, one sample of moving image data corresponds to a frame, and one sample of audio data corresponds to an audio frame.

  mdat is a box whose box-type is mdat and each sample of moving image data and audio data is stored. The encoded moving image data and audio data are divided and stored in units of chunks. In the present embodiment, one chunk of moving image data is assigned to H.264. The video data is 1 GOP defined by the H.264 system. Further, one chunk of audio data is set as audio data of the number of frames corresponding to this 1 GOP.

  As shown in the file 203, it is also possible to use MovieFragmentBox (moof-box) for dividing and arranging the mdat box into a plurality of parts. In moof, box-type is moof, and management information of moov and the following mdat box is stored in box-data. The file 203 includes one moov box and n moof boxes. The configuration of the moof box is shown at 205 in FIG. The moof box-data contains mfhd and one or more traf. In mfhd, a fragment sequence number is stored. The traf box is information that defines one or more video tracks, or video and audio tracks. Each traf includes tfhd and trun. tfhd stores a default value of the length and size of each chunk stored in the following mdat. trun stores these values when the display time and size of the sample stored in each chunk stored in the subsequent mdat changes in units of samples. In addition, when the size of each chunk stored in mdat is different, information on the offset value from the beginning of mdat to the beginning of each chunk is also stored in trun.

  In addition, in movia and stbl of moov, information such as size and offset regarding a plurality of chunks constituting each track is stored in one box-data. On the other hand, trun of moof stores information such as size and offset related to one chunk. Therefore, the same number of trun boxes as the number of chunks stored in mdat later is stored in moof.

  In this way, one MP4 format file 203 is constituted by one moov box, one or more mdat boxes (a plurality of first storage units), and one or more moof boxes (a plurality of second storage units). can do. The sizes of moov, mdat, and moof vary depending on the number of moving image and audio sample data, that is, the recording time and the amount of moving image and audio data after compression.

  Next, a moving image recording process and an external transmission process will be described. In the present embodiment, the processing described using the flowchart of the drawing is realized by the control unit 106 controlling each unit by loading and executing a program stored in a memory (not shown).

  FIG. 3 is a flowchart showing processing during recording. The user operates the operation input unit 107 to record an input moving image or sound in the recording medium 108 and a transmission mode in which the input moving image or sound is not recorded but transmitted to the outside. Either can be selected. When the control unit 106 receives a recording start instruction from the operation input unit 107 in a state where either the recording mode or the transmission mode is selected in this way, the control unit 106 determines the set mode (S301).

  The control unit 106 executes the first mode process when the recording mode is set (S302), and executes the second mode process when the transmission mode is set (S303). Each mode process generates an information file in a format suitable for the output destination.

  The first mode process will be described. FIG. 4 is a flowchart of the first mode process. FIG. 5 is a diagram showing the state of data stored in the memory 102 and data recorded on the recording medium 108 in the first mode processing.

  Upon receiving an instruction to start recording, the control unit 106 instructs the file data processing unit 104 to generate ftyp, moov, and mdat data. The file data processing unit 104 generates ftyp and stores it in the memory 103 (S401). Further, the file data processing unit 104 generates a moov box in which invalid values (dummy data) are stored in box-size and box-data, and stores them in the memory 103 (S402). Further, the file data processing unit 104 generates an mdat box in which an invalid value (dummy data) is stored in box-size, and stores it in the memory 103 (S403). The configuration of data stored in the memory 103 at this time is indicated by reference numeral 501 in FIG. In FIG. 5, an invalid value (dummy data) is stored in the area indicated by (d).

  Next, the control unit 106 causes the signal processing unit 102 to start encoding moving image data and audio data. The signal processing unit 102 encodes the moving image data and audio data sequentially stored in the memory 103, and stores the encoded moving image data and audio data in the memory 103 (S404). At this time, the signal processing unit 102 stores the moving image data and audio data in the box-data area in the moov box. Further, the signal processing unit 102 outputs information such as the encoded moving image data and the sample data size of the audio data to the file data processing unit 104 and the control unit 107. The configuration of the data stored in the memory 103 at this time is indicated by 502 in FIG.

  In this way, encoding of moving image data and audio data is continued, and in response to the amount of unrecorded data stored in the memory 103 reaching a predetermined amount, the control unit 107 instructs the recording / reproducing unit 108. To record data. The recording / playback unit 108 reads unrecorded data from the memory 103 in the order of ftyp, moov, mdat, and records the data in the recording medium 109 (S405).

  Then, the control unit 106 stores the encoded moving image data and audio data in the memory 103 continuously until a recording stop instruction is issued, and further continues the recording process on the recording medium 109. The configuration of the data stored in the memory 103 and the data recorded in the recording medium 109 at this time is indicated by reference numeral 503 in FIG.

  When receiving an instruction to stop recording from the operation input unit 107 (S406), the control unit 106 instructs the signal processing unit 102 to stop the encoding processing of the moving image and the sound and also instructs the recording / reproducing unit 108. Instruct to stop recording on the recording medium 109. When the recording / reproducing unit 108 reads out the unrecorded mdat data stored in the memory 103 and records it in the recording medium 109, the recording / reproducing unit 108 stops the recording (S407). The state of the data stored in the memory 103 and the data recorded in the recording medium 109 at this time is indicated by reference numeral 504 in FIG.

  Next, the control unit 106 instructs the recording / reproducing unit 108 to read the data in the moov box and the box-size data in the mdat box from the MP4 file recorded in the recording medium 109 (S408). The recording / playback unit 108 reads the data in the moov box and the box-size data in the mdat box from the MP4 file recorded in the recording medium 109 and stores the data in the memory 103. The state of the data stored in the memory 103 and the data recorded in the recording medium 109 at this time is indicated by reference numeral 505 in FIG. As shown at 505, the moov box data stored in the memory 103 and the box-size data in the mdat box each contain invalid values.

  Next, the control unit 106 instructs the file data processing unit 104 to change the invalid values of the moov box data stored in the memory 103 and the box-size data in the mdat box to correct values. The file data processing unit 104 calculates the size of the moov box and the size of the mdat box based on information such as the sample data size output from the signal processing unit 102 during recording of moving images and audio. Also, the file data processing unit 104 generates moov box data based on information such as the sample data size output from the signal processing unit 102 during recording, and changes the moov box-data (S409). The state of the data stored in the memory 103 and the data recorded in the recording medium 109 at this time is indicated by reference numeral 506 in FIG.

  As described above, when the invalid value stored in the memory 103 is changed by the file data processing unit 104, the control unit 106 instructs the recording / reproducing unit 108 to record the updated data. The recording / playback unit 108 reads the data in the moov box and the box-size data in the mdat box from the memory 103, and updates the data recorded in the original MP4 file with the read data (S410). The state of the data stored in the memory 103 and the data recorded in the recording medium 109 at this time is indicated by reference numeral 507 in FIG.

  As a result, the data of the MP4 file finally recorded on the recording medium 109 is in the format 202 in FIG.

  Next, the second mode process will be described. FIG. 6 is a flowchart of the second mode process. FIG. 7 is a diagram illustrating a configuration of data stored in the memory 102 and data transmitted by the external IF 110 in the second mode processing.

  Upon receiving an instruction to start transmission, the control unit 106 instructs the file data processing unit 104 to generate ftyp, moov, and mdat data. The file data processing unit 104 generates ftyp and stores it in the memory 103 (S601). Further, the file data processing unit 104 generates a moov box in which invalid values (dummy data) are stored in box-size and box-data, and stores them in the memory 103 (S602). Further, the file data processing unit 104 generates an mdat box in which an invalid value (dummy data) is stored in box-size, and stores the mdat box in the memory 103 (S603). A state of data stored in the memory 103 at this time is indicated by reference numeral 701 in FIG. In FIG. 7, an invalid value (dummy data) is stored in the area indicated by (d).

  Next, the control unit 106 causes the signal processing unit 102 to start encoding moving image data and audio data. The signal processing unit 102 encodes the moving image data and audio data sequentially stored in the memory 103, and stores the encoded moving image data and audio data in the memory 103 (S604). That is, the signal processing unit 102 stores the moving image data and audio data in the box-data area in the mdat box. Further, the signal processing unit 102 outputs information such as the encoded moving image data and the sample data size of the audio data to the file data processing unit 104 and the control unit 107. A configuration of data stored in the memory 103 at this time is indicated by reference numeral 702 in FIG.

  In this way, encoding of moving image data and audio data is continued until an instruction to stop transmission is received from the operation input unit 107. If there is no instruction to stop transmission (S605), the control unit 106 transmits the untransmitted code stored in the memory 103 based on the encoded moving image data and audio data information from the signal processing unit 102. It is determined whether or not the data amount of the digitized data has reached a predetermined amount L (S609).

  When the data amount of the untransmitted encoded data stored in the memory 103 has not reached L, the encoding of the moving image data and the audio data is continued as it is. Here, the predetermined value L can be determined based on, for example, the amount of encoded moving image data and audio data that can be stored in the memory 103. That is, it can be determined based on the number of frames of moving image data that can be stored in the memory 103 based on the average data rate of the encoded moving image data and audio data.

  When the data amount of the untransmitted encoded data stored in the memory 103 reaches a predetermined value L, the control unit 106 sets the predetermined amount of the compressed moving image data stored in the memory 103 at that time. The frame just before reaching is detected. Further, the control unit 106 detects a frame of audio data corresponding to the frame immediately before reaching the predetermined value from the compressed audio data stored in the memory 103. Then, from the transmission start instruction, one mdat box is generated from the moving image data up to the frame immediately before reaching the predetermined value and the audio data up to the corresponding audio frame, and the mdat box is divided. In the present embodiment, the amount of encoded moving image data varies from frame to frame. Therefore, the number of frames of encoded moving image data corresponding to the predetermined value L is not constant. In this embodiment, when the data amount of untransmitted encoded data stored in the memory 103 reaches a predetermined value L, the moving image data is divided in units of frames. Also, the audio data corresponding to the divided frames of the moving image data is divided in units of audio frames.

  The control unit 106 instructs the file data processing unit 104 to change the invalid values of the moov box data stored in the memory 103 and the box-size data in the mdat box to correct values.

  The file data processing unit 104 calculates the size of the moov box and the size of the mdat box based on information such as the sample data size output from the signal processing unit 102 during the recording of the moving image and the sound, and the box-size data To change. Further, the file data processing unit 104 generates moov box data based on information such as the sample data size output from the signal processing unit 102 during recording, and changes the moov box-data (S610). In addition, the file data processing unit 104 stores the track information of moving image data and audio data (data relating to reproduction compatibility of moving images and audio, such as a compression format) in the data-box of moov. By this process, one moov box is generated. A configuration of data stored in the memory 103 at this time is indicated by reference numeral 702 in FIG.

  Then, the control unit 106 instructs the external IF 110 to transmit unsent data including the ftyp box, one moov box updated in this way, and one mdat box to the outside. The external IF 110 reads untransmitted data from the memory 103 and transmits it to the network 112 (S611). At this time, the external IF 110 first transmits the ftyp box, and then transmits the moov box and the mdat box in this order. Then, when the transmission of the designated untransmitted data is completed, the external IF 110 stops the transmission.

  Next, the control unit 106 instructs the file data processing unit 104 to newly generate a moof box and an mdat box. The file data processing unit 104 newly generates a moof box in which invalid values (dummy data) are stored in box-size and box-data, and stores them in the memory 103 (S612). The file data processing unit 104 generates an mdat box storing an invalid value (dummy data) in box-size and stores it in the memory 103 (S603). The state of the data stored in the memory 103 at this time and the transmitted data are indicated by reference numeral 703 in FIG.

  Then, encoding of moving image data and audio data is continued. When there is no instruction to stop transmission and the data amounts of untransmitted encoded moving image data and audio data stored in the memory 103 reach L, the control unit 106 stores the moving image data stored in the memory 103 at that time. And one mdat box is generated with the corresponding audio data.

  Then, the control unit 106 changes the invalid value of the moof box data stored in the memory 103 and the box-size data in the mdat box to a correct value according to the MP4 file format, with respect to the file data processing unit 104. I will tell you. The file data processing unit 104 calculates the size of the moof box and the size of the mdat box based on information such as the sample data size output from the signal processing unit 102 during the recording of the moving image and the sound, and the box-size data To change. Also, the file data processing unit 104 generates moof box data based on information such as the sample data size output from the signal processing unit 102 during recording, and changes the box-data of the moof (S610). The configuration of the data stored in the memory 103 at this time and the transmitted data is shown at 704 in FIG. Here, as described above, the management information of the moving image data stored in mdat transmitted after moof is stored in moof.

  Then, the control unit 106 instructs the external IF 110 to transmit unsent data including the updated moof box and mdat box to the outside. The external IF 110 reads untransmitted data from the memory 103 and transmits it to the network 112 (S611). Then, when the transmission of the designated untransmitted data is completed, the external IF 110 stops the transmission.

  Next, the control unit 106 instructs the file data processing unit 104 to newly generate a moof box and an mdat box. The file data processing unit 104 newly generates moof box data in which invalid values (dummy data) are stored in box-size and box-data, and stores them in the memory 103 (S612). The file data processing unit 104 generates an mdat box storing an invalid value (dummy data) in box-size and stores it in the memory 103 (S603). The configuration of the data stored in the memory 103 at this time and the transmitted data is indicated by reference numeral 705 in FIG.

  Thereafter, the same process is repeated until an instruction to stop transmission is received. When receiving an instruction to stop transmission from the operation input unit 107 (S605), the control unit 106 instructs the signal processing unit 102 to stop the encoding of the moving image and the audio. In addition, the control unit 106 generates one mdat box from the moving image data and audio data stored in the memory 103 when an instruction to stop transmission is given.

  Then, the control unit 106 instructs the file data processing unit 104 to change the invalid value of the moof box data stored in the memory 103 and the box-size data in the mdat box to a correct value. The file data processing unit 104 calculates the size of the moof box and the size of the mdat box based on information such as the sample data size output from the signal processing unit 102 during the recording of the moving image and the sound, and the box-size data To change. Also, the file data processing unit 104 generates moof box data based on information such as the sample data size output from the signal processing unit 102 during recording, and changes the box-data of the moof (S606). The configuration of the data stored in the memory 103 at this time and the data already transmitted is indicated by reference numeral 706 in FIG.

  Then, the control unit 106 instructs the external IF 110 to transmit unsent data including the updated moof box and mdat box to the outside. The external IF 110 reads untransmitted data from the memory 103 and transmits it to the network 112 (S607). Then, when the transmission of the designated untransmitted data is completed, the external IF 110 stops the transmission (S608). The configuration of the data stored in the memory 103 at this time and the transmitted data is shown at 707 in FIG. As a result, the format of the moving image file to be transmitted is the format indicated by 203 in FIG.

  As described above, in the present embodiment, in the case where the encoded data is recorded on the recording medium in accordance with the MP4 file format while the information data such as the moving image or the audio is encoded, the invalid value is stored in the management information and recorded. Record on media. Then, after the recording is stopped, the value of the management information recorded on the recording medium is updated. Therefore, since management information is stored during recording, it is not necessary to prepare a large-capacity memory.

  In the present embodiment, when the encoded data is transmitted to the outside in accordance with the MP4 file format while encoding the moving image and the sound, the amount of data of the encoded moving image and the sound has reached a predetermined value. Depending on, multiple mdat boxes are created one by one. Then, moov (moof) data is transmitted together with each mdat box. At this time, data is transmitted in the order of ftyp → moov (moof) → mdat box. Therefore, the receiving device can sequentially decode and output the received data.

  In this embodiment, the moving image and the sound are encoded and recorded or transmitted according to the MP4 file format. However, other formats can be used. For example, the present invention can be similarly applied to any configuration in which management information such as data size is provided before moving image data and audio data.

  In the present embodiment, the first mode process and the second mode process are switched according to the selected mode among the recording mode and the transmission mode. However, the present embodiment is not limited to this. For example, when generating a file for recording data on a rewritable recording medium, the first mode process is executed, and a file for recording data on a write-once recording medium in which the recording data cannot be rewritten is generated. Then, the second mode process may be executed. In other words, the format of the file may be determined as either the type shown in the file 202 in FIG. 2 or the type shown in the file 203 depending on the output destination of the generated file.

  Further, in the present embodiment, the mdat is divided (for each predetermined amount) according to the fact that the data amount of the untransmitted encoded moving image and audio data stored in the memory 103 has reached the predetermined value L. A configuration may be adopted in which mdat is divided in response to the amount of moof data reaching a predetermined value M.

  For example, in the memory 103, a storage area for moof and a storage area for mdat are allocated in advance. Then, mdat is divided and transmitted in response to the data stored in the storage area of moof reaching a predetermined value M (M <L). In this case, even if the data amount of the untransmitted encoded moving image and audio data stored in the mdat storage area does not reach the predetermined value L, the mdat is divided at that time.

Second Embodiment Next, a second embodiment will be described. In the present embodiment, a process of reproducing recorded MP4 format data and transmitting it to the outside will be described. Also in the present embodiment, the processing described using the flowchart in the drawing is realized by the control unit 106 controlling each unit by loading and executing a program stored in a memory (not shown).

  FIG. 8 is a diagram illustrating a configuration of the data processing device 100 according to the second embodiment. In the apparatus of FIG. 8, a conversion unit 114 is added to the configuration of FIG. In this embodiment, the number of pixels on one screen of the moving image data reproduced from the recording medium 109 can be changed, and the changed moving image data can be transmitted to the outside. In the apparatus of FIG. 8 as well, the processes of FIGS. 3, 4, and 6 can be executed as in the first embodiment. Hereinafter, transmission processing of a moving image file recorded on the recording medium 109 in the apparatus of FIG. 8 will be described.

  The user can set whether or not to change the number of pixels of the moving image to be transmitted from the operation input unit 107 before transmitting the moving image file recorded on the recording medium 109. In the present embodiment, the number of pixels per screen of moving image data recorded on the recording medium 109 by the processing of FIG. 4 is set as the first number of pixels. Then, the user can instruct to convert the number of pixels of the moving image recorded on the recording medium 109 to the second number of pixels smaller than the first number of pixels and transmit the converted number to the outside.

  FIG. 9 is a flowchart showing processing for transmitting a moving image file recorded on the recording medium 109 to the outside of the apparatus. The processing in FIG. 9 is executed by the control unit 106 controlling each unit.

  When the number of pixels of the moving image to be transmitted is set by the user and the transmission of the moving image file is instructed, the process is started. First, the control unit 106 determines the number of pixels of the moving image to be transmitted (S901). When the number of pixels of the moving image to be transmitted is the same first pixel number as the recorded moving image, the control unit 106 instructs the recording / reproducing unit 108 to reproduce the designated moving image file. The recording / playback unit 108 sequentially reads the designated moving image file from the recording medium 109 and stores it in the memory 103. Then, the control unit 106 instructs the external IF 110 to transmit the moving image file data stored in the memory 103 to the outside. The external IF 110 reads the data of the moving image file stored in the memory 103 and sequentially transmits the data to the external device 113 via the network 112 (S902).

  When receiving an instruction to stop transmission from the operation input unit 107 or when the reproduction of the moving image file being reproduced is completed (S903), the control unit 106 stops the reproduction of the moving image file by the recording / reproducing unit 108. Let At the same time, the transmission of the MP4 file by the external IF 110 is also stopped (S904).

  On the other hand, when the number of pixels of the moving image to be transmitted is the second number of pixels in S901, the control unit 106 instructs the recording / reproducing unit 108 to reproduce the designated moving image file. The recording / playback unit 108 sequentially reads the designated moving image file from the recording medium 109 and stores it in the memory 103 (S905). Next, the file data processing unit 104 detects the data in the moov box included in the reproduced moving image file while parsing the MP4 file data stored in the memory 103. Then, necessary data such as the sample data size in the moov is acquired and sent to the control unit 106. Based on the data sent from the file data processing unit 104, the control unit 106 instructs the recording / playback unit 108 to sequentially read the data of the moving image file from the recording medium 109. In addition, the control unit 106 instructs the signal processing unit 102 to decode the moving image data and audio data in the mdat box. The signal processing unit 102 reads and decodes the moving image data and audio data encoded from the memory 103, and stores them in the memory 103 (S906).

  The control unit 106 instructs the conversion unit 114 to change the number of pixels of the decoded moving image data to the second number of pixels. The conversion unit 114 sequentially reads each frame of the moving image data decoded from the memory 103, and changes the number of pixels of each frame from the first number of pixels to the second number of pixels. Then, the conversion unit 114 stores the moving image data of the second number of pixels in the memory 103 (S907).

  Next, the control unit 106 executes the second mode process described above, converts the moving image data and audio data of the second number of pixels stored in the memory 103 into the MP4 file format, and transmits the MP4 file format from the external IF 110. (S908). In the first embodiment, the moving image data and audio data obtained by the input unit 101 are encoded, converted into the MP4 file format, and transmitted. In the present embodiment, not the moving image data and the audio data from the input unit 101 but the moving image data reproduced from the recording medium 109 and converted into the second number of pixels by the converting unit 114 as described above. Encode audio data. Then, the encoded moving image data and audio data are converted into the MP4 file format by the process of FIG. 6 and transmitted from the external IF 110 to the external device 113 via the network 112.

  In this way, when the number of pixels of a moving image reproduced from a recording medium is converted, encoded and transmitted again, the size of the moving image data is not determined until all the moving images of the transmission target file are encoded.

  Therefore, in the present embodiment, when the number of pixels of the reproduced moving image is converted and then encoded again and transmitted to the outside, one mdat is determined according to the predetermined amount of moving image and audio being encoded. Create a box. And moov (moof) data is transmitted with this mdat box. Therefore, the receiving device can sequentially decode and output the received data.

  In the present embodiment, the present invention has been described by taking the example of converting the number of pixels of the reproduced encoded moving image data and transmitting it to the outside. However, the present invention is not limited to this. For example, the present invention can be applied to decoding and re-encoding of reproduced data even when frame rate conversion (for example, frame decimation) is performed instead of or in addition to the conversion of the number of pixels. it is obvious.

Third Embodiment Next, a third embodiment will be described. The data processing apparatus 100 in the third embodiment is the same as that in FIG. Also in the third embodiment, similarly to the first and second embodiments, the processes of FIGS. 3, 4, 6, and 9 can be executed. In the third embodiment, when the moving image file is transmitted to the external device, the predetermined value L is set based on the size of the buffer memory for temporarily storing the moving image file received by the external device.

  Hereinafter, the moving image file transmission processing in the third embodiment will be described. Also in the present embodiment, the processing described using the flowchart in the drawing is realized by the control unit 106 controlling each unit by loading and executing a program stored in a memory (not shown).

  FIG. 10 is a diagram illustrating a flowchart of processing during recording in the third embodiment. Note that the same processes as those in FIG. 3 are denoted by the same reference numerals, and detailed description thereof is omitted. When the transmission mode is set when the recording start instruction is received, the control unit 106 sets the size of the buffer memory for temporarily storing the moving image file received by the external device 113 by the external IF 110. Contact The external IF 110 receives information related to the size of the buffer memory from the external device 113 and notifies the control unit 106 of the information (S1001). Based on the size of the buffer memory received by the external IF 110, the control unit 106 sets the predetermined value L used in the transmission mode to be smaller than the size of the buffer memory (S1002). Thereafter, as described above, the second mode process is executed (S303).

  As described above, in the present embodiment, the size of the buffer memory in the external device to which the moving image file is transmitted is acquired in the transmission mode. A predetermined value L is set so as not to exceed the size of the buffer memory.

  Therefore, the size of each mdat box of the moving image file transmitted in the transmission mode is smaller than the size of the buffer memory of the external device 113 on the receiving side. Therefore, the external 114 can successfully receive and decode the moving image file transmitted from the data processing apparatus 100.

  In the present embodiment, an apparatus for recording moving image data and audio data has been described. However, the present invention is also applicable to an apparatus for recording other input information data.

Other Embodiments Each unit constituting the recording apparatus and each step of the recording method in the embodiment of the present invention described above can be realized by operating a program stored in a RAM or ROM of a computer. This program and a computer-readable storage medium storing the program are included in the present invention.

  In addition, the present invention can be implemented as, for example, a system, apparatus, method, program, storage medium, or the like. Specifically, the present invention may be applied to a system including a plurality of devices. The present invention may be applied to an apparatus composed of a single device.

  In the present invention, a software program (in the embodiment, a program corresponding to the flowcharts shown in FIGS. 2, 5 and 7) for realizing the functions of the above-described embodiments is directly or remotely supplied to the system or apparatus. This includes cases where This includes the case where the system or the computer of the apparatus is also achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention. In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Examples of the storage medium for supplying the program include a flexible disk, a hard disk, an optical disk, and a magneto-optical disk. Further, there are MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R) and the like.

  As another program supply method, there is a method of connecting to a homepage on the Internet using a browser of a client computer. It can also be supplied by downloading the computer program itself of the present invention or a compressed file including an automatic installation function from a homepage to a storage medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  As another method, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and encrypted from a homepage via the Internet to users who have cleared predetermined conditions. Download the key information to be solved. It is also possible to execute the encrypted program by using the key information and install the program on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. Furthermore, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can be realized by the processing.

  As another method, a program read from a storage medium is first written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Then, based on the instructions of the program, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are realized by the processing.

Claims (4)

An input means for inputting information data;
Encoding means for encoding the information data input by the input means;
An information file having a plurality of storage units each including size information, wherein the plurality of storage units store one or more first storage units for storing information data encoded by the encoding means Generating means for generating an information file including management information relating to information data stored in the first storage unit, and one or more second storage units;
Recording means for recording the information file generated by the generating means on a recording medium;
Transmitting means for transmitting the information file generated by the generating means to an external device;
One of a plurality of modes including a recording mode in which the information file generated by the generating unit is recorded by the recording unit, and a transmission mode in which the information file generated by the generating unit is transmitted by the transmitting unit. Setting means for setting;
In the recording mode, the generation means is controlled to generate one information file that includes only one each of the first storage unit and the second storage unit. Control means for controlling the generation means so as to generate the information file including one storage unit and a plurality of the second storage units;
In the transmission mode, the control means stores the encoded information data each time the data amount of the encoded information data reaches a predetermined amount while encoding the input information data. Generating the first storage unit and generating the second storage unit in which the management information corresponding to the information data stored in the generated first storage unit is stored. And transmitting means for controlling the means and the generating means, transmitting the second storage unit corresponding to the generated first storage unit, and then transmitting the generated first storage unit. A data processing apparatus characterized by controlling the above. The information data includes moving image data and audio data, and the generation unit stores the encoded moving image data having the number of frames corresponding to the predetermined amount in one first storage unit, and The data processing apparatus according to claim 1, wherein the audio data of an audio frame corresponding to the moving image data stored in one storage unit is stored in the first storage unit together with the moving image data . In a control method of a data processing apparatus having an input means for inputting information data,
An encoding step of encoding the information data input by the input means;
An information file having a plurality of storage units each including size information, wherein the plurality of storage units store one or more first storage units for storing the information data encoded in the encoding step Generating an information file including one or more second storage units for storing management information related to information data stored in the first storage unit;
A recording step of recording the information file generated in the generating step on a recording medium;
A transmission step of transmitting the information file generated in the generation step to an external device;
One of a plurality of modes including a recording mode in which the information file generated in the generation step is recorded in the recording step, and a transmission mode in which the information file generated in the generation step is transmitted in the transmission step. A setting step to set;
In the recording mode, the generation step is controlled so as to generate one information file that includes only one each of the first storage unit and the second storage unit, and in the transmission mode, a plurality of the first storage units are controlled. A control step for controlling the generation step so as to generate the information file including one storage unit and a plurality of the second storage units;
In the transmission step, the encoded information data is stored each time the amount of the encoded information data reaches a predetermined amount while the input information data is encoded in the transmission mode . Generating the first storage unit and generating the second storage unit in which the management information corresponding to the information data stored in the generated first storage unit is stored. And transmitting the second storage unit corresponding to the generated first storage unit, and then transmitting the generated first storage unit. The control method characterized by controlling. The information data includes moving image data and audio data, and the generating step stores the encoded moving image data having a number of frames corresponding to the predetermined amount in one first storage unit, and 4. The control method according to claim 3, wherein the audio data of the audio frame corresponding to the moving image data stored in one storage unit is stored in the first storage unit together with the moving image data .

Images