JP7818656B2 - Video data processing device, video data processing method and program, content receiving device, content playback device, content display device, server, content broadcasting system, and content distribution system - Google Patents

Description

The present invention relates to video data processing.

Technology has been known to prevent the unauthorized output of content, including video data, by using specific key information to encrypt video data from conditional access broadcasts received by broadcast receiving devices and copyright-protected video data output from devices such as video playback players. For example, Patent Document 1 discloses a broadcast receiving device that receives individual information (EMM) carried on digital broadcast waves, decrypts the individual information using a unique master key Km to extract a work key Kw for the content, decrypts encrypted information received via the Internet using the work key Kw to extract an encryption key Kc, and then uses this encryption key Kc to decrypt the content.

Japanese Patent Application Laid-Open No. 2003-264541

However, the technology that prevents the unauthorized output of video data by encryption using the above-mentioned key information may not be able to prevent the unauthorized output of video data due to unauthorized tampering with the key information. Therefore, studies are being conducted to prevent the unauthorized output of video data by making it possible to track those who are unauthorizedly outputting video data.

One aspect of the present invention is a video data processing device that processes video data. This video data processing device includes a frame division unit that divides each of a plurality of frames constituting video data into a plurality of regions using a predetermined division method; an information embedding unit that embeds, for each of the plurality of frames, information for identifying the outputter of the video data in some or all of the plurality of regions obtained by dividing the frame; and a frame reversion unit that combines, for each of the plurality of frames, the plurality of regions with the embedded information to revert to a frame.

In the video data processing device, the information embedding unit may embed information for identifying the person who output the video data and time information when the video data was played or output. The information embedding unit may also embed information for identifying the person who output the video data, the time information, and additional information linked to these pieces of information.

In the video data processing device, the information embedding unit may embed the information as an invisible digital watermark.

In the video data processing device, the frame division unit may divide each of the multiple frames into multiple square regions, multiple non-square rectangular regions, or multiple regions that are a mixture of square regions and non-square rectangular regions.

In the video data processing device, the frame division unit may divide each of the plurality of frames into a plurality of regions of equal or unequal size.

In the video data processing device, the information embedding unit may embed information into the region using a wavelet transform, or using both a wavelet transform and a discrete cosine transform.

In the video data processing device, the multiple regions within the frame may include multiple small regions that are too small to accommodate the information to be embedded, and the information embedding unit may divide the information to be embedded to generate multiple pieces of divided information, and distribute and allocate the multiple pieces of divided information across the multiple regions within the frame.

In the video data processing device, each of the multiple pieces of division information may include position information of the area in which the information is located and an error detection code for the entire multiple pieces of division information.

In the video data processing device, the frame division unit may change the frame division method for each frame, for each set of frames, or for each predetermined time period.

In the video data processing device, the frame division unit may change the frame division method for each of a plurality of pieces of content having video data, or for each of a plurality of pieces of content.

In the video data processing device, the information embedding unit may change the information embedding method for each frame, for each set of frames, or for each specified time period.

In the video data processing device, the information embedding unit may change the information embedding method for each piece of content or for each set of multiple pieces of content containing video data.

A method according to another aspect of the present invention is a method for processing video data. This method includes dividing each of a plurality of frames constituting the video data into a plurality of regions using a predetermined division method; embedding information for identifying the outputter of the video data in some or all of the regions obtained by dividing each of the plurality of frames; and combining the regions with the embedded information to return each of the plurality of frames to a frame.

A program according to yet another aspect of the present invention is a program executed on a computer or processor included in a video data processing device that processes video data. This program includes program code for dividing each of a plurality of frames constituting the video data into a plurality of regions using a predetermined division method; program code for embedding, for each of the plurality of frames, information for identifying the outputter of the video data in some or all of the plurality of regions obtained by dividing the frame; and program code for combining, for each of the plurality of frames, the plurality of regions with the embedded information to return the frame to its original state.

In the above method and program, information for identifying the person who output the video data and time information when the video data was played or output may be embedded. Also, information for identifying the person who output the video data, the time information, and additional information linking these pieces of information may be embedded.

In the method and program, the information may be embedded as an invisible digital watermark.

In the method and program, each of the multiple frames may be divided into multiple square regions, multiple non-square rectangular regions, or multiple regions that are a mixture of square regions and non-square rectangular regions.

In the method and program, each of the multiple frames may be divided into multiple regions of equal or unequal size.

In the method and program, information may be embedded in the region using a wavelet transform, or using both a wavelet transform and a discrete cosine transform.

In the above method and program, the multiple areas within the frame may include multiple small areas that are too small to accommodate the information to be embedded, and the information to be embedded may be divided to generate multiple pieces of divided information, which may then be distributed and placed in the multiple areas within the frame.

In the above method and program, each of the multiple pieces of division information may include position information of the area in which the information is located and an error detection code for the entire multiple pieces of division information.

In the above method and program, the frame division method may be changed for each frame, for each set of frames, or for each specified time period.

In the above method and program, the frame division method may be changed for each content or for each of multiple contents containing video data.

In the above method and program, the method of embedding the information may be changed for each frame, for each set of frames, or for each specified time period.

In the above method and program, the method of embedding the information may be changed for each piece of content or for each set of multiple pieces of content containing video data.

An apparatus according to yet another aspect of the present invention is a video data processing device that processes video data. This video data processing device includes a frame division unit that divides each of the multiple frames that make up the video data into multiple regions using the predetermined division method, and an information extraction unit that extracts, for each of the multiple frames, information for identifying the outputter of the video data from some or all of the multiple regions into which the frame is divided, based on the information embedding method.

A server according to yet another aspect of the present invention is a server that manages information used by any of the video data processing devices. This server includes a storage unit that stores information on the frame division method and the information embedding method, as well as information that identifies the video data processing device, and a communication unit that communicates via a communication network or communication line.

The server may transmit information about the frame division method and information embedding method used in the video data processing device, or may receive information about the frame division method and information embedding method used in the video data processing device.

A device according to yet another aspect of the present invention is a content receiving device that receives and outputs content including video data via broadcast radio waves or streaming distribution, and is equipped with any of the video data processing devices described above.

A broadcasting system according to yet another aspect of the present invention comprises the content receiving device and a broadcasting device that broadcasts content including video data.

A distribution system according to yet another aspect of the present invention includes the content receiving device and a server that streams content including video data.

A device according to yet another aspect of the present invention is a content playback device that plays back and outputs content including video data using a video data file read from a recording medium or a video data file downloaded from a server, and is equipped with any of the video data processing devices described above.

The program that divides the frame into multiple regions, embeds information in the multiple regions, and combines the multiple regions may include a trained model used in machine learning.

According to this invention, information for identifying the person outputting video data is embedded in some or all of the multiple regions obtained by dividing a frame of video data, and the multiple regions with the embedded information are then combined and returned to a frame for output. This allows the information embedded in the frame to be extracted without being tampered with, even if the output video data is leaked, making it possible to identify the person who illegally output the video data.

FIG. 1 is a block diagram showing an example of a moving image data processing device having an information embedding function according to an embodiment. Fig. 2(a) is an explanatory diagram showing an example of a frame before division, Fig. 2(b) is an explanatory diagram showing an example of multiple regions into which information has been embedded after dividing a frame, and Fig. 2(c) is an explanatory diagram showing an example of a frame into which the multiple regions into which information has been embedded have been combined. FIG. 3 is an explanatory diagram showing an example of frame division. FIG. 4 is an explanatory diagram showing another example of frame division. FIG. 5 is an explanatory diagram showing yet another example of frame division. FIG. 6 is an explanatory diagram showing an example of a change in the screen division method for frames in video data. FIG. 7 is a block diagram showing an example of a content playback device including a video data processing device according to an embodiment. FIG. 8 is an explanatory diagram illustrating an example of the overall configuration of a content distribution system according to the embodiment. FIG. 9 is a sequence diagram showing an example of content distribution in the content distribution system of FIG. FIG. 10 is a block diagram showing an example of a schematic configuration of a content receiving device including a moving image data processing device according to an embodiment. FIG. 11 is a block diagram showing an example of a video data processing device having an information extraction function according to an embodiment.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
The device according to the embodiment described herein is a video data processing device that divides each of a plurality of frames constituting video data of video content into a plurality of regions using a predetermined division method, embeds information for identifying the outputter of the video data in some or all of the regions obtained by dividing the frame for each of the plurality of frames, and combines the plurality of regions with the embedded information for each of the plurality of frames to return the plurality of frames to a single frame. By embedding information for identifying the outputter of the video data in some or all of the regions obtained by dividing the frame in this manner, the information embedded in the frame can be extracted without being tampered with, thereby enabling the identification of an unauthorized outputter of video data and preventing the unauthorized output of video data.

Figure 1 is a block diagram showing an example of the schematic configuration of a video data processing device 100 according to this embodiment. In Figure 1, the video data processing device 100 includes a frame division unit 101, an information embedding unit 102, and a frame return unit 103.

The frame division unit 101 divides each of the multiple frames that make up the video data into multiple regions (1 to N) using a predetermined division method. For example, the frame division unit 101 divides the frame 900 shown in Figure 2(a) into multiple (four in the illustrated example) equally sized square regions 910(1) to 910(2) shown in Figure 2(b).

For each of the multiple frames, the information embedding unit 102 embeds information for identifying the outputter of the video data (hereinafter also referred to as "outputter identification information") in some or all of the multiple regions 910(1) to 910(4) obtained by dividing the frame, as shown in FIG. 2(b). For example, the information embedding unit 102 generates divided images of the multiple regions obtained by dividing each frame of the video data received from a content playback device (e.g., a video playback player), and embeds outputter identification information in the multiple divided images.

By embedding information to identify the outputter, when content containing video data is leaked, the information to identify the outputter can be restored from the content, making it possible to identify who output and viewed the content.

Note that for convenience of explanation, in Figure 2(b), the information embedded in each of the regions 910(1) to 910(4) (in the illustrated example, the numerical information "123") is shown so that it can be seen, but in reality the information is embedded in an invisible manner. Also, in Figure 2(b), information is embedded in all of the multiple regions 910(1) to 910(4), but information may also be embedded in only some of the multiple regions 910(1) to 910(4).

The person outputting the video data is, for example, the viewer of the content that includes the video data. The information for identifying the outputter is embedded in a form that cannot be recognized (read) by the normal outputter, for example. The information for identifying the outputter may be embedded as an invisible digital watermark using the digital watermarking technology disclosed in Japanese Patent Application Laid-Open Nos. 10-243398 and 2020-088469, etc.

The output person identification information may be, for example, identification (ID) information set within a content playback device (e.g., a video playback player, a terminal with video playback capabilities, a game console, etc.) or a content receiving device (e.g., a broadcast receiving device such as a television), unique information about the device, or identification (ID) information specified by an external server such as a distribution server or management server. The output person identification information may be the global IP address of the content playback device or content receiving device. The output person identification information may be a user ID, such as a user of the content playback device or a user of the content receiving device. The output person identification information may be a user ID (e.g., a membership ID) that identifies a user of a video service or content distribution service. The output person identification information may also be different information for each outputter (e.g., a client or user of a distribution service) who outputs and uses video data.

The information embedding unit 102 may embed additional information linked to the outputter identification information along with the outputter identification information. Here, the additional information may be, for example, session information such as a session ID that identifies a communication session established with the server, or other information.

The information embedding unit 102 may embed time information (including date information) when the video data was played or output along with the outputter identification information. By embedding the time information along with the outputter identification information, when content including the video data is leaked, the outputter identification information and time information can be restored from the content, making it possible to determine who output and viewed the content and when.

The information embedding unit 102 may embed additional information linked to the outputter identification information and time information, along with the outputter identification information and time information. Here, the additional information may be, for example, session information such as a session ID that identifies a communication session established with the server, or other information.

For each of the multiple frames, the frame return unit 103 combines the multiple areas in which the information is embedded and returns them to frame 920, as shown in Figure 2(c). In this state, the embedded information cannot be read. Note that for the sake of convenience, Figure 2(c) shows the embedded information (in the illustrated example, four pieces of numerical information "123") so that it can be seen, but in reality the information is embedded in an invisible manner.

Video data containing frames returned by combining images from multiple regions in the frame return unit 103 is output to a video display device or the like in synchronization with audio data.

In the video data processing device 100 configured as described above, the frame division unit 101 may divide each of the multiple frames into multiple (1 to N) non-square rectangular regions, or may divide the frames into multiple regions 911(1) to 911(6) that are a mixture of square region 911(1) and non-square rectangular regions 911(2) to 911(6), as shown in FIG. 3, for example. The frame division unit 101 may also divide each of the multiple frames 900 into multiple regions 911(1) to 911(6) of unequal sizes, as shown in FIG. 3, for example.

Furthermore, in the video data processing device 100 configured as described above, the frame division unit 101 may divide the frame 900 into multiple regions, as shown in FIG. 4, using wavelet transform technology, such as that disclosed in Japanese Patent Application Laid-Open No. 10-276321. The illustrated example shows division into multiple regions (HH1, HL1, LH1, LL1, HH2, HL2, LH2, LL2, HH3, HL3, LH3, LL3) using multiple wavelet transforms. By using wavelet transforms in this way, it is possible to generate regions of the frame that have little impact on image quality (for example, high-frequency regions in the spatial frequency domain, or high-frequency regions in the frequency domain obtained by transforming the temporal changes in the image).

Here, if the size of each of the multiple divided regions is large enough to accommodate the information to be embedded, the information may be embedded in the smallest region that is part of the multiple regions. For example, in Figure 4, if the size of each of the multiple wavelet transform regions HH1 to LL3 is large enough to accommodate the information to be embedded, the information is embedded in the smallest region LL3 or LL2. If the size of the smallest region LL3 is not large enough to accommodate the information to be embedded, the information is embedded in region LL2. In this case, in order to remove the embedded information from the video data, an attacker (unauthorized outputter) needs to know both how the frames of the video data were divided (the division method) and in which region of the wavelet transform the information is embedded (the location information of the region where the information is embedded), which increases the resistance to tampering and deletion of the embedded information.

The frame division unit 101 may also divide each of the multiple frames 900 into multiple regions using both the wavelet transform technology described above and the discrete cosine transform technology disclosed in, for example, Japanese Patent Application Laid-Open Nos. 11-317859 and 11-317860. By using wavelet transform or discrete cosine transform in this way, it is possible to generate regions of the multiple regions of a frame that have little impact on image quality (for example, high-frequency regions in the spatial frequency domain, or high-frequency regions in the frequency domain obtained by transforming temporal changes in the image). In particular, by performing a discrete cosine transform on an image after wavelet transform, the changes in the image become more natural, making it difficult to tell that embedded information has been embedded.

Furthermore, as shown in FIG. 5, the multiple regions 912(1) to 912(12) within the frame 900 may include multiple small regions 912(1) to 912(6) that are too small to contain the information to be embedded. In this case, the information embedding unit 102 divides the information to be embedded into multiple pieces of divided information and distributes the multiple pieces of divided information across the multiple small regions 912(1) to 912(6) within the frame 900. This increases the resistance to extraction, tampering, and deletion of embedded information when an attacker (illegible outputter) combines leaked videos in detail.

Here, when the information to be embedded is divided into multiple pieces of split information and embedded, each of the multiple pieces of split information may have position information within the frame of the area where the information is placed, and an error detection code for the entire multiple pieces of split information. In this case, even if an attacker (unauthorized outputter) carefully combines leaked videos and the combined videos contain split information from multiple users (unauthorized outputters), it is possible to identify each of the multiple users (unauthorized outputters).

Furthermore, in the video data processing device 100 configured as described above, the frame division unit 101 may change the frame screen division methods A to F for each frame, for each set of frames, or at predetermined time intervals (for example, every 10 seconds or every minute), as shown in FIG. 6. In this case, even if multiple attackers (unauthorized outputters) cooperate to modify the video by replacing frames, it becomes difficult to erase all of the information in the video, and the attackers (unauthorized outputters) can be identified.

Furthermore, in the video data processing device 100 configured as described above, the frame division unit 101 may change the frame division method for each piece of content or for each set of multiple pieces of content having video data.

Information about the division method used by the frame division unit 101 is sent to the server when a change occurs, and is stored and managed within the server. The server may be a distribution server that distributes content, or an information management server that is provided separately from the distribution server.

In the video data processing device 100 configured as described above, the information embedding unit 102 may embed information into regions of each frame using wavelet transform technology, such as that disclosed in Japanese Patent Application Laid-Open No. 10-276321. The information embedding unit 102 may also embed information into regions of each frame using discrete cosine transform technology, such as that disclosed in Japanese Patent Application Laid-Open Nos. 11-317859 and 11-317860. By using wavelet transform or discrete cosine transform in this way, information can be embedded into regions of a frame that have little impact on image quality (for example, high-frequency regions in the spatial frequency domain, or high-frequency regions in the frequency domain obtained by transforming temporal changes in the image), thereby minimizing degradation of image quality.

Furthermore, in the video data processing device 100 configured as described above, the information embedding unit 102 may divide the information to be embedded to generate multiple pieces of split information, and distribute the multiple pieces of split information across multiple areas within the frame. Here, each of the multiple pieces of split information may have position information for the area in which the information is placed, and an error detection code for the entire multiple pieces of split information. Even if an attacker (illegal outputter) carefully combines leaked videos and the combined video contains split information from multiple users (illegal outputters), it is possible to identify each of the multiple users (illegal outputters) involved.

The information embedding unit 102 may also change the information embedding method for each frame, for each set of frames, or for each specified time period (for example, every 10 seconds or every minute). In this case, even if multiple attackers (unauthorized outputters) cooperate to modify the video by replacing frames, it becomes difficult to erase all of the information in the video, and the attackers (unauthorized outputters) can be identified. The information embedding unit 102 may also change the information embedding method for each piece of content or for each set of content containing video data.

Note that information about the embedding method used by the information embedding unit 102 is sent to the server when it is changed, and is stored and managed within the server. The server may be a distribution server that distributes content, or an information management server that is provided separately from the distribution server.

FIG. 7 is a block diagram showing an example of a content playback device including a video data processing device according to an embodiment. The content playback device (hereinafter also referred to as a "video playback player") 10 is a device that plays and outputs content including video data using a video data file read from a recording medium or a video data file downloaded from a server. In FIG. 7, the content playback device (hereinafter also referred to as a "video playback player") 10 includes the video data processing device 100 configured as described above, a storage unit 110, a communication unit 120, a playback/control unit 130, and an output unit 140. The storage unit 110 stores a content file containing video data received from a server such as a distribution server, information on frame division methods and information embedding methods received from the server such as the distribution server, information for identifying the video data processing device 100, and various programs. The communication unit 120 communicates with a server such as the distribution server via a communication network or communication line. The playback/control unit 130 plays video data and audio data consisting of consecutive frames based on the content file stored in the storage unit 110. Furthermore, the playback/control unit 130 executes a predetermined control program to control each unit. The output unit 140 outputs video data having frames in which the predetermined information is embedded by the video data processing device 100 to a video display device or the like in synchronization with audio data. Note that the content playback device 10 may include a display unit for displaying video data and an audio output unit for outputting audio data instead of or in addition to the output unit 140.

Figure 8 is an explanatory diagram showing an example of the overall configuration of a content distribution system according to an embodiment. In Figure 8, the content distribution system includes a content playback device (video playback player) 10 having the video data processing device 100 configured as described above, a server group 20 including a distribution server 210 and a time server 220, and a video display device 30. The distribution server 210 also serves as a management server and includes a storage unit that stores information on the frame division method and information embedding method used in the video data processing device 100 and information that identifies the video data processing device 100, and a communication unit that communicates with the content playback device (video playback player) 10 via a communication network or communication line. The distribution server 210 transmits information on the frame division method and information embedding method used in the video data processing device 100. The distribution server 210 may receive information on the frame division method and information embedding method used in the video data processing device 100. The management server may be provided separately from the distribution server 210. The time data distributed from the time server 220 to the content playback device (video playback player) 10 can be used for synchronization processing of the video data processing device 100 in the content playback device (video playback player) 10. The video display device 30 is, for example, a monitor such as an LCD, a projector, or the display of a terminal device (e.g., a smartphone).

Figure 9 is a sequence diagram showing an example of content distribution in the content distribution system of Figure 8. In Figure 9, the playback/control unit 130 of the video playback player (content playback device) 10 executes a specified application program and sends a playback request to the distribution server 210, requesting playback of video content. Upon receiving the playback request from the video playback player 10, the distribution server 210 transmits to the video playback player 10 the file of the video content to be played, initial information specifying the frame division method and information embedding method, and embedding information to be embedded in the frame division areas. The playback/control unit 130 of the video playback player 10 transfers the initial information specifying the frame division method and information embedding method received from the distribution server 210 to the video data processing device 100, and begins transmitting video data generated by playing the video content file to the video data processing device 100. The video data processing device 100 embeds information into the video data based on the division method and embedding method specified by the distribution server 210, and begins transmitting the video data with the embedded information to the video display device 30.

The distribution server 210 changes the frame division method and information embedding method every predetermined time (e.g., 10 seconds) and transmits information about the changed division method and embedding method to the video playback player 10. The distribution server 210 may also receive information about the frame division method and information embedding method used by the video data processing device 100. When the playback/control unit 130 of the video playback player 10 receives information about the changed division method and embedding method from the distribution server 210, it transfers the information about the changed division method and embedding method to the video data processing device 100. Each time the distribution server 210 changes the division method and embedding method, the video data processing device 100 embeds information into subsequent video data based on the changed division method and embedding method and transmits the video data with the embedded information to the video display device 30.

Figure 10 is a block diagram showing an example of the schematic configuration of a content receiving device 11 equipped with a video data processing device 100 according to an embodiment. The content receiving device 11 receives and outputs content including video data, for example, via broadcast radio waves or streaming distribution. Note that in Figure 10, components common to those in Figure 7 above are designated by the same reference numerals and will not be described again.

In FIG. 10, the content receiving device 11 includes the video data processing device 100 configured as described above, a storage unit 110, a communication unit 120, a playback/control unit 130, an output unit 140, and a receiving unit 150. The receiving unit 150 receives content including video data via airwaves from a broadcasting device at a broadcast station, or receives content including video data via streaming distribution from a server. The playback/control unit 130 plays video data and audio data consisting of multiple consecutive frames based on the content received via airwaves or streaming distribution, and sends the played video data and audio data to the video data processing device 100. The output unit 140 outputs video data having frames in which the above-mentioned specified information is embedded, synchronized with the audio data, to a video display device or the like. Note that the content receiving device 11 may include a display unit for displaying video data and an audio output unit for outputting audio data instead of or in addition to the output unit 140.

A broadcasting system according to an embodiment may be configured to include the content receiving device 11 of FIG. 10 and a broadcasting device that broadcasts content including video data. A distribution system according to an embodiment may be configured to include the content receiving device 11 of FIG. 10 and a server that streams content including video data.

Figure 11 is a block diagram showing an example of a video data processing device 160 having an information extraction function according to an embodiment. In Figure 11, the video data processing device 160 is a device that can extract information embedded in video data in the event that the video data embedded by the video data processing device 100 is leaked. The video data processing device 160 includes a frame division unit 161 and an information extraction unit 162. The frame division unit 161 divides each of the multiple frames constituting video data received from the content playback device (video playback player) or the like into multiple regions using a predetermined division method used by the video data processing device 100. The information extraction unit 162 extracts information for identifying the outputter of the video data from some or all of the multiple regions obtained by dividing the frames for each of the multiple frames, based on the information embedding method used by the video data processing device 100. For example, the information extraction unit 162 extracts information from the information-embedded regions using an inverse discrete cosine transform or an inverse wavelet transform after dividing the frames.

In the above embodiment, machine learning may be used to divide a frame into multiple regions, embed information in the multiple regions of a frame, and combine the multiple regions.

As described above, this embodiment prevents the tampering and deletion of information embedded in video data and makes it possible to identify those who are illegally outputting video data, thereby preventing the illegal output of video data.

Furthermore, the present invention can provide a video data processing device that can prevent the unauthorized output of video data, thereby contributing to the achievement of Goal 9 of the Sustainable Development Goals (SDGs), "Build resilient infrastructure, promote inclusive and sustainable industrialization, and promote innovation and resilience."

The processing steps and components of the video data processing device, content receiving device, content playback device, broadcasting system, and distribution system described in this specification can be implemented by various means. For example, these steps and components may be implemented by hardware, firmware, software, or a combination thereof.

For hardware implementations, the processing units and other means used to implement the above steps and components in an entity (e.g., various computer devices, communication devices, receivers, transmitters, displays, terminals, hard disk drive devices, or optical disk drive devices) may be implemented in one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processors (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units, computers designed to perform the functions described herein, or combinations thereof.

Furthermore, for firmware and/or software implementations, the means, such as processing units, used to realize the above components may be implemented with programs (e.g., code, such as procedures, functions, modules, instructions, etc.) that perform the functions described herein. In general, any computer/processor-readable medium tangibly embodying firmware and/or software code may be used to implement the means, such as processing units, used to realize the above steps and components described herein. For example, the firmware and/or software code may be stored in memory and executed by a computer or processor, such as in a control device. The memory may be implemented within the computer or processor, or external to the processor. The firmware and/or software code may also be stored on a computer- or processor-readable medium, such as, for example, random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), electrically erasable programmable read-only memory (EEPROM), flash memory, floppy disk, compact disk (CD), digital versatile disk (DVD), magnetic or optical data storage device, etc. The code may be executed by one or more computers or processors and may cause the computers or processors to perform certain aspects of the functionality described herein.

The medium may also be a non-transitory recording medium. Furthermore, the program code may be in any format as long as it can be read and executed by a computer, processor, or other device or machine, and its format is not limited to a specific format. For example, the program code may be source code, object code, or binary code, or may be a mixture of two or more of these types of code.

Furthermore, the description of the embodiments disclosed herein is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to the present disclosure will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other variations without departing from the spirit or scope of the present disclosure. Thus, the present disclosure is not intended to be limited to the examples and designs described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

10: Content playback device (video playback player)
11: Content receiving device 20: Server group 30: Video display device 100: Video data processing device 101: Frame dividing unit 102: Information embedding unit 103: Frame returning unit 110: Storage unit 120: Communication unit 130: Control unit 140: Output unit 150: Receiving unit 160: Video data processing device 161: Frame dividing unit 162: Information extraction unit 210: Distribution server 220: Time server 900: Frames 910, 911, 912: Area (divided from frame) 920: Frame with embedded information

Claims (22)

A video data processing device that processes video data,
a frame dividing unit that divides each of a plurality of frames constituting the video data into a plurality of regions using a predetermined division method;
an information embedding unit that embeds information for identifying a person who outputs the video data into a part of the plurality of regions obtained by dividing each of the plurality of frames;
a combining unit that combines the plurality of regions after embedding the information in parts of the plurality of regions for each of the plurality of frames to return the plurality of regions to the frame;
A video data processing device comprising: 2. The video data processing device of claim 1,
the video data composed of the plurality of frames before being divided into the plurality of regions by the frame dividing unit is video data output from a content playback device that plays video content including the video data read from a recording medium, or video data output from a content receiving device that receives video content including the video data via broadcast radio waves or streaming distribution,
The video data processing device, characterized in that the information embedding unit embeds information for identifying the person who output the video data and time information when the content playback device or the content receiving device output the video data. 2. The video data processing device of claim 1,
The video data processing device, wherein the information embedding unit embeds the information as an invisible digital watermark. 2. The video data processing device of claim 1,
A video data processing device characterized in that the frame division unit divides each of the multiple frames into multiple square regions, multiple non-square rectangular regions, or multiple regions that are a mixture of square regions and non-square rectangular regions. 2. The video data processing device of claim 1,
The video data processing device, wherein the frame dividing unit divides each of the plurality of frames into a plurality of regions of equal or unequal size. 2. The video data processing device of claim 1,
the information embedding unit embeds information into the region using a wavelet transform, or performs a discrete cosine transform on the image after embedding information into the region using the wavelet transform;
A video data processing device comprising: 2. The video data processing device of claim 1,
the plurality of regions in the frame include a plurality of small regions that are too small to accommodate information to be embedded by the information embedding unit ,
The video data processing device, wherein the information embedding unit divides the information to be embedded into a plurality of pieces of divided information, and distributes and arranges the plurality of pieces of divided information in a plurality of areas within the frame. 8. The video data processing device of claim 7,
10. A video data processing device, comprising: a plurality of pieces of division information each having position information of the area in which the piece of division information is arranged; and an error detection code for the entirety of the plurality of pieces of division information. 2. The video data processing device of claim 1,
The video data processing device, wherein the frame division unit changes the frame division method for each frame, for each set of frames, or for each predetermined time period. 2. The video data processing device of claim 1,
The video data processing device, wherein the frame dividing unit changes the frame dividing method for each of a plurality of video contents having video data or for each of a plurality of video contents. 2. The video data processing device of claim 1,
The video data processing device, wherein the information embedding unit changes the information embedding method for each frame, for each set of frames, or for each predetermined time period. 2. The video data processing device of claim 1,
The video data processing device, wherein the information embedding unit changes the information embedding method for each video content or for each of a plurality of video contents having video data. A video data processing device that processes video data,
a frame dividing unit that divides each of a plurality of frames constituting the video data in which the information is embedded into a plurality of regions by the predetermined dividing method used in the video data processing device of claim 1;
an information extraction unit that extracts, for each of the plurality of frames, information for identifying a person who has output the moving image data from a part of the plurality of regions into which the frame is divided, based on the information embedding method used in the moving image data processing device of claim 1;
A video data processing device comprising: A server for managing information used in any one of the video data processing devices according to any one of claims 1 to 13,
a storage unit that stores information on the frame division method and the information embedding method, and information for identifying the moving image data processing device;
A server comprising: a communication unit that communicates via a communication network or a communication line. 15. The server of claim 14,
A server that transmits information on a method for dividing the frames and a method for embedding the information used in the video data processing device. 15. The server of claim 14,
A server that receives information on the frame division method and the information embedding method used in the video data processing device. A content receiving device that receives and outputs video content including video data via broadcast radio waves or streaming distribution,
A video data processing device according to any one of claims 1 to 13,
the frame division unit of the video data processing device divides each of a plurality of frames constituting the video data output from the content receiving device into a plurality of regions using a predetermined division method;
the information embedding unit of the video data processing device embeds, for each of the plurality of frames, information for identifying a person who output the video data from the content receiving device in a part of the plurality of regions obtained by dividing the frame;
A content receiving device comprising: 20. A broadcasting system comprising: the content receiving device of claim 17; and a broadcasting device that broadcasts video content including the video data. 20. A distribution system comprising: the content receiving device of claim 17; and a server that streams video content including the video data. A content playback device that plays back and outputs video content including video data using a file of video data read from a recording medium or a file of video data downloaded from a server, comprising:
A video data processing device according to any one of claims 1 to 13 ,
the frame division unit of the video data processing device divides each of a plurality of frames constituting the video data output from the content playback device into a plurality of regions using a predetermined division method;
the information embedding unit of the video data processing device embeds, for each of the plurality of frames, information for identifying a person who output the video data from the content playback device in a part of the plurality of regions obtained by dividing the frame;
A content playback device comprising: 1. A method for processing video data, comprising:
Dividing each of a plurality of frames constituting video data into a plurality of regions using a predetermined division method;
embedding information for identifying a person who outputs the video data in a part of the plurality of regions obtained by dividing each of the plurality of frames;
For each of the plurality of frames, embedding the information in a portion of the plurality of regions and then combining the plurality of regions to return the frame;
A method comprising: A program executed on a computer or processor provided in a video data processing device that processes video data,
program code for dividing each of a plurality of frames constituting video data into a plurality of regions using a predetermined division method;
a program code for embedding information for identifying a person who outputs the video data into a part of the plurality of regions obtained by dividing each of the plurality of frames;
a program code for embedding the information in a part of each of the plurality of regions , and then combining the plurality of regions to return the frame to the original frame;
A program comprising: