JP7586527B2 - Method and device for displaying user's emotional expression in video content - Google Patents

Description

This disclosure relates to a method and device for displaying a user's emotional expression in video content, and more specifically, to a method and device for outputting visual effects associated with the user's emotional expression when playing video content.

Recently, with the development of social networking services (SNS) and video distribution platforms, the consumption of video content such as live internet broadcasting has become very active. In live internet broadcasting, functions that allow viewers to express their emotions and associated effects are provided to facilitate communication between broadcasters and viewers. For example, when a "Like" button is clicked, the associated effect is displayed on the screen.

The problem with these effects is that the effects associated with each viewer's "like" are the same or similar to each other, making it difficult for service users to distinguish between their own effects and those of other viewers. In addition, simple 2D motion has become commonplace, resulting in a lack of differentiation between video distribution platforms. This has limited the bond that can be formed between broadcasters and viewers.

Korean Patent Application Publication No. 2012-0108485

This disclosure provides a method, computer program, and device (system) for displaying a user's emotional expression in video content to solve the above problems.

According to one embodiment of the present disclosure, a method for displaying a user's emotional expression in video content, which is performed by at least one processor of a user terminal, includes the steps of outputting the video content in a first area on a display of the user terminal, outputting chat content associated with the video content in a second area on the display, receiving user input associated with the user's emotional expression in a third area on the display, and outputting a first visual effect associated with the emotional expression in the second area in response to receiving the user input.

A computer-readable computer program is provided for executing a method for displaying a user's emotional expression according to one embodiment of the present disclosure.

A user terminal according to an embodiment of the present disclosure includes a communication module, a memory, a display, and at least one processor coupled to the memory and configured to execute at least one computer-readable program contained in the memory. The at least one program includes instructions for outputting video content in a first area on the display, outputting chat content associated with the video content in a second area on the display, receiving user input associated with a user's emotional expression in a third area on the display, and outputting a first visual effect associated with the emotional expression in the second area in response to receiving the user input.

According to some embodiments of the present disclosure, by encouraging users to actively click the "Like" button, it is possible to induce active participation in content beyond just chat participation.

Some embodiments of the present disclosure allow users to easily distinguish their own emotional expressions from those of other users.

According to some embodiments of the present disclosure, a live broadcast host, a viewer user, etc. can visually confirm the increase in the number of accumulated emotional expressions and can easily confirm that the number of accumulated emotional expressions has reached a target value.

The effects of this disclosure are not limited to these, and other effects not mentioned should be clearly understood by a person having ordinary skill in the art to which this disclosure pertains (hereinafter referred to as "a person skilled in the art") from the claims.

BRIEF DESCRIPTION OF THE DRAWINGS Examples of the present disclosure will now be described, without limitation, with reference to the accompanying drawings, in which like reference numerals refer to like elements and in which: FIG.
FIG. 13 is a diagram showing an example of displaying an emotional expression of a user according to an embodiment of the present disclosure. 1 is a schematic diagram showing a configuration in which an information processing system according to an embodiment of the present disclosure is connected so as to be communicable with a plurality of user terminals. 2 is a block diagram showing an internal configuration of a user terminal and an information processing system according to an embodiment of the present disclosure. FIG. FIG. 2 illustrates a detailed area of a user interface according to one embodiment of the present disclosure. FIG. 11 is a diagram showing an example in which an effect associated with an emotional expression of a user is displayed according to an embodiment of the present disclosure. FIG. 13 is a diagram illustrating an example of an output of a visual effect according to an increase in the number of accumulated emotional expressions according to an embodiment of the present disclosure. A figure showing an example of setting values of visual effects displayed in an area where chat content is output in accordance with an embodiment of the present disclosure. FIG. 11 is a diagram showing an example of setting values of visual effects associated with the cumulative number of emotional expressions of video content according to an embodiment of the present disclosure. 1 is a flowchart illustrating a method for displaying a user's emotional expression in video content according to an embodiment of the present disclosure.

The specific contents for implementing this disclosure will be described in detail below with reference to the attached drawings. However, in the following description, specific descriptions of well-known functions and configurations will be omitted if they may unnecessarily obscure the gist of this disclosure.

In the accompanying drawings, identical or corresponding components are given the same reference symbols. Furthermore, in the following description of the embodiments, duplicated descriptions of identical or corresponding components may be omitted. However, even if a description of a component is omitted, it should not be intended that such a component is not included in a certain embodiment.

Advantages and features of the disclosed embodiments and methods for achieving them will become apparent from the following examples, taken in conjunction with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below, and may be embodied in various different forms. However, the embodiments are provided solely for the purpose of making the disclosure complete and enabling those skilled in the art to accurately appreciate the scope of the invention.

The terms used in this disclosure are briefly explained, and the disclosed embodiments are specifically described. The terms used in this specification are currently common terms that are widely used as much as possible, taking into consideration the functions in this disclosure, but these terms may change depending on the intentions of engineers in related fields, legal precedents, the emergence of new technologies, etc. In addition, in certain cases, there may be terms arbitrarily selected by the applicant, but the meanings of these terms will be described in detail in the description of the invention. Therefore, the terms used in this disclosure should be defined based on the meanings of the terms and the overall content of this disclosure, rather than simply the names of the terms.

In this disclosure, unless otherwise clearly specified in the context, singular expressions include plural expressions and plural expressions include singular expressions. Throughout the specification, when a part "comprises" a certain element, this does not exclude other elements and means that other elements may also be included, unless specifically stated to the contrary.

Also, the term "module" or "unit" as used in the specification means a software or hardware component, and the "module" or "unit" performs a certain function. However, the "module" or "unit" is not limited to software or hardware. The "module" or "unit" may be configured to be on an addressable storage medium and may be configured to execute one or more processors. Thus, by way of example, a "module" or "unit" may include at least one of a software component, an object-oriented software component, a class component, a task component, and a process, a function, an attribute, a procedure, a subroutine, a program code segment, a driver, firmware, microcode, a circuit, data, a database, a data structure, a table, an array, or a variable. The components and "modules" or "units" may be combined into fewer components and "modules" or "units" or further separated into additional components and "modules" or "units" in which the functions provided therein are further provided.

According to one embodiment of the present disclosure, a "module" or "part" may be embodied with a processor and a memory. A "processor" should be broadly construed to include a general-purpose processor, a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a controller, a microcontroller, a state machine, and the like. In some environments, a "processor" may also refer to an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), and the like. A "processor" may also refer to a combination of processing devices, such as, for example, a combination of a DSP and a microprocessor, a combination of multiple microprocessors, a combination of one or more microprocessors coupled with a DSP core, or any other such configuration. Additionally, a "memory" should be broadly construed to include any electronic component capable of storing electronic information. "Memory" can refer to various types of processor-readable media such as Random Access Memory (RAM), Read Only Memory (ROM), Non-Volatile Random Access Memory (NVRAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), flash memory, magnetic or optical data storage devices, registers, etc. Memory is said to be in electronic communication with the processor if the processor can read/write information from the memory or write information to the memory. Memory that is integrated with a processor is in electronic communication with the processor.

In this disclosure, a "user" may refer to a user watching a live video, and "other users" may refer to other users watching the same live video.

FIG. 1 is a diagram illustrating an example of displaying a user's emotional expression according to one embodiment of the present disclosure. As shown in the figure, a user terminal 110 can display a screen on which video content is played on a display 120. In one embodiment, the video content can be live video, recorded video of live video, pre-stored video, etc.

In one embodiment, the user 100 can click a button associated with an emotional expression when the video content is played. For example, when the video content is played, a "Like" button 130 that allows the user to input positive feedback is displayed on the display 120 of the user terminal 110 together with the video content. The user 100 can input positive feedback by touching or clicking the "Like" button 130 on the display 120. Additionally, the user 100 can communicate with the live broadcast host, other viewers, etc. by inputting text through a chat input window on the display 120.

In one embodiment, when the user 100 selects the "Like" button 130, the user terminal 110 can output a visual effect 140 associated with the emotional expression. For example, the user terminal 110 can output the visual effect 140 in an area on the display where the chat content is output. In this case, the visual effect 140 can be output in a layer below the layer where the chat content is output. The visual effect 140 can have any size, any hue, or any transparency, and can be output at any position within the area on the display where the chat content is output. The visual effect 140 can be output for a predetermined time or any time on the display 120, and a blurred image can be used. In addition, the user 100 can select the "Like" button 130 several times, at which time multiple visual effects can be output on the display 120.

When the user 100 selects the "Like" button 130, the visual effect 140 can be displayed in the same or similar manner not only on the user terminal 110 of the user 100, but also on the user terminals of other users watching the same video content and on the user terminal of the live broadcast host. Also, when other users watching the same video content click the "Like" button, the visual effect can be output on the display 120 of the user terminal 110 so that the user 100 can confirm that the other users have clicked the "Like" button.

With this configuration, users watching the video content are encouraged to actively click the "Like" button 130, which can encourage active participation by users in expressing their emotions in addition to participating in chat. In addition, users can check the emotional expressions of viewers without being disturbed while watching the video content and chat content. In live video content, such visual effects 140 can have a similar effect to that of the glow sticks of audience members at an offline concert.

In one embodiment, the user terminal 110 can output visual effects 150 associated with the cumulative number of emotional expressions related to video content. For example, the user terminal 110 can output visual effects 150 associated with the cumulative number of "likes" clicked by users watching the same video content. The visual effects 150 can be output to a layer below the layer to which the chat content is output. In addition, the visual effects 150 can be output to the same layer as the visual effects 140 or a layer below it.

In one embodiment, the visual attributes of the visual effect 150 may change based on the number of accumulated emotional expressions associated with the video content. For example, the visual effect 150 may increase in size as the number of accumulated emotional expressions increases. With this configuration, the user 100 can intuitively check the number of accumulated emotional expressions associated with the video content.

2 is a schematic diagram showing a configuration in which an information processing system 230 according to an embodiment of the present disclosure is connected to be able to communicate with a plurality of user terminals 210_1, 210_2, and 210_3. As shown in the figure, a plurality of user terminals 210_1, 210_2, and 210_3 are connected to an information processing system 230 capable of providing a video content service via a network 220. Here, the plurality of user terminals 210_1, 210_2, and 210_3 may include terminals of users to which the video content service is provided. In one embodiment, the information processing system 230 may include one or more server devices and/or databases capable of storing, providing, and executing computer executable programs (e.g., downloadable applications) and data associated with the video content service, or one or more distributed computing devices and/or distributed databases based on a cloud computing service.

The video content service provided by the information processing system 230 can be provided to users via a video content playback application or a web browser installed in each of the user terminals 210_1, 210_2, and 210_3. For example, the information processing system 230 can provide information corresponding to a video content playback request, a request for information associated with the video content, or a user input associated with a user's emotional expression received from the user terminals 210_1, 210_2, and 210_3 via a video content playback application or the like, or perform corresponding processing.

A plurality of user terminals 210_1, 210_2, and 210_3 can communicate with the information processing system 230 via the network 220. The network 220 can be configured to enable communication between the plurality of user terminals 210_1, 210_2, and 210_3 and the information processing system 230. Depending on the installation environment, the network 220 can be, for example, a wired network such as Ethernet (registered trademark), PLC (Power Line Communication), telephone line communication device, and RS-serial communication, a mobile communication network, a wireless network such as WLAN (Wireless LAN), Wi-Fi (registered trademark), Bluetooth (registered trademark), and ZigBee, or a combination thereof. The communication method is not limited, and includes not only communication methods that utilize a communication network that can include network 220 (e.g., a mobile communication network, wired Internet, wireless Internet, broadcasting network, satellite network, etc.), but also short-range wireless communication between user terminals 210_1, 210_2, and 210_3.

In FIG. 2, a mobile phone terminal 210_1, a tablet terminal 210_2, and a PC terminal 210_3 are shown as examples of user terminals, but are not limited thereto. The user terminals 210_1, 210_2, and 210_3 may be any computing device capable of wired and/or wireless communication and capable of installing and executing a video content playback application or a web browser. For example, the user terminal may include a smartphone, a mobile phone, a navigation system, a computer, a notebook, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a tablet PC, a game console, a wearable device, an IoT (internet of things) device, a VR (virtual reality) device, an AR (augmented reality) device, a set-top box, etc. Also, in FIG. 2, three user terminals 210_1, 210_2, and 210_3 are shown communicating with the information processing system 230 via the network 220, but this is not limited thereto, and a different number of user terminals may be configured to communicate with the information processing system 230 via the network 220.

According to one embodiment, the information processing system 230 can receive user inputs associated with user emotional expressions from multiple user terminals 210_1, 210_2, and 210_3. The information processing system 230 can then provide data or setting values associated with each user input, the number of cumulative emotional expressions associated with video content, or visual effects to the multiple user terminals 210_1, 210_2, and 210_3.

3 is a block diagram showing the internal configuration of a user terminal 210 and an information processing system 230 according to an embodiment of the present disclosure. The user terminal 210 can refer to any computing device capable of executing a video content playback application or a web browser and capable of wired/wireless communication, and can include, for example, the mobile phone terminal 210_1, the tablet terminal 210_2, and the PC terminal 210_3 of FIG. 2. As shown in the figure, the user terminal 210 can include a memory 312, a processor 314, a communication module 316, and an input/output interface 318. Similarly, the information processing system 230 can include a memory 332, a processor 334, a communication module 336, and an input/output interface 338. As shown in FIG. 3, the user terminal 210 and the information processing system 230 can be configured to communicate information and/or data via the network 220 using their respective communication modules 316 and 336. Furthermore, the input/output device 320 can be configured to input information and/or data to the user terminal 210 and output information and/or data generated from the user terminal 210 via the input/output interface 318.

The memories 312 and 332 may include any non-transitory computer-readable recording medium. According to an embodiment, the memories 312 and 332 may include a permanent mass storage device such as a read only memory (ROM), a disk drive, a solid state drive (SSD), and a flash memory. As another example, a permanent mass storage device such as a ROM, an SSD, a flash memory, and a disk drive may be included in the user terminal 210 or the information processing system 230 as a separate permanent storage device separate from the memory. In addition, the memories 312 and 332 may store an operating system and at least one program code (e.g., code for a video content playback application installed and operated in the user terminal 210).

Such software components can be loaded from a computer-readable recording medium separate from the memories 312 and 332. Such separate computer-readable recording media can include recording media directly connectable to such user terminals 210 and information processing systems 230, and can include computer-readable recording media such as floppy drives, disks, tapes, DVD/CD-ROM drives, and memory cards. As another example, software components, etc. can be loaded into the memories 312 and 332 via a communication module rather than a computer-readable recording medium. For example, at least one program can be loaded into the memories 312 and 332 based on a computer program to be installed by a file provided via the network 220 by a developer or a file distribution system that distributes application installation files.

The processors 314, 334 may be configured to process computer program instructions by performing basic arithmetic, logic, and input/output operations. The instructions may be provided to the processors 314, 334 by the memory 312, 332 or the communication modules 316, 336. For example, the processors 314, 334 may be configured to execute instructions received by program code stored in a storage device such as the memory 312, 332.

The communication modules 316, 336 can provide configurations and functions for the user terminal 210 and the information processing system 230 to communicate with each other via the network 220, and can provide configurations and functions for the user terminal 210 and/or the information processing system 230 to communicate with other user terminals or other systems (e.g., separate cloud systems, etc.). As an example, a request or data (e.g., a video content playback request, a user input associated with a user's emotional expression, or data associated therewith, etc.) generated by the processor 314 of the user terminal 210 via a program code stored in a recording device such as the memory 312 can be transmitted to the information processing system 230 via the network 220 under the control of the communication module 316. Conversely, a control signal or command provided by the processor 334 of the information processing system 230 can be received by the user terminal 210 via the communication module 316 of the user terminal 210 via the communication module 336 and the network 220. For example, the user terminal 210 can receive data associated with the emotional expressions of other users or data associated with the cumulative number of emotional expressions related to video content from the information processing system 230 via the communication module 316.

The input/output interface 318 may be a means for interfacing with the input/output device 320. As an example, the input device may include a device such as a camera including an audio sensor and/or an image sensor, a keyboard, a microphone, a mouse, etc., and the output device may include a device such as a display, a speaker, a haptic feedback device, etc. As another example, the input/output interface 318 may be a means for interfacing with a device having a configuration or function for performing input and output integrated into one, such as a touch screen. For example, when the processor 314 of the user terminal 210 processes the instructions of a computer program loaded into the memory 312, a service screen configured using information and/or data provided by the information processing system 230 or another user terminal may be displayed on the display via the input/output interface 318. In FIG. 3, the input/output device 320 is shown not to be included in the user terminal 210, but is not limited thereto and may be configured integrally with the user terminal 210. In addition, the input/output interface 338 of the information processing system 230 may be a means for interfacing with a device (not shown) for input or output that may be connected to or included in the information processing system 230. In FIG. 3, the input/output interfaces 318, 338 are shown as elements configured separately from the processors 314, 334, but are not limited thereto, and the input/output interfaces 318, 338 may be configured to be included in the processors 314, 334.

The user terminal 210 and the information processing system 230 may include more components than those shown in FIG. 3. However, it is not necessary to explicitly show most of the conventional technical components. According to an embodiment, the user terminal 210 may be embodied to include at least a portion of the input/output device 320 described above. The user terminal 210 may further include other components such as a transceiver, a global positioning system (GPS) module, a camera, various sensors, and a database. For example, if the user terminal 210 is a smartphone, it may include components that a smartphone typically has, and may be embodied to further include various components such as an acceleration sensor, a gyro sensor, a camera module, various physical buttons, a button using a touch panel, an input/output port, and a vibrator for vibration.

FIG. 4 is a diagram illustrating detailed regions of a user interface 400 according to one embodiment of the present disclosure. As shown in the figure, the user interface 400 may include a first region 410, a second region 420, and a third region 430. Each of the regions 410, 420, and 430 is not limited thereto, and may be configured such that its position and size are different from those shown in FIG. 4.

Video content can be output to the first area 410. Chat content associated with the video content can be output to the second area 420. The chat content can include real-time chat between users watching the video content, public notices, important notifications, and the like. The second area 420 can include a first layer to which chat content is output, and a second layer to which visual effects are output. Here, the first layer can be a higher layer than the second layer.

The visual effects output to the second layer may include visual effects associated with emotions that are output when a user watching the video content selects the "Like" button, and visual effects associated with the number of accumulated emotions related to the video content. As described above, the visual attributes of the visual effects associated with the number of accumulated emotions related to the video content may change based on the number of accumulated emotions. The second layer may have a background color/background image and a default transparency. In one example, the transparency of the second layer increases from the bottom to the top.

In one embodiment, the first area 410 in which the video content is output and the second area 420 in which the chat content is output may partially overlap. In this case, the second area 420 may further include a third layer in which a portion of the video content is output. The second layer may be a layer higher than the third layer. With this configuration, the first area 410 in which the video content is displayed is maximized, while at the same time allowing the user to view both the chat content and visual effects through the second area 420.

In the third area 430, various buttons/icons including a "Like" button may be displayed. When the user clicks the "Like" button in the third area 430, a visual effect associated with an emotional expression may be output in the second area 420. Additionally or alternatively, when the user clicks the "Like" button in the third area 430, an effect associated with an emotional expression may be output in the third area 430, as will be described below with reference to FIG. 5. In one embodiment, the first area 410 where the video content is output and the third area 430 may partially overlap. In this case, various buttons/icons included in the third area 430 may be output on the video content.

FIG. 5 is a diagram showing an example in which an effect associated with a user's emotional expression according to one embodiment of the present disclosure is displayed. A first operation 510 shows an example in which, when another user watching the video content selects the "Like" button, a first visual effect 512 associated with the emotional expression of the other user is output to a second area 514 of the display. A plurality of visual effects associated with the emotional expressions of the other user, etc. can be output to the second area 514. With this configuration, the user can visually grasp the degree of response of the other user, etc. to the video content. As shown in the figure, when the other user selects the "Like" button, no visual effect is output to the third area 516.

In one embodiment, if the number of "Like" buttons clicked by a user or the like viewing video content within a certain period of time exceeds a predetermined threshold, the size or duration of the first visual effect 512 may be reduced. This configuration can prevent problems such as the first visual effect 512 being excessively output in the second area or occupying too much area, and prevent visual fatigue of the user.

The second operation 520 shows an example in which, when the user selects the "Like" button 524, a second visual effect 526 associated with the user's emotional expression is output in the second area 514 of the display, and a third visual effect 528 associated with the user's emotional expression is output in the third area 516 of the display. For example, the third visual effect 528 output in the third area 516 of the display may be an animation including a motion in which at least one visual effect (e.g., a heart-shaped visual effect) rises from the lower to the upper part of the third area. With this configuration, the user can easily distinguish his/her own emotional expression from the emotional expressions of other users, and this configuration can induce the user to actively click the "Like" button 524, thereby inducing the user's active emotional expression in addition to participating in the chat.

In one embodiment, the third visual effect 528 output in the third area 516 of the display may have different attributes than the first visual effect 512 and the second visual effect 526 output in the second area 514 of the display. For example, the third visual effect 528 may have a different shape, hue, transparency, degree of blurring, size, animation effect, etc. than the first and second visual effects 512, 526. Additionally or alternatively, the third visual effect 528 may be output for a longer duration than the first and second visual effects 512, 526.

In one embodiment, the third visual effect 528 can be output in the top layer of the third area 516. Thus, the third visual effect 528 is not obscured by the various buttons/icons displayed in the third area 516, and the user can easily see the feedback associated with the "Like" button that he or she clicked.

As described above, by making the visual effect different when the user selects the "Like" button and when other users select the "Like" button, and by particularly emphasizing the user's visual effect, the user can recognize that his or her emotional expression is differentiated from the emotional expressions of other users. In other words, the user can immediately check his or her own emotional expression by the visual effect displayed in the third area 516 of the display, and can immediately check the emotional expressions of all users watching the video content by the visual effect displayed in the second area 514 of the display.

FIG. 6 is a diagram showing an example of output of visual effects 612, 622, 634, 636 according to an increase in the number of cumulative emotional expressions according to an embodiment of the present disclosure. As shown in the first operation 610 and the second operation 620, as the number of cumulative emotional expressions of the video content increases, the magnitude of the visual effects 612, 622 also increases. Also, as shown in the third operation 630, when the number of cumulative emotional expressions of the video content reaches a predetermined target value, the visual effects 634, 636 associated therewith may be output. With this configuration, a live broadcast host, a user, etc. can intuitively confirm that the number of cumulative emotional expressions of the video content is increasing and reaching the target value.

The first operation 610 illustrates an example in which a visual effect 612 associated with the number of accumulated emotional expressions of the video content is output to a second area 614 of the display at the start of the video content. Here, the number of accumulated emotional expressions of the video content is 0, and as the number of accumulated emotional expressions increases, the size of the visual effect 612 also increases. The visual effect 612 can be output at any position within the second area 614, and preferably at the center of the second area 614.

The second operation 620 shows an example in which the number of accumulated emotions of the video content increases as the video content progresses, and a visual effect 622 larger than the initial visual effect 612 is output in the second area 614 of the display. In one embodiment, the size of the visual effect 622 can be determined based on the ratio between the current number of accumulated emotions and the target value. For example, if the target value is 1,000 and the current number of accumulated emotions is 500, the size of the visual effect 622 can be half the maximum size. In FIG. 6, the size of the visual effect 622 is shown to be larger than the size of the visual effect 612, but is not limited thereto, and visual attributes such as the hue, transparency, or blurring degree of the visual effect can change as the number of accumulated emotions of the video content increases. For example, as the number of accumulated emotions increases, the transparency of the visual effect gradually decreases, and the visual effect can be output more clearly.

A third operation 630 illustrates an example in which the number of accumulated emotional expressions reaches a predetermined target value (e.g., 1,000) and visual effects 634, 636 are output in a first area 632 of the display. In one embodiment, the visual effect 634 has a predetermined shape, size, and hue, and a predetermined animation effect is applied. The visual effect 634 can be output at any position within the first area 632 where the video content is output, and can be output at the center of the first area 632.

In one embodiment, a visual effect 636 (e.g., text, an image, etc.) indicating the predetermined target value may be displayed along with the visual effect 634. For example, the visual effect 636 may display a number in the form of "1,000," "1K," "1M," etc., or may display a symbol or graphic that the user should recognize as indicating a particular number (e.g., multiple star-shaped graphics each representing 100).

In one embodiment, the first area 632 may include a first layer on which video content is output and a second layer on which visual effects 634, 636 are output. Here, the second layer may be a higher layer than the first layer. With this configuration, the user can clearly recognize that the number of accumulated emotional expressions has reached a predetermined target value.

In one embodiment, before outputting the visual effect 634 in the first area 632 and after outputting the visual effect in the second area 614, a connecting visual effect can be output to seamlessly connect the visual effect output in the second area 614 and the visual effect 634 output in the first area 632. For example, the visual effect 634 can be output after the visual effect output in the second area 614 rises to the first area 632. With this configuration, connectivity between the visual effects output in the second area 614 and the first area 632 can be provided when the number of accumulated emotional expressions reaches a target value.

FIG. 7 is a diagram showing an example of setting values 700 for visual effects displayed in an area where chat content is output according to one embodiment of the present disclosure. As shown in the figure, the setting values 700 can include at least one of the type of visual effect, the size range, the transparency range, the blurring range, or the duration range. A video content service administrator or a video content administrator can modify or delete part of the setting values 700, or add new data to the setting values 700. For example, in the case of video content that is expected to attract a large number of viewers, the administrator can set the duration interval of the visual effect to be shorter than the basic value.

When video content is played back via a user terminal, visual effects based on the data in the setting values 700 can be output on the display of the user terminal. The user terminal can receive all or part of the setting values 700 from the information processing system, or receive video or visual effect data that reflects all or part of the setting values 700, and output visual effects based on the data in the setting values 700 together with the video content.

The data in the setting value 700 shown in FIG. 7 is merely an example and is not limited thereto. For example, the types of visual effects are not limited to heart shapes and star shapes, but may include various shapes such as circles. Similar to the setting value 700, various setting values associated with the visual effects output in the third area of the display may be stored by a video content service administrator or a video content administrator.

8 is a diagram showing an example of a setting value 800 of a visual effect associated with the number of accumulated emotional expressions of a video content according to an embodiment of the present disclosure. As shown in the figure, the setting value 800 may include a type of visual effect, an initial position, a subsequent position, a maximum size, a hue, a transparency, a blurring process, a number of target user inputs, a size conversion interval, and the like. Based on the setting value 800 and the number of accumulated emotional expressions, the visual attributes of the visual effect associated with the number of accumulated emotional expressions of the video content may change. A video content service administrator or a video content administrator may modify or delete a part of the setting value 800 or add new data to the setting value 800. For example, if an administrator expects a large influx of viewers, the administrator may set a target value for the number of accumulated emotional expressions higher than the base value.

When video content is played back via a user terminal, visual effects based on the data in the setting values 800 can be output on the display of the user terminal. The user terminal can receive all or part of the setting values 800 from the information processing system, or receive video or visual effect data that reflects all or part of the setting values 800, and output visual effects based on the data in the setting values 800 together with the video content.

In one embodiment, the set value 800 may include information associated with the positions of visual effects before and after the number of accumulated emotional expressions reaches a predetermined target value. For example, the set value 800 may include information related to the positions of visual effects associated with the number of accumulated emotional expressions and the positions of visual effects associated with the reaching of the target number of accumulated emotional expressions. The information related to the positions may include, but is not limited to, coordinate values (e.g., X: 150, Y: 30), and may include any type of information that can identify a position. In addition, the set value 800 may include various position information to include various movements, as well as the initial position and subsequent positions.

In one embodiment, the setting value 800 may include information related to a target value for the number of accumulated emotional expressions and a detailed section in which the visual attribute of the visual effect changes. For example, the target value may be set to 2,000, the first section value to 500, the second section value to 1,000, and the third section value to 1,500. In this case, the visual effect increases in size every time the number of accumulated emotional expressions reaches 500, 1,000, and 1,500, respectively, and when it reaches 2,000, a visual effect associated with the achievement of the goal may be output. The number of detailed sections may be set by an administrator, and the visual attribute may be set to change in proportion to the number of accumulated emotional expressions without dividing the detailed sections. Also, the visual attribute may be set to not change until the target value is reached, and a visual effect associated with the achievement of the target value may be output at the same time as the target value is reached. The detailed section value may be expressed as the number of accumulated emotional expressions (e.g., 500) as described above, or as a percentage value with the target value as the maximum value. For example, if the target value is 2,000 and the interval value is 30%, the visual attributes of the visual effect may change when the cumulative number of emotional expressions reaches 600.

The data in the setting values 800 shown in FIG. 8 are merely examples and are not limited to these. For example, the types of visual effects are not limited to heart shapes and star shapes, but can include various shapes such as circles.

FIG. 9 is a flowchart illustrating a method 900 for displaying a user's emotional expression in video content according to one embodiment of the present disclosure. Method 900 may be performed by at least one processor of a user terminal. Method 900 may begin by the processor outputting video content in a first region on a display of the user terminal (S910). Thereafter, the processor may output chat content associated with the video content in a second region on the display (S920).

The processor may then receive user input associated with the user's emotional expression in a third region on the display (S930). In response to receiving the user input, the processor may output a first visual effect associated with the emotional expression in the second region (S940). Here, the first visual effect may have at least one of any size, any hue, or any transparency, and may be output at any position within the second region. Alternatively, in response to receiving the user input, the processor may output a second visual effect associated with the user's emotional expression in the third region at the same time as outputting the first visual effect in the second region.

In one embodiment, the second area may include a first layer to which chat content is output and a second layer to which the first visual effect is output. In this case, the first layer may be a layer higher than the second layer. In addition, the first area to which video content is output and the second area to which chat content is output may partially overlap, and the second area may further include a third layer to which part of the video content is output. In this case, the second layer may be a layer higher than the third layer.

In one embodiment, the processor can output a third visual effect associated with the other user's emotional expression in the second area. When the processor outputs the third visual effect associated with the other user's emotional expression in the second area, the visual effect associated with the other user's emotional expression is not output in the third area.

In one embodiment, the processor can output a fourth visual effect in the second region, the visual attribute of which changes based on the number of accumulated emotional expressions associated with the video content. Here, the fourth visual effect increases in magnitude as the number of accumulated emotional expressions associated with the video content increases. In this case, the second region can include a first layer in which chat content is output, and a second layer in which the fourth visual effect is output. The first layer can be a higher layer than the second layer.

In one embodiment, in response to determining that the number of cumulative emotional expressions associated with the video content has reached a predetermined target value, the processor can output a fifth visual effect in the first region. In this case, the first region can include a fourth layer in which the video content is output and a fifth layer in which the fifth visual effect is output. The fifth layer can be a layer higher than the fourth layer. Also, before outputting the fifth visual effect and after outputting the fourth visual effect, the processor can output a sixth visual effect for seamlessly connecting the fourth visual effect output in the second region and the fifth visual effect output in the first region. Additionally, the processor can output a seventh visual effect indicating the predetermined target value together with the fifth visual effect in the first region.

The flowchart of FIG. 9 and the above description are merely illustrative and may be implemented differently in some embodiments. For example, one or more steps may be omitted, the order of the steps may be changed, one or more steps may overlap, or one or more steps may be repeated multiple times.

The above-mentioned method may be provided as a computer program stored in a computer-readable recording medium for execution by a computer. The medium may be a medium for continuously storing a computer-executable program or a medium for temporarily storing the program for execution or download. The medium may be a variety of recording or storage means in the form of a single or multiple pieces of hardware combined, and may not be limited to a medium directly connected to a computer system, but may be distributed over a network. Examples of the medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, ROMs, RAMs, flash memories, etc., configured to store program instructions. Other examples of the medium include recording or storage media managed by app stores that distribute applications, and other sites and servers that supply or distribute various software.

The methods, operations, or techniques of the present disclosure may be embodied in a variety of ways. For example, such techniques may be embodied in hardware, firmware, software, or a combination thereof. Those skilled in the art will appreciate that the various exemplary logical blocks, modules, circuits, and algorithmic steps described in the present disclosure may be embodied in electronic hardware, computer software, or a combination of both. To clearly illustrate such alternatives between hardware and software, the various exemplary components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is embodied as hardware or software will vary depending on the particular application and design requirements imposed on the overall system. Those skilled in the art may also embody the described functionality in a variety of ways for each particular application, but such embodying should not be interpreted as departing from the scope of the present disclosure.

In a hardware implementation, the processing units utilized to perform the techniques may be embodied as one or more ASICs, DSPs, digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units designed to perform the functions described in this disclosure, computers, or any combination thereof.

Thus, the various exemplary logic blocks, modules, and circuits described in this disclosure may be embodied or performed by any combination of general purpose processors, DSPs, ASICs, FPGAs or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, or any combination designed to perform the functions described herein. A general purpose processor may be a microprocessor, but alternatively, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be embodied by a combination of computing devices, such as a DSP and a microprocessor, multiple microprocessors, one or more microprocessors associated with a DSP core, or any other configuration.

In a firmware and/or software implementation, the techniques may be embodied with instructions stored on a computer-readable medium, such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable PROM (EEPROM), flash memory, compact disc (CD), magnetic or optical data storage devices, and the like. The instructions may be executable by one or more processors, causing the processors, etc., to perform certain aspects of the functions described in this disclosure.

Although the above embodiments have been described as utilizing aspects of the presently disclosed subject matter on one or more stand-alone computer systems, the present disclosure is not limited thereto and may be embodied in any computing environment, such as a network or distributed computing environment. Furthermore, aspects of the subject matter in the present disclosure may be embodied on multiple processing chips or devices, and storage may be affected similarly across multiple devices. Such devices may include PCs, network servers, and handheld devices.

In this specification, the present disclosure has been described by way of some examples, but various modifications and changes are possible without departing from the scope of the present disclosure that would be understood by a person skilled in the art to which the present disclosure pertains. Furthermore, such modifications and changes should be understood to fall within the scope of the claims attached to this specification.

100 User 110 User terminal 120 Display 130 "Like" button 140 Visual effect associated with user's emotional expression 150 Visual effect associated with number of accumulated emotional expressions

Claims (16)

A method for displaying a user's emotional expression in video content, the method being performed by at least one processor of a user terminal, comprising:
outputting the video content in a first area on a display of the user terminal;
outputting chat content associated with the video content in a second area on the display;
receiving a user input associated with a user's emotional expression at a third area on the display;
and in response to receiving the user input, outputting in the second area a first visual effect associated with the emotional expression , and outputting in the third area a second visual effect associated with the emotional expression . 2. The method of claim 1, wherein in response to receiving the user input, the first visual effect is output in the second area while the second visual effect is output in the third area. The method for displaying a user's emotion expression in video content according to claim 1, wherein the first visual effect has at least one of an arbitrary size, an arbitrary hue, and an arbitrary transparency, and is output at an arbitrary position within the second area. the second area includes a first layer on which the chat content is output and a second layer on which the first visual effect is output;
The method for displaying a user's emotional expression in video content according to claim 1 , wherein the first layer is a layer higher than the second layer. a first area to which the video content is output and a second area to which the chat content is output partially overlap each other;
the second area further includes a third layer through which a portion of the video content is output;
The method for displaying a user's emotional expression in video content according to claim 4 , wherein the second layer is a layer higher than the third layer. The method for displaying a user's emotional expression in video content according to claim 1, further comprising the step of outputting a third visual effect associated with the emotional expression of another user in the second area. The method for displaying a user's emotional expression in video content according to claim 6, wherein when a third visual effect associated with the other user's emotional expression is output in the second area, the visual effect associated with the other user's emotional expression is not output in the third area. The method for displaying a user's emotional expressions in video content according to claim 1, further comprising a step of outputting a fourth visual effect in the second area, the visual attribute of which changes based on the number of accumulated emotional expressions associated with the video content. The method for displaying user emotional expressions in video content according to claim 8, wherein the fourth visual effect increases in magnitude with an increase in the number of cumulative emotional expressions associated with the video content. the second area includes a first layer to which the chat content is output and a second layer to which the fourth visual effect is output;
The method for displaying a user's emotional expression in video content according to claim 8 , wherein the first layer is a layer higher than the second layer. The method for displaying a user's emotional expressions in video content according to claim 8, further comprising the step of outputting a fifth visual effect in the first area in response to determining that the number of accumulated emotional expressions associated with the video content has reached a predetermined target value. the first area includes a fourth layer to which the video content is output and a fifth layer to which the fifth visual effect is output;
The method for displaying a user's emotional expression in video content according to claim 11, wherein the fifth layer is a layer higher than the fourth layer. The method for displaying a user's emotional expression in video content according to claim 11, further comprising the step of outputting a sixth visual effect before outputting the fifth visual effect and after outputting the fourth visual effect, for seamlessly connecting the fourth visual effect output in the second area and the fifth visual effect output in the first area. The method for displaying a user's emotional expression in video content according to claim 11, further comprising the step of outputting, in the first area, a seventh visual effect indicating the predetermined target value together with the fifth visual effect. A computer-readable computer program for executing the method for displaying a user's emotional expression in video content according to any one of claims 1 to 14. A user terminal,
A communication module;
Memory,
A display and
at least one processor coupled to the memory and configured to execute at least one computer readable program contained in the memory;
The at least one program comprises:
outputting video content in a first area on the display;
outputting chat content associated with the video content in a second area on the display;
receiving a user input associated with a user's emotional expression at a third area on the display;
and in response to receiving the user input, outputting in the second area a first visual effect associated with the emotional expression , and outputting in the third area a second visual effect associated with the emotional expression .

Images