JP7640185B2 - Information verification method and system - Google Patents

Description

The present disclosure relates to a method and system for verifying information received via an instant messaging application that provides video calling services, and in particular, to a method and system for verifying a user's gender information received via an instant messaging application.

User terminals such as smartphones, tablet PCs, laptop computers, and desktop computers equipped with cameras are becoming more and more popular. In addition, recent developments in communication technology allow users to easily send images and videos taken using their own terminals to others. Furthermore, since users can send or broadcast videos taken using their own terminals to others in real time, video call services and personal broadcasting services are widely used. In the case of using anonymous chat services in this environment, there is an increasing demand from users to use not only text chat but also video call services.

Meanwhile, some users of anonymous chat services may use anonymous chat services through video calls after entering a gender different from their own gender. If a person is matched with an anonymous chat service based on such a false gender, not only may the matched person feel uncomfortable, but the reliability of the anonymous chat service may also be adversely affected. In order to check for such false gender, a method is used in which monitoring personnel directly use the application to expose users who act under a false gender, or directly inspect and expose the image declared by the user. However, since such inspection work is performed manually, the number of users who can be inspected may be limited depending on the number of monitoring personnel. In addition, since the monitoring personnel verify whether the user's gender is false based on their own judgment, there is a risk that the inspection results by the monitoring personnel may be incorrect.

Korean Patent No. 10-1277322

This disclosure provides an information verification method, computer program, recording medium, system, etc. to solve the problems described above.

A method and system are provided for receiving a gender associated with a user account and verifying the gender associated with the received user account based on an image including the user's face captured through an image sensor while an application is running.

A method and system are provided for collecting information and/or data associated with a user account received or processed via an instant messaging application and verifying the gender associated with the user account based on the collected information and/or data associated with the user account.

Methods and systems are provided that utilize facial imagery of a user as well as information and/or data associated with a user account received or processed via an instant messaging application to verify the gender associated with a user account.

In this application, "face" and "face" are synonymous (face) unless the context clearly indicates otherwise.

The present disclosure may be embodied in a variety of ways, including as a method, system, device, or computer-readable storage medium storing the commands.

A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service according to one embodiment of the present disclosure includes the steps of receiving a gender associated with a first user account, receiving an image including a face captured through an image sensor while the application is operating, inputting the received image into an artificial neural network model and outputting a gender associated with the face included in the received image, and verifying the received gender based on the output gender.

According to one embodiment, the artificial neural network model is generated by performing machine learning based on data representing a plurality of training images and data representing genders of people within the plurality of training images.

According to one embodiment, the received image includes clothing, and the step of outputting a gender associated with a face included in the received image includes the steps of extracting image features from the received image and inputting the extracted image features into an artificial neural network model to output the gender.

According to one embodiment, the step of verifying the received gender based on the output gender includes the step of providing the received image to a separate monitoring system if the output gender differs from the received gender.

According to one embodiment, the step of verifying the received gender based on the output gender includes a step of providing the received image to a separate monitoring system if the output gender is the same as the received gender and the reliability of the output gender is equal to or less than a predetermined reliability.

According to one embodiment, if the gender received in the separate monitoring system is determined to be different from the gender associated with the first user account, a penalty is applied to the first user account.

According to one embodiment, the information verification method further includes a step of receiving evaluation information for the first user account from the second user account, and the step of verifying the received gender based on the output gender includes a step of verifying the received gender based on the received evaluation information and the output gender.

According to one embodiment, the information verification method further includes receiving interest information associated with the first user account, and verifying the received gender based on the output gender includes verifying the received gender based on the interest information and the output gender.

According to one embodiment, the information verification method further includes a step of receiving evaluation information for one or more second user accounts provided by the first user account, and the step of verifying the received gender based on the output gender includes a step of verifying the received gender based on the evaluation information for one or more second user accounts provided by the received first user account and the output gender.

According to one embodiment, the information verification method further includes a step of receiving one or more second user accounts that are previously matched with the first user account, and the step of verifying the received gender based on the output gender includes a step of verifying the received gender based on the received information for the one or more second user accounts and the output gender.

According to one embodiment, the information verification method further includes a step of receiving declared information for the first user account, and the step of verifying the received gender based on the output gender includes a step of verifying the received gender based on the received declared information and the output gender.

According to one embodiment, the information verification method further includes receiving information for a plurality of user accounts associated with the first user account within the application, and verifying the received gender based on the output gender includes verifying the received gender based on the information for the plurality of user accounts associated with the first user account and the output gender.

According to one embodiment, the information verification method further includes a step of collecting user activity information for the first user account, and the step of verifying the received gender based on the output gender includes a step of verifying the received gender based on the collected user activity information and the output gender.

According to one embodiment, the user activity information for the first user account includes information on at least one of a blur item, a facial effect item, a lock-in item, a shake item, or a sticker item used by the first user account while making a video call with the second user account.

According to one embodiment, receiving a gender associated with the first user account includes receiving at least one of a gender entered while the first user account was subscribed to the application or a gender extracted from account information associated with the first user account.

According to one embodiment, the step of receiving an image including a face includes a step of receiving an image including the detected face when a face is detected in image data captured through an image sensor operated after the first user account is subscribed to the application.

According to one embodiment, the information verification method further includes receiving text entered during a text chat between the first user account and one or more second user accounts, and verifying the received gender based on the output gender includes verifying the received gender based on the received text and the output gender.

In one embodiment of the present disclosure, a computer program is provided for executing a method for verifying information received via an instant messaging application that operates on the user terminal and provides a video call service.

The disclosed system for verifying information received via an instant messaging application providing a video calling service includes a communication module configured to receive a gender associated with a first user account from a user terminal and receive an image including a face captured through an image sensor while the application is operated, and a processor configured to input the received image into an artificial neural network model to output a gender associated with the face included in the received image, and verify the received gender based on the output gender.

According to one embodiment, the communication module is further configured to receive rating information for the first user account from the second user account, and the processor is further configured to verify the received gender based on the received rating information and the output gender.

According to some embodiments of the present disclosure, by verifying a user's gender information received via an instant messaging application, distrust that a user may have regarding the gender of the other party using the anonymous video chat service, as well as distrust toward the anonymous video chat service, may be minimized or eliminated.

In some embodiments of the present disclosure, the information processing system can minimize the cost of manpower testing a user's gender by analyzing the gender associated with the user account based on information about the user account collected via an instant messaging application.

According to some embodiments of the present disclosure, the verification of a user's gender is performed through an information processing system and a separate monitoring system, i.e., a two-step system, so that the error rate of the verification result for the user's gender can be reduced or minimized.

Non-limiting embodiments of the present disclosure will be described with reference to the accompanying drawings, in which like reference numerals indicate like elements, as described below.
1 is a schematic diagram showing a configuration in which an information processing system is communicatively connected to a plurality of user terminals to provide an instant messaging service according to an embodiment of the present disclosure. 2 is a block diagram showing an internal configuration of a user terminal and an information processing system according to an embodiment of the present disclosure. FIG. FIG. 1 is a block diagram illustrating a configuration of an information processing system configured to provide a video calling service and verify a user's gender according to one embodiment of the present disclosure. FIG. 2 is a schematic diagram illustrating an artificial neural network model configured to output, from an input image, a gender associated with a person or face in the input image according to one embodiment of the present disclosure. 1 is a flowchart illustrating a method for verifying information received via an instant messaging application operating in a user terminal and providing a video call service according to an embodiment of the present disclosure. 10 is a flowchart illustrating detailed steps of verifying the received gender based on the output gender according to one embodiment of the present disclosure. 1 is a diagram illustrating an example of receiving a gender associated with a user account while the user account is being subscribed to an instant messaging application according to an embodiment of the present disclosure. 1 is a diagram illustrating an example of detecting a face image from an image captured through an image sensor and inputting requirements for a partner of a video call service while an instant messaging application according to an embodiment of the present disclosure is operated. 1 is a diagram illustrating an example of applying a blurring process to an image including at least a portion of a user in an instant messaging application according to an embodiment of the present disclosure. 1 is a diagram illustrating an example of applying facial effect processing and sticker items to an image including a user's face in an instant messaging application according to an embodiment of the present disclosure. 1 is a diagram illustrating an example of starting a video call session according to an embodiment of the present disclosure, adding a video call partner during the video call session, and performing text chat. 1 is a diagram illustrating an example of sending evaluation information evaluating a counterpart during a video call session with the counterpart and receiving evaluation information from the counterpart according to an embodiment of the present disclosure. 1 is a diagram showing an example of using a lock-in item to prevent a party from answering a video call session according to an embodiment of the present disclosure; 1 is a diagram showing an example of using a shake item of a user terminal during a video call with a partner according to an embodiment of the present disclosure. 1 is a diagram showing an example of sending a declaration item during a video call session with a partner according to an embodiment of the present disclosure. 1 is a diagram illustrating an example of querying messages and friend lists associated with a user account according to an embodiment of the present disclosure. 1 is a diagram illustrating an example of outputting profile information related to a user account according to an embodiment of the present disclosure. 1 is a diagram illustrating an example of outputting one or more user accounts that have made a video call with a user account according to an embodiment of the present disclosure.

The specific contents for implementing the present disclosure will be described in detail below with reference to the attached drawings. However, in the following description, specific descriptions of well-known functions and configurations will be omitted if there is a risk of unnecessarily obscuring the gist of the present disclosure.

In the accompanying drawings, identical or corresponding components are given the same reference symbols. In addition, in the following description of the embodiments, duplicated description of identical or corresponding components may be omitted. However, even if a description of a component is omitted, it is not intended that such a component is not included in a certain embodiment.

Advantages and features of the disclosed embodiments, and methods for achieving the same, will become apparent from the following detailed description of the embodiments in conjunction with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below, and may be embodied in various different forms, and the embodiments are provided solely to ensure that this disclosure is complete and to fully convey the scope of the invention to those skilled in the art to which the disclosure pertains.

We will briefly explain the terms used in this specification and provide a specific description of the disclosed embodiments.

The terms used in this specification are currently common terms that are widely used as much as possible while taking into consideration the functions in this disclosure, but these may change depending on the intentions or precedents of engineers in related fields, the emergence of new technologies, etc. In addition, in certain cases, the applicant may arbitrarily select terms, and in such cases, the meanings of the terms will be described in detail in the description of the relevant invention. Therefore, the terms used in this disclosure should be defined based on the meanings that the terms have and the overall content of this disclosure, rather than simply by the name of the terms.

In this specification, the singular expression includes the plural expression unless the context clearly indicates otherwise. In addition, the plural expression includes the singular expression unless the context clearly indicates otherwise.

Throughout the specification, when a part is said to "comprise" certain elements, this does not mean that it excludes other elements, but that it may further include other elements, unless specifically stated to the contrary.

Also, the term "module" or "unit" as used in the specification means a software or hardware component, and the "module" or "unit" performs a certain role. However, the meaning of "module" or "unit" is not limited to software or hardware. The "module" or "unit" can be configured to be in an addressable storage medium, and can be configured to execute one or more processors. Thus, as an example, a "module" or "unit" can include components such as software components, object-oriented software components, class components, and task components, and at least one of a process, a function, an attribute, a procedure, a subroutine, a segment of program code, a driver, firmware, microcode, a circuit, data, a database, a data structure, a table, an array, or a variable. The components and "modules" or "units" can be combined into fewer components and "modules" or "units" or further separated into additional components and "modules" or "units".

According to one embodiment of the present disclosure, a "module" or "unit" may be embodied with a processor and memory. A "processor" should be broadly construed to include a general-purpose processor, a central processing unit (CPU), a microprocessor, a digital signal processor (DSP), a controller, a microcontroller, a state machine, and the like. In some circumstances, a "processor" may also refer to an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), and the like. A "processor" may also refer to a combination of processing devices, such as, for example, a combination of a DSP and a microprocessor, a combination of multiple microprocessors, a combination of one or more microprocessors coupled with a DSP core, or any other such combination of configurations. Also, a "memory" should be broadly construed to include any electronic component capable of storing electronic information. "Memory" may refer to various types of processor-readable media, such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), flash memory, magnetic or optical data storage devices, registers, etc. Memory is said to be in electronic communication with the processor if the processor can read information from and/or write information to the memory. Memory that is integrated with a processor is in electronic communication with the processor.

In this disclosure, a "user account" may refer to an account or data associated therewith that a user creates and uses in an instant messaging application. Additionally, a user account for an instant messaging application may refer to a user who uses the instant messaging application. Similarly, a user who uses a video calling service provided by an instant messaging application may refer to a user account for an instant messaging application.

In this disclosure, an "image" can include multiple images or footage. Also, an image can include an image captured through an image sensor attached to a user terminal, or an image captured by an image sensor configured to be able to communicate with a user terminal. Also, an image can include a partial image extracted from a captured video footage.

For purposes of this disclosure, "during the time a user account is subscribed to an application" or "at the time a user account is subscribed to an application" may refer to the period during which information and/or data required to subscribe a user account to an application is obtained or received.

In the present disclosure, "user activity information" may include information or data indicating the activity of a user or a user terminal using a user account of an instant messaging application. According to one embodiment, the user activity information of a user account may refer to information or data used by the user account while the instant messaging application is running. For example, the user activity information may include, but is not limited to, a blur item, a facial effect item, a sticker item, etc. applied to an image including the user's face. According to another embodiment, the user activity information of a user account may refer to information or data used during a video call provided by the user account in the instant messaging application. For example, the user activity information may include, but is not limited to, a lock-in item, a shake item, etc. used during a video call with the other party.

1 is a schematic diagram showing a configuration in which an information processing system (130) is communicatively connected to a plurality of user terminals (112, 114, 116) to provide an instant messaging service according to an embodiment of the present disclosure. The information processing system (130) may include a system that can store, process, and verify information received through an instant messaging service to a plurality of user terminals (112, 114, 116) via a network (120), as well as provide information through the instant messaging service. According to an embodiment, the information processing system (130) may include one or more server devices and/or databases that can store, provide, and execute computer executable programs (e.g., downloadable applications) and data related to the instant messaging service, or one or more distributed computing devices and/or distributed databases based on a cloud computing service. The instant messaging service provided by the information processing system (130) may be provided to users through an instant messaging application installed in a plurality of user terminals (112, 114, 116). For example, the instant messaging service may include a video call service and/or a text messaging service between the user terminals (112, 114, 116). In FIG. 1, it has been described that the information processing system (130) may be configured to verify information received through an instant messaging application, but is not limited thereto, and may be configured to verify information received through an instant messaging application through a system separate from the information processing system (130).

In FIG. 1, a mobile phone terminal (112), a tablet terminal (114), and a PC terminal (116) are illustrated as examples of user terminals, but are not limited thereto, and a user terminal can be any computing device capable of wired and/or wireless communication, having an image sensor (e.g., a camera) attached or capable of communicating with an image sensor, and having an instant messaging application installed and running. For example, the user terminal may include a smart phone, a mobile phone, a navigation system, a computer, a laptop, a digital broadcasting terminal, a PDA (Personal Digital Assistant), a PMP (Portable Multimedia Player), a tablet PC, a game console, a wearable device, an IoT (internet of things) device, a VR (virtual reality) device, an AR (augmented reality) device, and the like. Also, while FIG. 1 illustrates three user terminals (112, 114, 116) communicating with the information processing system (130) via the network (120), this is not limited, and a different number of user terminals may be configured to communicate with the information processing system (130) via the network (120).

The communication method is not limited, and may include not only a communication method utilizing a communication network (e.g., a mobile communication network, a wired Internet, a wireless Internet, a broadcast network, a satellite network, etc.) that the network (120) may include, but also short-range wireless communication between user terminals. For example, the network (120) may include one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, etc. In addition, the network (120) may include one or more of the following network topologies, including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network.

The information processing system (130) may provide a video call service between user terminals (112, 114, 116) on which an instant messaging application is operated. According to one embodiment, the information processing system (130) may match a first user of a first user terminal and a second user of a second user terminal based on a specified condition, and may interconnect the first user terminal and the second user terminal so that a video call can be made between both users. Such specified conditions may include conditions for a party with which the user himself/herself desires to make a video call, and may include conditions input by at least one of the first user or the second user. For example, the specified conditions may include, but are not limited to, the gender, region, age, occupation, annual income, physical condition, etc. of the other party. According to another embodiment, the information processing system (130) may randomly match a first user of a first user terminal and a second user of a second user terminal, and interconnect the first user terminal and the second user terminal so that a video call can be made between both users.

The information processing system (130) may be configured to collect information through an instant messaging application. According to one embodiment, the information processing system (130) may be configured to receive an image including a user's face captured through an image sensor attached to a user terminal during operation of the instant messaging application. For example, such an image including the user's face may be detected or selected from an image (e.g., a video image) captured after the user subscribes to the instant messaging application, and the detected image may be provided to the information processing system (130). The detected image may include not only the user's face but also the user's clothes. According to another embodiment, the information processing system (130) may collect any information and/or data related to a user for an instant messaging application. For example, the information processing system (130) may collect information input by the user to the instant messaging application, a history of the user's use of the instant messaging application, the user's friend list, input information of other users for the user, text input during a text chat, etc., but is not limited thereto.

The information processing system (130) may be configured to verify information received via an instant messaging application. According to one embodiment, the information received from the user terminal may be configured to verify information received when the user subscribes to the instant messaging application. Here, the information received from the user terminal may include information about the user, information indicating the user, etc., and may include, but is not limited to, the user's gender, age, or year of birth.

The information processing system (130) may be configured to verify information on the user's gender received based on information collected through an instant messaging application. According to one embodiment, the information processing system (130) may verify information on the user's gender received by analyzing an image including the user's face. For example, an image including the user's face or image feature information extracted therefrom may be input to a trained artificial neural network model to output the user's gender. According to another embodiment, the information processing system (130) may analyze the user's gender received based on information related to the user collected through an instant messaging application as well as the analysis result on the image including the user's face. For example, in addition to the user's gender result analyzed from the image including the user's face, the user's gender may be verified based on at least one of information input by the user through an instant messaging application, history information of the user's use of the instant messaging application, information on the user's friend list, input information of other users regarding the user, or text information input during a text chat. As another example, the information processing system (130) may verify the gender of the received user only by using information related to the user collected through the instant messaging application, without considering the analysis results of the image including the user's face. If the received gender of the user is different from the actual gender of the user, the information processing system may be provided to a separate verification system (e.g., a monitoring personnel check, a different algorithm for gender verification, etc.). In addition, a user account in which the user's gender is entered falsely may be penalized (e.g., suspended, withdrawn, etc.) when using an instant messaging application. In FIG. 1, the information processing system (130) is disclosed as verifying the information received through the instant messaging application, but is not limited thereto, and the user terminal on which the instant messaging application is operated may be configured to verify the received information.

2 is a block diagram showing the internal configuration of a user terminal (112) and an information processing system (130) in one embodiment of the present invention. The user terminal (112) may include a memory (216), a processor (218), a communication module (220), and an input/output interface (214). Similarly, the information processing system (130) may include a memory (234), a processor (236), a communication module (238), and an input/output interface (232). As shown in FIG. 2, the user terminal (112) and the information processing system (130) may be configured to communicate information and/or data via the network (120) using their respective communication modules (220, 238). In addition, the input/output device (212) may be configured to input information and/or data to the user terminal (112) via the input/output interface (214) and output information and/or data generated from the user terminal (112). In FIG. 2, the memory (234), the processor (236), the communication module (238), and the input/output interface (232) are illustrated as the internal configuration of the user terminal (112), but other user terminals (e.g., the user terminals (114, 116) in FIG. 1) may also include the same or similar internal configuration as the internal configuration of the user terminal (112).

The memory (216, 234) may include any non-transitory computer-readable recording medium. According to an embodiment, the memory (216, 234) may include a non-volatile mass storage device such as a random access memory (RAM), a read only memory (ROM), a disk drive, a solid state drive (SSD), a flash memory, etc. As another example, a non-volatile mass storage device such as a ROM, an SSD, a flash memory, a disk drive, etc. may be included in the user terminal (112) or the information processing system (130) as a separate permanent storage device separate from the memory (216, 234). In addition, the memory (216, 234) may store an operating system and at least one program code (e.g., code for a browser installed and operated in the user terminal (112) or an instant messaging application installed in the user terminal (112) to provide an instant messaging service). Such software components may be loaded from a computer-readable recording medium separate from the memory (216, 234). Such separate computer-readable recording medium may include a recording medium directly connectable to these user terminals and the information verification system, and may include computer-readable recording media such as a floppy drive, a disk, a tape, a DVD/CD-ROM drive, a memory card, etc. As another example, the software components may be loaded into the memory (216, 234) through a communication module (220, 238) rather than a computer-readable recording medium. For example, at least one program may be loaded into the memory (216, 234) based on a computer program (e.g., the instant messaging application described above) installed by a file provided over the network (120) by a developer or a file distribution system that distributes the installation file of the application.

The processors (218, 236) can be configured to process computer program commands by performing basic arithmetic, logic, and input/output operations. The commands can be provided to the processors (218, 236) by the memory (216, 234) or the communication module (220, 238). For example, the processors (218, 236) can be configured to execute commands received by program code stored in a storage device such as the memory (216, 234).

The communication module (220, 238) may provide a configuration or function for the user terminal (112) and the information verification system (130) to communicate with each other via the network (120), and may provide a configuration or function for the user terminal (112) and/or the information processing system (130) to communicate with other user terminals or other systems (e.g., a separate monitoring system). As an example, a request generated by the processor (218) of the user terminal (112) according to a program code stored in a recording device such as the memory (216) may be transmitted to the information processing system (130) via the network (120) under the control of the communication module (220). Conversely, control signals, commands, content, files, etc. provided under the control of the processor (236) of the information processing system (130) may be received by the user terminal (112) through the communication module (220) of the user terminal (112) via the communication module (238) and the network (120). For example, control signals, commands, content, files, etc. of the information processing system (130) received through the communication module (220) can be transmitted to the processor (218) or memory (216), and the content, files, etc. can be stored in a storage medium (the permanent storage device described above) that the user terminal (112) can further include.

The input/output interface (214) may be a means for interfacing with the input/output device (212). As an example, the input device may include a device such as a camera, keyboard, microphone, or mouse, and the output device may include a device such as a display, speaker, or haptic feedback device. As another example, the input/output interface (214) may be a means for interfacing with a device in which the configuration or function for performing input and output is integrated into one, such as a touch screen. For example, when the processor (218) of the user terminal (112) processes a command of a computer program loaded in the memory (216), a service screen or content configured using information and/or data provided by the information processing system (130) or another user terminal may be displayed on the display via the input/output interface (214). The input/output device (212) may be configured as a single device together with the user terminal (112). In addition, the input/output interface (232) of the information processing system (130) may be connected to the information processing system (130) or may be a means for interfacing with an input or output device (not shown) that may be included in the information processing system (130). In FIG. 2, the input/output interfaces (214, 232) are illustrated as elements configured separately from the processors (218, 236), but are not limited thereto, and the input/output interfaces (214, 232) may be configured to be included in the processors (218, 236).

The user terminal (112) and the information processing system (130) may include more components than those in FIG. 2. However, it is not necessary to clearly illustrate most of the conventional technical components. According to an embodiment, the user terminal (112) may be embodied to include at least some of the above-mentioned input/output devices. The user terminal (112) may further include other components such as a transceiver, a GPS (Global Positioning System) module, a camera, various sensors, a database, and the like. For example, if the user terminal (112) is a smartphone, it may include components that are generally included in a smartphone, and may be embodied to further include various components such as an acceleration sensor, a gyro sensor, a camera module, various physical buttons, buttons using a touch panel, an input/output port, and a vibrator for vibration.

According to one embodiment, the processor (218) of the user terminal (112) may be configured to operate an instant messaging application providing a video call service. At this time, program code related to the instant messaging application may be loaded into the memory (216) of the user terminal (112). During operation of the instant messaging application, the processor (218) of the user terminal (112) may receive information and/or data provided from the input/output device (212) via the input/output interface (214) or may receive information and/or data from the information processing system (130) through the communication module (220), process the received information and/or data, and store it in the memory (216). Also, such information and/or data may be provided to the information processing system (130) through the communication module (220).

While the instant messaging application is operated, the user terminal (112) may be configured to operate a camera, which is an input device connected to an input/output interface. For example, the camera may be arranged to capture an image including the face of the user of the user terminal (112), and may be installed on the front and/or rear of the user terminal (112). The video or image captured through the camera may be transmitted to the processor (218). According to an embodiment, the processor (218) may be configured to detect whether there is an image including a face from a video or image captured while the application is operated (e.g., while the application is operated after the user subscribes to the application). The processor (218) may be configured to detect an image including a face from a received image by applying any face recognition or detection algorithm, technique and/or artificial intelligence technique known in the object recognition or detection field. For example, the processor (218) may be configured to extract one or more feature points from the received image and determine whether a face is included in the received image based on the extracted feature points. If a face is detected from the video or image received from the camera, the processor (218) may provide the image including the face to the information processing system (130) via the communication module (220) and the network (120). According to another embodiment, during a video call service with another person provided by an instant messaging application, one or more images captured through the camera may be provided to the information processing system (130) via the communication module (220) and the network (120). In addition, the processor (236) of the information processing system (130) may provide one or more images received from the other user terminal during a call with the user terminal (112) to the user terminal (112). During such a video call service, the user's voice received through a microphone connected to the input/output interface together with the image captured through the camera may also be provided through the information processing system (130) and provided to the other user terminal.

According to an embodiment, while the instant messaging application is operating, the processor (218) may receive text, images, etc., input or selected through an input device such as a touch screen or keyboard connected to the input/output interface, and may store the received text and/or image in the memory (216) or provide it to the information processing system (130) through the communication module (220) and the network (120). For example, the processor (218) may receive user information such as a user's gender and age, text information such as a text message, interest information, and declaration information input during the instant messaging service through an input device such as a touch screen or keyboard. The processor (218) may also be configured to receive evaluation information on the other party and item information such as a blur item, a facial effect item, a lock-in item, a shake item, and a sticker item through the input device. Thus, the received text and/or image may be provided to the information processing system (130) through the communication module (220) and the network (120).

During operation of the instant messaging application, the processor (218) may be configured to output the processed information and/or data through an output device such as a display output device (e.g., a touch screen, a display, etc.) or an audio output device (e.g., a speaker) of the user terminal (112). According to one embodiment, the information and/or data provided by the instant messaging application may be displayed through a display output device, etc. For example, during a video call service provided by the instant messaging application, the processor (218) may be configured to display not only the image of the user but also the image of the other party through a display output device. As another example, the processor (218) may be configured to display various functions or configurations provided by the instant messaging application (e.g., a profile, a user information input interface, rating information, video processing items, a chat box, a friend list, etc.) on a display output device. According to another embodiment, the information and/or data provided by the instant messaging application may be output through an audio output device, etc. For example, during a video call service, the processor (218) may be configured to output the voice of the other party received from the information processing system (130).

According to one embodiment, the processor (236) of the information processing system (130) may be configured to manage, process and/or store information and/or data received from a plurality of user terminals including the user terminal (112). For example, the processor (236) may provide a video call service and/or a text chat service provided by an instant messaging application to the plurality of user terminals based on the information and/or data received from the plurality of user terminals. For example, the processor (236) may be configured to provide video, audio and/or text data received from each user terminal to the other user terminal while both user terminals are performing a video call.

The processor (236) of the information processing system (130) may be configured to verify information and/or data received from the user terminal (112) while the instant messaging application is operating. According to one embodiment, the processor (236) of the information processing system (130) may be configured to receive information regarding the user's gender from the user terminal (112) and verify the received gender. Specifically, the processor (236) of the information processing system (130) may be configured to verify the user's gender based on the received information and/or data related to the user terminal (112). A specific manner in which the processor (236) of the information processing system (130) verifies the information regarding the user's gender will be described in detail below.

Figure 3 is a block diagram showing a configuration of an information processing system (130) configured to provide a video calling service and verify a user's gender according to one embodiment of the present disclosure. The processor (236) of the information processing system (130) can be configured to include a data collection module (310), a data learning module (320), a data recognition module (330), and a gender verification module (340). The processor (236) can also transmit and receive information and/or data to and from an external device through the communication module (238). In addition, the processor (236) can store information and/or data in the memory (234) and retrieve information and/or data from the memory (234).

The data collection module (310) may be configured to receive an image including a user's face from each of a plurality of user terminals through the communication module (238) while the instant messaging application is operating. According to one embodiment, the data collection module (310) may receive an image including a user's face from an active user terminal of a user account after subscribing to the instant messaging application of the user account. For example, the received image may include not only the user's face but also at least one of other body parts of the user (e.g., neck, shoulders, arms, etc.) or clothing. The image received from the user terminal may be stored in the memory (234) or provided to the data recognition module (330).

The data collection module (310) may be configured to receive information related to the user account from the user terminal through the communication module (238) while the instant messaging application is operating. According to one embodiment, the data collection module (310) may be configured to receive gender related to the user account from the user terminal. According to another embodiment, the data collection module (310) may be configured to receive interest information related to the user account from the user terminal. According to yet another embodiment, the data collection module (310) may receive information for multiple user accounts related to the user account. For example, such multiple user accounts may be stored as a friend list for the user account.

The data collection module (310) may receive information on one or more user accounts with which the user account is matched in an instant messaging application through the communication module (238). According to one embodiment, a list of such one or more matched user accounts may be stored in the user account's usage history. Such one or more matched user accounts may be stored in the user account's usage history regardless of whether a video call or text chat service has been performed with the user account.

The data collection module (310) may be configured to receive information and/or data generated during a video call between a user account (e.g., a first user account) and another user account (e.g., a second user account) through the communication module (238). According to one embodiment, during a video call session between the first user account and the second user account, the data collection module (310) may receive evaluation information of the second user account for the first user account. Such evaluation information of the second user account for the first user account may be stored in association with the first user account. According to another embodiment, during a video call session between the first user account and the second user account, the data collection module (310) may receive evaluation information of the first user account for the second user account, and such evaluation information may be stored in association with the first user account. Here, the evaluation information may include evaluation items including icons indicating the characteristics of each user account or user, and numbers for each evaluation item. According to yet another embodiment, during a video call session between the first user account and the second user account, the data collection module (310) may receive reporting information for the first user account from the second user account. For example, the reporting information may include reporting items regarding information different from the information of the first user account during the video call (e.g., when the known gender and the gender of the person in the actual image are different), inappropriate behaviors performed by the user of the first user account, etc., and may also include the number of times for each reporting item. According to yet another embodiment, while the first user account is conducting a video call service with the second user account, the data collection module (310) may receive text messages between the first user account and the second user account.

The data collection module (310) may be configured to receive user activity information used during a video call between a user account (e.g., a first user account) and another user account (e.g., a second user account). According to an embodiment, such user activity information may include information received from the first user account during a video call session between the first user account and the second user account, as well as information received from the first user account before such a video call is performed. For example, the user activity information may include information on at least one of a blur item, a facial effect item, a lock-in item, a shake item, or a sticker item used by the first user account during a video call session with the second user account. Here, the facial effect item may include at least one of a facial filter applicable to the face of the first user account, an item for reducing the face of the first user account, or a beauty item applicable to the face of the first user account. The information and/or data received by the data collection module (310) may be stored in memory (234) in association with the user account and/or provided to the data recognition module (330) and/or gender verification module (340).

The data learning module (320) may receive data indicative of a plurality of learning images through the memory (234) or the communication module (238). For example, the plurality of learning images may include any set of images that may be learned to clearly show the distinction between males and females. The data indicative of the plurality of learning images may include data indicative of an image including a plurality of people or faces, data indicative of image features extracted from such an image, and the like. The data indicative of image features may include any information and data that may indicate or characterize an image, and may include, for example, information and data indicative of or characterizing an object (e.g., face, clothing, etc.) in an image. As an example, the information and data indicative of or characterizing an object (e.g., face, clothing, etc.) in an image may include information and data on at least one of feature points for the object, a segmentation mask for the object, or a depth for the object. In addition, the data learning module (320) may also receive data indicative of the gender of a person or face in the plurality of learning images. For example, data indicating gender may include data indicating male or female.

The data learning module (320) may generate an artificial neural network model by performing machine learning to input a plurality of training images and output gender. According to one embodiment, the data learning module (320) may be configured to input a plurality of training images and/or image features extracted therefrom to an artificial neural network model and output gender through unsupervised learning. In addition, the data learning module (320) may be configured to perform labeling, i.e., supervised learning, on the training image to generate or update an artificial neural network model when it is determined that the gender output for the training image is incorrect based on data indicating the gender associated with a person or face in the training image. Thus, the data learning module (320) may generate or update an artificial neural network model through semi-supervised learning using a plurality of learning images and data indicating gender associated with a person or face in the learning images. According to another embodiment, the data learning module (320) may generate an artificial neural network model by performing machine learning to input learning information associated with a user account and output gender. Here, the learning information associated with a user account may include information associated with a user account that may be received or processed via an instant messaging application. For example, the learning information associated with a user account may include, but is not limited to, at least one of rating information, interest information, history information, declaration information, friend list, user activity information, or text messages associated with a user account. In this case, the data learning module (320) may generate or update an artificial neural network model by performing machine learning to input not only the learning information associated with the user account but also the learning images into the artificial neural network model and output gender.

The data recognition module (330) may be configured to receive an image including a face received from a user account, input the received image to an artificial neural network model, and output a gender associated with a face or person in the received image. Here, the artificial neural network model may include an artificial neural network model trained by the data learning module (320). According to one embodiment, the data recognition module (330) may be configured to input image features extracted from an image including a face to the trained artificial neural network model, and output a gender associated with a person or face in the image. In addition, if it is determined that the output gender is different from the actual gender, the data recognition module (330) may be configured to provide the received image and the actual gender to the data learning module (320) so that the artificial neural network model is retrained. According to another embodiment, the data recognition module (330) may receive information corresponding to learning information associated with a user account used in training the artificial neural network model in the data learning module (320), and input the received information to the artificial neural network model to output gender. At this time, this information, as well as the received image, can be input to a trained artificial neural network model to output the gender. The gender output from the artificial neural network model can be provided to a gender verification module (340) to verify the gender of the user account.

The gender verification module (340) may verify the gender of the user account received when the user account subscribes to the instant messaging application based on the gender information provided by the data recognition module (330). According to one embodiment, the gender verification module (340) may impose a penalty such as suspension of use or withdrawal of subscription on the user account if the output gender is different from the gender of the received user account. According to another embodiment, the gender verification module (340) may transmit an image including a face related to the user account to a separate monitoring system if the output gender is different from the gender of the received user account. Here, the separate monitoring system may include a system that verifies the gender of the user account using a method or algorithm different from the verification method or algorithm performed by the gender verification module (340), and may be configured, for example, for monitoring personnel to directly inspect the received image. Alternatively, the gender verification module (340) may be configured to complete the verification of the gender of the user account if the output gender is the same as the gender of the received user account.

The gender verification module (340) may be configured to receive information related to the user account as well as the gender information output from the data recognition module (330) and verify the gender of the user account based on the output gender information and the received information. According to an embodiment, the information related to the user account may include information received from the user account via an instant messaging application or information generated or processed when the user account is active on the instant messaging application. For example, the information related to the user account may include, but is not limited to, at least one of rating information, interest information, history information, declaration information, friend list, user activity information, or text messages related to the user account. Here, the user activity information may include information on at least one of a blur item, a facial effect item, a lock-in item, a shake item, or a sticker item used by the user account during a video call with another user account.

According to one embodiment, the gender verification module (340) may be configured to verify the gender of the received user account through rule-based learning and prediction based on the information related to the received user account and the gender output from the data recognition module (330). For example, the gender verification module (340) may generate a table that matches the gender of the user account based on at least one of the output gender information or the information related to the user account. Thus, the gender verification module (340) may extract a gender corresponding to the information related to the received user account and the output gender received from the data recognition module (330) based on the generated table, and compare the extracted gender with the gender of the received user account. In another embodiment, the gender verification module (340) may verify the gender information of the received user account through a known machine learning technique using the information related to the received user account and the gender output from the data recognition module (330). For example, machine learning techniques may include, but are not limited to, a Find-S algorithm, a Version Space algorithm, and a Candidate Elimination algorithm. According to another embodiment, the gender verification module (340) may use information related to the received user account to change a weighting value used in outputting the gender of the user account or change a confidence score related to the output of the user's gender. The gender verification module (340) may be configured to provide an image including the face of the user account to a separate monitoring system if the received user account is different from the actual gender based on the information related to the received user account and the gender output from the data recognition module (330).

In FIG. 3, the processor (236) of the information processing system (130) is configured to include a data collection module (310), a data learning module (320), a data recognition module (330), and a gender verification module (340) to verify the gender of the user, but is not limited thereto, and the processor (218) of the user terminal may be configured to verify the gender of the user by including the same or similar configuration as the data collection module (310), the data learning module (320), the data recognition module (330), and the gender verification module (340). Also, in FIG. 3, the data collection module (310), the data learning module (320), the data recognition module (330), and the gender verification module (340) are illustrated as separate modules, but is not limited thereto, and each of these modules (310-340) may be combined and embodied as one or more modules.

FIG. 4 is a schematic diagram illustrating an artificial neural network model (400) configured to output gender associated with a person or face in an input image from an input image according to an embodiment of the present disclosure. The artificial neural network model (400) is a statistical learning algorithm or a structure for executing the algorithm, which is implemented based on the structure of a biological neural network in machine learning technology and cognitive science. According to an embodiment, the artificial neural network model (400) can represent a machine learning model having a problem-solving ability by learning such that a node, which is an artificial neuron formed by synaptic connections like a biological neural network, repeatedly adjusts the weight value of the synapse and reduces the error between a correct output corresponding to a specific input and an inferred output. For example, the artificial neural network model (400) may include any probability model, neural network model, etc. used in artificial intelligence learning methods such as machine learning and deep learning.

According to one embodiment, the artificial neural network model (400) may include an artificial neural network model configured to input training images including faces or people and/or image features extracted from such training images and output gender. In another embodiment, the artificial neural network model (400) may include an artificial neural network model configured to input training information received or processed via an instant messaging application and output gender. In yet another embodiment, the artificial neural network model (400) may include an artificial neural network model configured to input training information received or processed via an instant messaging application and training images including faces or people (or image features extracted from the training images) and output gender.

The artificial neural network model (400) is implemented as a multilayer perceptron (MLP) consisting of multiple nodes and connections between them. The artificial neural network model (400) according to the present embodiment can be implemented using one of various artificial neural network model structures including MLP. As shown in FIG. 4, the artificial neural network model (400) includes an input layer (420) that receives an input signal or data (410) from the outside, an output layer (440) that outputs an output signal or data (450) corresponding to the input data, and n (where n is a positive integer) hidden layers (430_1 to 430_n) that are located between the input layer (420) and the output layer (440) and receive a signal from the input layer (420), extract characteristics, and transmit them to the output layer (440). Here, the output layer (440) receives signals from the hidden layers (430_1 to 430_n) and outputs them to the outside.

There are two types of learning methods for the artificial neural network model (400): a supervised learning method in which the model learns to be optimized for solving a problem by inputting a teacher signal (correct answer), and an unsupervised learning method in which the model does not require a teacher signal. The data learning module (320) can train the artificial neural network model (400) to perform an analysis on an input image using supervised learning to provide gender information associated with a face or person in a learning image, and to extract a gender corresponding to the image. The artificial neural network model (400) trained in this manner can be provided to or accessed by the data recognition module (330), and can output a gender associated with a user account in response to an input of an image including a face received from the user account.

According to an embodiment, as illustrated in FIG. 4, the input variable of the artificial neural network model (400) capable of extracting gender information may be a training image including a face or a person. For example, the input variable input to the input layer (420) of the artificial neural network model (400) may be an image vector (410) in which the training image is composed of one vector data element. In response to the input of the training image including a face or a person, the output variable output from the output layer (440) of the artificial neural network model (400) may be a vector (450) indicating gender. In addition, the output layer (440) of the artificial neural network model (400) may be configured to output a vector indicating the confidence or accuracy of the output gender. For example, the vector indicating the confidence or accuracy of such an output may be interpreted or displayed as a score. In the present disclosure, the output variable of the artificial neural network model (400) is not limited to the types described above and may be indicated in various forms related to gender information and the confidence of the gender information.

In this way, the input layer (420) and output layer (440) of the artificial neural network model (400) are matched with a plurality of input variables and a plurality of corresponding output variables, and the synapse values between the nodes included in the input layer (420), hidden layers (430_1 to 430_n), and output layer (440) are adjusted, so that the artificial neural network model can learn to extract a correct output corresponding to a specific input. Through this learning process, the characteristics hidden in the input variables of the artificial neural network model (400) can be grasped, and the synapse values (or weights) between the nodes of the artificial neural network model (400) can be adjusted so that the error between the output variables calculated based on the input variables and the target output is reduced. Using the artificial neural network model (400) trained in this way, gender information for a person or face in an input image can be output in response to the input image.

According to another embodiment, the input variables of the artificial neural network model (400) capable of extracting gender information may include learning information received or processed via an instant messaging application. For example, the learning information received or processed via an instant messaging application may include, but is not limited to, at least one of rating information, interest information, history information, declaration information, friend list, user activity information, or text messages. In response to such learning information, the output layer (440) of the artificial neural network model (400) may be a vector indicating gender and a vector indicating confidence or accuracy for gender. According to yet another embodiment, the input variables of the artificial neural network model (400) capable of extracting gender information may include such learning information and a learning image including a face, and the output layer (440) of the artificial neural network model (400) may be a vector indicating gender and a vector indicating confidence or accuracy for gender. Here, the weights between the nodes included in the input layer (420), hidden layers (430_1 to 430_n), and output layer (440) can be adjusted so that a correct output corresponding to a specific input can be extracted. The artificial neural network model (400) capable of extracting such gender information can be provided to or accessed by the data recognition module (330), and an image including a face or person in association with a user account and/or information related to the user account can be input to the artificial neural network model (400), and the gender of the user account and a score indicating the confidence or accuracy of the gender can be output.

FIG. 5 is a flowchart illustrating a method (500) for verifying information received via an instant messaging application operating on a user terminal to provide a video call service according to one embodiment of the present disclosure. The method may be performed by an information processing system (130) or a user terminal (112, 114, 116) and may begin with a step (S510) of receiving a gender (e.g., a user's gender) associated with a first user account. According to one embodiment, the gender associated with the user account may be directly input when subscribing to an application for the user account. In another embodiment, the gender associated with the user account may be extracted from information for the account associated with the first user account.

Then, while the application is operating in step (S520), an image including a face captured through the image sensor may be received. For example, the image sensor may be attached to the front and/or rear of the user terminal so as to generate an image including the user's face. According to one embodiment, the image sensor may be configured to be automatically operated and generate an image after a user account is registered. If an image including the face of the user account is detected within the generated images, the image including the detected face may be provided to a data recognition module to verify the gender of the user account.

Next, the data recognition module may perform a step (S530) of inputting the received image into an artificial neural network model and outputting gender associated with the face included in the received image. Here, the artificial neural network model may be generated by machine learning performed by the data learning module based on data representing a plurality of training images and data representing gender for persons in the plurality of training images. In addition, the received image may include not only the user's face but also the user's clothing. Image features may be extracted from such an image, and the extracted image features may be input into the artificial neural network model to output gender.

Also, in step (S540), the gender verification module may be configured to verify the received gender based on the output gender. According to one embodiment, evaluation information for the first user account may be received from the second user account, and the gender verification module may verify the received gender based on the received evaluation information and the output gender. In another embodiment, interest information related to the first user account may be received, and the gender verification module may verify the received gender based on the received interest information and the output gender. According to yet another embodiment, evaluation information for one or more second user accounts provided by the first user account may be received, and the gender verification module may be configured to verify the received gender based on the evaluation information for one or more second user accounts provided by the received first user account and the output gender information. In yet another embodiment, one or more second user accounts that have previously been matched with the first user account are received, and the gender verification module may verify the received gender based on the received information for one or more second user accounts and the output gender. According to yet another embodiment, declared information for a first user account may be received, and the gender verification module may be configured to verify the received gender based on the received declared information and the output gender. According to yet another embodiment, information for a plurality of user accounts (e.g., a friend list) associated with the first user account in an application may be received, and the gender verification module may verify the received gender based on the information for the plurality of user accounts (e.g., the gender and number of friends) associated with the first user account and the output gender. In yet another embodiment, user activity information for the first user account may be collected, and the gender verification module may verify the received gender based on the collected user activity information and the output gender. For example, the user activity information for the first user account may include information on at least one of a blur item, a facial effect item, a lock-in item, a shake item, or a sticker item used by the first user account during a video call with the second user account. In yet another embodiment, text entered during a text chat between the user account and one or more second user accounts can be received, and the gender verification module can be configured to verify the received gender based on the received text and the output gender.

FIG. 6 is a flowchart showing detailed steps of the step of verifying the received gender based on the output gender according to one embodiment of the present disclosure (S540). First, the gender verification module may start with the step of determining whether the output gender is the same as the received gender (S610). If the output gender is different from the received gender, the received image may be provided to a separate monitoring system (S630). Alternatively, if the output gender is the same as the received gender, the gender verification module may determine whether the reliability (e.g., score) of the output gender received from the data recognition module is equal to or greater than a predetermined reliability. For example, if the score of the output gender in the artificial neural network model is 89 points or less, it may be analyzed that there is a recognition failure rate of about 30% of the output gender, and in this case, the predetermined reliability (score) may be set to 90 points. If the reliability of the output gender is equal to or greater than the predetermined reliability, the verification of the received gender may be completed (S640). Alternatively, if the confidence level for the output gender is less than a predetermined confidence level, the received image can be provided to a separate verification system (S630).

A separate verification system may analyze the received image to determine whether the received gender is identical to the gender associated with the user account (S650). If it is determined that the received gender is different from the gender associated with the user account, a penalty may be applied to the user account (S660). Alternatively, if it is determined that the received gender is identical to the gender associated with the user account, verification of the received gender may be completed (S640).

FIG. 7 is a diagram illustrating an example of receiving a gender associated with a user account while the user account is subscribed to an instant messaging application according to one embodiment of the present disclosure. Subscription to the instant messaging application may be performed through a first operation (710) and a second operation (720) in the user terminal. In one embodiment, the instant messaging application may be one of multiple applications installed and executed on the user terminal.

When the instant messaging application is operated, the user may be provided with an interface for subscribing to the instant messaging application. As illustrated in the first operation (710), a list of other sites or applications (712) may be displayed on the screen. The user may select one of the displayed list of other websites or applications (712) and log in with a user account of the selected website or application to subscribe to the instant messaging application. Here, the other websites may include websites to which any user is likely to have already subscribed, and the user may select a website to which he or she has already subscribed, and the account information of the selected website may be used when subscribing to the instant messaging application. The user's gender information may be extracted from the account information of the selected website, and the information processing system may be configured to verify the extracted gender information. As illustrated in the second operation (720), the user may be provided with an interface for inputting the user's gender (722) and birth year (724) when or during subscription to the instant messaging application. The received user gender (722) and year of birth (724) can be provided to an information processing system, and the received user gender (722) can be verified by the information processing system.

Figure 8 is a diagram showing an example of detecting an image including a face from a plurality of images captured through an image sensor and inputting requirements for a partner of a video call service while an instant messaging application according to one embodiment of the present disclosure is being operated. After a user subscribes to the instant messaging application, as shown in the first operation (810), input image data can be generated and displayed on the screen through an image sensor disposed on the front part of the user terminal operated by the instant messaging application.

The user terminal may determine whether there is an image including the user's face from the input video data. As illustrated in the first operation (810), for example, a smiley face emoji and the text "Finding a face" (812) may be displayed while detecting the user's face from the video data. If the user's face is detected from the video data, the image including the user's face may be used to verify the gender associated with the user. According to one embodiment, one image including the user's face may be used to verify the user's gender. According to another embodiment, multiple images including the user's face may be used to verify the user's gender. In this case, the multiple images including the face may be used to determine the depth of an object including the user's face, and the information on the object's depth may be used to verify the user's gender. Alternatively, the information processing system may input each of the multiple images including the user's face to the data recognition module (330) to output multiple genders and confidence levels, and analyze the output multiple genders and confidence levels to verify the user's gender.

As illustrated in the first operation (810), after a user subscribes to the instant messaging application, a number of icons (814, 816, 818, 820) may be displayed on the screen. For example, when the icon (814) is selected, information related to the user's profile may be displayed. For another example, when the icon (816) is selected, information related to a shop provided by the instant messaging application may be displayed. For yet another example, when the icon (818) is selected, information on a number of user accounts related to the user account (e.g., a friend list) and information on messages previously exchanged with the number of user accounts may be displayed. For yet another example, when the icon (820) is selected, information on the usage history of the user account (e.g., a list of users previously matched with the user account, etc.) may be displayed. Also, as illustrated in the first operation (810), the text "I am searching for anyone in everywhere" (822) may be displayed, allowing the user account to specify information on a person with whom the user account desires video calling services. When the text (822) is selected (e.g., touched), an interface is provided in which the user can input desired criteria for a partner for the video calling service, such as gender and region, as shown in the second operation (830).

FIG. 9 is a diagram illustrating an example of applying blur processing to an image including at least a portion of a user in an instant messaging application according to one embodiment of the present disclosure. A first operation (910) illustrates an operation in which image data including a user's face and clothes is displayed through an image sensor before the user matches a partner for a video call service. As illustrated, a swipe area (914) for starting to search for a partner for a video call may be displayed. When a swipe is performed after a specific point of the swipe area (914) is touched, a partner for the video call may be searched for based on previously set conditions.

A user may click an icon (912) for blurring an image to apply the blur item to one or more images including a portion of the user. According to an embodiment, when the user selects the second region (912), an interface, i.e., a second action (920), may be displayed in which the degree of the blur effect to be applied to the displayed image may be selected. The user may then determine the degree of the blur effect by touching a point on a bar (922) located at the bottom of the screen and then adjusting the point on the line. Information on the blur item may be stored as user activity information of the user account and may be used to determine the gender of the user account. For example, the blur item may be provided only to females, and if a particular user account uses the blur item more than a predetermined number of times, it may be interpreted as an action to deceive its gender, and the gender of the particular user account may be more likely to be determined to be false.

FIG. 10 is a diagram showing an example of applying facial effect processing and sticker items to an image including a user's face in an instant messaging application according to one embodiment of the present disclosure. A user can select items to be applied to the displayed image through a first operation (1010), a second operation (1020), and a third operation (1030) in a user terminal. For example, the items can include facial effect items and sticker items, including a face filter effect item and a face reduction item. The selected items can be used when the user has a video call with another user.

In one embodiment, as shown in a first action (1010), a user may select a first icon (1012) for applying a face filter item, and when a first area (1012) is selected, a list (1014) of applicable face filters may be displayed horizontally. The user may perform a swipe motion within these lists (1014) to display more face filters that are not currently displayed. The user may select one of the applicable face filters to apply to a portion (e.g., the face) or the entirety of the displayed image. Such face filters may include filters that can apply cosmetic effects to the face.

According to one embodiment, as shown in the second operation (1020), the user may select a second icon (1022) for applying a face reduction item, and when the second icon (1022) is selected, a bar (1024) may be displayed that allows the user to select the degree of face reduction. The user may determine the degree of reduction of the face included in the image by adjusting the points of the bar (1024) along the line. The degree of such face reduction may be displayed as a numerical value (e.g., 8 in FIG. 10).

In one embodiment, as shown in a third operation (1030), a user may select a third icon (1032) to select a sticker that can be applied to the face, and when the third icon (1032) is selected, a list of applicable stickers (1034) may be displayed horizontally. The user may perform a swipe motion within these lists (1034) to display more stickers that are not currently displayed. One of the displayed stickers may be selected, and the selected sticker may be used in a video call session with another user.

Information on facial effect items and sticker items that a user plans to use or has used during a video call session with another user may be stored as user activity information. Such user activity information may include information on the type and number of times of items used. The user activity information may be used to verify the gender of a user. Information on facial effect items and sticker items that are frequently used by men and women may be collected, and the collected information may be used to verify the gender of a user. According to one embodiment, the information processing system may be configured to verify the gender of a first user account based on user activity information including gender information, facial effect items, sticker items, etc. output from the data recognition module (330) for a first user account.

FIG. 11 is a diagram showing an example of starting a video call session according to one embodiment of the present disclosure, and adding a video call partner during the video call session to perform text chat. According to one embodiment, the information processing system may collect information on a second user account that is a video call partner to verify the gender of the first user account. In another embodiment, text entered during a text chat with the second user account may be collected to verify the gender of the first user account. Here, the text may include text entered from at least one of the first user account or the second user account.

A user of a first user account can determine a partner with whom to perform a video call of the first user account through a first operation (1110). As shown in the first operation (1110), when the information processing system matches a second user account that is a partner of a video call of the first user account, profile information (1114) for the second user account can be displayed on the screen. For example, the profile information can include a facial image, a residential area, interest information, and rating information for the second user account of the second user account. When the profile information for the second user account is displayed, if a skip icon (1112) is touched, a video call with the second user account can not be performed. In contrast, if the skip icon (1112) is not touched, a video call with the second user account can be performed.

During a video call session between a first user account and a second user account, the second user account can be added as a friend of the first user account. According to one embodiment, the user of the first user account can add the second user account as a friend of the first user account by selecting an icon (1122) for adding a friend displayed on the screen through a second operation (1120). In this case, the added second user account can be stored in association with the first user account.

During a video call session between the first user account and the second user account, the user of the first user account may engage in a text chat with the user of the second user account. The user of the first user account may input text through a text input area (1132) displayed on the screen through a third operation (1130), and the text input from the first user account and/or the second user account may be displayed in a text display window (1134). Such text may be stored in association with the first user account. The information processing system may be configured to collect text associated with the first user account and analyze the content of the text, and to verify the gender of the first user based on the content of the analyzed text. As an example, the information processing system may extract keywords from the collected text, assign weights to the extracted keywords, and verify the gender of the first user based on the keywords and weights. As another example, the information processing system may be configured to perform natural language processing on the collected text to verify the gender of the first user.

FIG. 12 is a diagram showing an example of sending evaluation information to evaluate a counterpart during a video call session with the counterpart and receiving evaluation information from the counterpart according to one embodiment of the present disclosure. A user of a first user account can send evaluation information for a second user account and can receive evaluation information for himself/herself from the second user account. Here, the evaluation information can include evaluation items selected for the user account. A first operation (1210) can represent an operation required when a user of a first user account sends evaluation information for a second user account, and a second operation (1220) can represent an operation in which a user of a first user account receives evaluation information for the first user account from the second user account.

According to one embodiment, an icon (1212) for displaying the rating information indicated by the first operation (1210) may be selected. When the icon (1212) is selected, a list of rating items (1214) may be displayed. As shown, the rating items may be displayed as Swags, and for example, Swags may include, but are not limited to, a Handsome icon, a Pretty icon, a Cute icon, a Stylish icon, a Lovely icon, a Humorous icon, and the like. For example, if a user of a first user account selects a Handsome icon for a second user account, the Handsome icon may be displayed on the screen of a user terminal on which the second user account is operated, and the selected icon may be stored in association with the first user account.

According to another embodiment, a first user account may receive rating information for the first user account from a second user account. As shown in a second operation (1220), a Pretty icon may be received. The received Pretty icon may be stored in association with the first user account.

The information processing system may collect evaluation information for the first user account from one or more second user accounts. The information processing system may store the type and number of Swags icons for the first user account collected from one or more second user accounts as evaluation information for the first user account. The information processing system may also be configured to analyze Swags icons used by multiple users to determine the gender of the user who used the Swags icon type and number of times. For example, if a Handsome icon, a Stylish icon, and/or a Humorous icon are given relatively frequently, the gender corresponding to such icons is likely to be determined to be male. As yet another example, if a Pretty icon, a Cute icon, and/or a Lovely icon are given relatively frequently, the gender corresponding to such icons is likely to be determined to be female. Thus, the information processing system may be configured to verify the gender of the first user account based on the collected evaluation information for the first user account (i.e., the type and number of icons in Swags). According to one embodiment, the evaluation information of the first user account may be used to adjust a weighting value used when the gender associated with the first user account is output by the data recognition module, or to adjust the reliability of the output gender. In FIG. 12, Swags is illustrated as including six icons, but is not limited thereto, and Swags may be composed of more than six icons.

13 is a diagram showing an example of using a lock-in item to prevent a party from leaving a video call session with a party according to an embodiment of the present disclosure. According to an embodiment, the information processing system may collect lock-in items used during a video call session to verify the gender of a first user account. Here, the collected lock-in items may include the type and number of times of the lock-in items. For example, information about lock-in items used by a first user account with respect to one or more second user accounts with which the first user account is in a video call may be collected as user activity information of the first user account. As another example, information about lock-in items used by one or more second user accounts with respect to the first user account may be stored in association with the first user account.

In one embodiment, as illustrated in the first operation (1310), the first user account may be provided with a list (1312) of selectable lock-in items during a video call session with the second user account. Here, the list (1312) of lock-in items may include a plurality of lock-in items that provide a function of preventing the other party from exiting the video call session for a certain period of time. For example, as illustrated, the list (1312) of lock-in items may include a 10-second lock-in item, a 20-second lock-in item, and a 30-second lock-in item. Such lock-in items may be purchased with coins that the first user account may use in an instant messaging application. The lock-in items used in this manner may be stored as user activity information of the first user account and may be used to verify the gender of the first user account. The information processing system may be configured to analyze information on a plurality of lock-in items used by a plurality of users to determine the gender of the user who used the type and number of lock-in items.

According to one embodiment, as illustrated in the second operation (1320), the first user account can receive a lock-in item from the second user account during the video call session of the second user account and display it on the screen. For example, the received item can be a 10-second lock-in item (1322), and the received 10-second lock-in item (1322) can be displayed on the screen of the first user account. In this case, the first user account cannot leave the video call session of the second user account. The information processing system can collect the lock-in items received by the first user account from multiple video call parties and store the collected lock-in items in association with the first user account. The collected lock-in items can be used to verify a gender associated with the first user account.

FIG. 14 is a diagram showing an example of using a shake item of a user terminal during a video call with a counterpart according to an embodiment of the present disclosure. Here, the shake item can be used when the counterpart has a favorable attitude during a video call session. For example, during a video call session between a first user account and a second user account, if the first user account uses a shake item on the second user account, a first operation (1410) can be performed. As another example, during a video call session between the first user account and the second user account, if the second user account uses a shake item on the first user account, a second operation (1420) can be performed.

According to one embodiment, a user of a first user account may use a shake item by shaking a user terminal on which the first user account is operated during a video call session with a second user account. As illustrated in the first operation (1410), when the shake item is used, a first special effect expressing affection may be displayed on the screen. And, when the second user account uses the shake item during the video call session between the first user account and the second user account, a second special effect indicating mutual affection may be displayed. As illustrated in the second operation (1420), the second special effect may include a greater amount of effects than the first special effect. When the first user account uses a shake item for the second user account during the video call session between the first user account and the second user account, the shake item used may be stored as user activity information of the first user account. The information processing system may collect information about the shake items used by the first user account for one or more user accounts with which the first user account was a video call partner as user activity information of the first user account. User activity information for the first user account can be used to verify the gender of the first user account. Also, shake items used by one or more second user accounts with respect to the first user account can be stored as information associated with the first user account and can be used to verify the gender of the first user account.

FIG. 15 is a diagram showing an example of sending a report item during a video call with a counterpart according to one embodiment of the present disclosure. According to one embodiment, a second user account can report a first user account if the user of the first user account exhibits inappropriate behavior or information different from the profile information of the first user account is found during a video call session with the first user account. When reporting the first user account, the second user account can select or write a report item for the first user account.

As shown in FIG. 15, the second user account may select an icon (1510) for reporting the first user account during a video call session with the first user account. When the icon (1510) is selected, a list of reporting items (1520) may be displayed on the screen. For example, the list of reporting items (1520) may include items such as "Violence or Harmful Behavior", "Sexual Harassment", and "Other", and may include any items that may be reported when the behavior is inappropriate toward the other party or is different from the other party's profile information. According to an embodiment, if the gender of the first user account understood on the video call is male and the profile of the first user account is displayed as female, the user of the second user account may report the first user account, and as shown in FIG. 15, the user may select the "Other" item and report that the gender of the first user account is different from the actual gender. Such declarations can be provided to an information processing system and used to verify the gender of the first user account.

FIG. 16 is a diagram showing an example of querying messages and friend lists associated with a user account according to one embodiment of the present disclosure. A user can search for information associated with the user account, i.e., messages exchanged between the user and other users, multiple user accounts registered in association with the user account (i.e., friend lists), etc., through a first operation (1610) and a second operation (1620) on the user terminal. Such text entered during a text chat with other users and the friend list can be provided to an information processing system and used to verify the gender of the user account.

As shown in the first operation (1610), when a user touches the "Message" text (1612) displayed on the screen, a list (1614) of multiple user accounts that have had a text chat with the user's user account may be displayed. When one of the lists (1614) of multiple user accounts is selected, text entered during the text chat may be displayed. Here, the text entered during the text chat may include all text entered from the user account and/or text entered from other user accounts in the chat box. Such text entered during the text chat may be provided to an information processing system and analyzed, and the gender of the user account may be verified based on the analyzed text. For example, any analysis algorithm or technique already known in the related field may be used as the text analysis algorithm or technique, for example, keyword-based analysis, natural language processing analysis technique, etc. may be used.

As shown in the second operation (1620), when the user touches the "Friends" text (1622) displayed on the screen, a plurality of user accounts associated with the user account, i.e., a friends list (1624), may be displayed on the screen. Information (e.g., gender, age, etc.) for the plurality of user accounts included in the friends list (1624) may be provided to the information processing system, and the gender of the user account may be verified based on the information for the plurality of user accounts included in the friends list. According to one embodiment, if the proportion of males among the plurality of user accounts included in the friends list is higher than a predetermined proportion, the gender of the user account is more likely to be female than male. In this case, when performing an algorithm for determining the gender of the user account in combination with other information related to the user account, the information processing system may perform any operation of assigning a higher weight and/or confidence level to the user account when the gender of the user account is determined to be female.

FIG. 17 is a diagram showing an example of outputting profile information related to a user account according to an embodiment of the present disclosure. In one embodiment, in order to verify the gender of a user account, the information processing system may collect the profile information of the user account as information related to the user account. Here, the profile information of the user account may include any information indicating the characteristics of the user account, and may include information input from the user account and/or information about the user account input from another user account. For example, the profile information of the user account may include information about a profile image, ratings (swaggs), interests (interests), language (language), region, etc. The information processing system may use such profile information when verifying the gender of the user account.

According to one embodiment, the information processing system may collect information on the Swags icon received by the user account as the evaluation information of the user account. As illustrated, for example, the Swags list (1710) may include the type and number of Swags icons received by the user account. Thus, when verifying the gender of the user account, the information processing system may assign a higher weight to the top icon that the user account has received more than others among the Swags icons stored in the profile information. For example, if the user account has received more Handsome icons, Stylish icons, and/or Humorous icons than other icons, the information processing system may perform any operation that can assign a higher weight and/or confidence to determining that the gender of the user account is male when determining the gender of the user account in combination with other information related to the user account. Alternatively, if a user account receives more Pretty icons, Cute icons, and/or Lovely icons than other icons, any action may be performed that can be given a higher weighting and/or confidence in determining that the user account's gender is female.

In one embodiment, the information processing system may receive a list of interest items (1720) received by the user account as interest information for the user account. As illustrated, for example, the interest information may be displayed with tags in front of the interest items. The information processing system may also store weight information indicating gender corresponding to each reference keyword indicating an interest. Thus, the information processing system may determine weights indicating gender for the interest items included in the received list of interest items (1720) and use them to verify the gender of the user account.

FIG. 18 is a diagram showing an example of outputting one or more user accounts that have had a video call with a user account according to one embodiment of the present disclosure. A user account (e.g., a first user account) may store one or more other user accounts (second user accounts) that have previously been matched with the user account. Such one or more second user accounts may be displayed through a history in an instant messaging application. For example, as shown in FIG. 18, a list (1810) of multiple user accounts may be displayed in the history of the first user account as user accounts that have previously been matched with the first user account.

The information processing system may be configured to receive one or more second user accounts previously matched with the first user account. The information processing system may verify the gender of the first user account based on information for the received one or more second user accounts. According to one embodiment, the gender of the received one or more second user accounts may be used to verify the gender of the first user account. For example, if there are more males than females in the gender of the second user account, a greater weight may be assigned to the gender of the second user account being determined to be male.

The method for verifying information received through an instant messaging application providing a video call service as described above may also be embodied as computer readable code in a computer readable recording medium. The computer readable recording medium includes all kinds of recording devices in which data readable by a computer system is stored. Examples of computer readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. Also, the computer readable recording medium may be distributed among computer systems connected to a network, and the computer readable code may be stored and executed in a distributed manner. Functional programs, codes, and code segments for implementing the above embodiments may be easily construed by a programmer skilled in the art to which the present invention pertains.

The methods, operations, or techniques of the present disclosure may be embodied by a variety of means. For example, these techniques may be embodied by hardware, firmware, software, or a combination thereof. Those skilled in the art will appreciate that the various exemplary logic blocks, modules, circuits, and algorithmic steps described in conjunction with the present disclosure may be embodied in electronic hardware, computer software, or a combination of both. To clearly illustrate such interchangeability of hardware and software, the various exemplary components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is embodied as hardware or software will depend on the particular application and design requirements imposed on the overall system. Those skilled in the art may also embody the described functionality in a variety of ways for each particular application, but such embodying should not be construed as departing from the scope of the present disclosure.

In a hardware implementation, the processing units used to perform the techniques may be embodied as one or more ASICs, DSPs, digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units designed to perform the functions described in this disclosure, computers, or combinations thereof.

Thus, the various example logic blocks, modules, and circuits described in connection with this disclosure may be embodied or implemented with any combination of general purpose processors, DSPs, ASICs, FPGAs or other programmable logic devices, discrete gate or transistor logic, discrete hardware components, or any combination designed to perform the functions described herein. A general purpose processor may be a microprocessor, but alternatively, the processor may be any conventional processor, controller, microcontroller, or state machine. A processor may also be embodied with a combination of computing devices, such as a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in conjunction with a DSP core, or any other configuration.

In a firmware and/or software implementation, the techniques may also be embodied with commands stored on a computer-readable medium such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable PROM (EEPROM), flash memory, compact disc (CD), magnetic or optical data storage device, etc. The commands may be executed by one or more processors and may cause the processors to perform certain aspects of the functionality described in this disclosure.

If embodied in software, the techniques may be stored on or transmitted through a computer-readable medium as one or more commands or codes. Computer-readable media includes both computer storage media and communication media, including any medium that facilitates transfer of a computer program from one place to another. Storage media may be any available medium accessible by a computer. By way of non-limiting example, these computer-readable media may include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to transport or store desired program code in the form of commands or data structures and that can be accessed by a computer. Also, any connection may be properly referred to as a computer-readable medium.

For example, if the software is transmitted from a website, server, or other remote source using coaxial cable, fiber optic cable, twisted wire, digital subscriber line (DSL), or wireless technologies such as infrared, radio and microwave, the coaxial cable, fiber optic cable, twisted wire, digital subscriber line, or wireless technologies such as infrared, radio and microwave are included within the definition of media. As used herein, disk and disc include CDs, laser discs, optical discs, digital versatile discs (DVDs), floppy disks, and Blu-ray discs, where disks typically reproduce data magnetically, while discs reproduce data optically using lasers. Combinations of the above should also be included within the scope of computer-readable media.

A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium may be coupled to the processor such that the processor can read information from, and record information on, the storage medium. Alternatively, the storage medium may be integrated into the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. Alternatively, the processor and the storage medium may reside as discrete components in a user terminal.

Although the embodiments described above have been described as utilizing aspects of the presently disclosed subject matter on one or more stand-alone computer systems, the present disclosure is not limited thereto and may be implemented in conjunction with any computing environment, such as a network or distributed computing environment. Additionally, aspects of the subject matter in the present disclosure may be implemented on multiple processing chips or devices, and storage may be affected across multiple devices as well. These devices may include PCs, network servers, and handheld devices.

In this specification, the present disclosure has been described with reference to some examples, but various modifications and changes can be made without departing from the scope of the present disclosure that would be understandable to a person of ordinary skill in the art to which the present disclosure pertains. Furthermore, such modifications and changes must be considered to fall within the scope of the claims appended hereto.

112, 114, 116: User terminal 120: Network 130: Information processing system 212: Input/output device 214, 232: Input/output interface 216, 234: Memory 218, 236: Processor 220, 238: Communication module 310: Data collection module 320: Data learning module 330: Data recognition module 340: Gender verification module

Claims (19)

1. A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service, comprising:
receiving a gender of a user specified by a first user account;
receiving an image including a face captured through an image sensor while the application is running;
inputting the received image into an artificial neural network model and outputting a gender of a user of a face contained within the received image;
and verifying the received gender based on the output gender, further comprising receiving evaluation information for the first user account from a second user account;
A method of verifying information, wherein verifying the received gender based on the output gender includes verifying the received gender based on the received evaluation information and the output gender. The method of verifying information according to claim 1, wherein the artificial neural network model is generated by performing machine learning based on data representing a plurality of training images and data representing the gender of people in the plurality of training images. the received image includes clothing;
The step of outputting the gender of the user of the face contained in the received image includes:
extracting image features from the received image;
and inputting the extracted image features into the artificial neural network model to output the gender. The method for verifying information according to any one of claims 1 to 3, wherein the step of verifying the received gender based on the output gender includes a step of providing the received image to a separate monitoring system if the output gender is different from the received gender. The method of claim 4, wherein the step of verifying the received gender based on the output gender includes the step of providing the received image to the separate monitoring system if the output gender is the same as the received gender and the reliability of the output gender is equal to or less than a predetermined reliability. 6. The method of claim 5, wherein if the separate monitoring system determines that the received gender is different from the user gender specified by the first user account, a penalty is imposed on the first user account. 1. A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service, comprising:
receiving a gender of a user specified by a first user account;
receiving an image including a face captured through an image sensor while the application is running;
inputting the received image into an artificial neural network model and outputting a gender of a user of a face contained within the received image;
and verifying the received gender based on the output gender, further comprising receiving interest information associated with the first user account;
A method of verifying information , wherein verifying the received gender based on the output gender comprises verifying the received gender based on the subject of interest information and the output gender. 1. A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service, comprising:
receiving a gender of a user specified by a first user account;
receiving an image including a face captured through an image sensor while the application is running;
inputting the received image into an artificial neural network model and outputting a gender of a user of a face contained within the received image;
and verifying the received gender based on the output gender, further comprising receiving evaluation information provided by the first user account for one or more second user accounts;
A method for verifying information, wherein the step of verifying the received gender based on the output gender includes a step of verifying the received gender based on reputation information provided by the received first user account for one or more second user accounts and the output gender. 1. A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service, comprising:
receiving a gender of a user specified by a first user account;
receiving an image including a face captured through an image sensor while the application is running;
inputting the received image into an artificial neural network model and outputting a gender of a user of a face contained within the received image;
and verifying the received gender based on the output gender. The method further comprising receiving one or more second user accounts that have been previously matched with the first user account;
A method for verifying information, wherein verifying the received gender based on the output gender includes verifying the received gender based on the received information for one or more second user accounts and the output gender. 1. A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service, comprising:
receiving a gender of a user specified by a first user account;
receiving an image including a face captured through an image sensor while the application is running;
inputting the received image into an artificial neural network model and outputting a gender of a user of a face contained within the received image;
and verifying the received gender based on the output gender .
A method for verifying information, wherein the step of verifying the received gender based on the output gender includes the step of verifying the received gender based on the received declaration information and the output gender. 1. A method for verifying information received via an instant messaging application operating on a user terminal and providing a video calling service, comprising:
receiving a gender of a user specified by a first user account;
receiving an image including a face captured through an image sensor while the application is running;
inputting the received image into an artificial neural network model and outputting a gender of a user of a face contained within the received image;
and verifying the received gender based on the output gender, further comprising receiving information for a plurality of user accounts associated with the first user account within the application;
A method of verifying information, wherein verifying the received gender based on the output gender includes verifying the received gender based on information and the output gender for a plurality of user accounts associated with the first user account. collecting user activity information for the first user account;
The method of verifying information described in any one of claims 1 to 3, wherein the step of verifying the received gender based on the output gender includes the step of verifying the received gender based on the collected user activity information and the output gender. The method of claim 12, wherein the user activity information for the first user account includes information on at least one of a blur item, a face effect item, a lock-in item, a shake item, or a sticker item used by the first user account while making a video call with a second user account. The method of verifying information of any one of claims 1 to 13, wherein the step of receiving the user's gender specified by the first user account includes the step of receiving at least one of a gender entered while the first user account was registered with the application or a gender extracted from information for an account associated with the first user account. The method for verifying information described in any one of claims 1 to 14, wherein the step of receiving an image including the face includes a step of receiving an image including the detected face when the face is detected in video data captured through the image sensor operated after the first user account is registered to the application. receiving text entered during a text chat between the first user account and one or more second user accounts;
4. The method of verifying information according to any one of claims 1 to 3, wherein the step of verifying the received gender based on the output gender comprises the step of verifying the received gender based on the received text and the output gender. A computer program for executing on a computer the method for verifying information received via an instant messaging application running on a user terminal and providing a video calling service according to any one of claims 1 to 16 . 1. A system for verifying information received via an instant messaging application that provides a video calling service, comprising:
a communication module configured to receive, from the user terminal, a user's gender specified by a first user account, and to receive an image including a face captured through an image sensor while the application is being operated;
a processor configured to input the received image into an artificial neural network model to output a gender of a user of a face contained within the received image, and to verify the received gender based on the output gender ;
The communication module is further configured to receive rating information for the first user account from a second user account;
The system, wherein the processor is configured to, when validating the received gender based on the output gender, verify the received gender based on the received assessment information and the output gender . The communication module is further configured to receive rating information for the first user account from a second user account;
20. The system of claim 18 , wherein the processor is further configured to verify the received gender based on the received assessment information and the output gender.

Images