JP7553014B2 - Online test support device and program - Google Patents

Description

The present invention relates to technology that supports online testing.

In recent years, the use of information and communication technology (ICT) in education has progressed, and online education has begun to take hold. In particular, in 2020, requests were made to refrain from going out to prevent the spread of infection, and online education became widespread as a practical means. It is expected that this will become an opportunity for online education to form a new social infrastructure.

In online education, pupils and students may study at home using computers such as personal computers or tablet devices. In addition to attending classes at home, they may also take exams at home. In other words, in-school tests and mock tests are conducted by loading exam content provided by the school onto a computer, solving the questions contained in the exam content, and sending back the answers.

Special Publication No. 2001-510593

However, with online exams (hereafter referred to as "online exams"), the question arises of how to prevent cheating. Unlike regular exams taken in school classrooms, teachers (supervisors) cannot directly supervise each student or pupil (candidate).

Patent Document 1 discloses a "system for controlling the administration of a secure examination conducted at a remote testing station and supervised remotely." In this example, examinees are filmed by a video camera, and the footage is used to prevent cheating. Specifically, examinees' footage is used as data showing their physical characteristics for identity authentication. This prevents switching examinees. As for other types of cheating, the footage is simply recorded and made available for the supervisor to view, to assist in supervision. Therefore, Patent Document 1 has the problem that the burden on the supervisor to prevent cheating and other cheating is heavy. In particular, the effort required to supervise many examinees by one person in a communication environment is enormous, unlike when supervising in person in a classroom, and there is a problem that things are easily overlooked. This leads to the problem that examinees are more likely to cheat.

The present invention was developed based on the recognition of the above problems, and its main purpose is to provide technology that prevents cheating in online exams.

In one aspect of the present invention, the online test support device is an online test support device capable of communicating with examinee terminals and supervisor terminals via a network, and includes a video/audio receiving unit that continuously receives video and audio of examinees during the test from the examinee terminal, a monitoring unit that detects prohibited items, fraudulent behavior, suspicious behavior, or third parties during the test based on the examinee's video and audio, and an alert notification unit that sends an alert notification to the supervisor terminal when prohibited items, fraudulent behavior, suspicious behavior, or third parties are detected.

The present invention makes it possible to prevent cheating in online tests. This allows online tests to be conducted properly and smoothly.

FIG. 1 is a network configuration diagram of an online testing system. FIG. 13 is a screen diagram showing an example of a test content screen. Fig. 3(A) is a screen diagram showing an example of a supervisor screen, and Fig. 3(B) is a screen diagram showing an example of an examinee enlargement screen. FIG. 2 is a functional block diagram of an online examination server. FIG. 13 is a data structure diagram of examinee master data. FIG. 1 is a sequence diagram of an online test. FIG. 1 is a sequence diagram of an online test. 1 is a flow chart showing a process for proctoring support in an online exam server. 1 is a flow chart showing a process for proctoring support in an online exam server.

[Embodiment]
FIG. 1 is a network configuration diagram of an online testing system.
An online examination system allows students to take exams at school, cram school, etc. from home. Students take the exam using a computer such as a notebook personal computer or tablet terminal at home. Alternatively, they may take the exam using a personal computer installed in a shared environment such as a self-study booth. In the following, the computer used by the examinee is referred to as an examinee terminal 100. FIG. 1 shows four examinees using examinee terminals 100a to d (hereinafter, collectively referred to as "examinee terminal 100" when referring to them collectively or when no particular distinction is made). In the case of an exam administered by a class, each of the students in the class uses an examinee terminal 100 in the same manner.

The examinee terminal 100 can connect to the online examination server 200 via the Internet. Examination questions distributed from the online examination server 200 are displayed on the examinee terminal 100, and the examinee solves the examination questions and inputs the answers by operating the examinee terminal 100.

The online exam system also captures video and audio of the exam, allowing a supervisor to supervise each examinee. In a normal exam where examinees gather in a classroom or exam hall, a supervisor is present to supervise the examinees. However, when taking the exam from home, a supervisor cannot be present at each examinee's home, so a supervisor supervises each examinee remotely. The supervisor could be, for example, a school teacher or a cram school instructor.

To enable photographing of the examinee, a notebook personal computer with a built-in web camera is used as the examinee terminal 100. The notebook personal computer also has a microphone for inputting surrounding sounds.

Images of the examinees and surrounding audio are sent from the examinee terminal 100 to the online exam server 200. The online exam server 200 relays the images and audio to the supervisor terminal 300. The supervisor terminal 300 used by the supervisor is a computer such as a notebook personal computer or a tablet terminal. Here, like the examinee terminal 100, a notebook personal computer with a built-in web camera is used as the supervisor terminal 300. The supervisor checks for any dishonest behavior such as cheating or suspicious behavior that may be cheating by using the images of each examinee displayed on the supervisor terminal 300 and the audio during the exam output from the speaker of the supervisor terminal 300.

The online exam server 200 also performs processing to support supervision using AI (artificial intelligence) functions. Specifically, it recognizes the video of each examinee and the audio during the exam to automatically detect cheating or suspicious behavior that may be cheating. If the online exam server 200 detects cheating or suspicious behavior by an examinee, it sends a large image of that examinee and the examinee's audio to the supervisor terminal 300. This allows the supervisor to focus on supervising that examinee and make the right decision. In this way, even if the examinee is automatically monitored by the AI function, the examinee has the impression that he or she is being monitored by an inspector. This causes the examinee to exert self-restraint, and cheating or other such misconduct is naturally prevented.

FIG. 2 is a screen diagram showing an example of the test content screen 110. As shown in FIG.
The test contents distributed from the online test server 200 to each examinee terminal 100 include image data of the test questions 112 and structured data of the answer columns 114 .

The examinee terminal 100 is equipped with a browser. The browser of the examinee terminal 100 displays a test content screen 110, which is a web page. Test questions 112 are displayed on the left side of the test content screen 110. The test questions 112 are made up of a number of questions. An answer column 114 is displayed on the right side of the test content screen 110, in which buttons corresponding to the options for each question are arranged based on the structured data.

The examinee reads and answers each question displayed on the left. This diagram shows an example of a multiple-choice question in which the examinee selects the answer they think is correct from answer options 1 to 4. If the examinee thinks option "3" is the correct answer for question 1, he or she clicks on the box "3" that corresponds to question 1 in the answer column 114. A check mark will then be displayed in the box, and option number "3" for question 1 will be stored internally. The same process is carried out for the other questions.

When the test is completed, the internally stored answers, i.e., the choice numbers for each question, are sent to the online test server 200. This process is equivalent to submitting an answer sheet in a normal test.

The online exam server 200 checks the behavior of each examinee during the exam. The WEB camera built into the notebook personal computer is installed facing the user. In other words, the WEB camera shows the examinee taking the exam. Images of the examinee taken by the WEB camera are sent to the online exam server 200 at any time. The images are either moving images or periodic still images.

Here, we will focus on four types of cheating: "leaving the seat without permission," "reading a book," "looking at a smartphone," and "receiving advice from a third party."

Let's explain "leaving without permission". It is okay for a candidate to leave the room only after asking the supervisor and getting permission. For this reason, the online exam system allows the candidate to call out to the supervisor to get permission. The process of the candidate calling out to the supervisor will be described later. If a candidate leaves the room, they can go somewhere out of the supervisor's line of sight and read something or talk to someone, which could lead to the candidate obtaining answers or solutions illegally. Therefore, even if there is no proof that they have obtained specific information about the exam, this is treated as cheating. Specifically, if a candidate disappears from the video, it is determined that they have "left without permission". In other words, if a person who is captured on the video is detected as a candidate through image analysis, and a candidate who was detected up until that point is no longer detected, it is determined that they have "left without permission".

Let us explain "book reading." Books include, for example, textbooks and reference books. One of the aims of the test is to confirm the acquisition of textbook knowledge, so it is assumed that the test taker will answer based on their own knowledge without looking at the textbook. Contrary to this, falsely pretending to have acquired knowledge constitutes cheating. Specifically, if the video contains a book and the test taker's gaze is directed at the book, it will be determined that the test taker is "reading a book." In other words, image analysis is used to detect books that appear in the video, and the test taker's gaze direction is detected. If the gaze is directed at the location of the book, it will be determined that the test taker is "reading a book." Test takers are also prohibited from carrying books during the test. In other words, if a book is captured in the video around the test taker, they will be subject to vigilance.

Let us explain "browsing a smartphone." Smartphones can store any data and access external information. As such, it is easy to obtain the knowledge required for the exam using a smartphone, and so looking at a smartphone in itself is considered cheating. Specifically, image analysis is used to detect smartphones appearing in the footage, and the direction of the examinee's gaze is detected. If the gaze is directed toward the smartphone, it is determined that the examinee is "browsing a smartphone." It is also prohibited to possess a smartphone during the exam. If a smartphone is seen in the footage around the examinee, it will be a cause for concern.

Let us explain "advice from a third party." A third party refers to anyone other than the test taker and the supervisor, such as a family member, friend, or private tutor. Answering a question based on knowledge from another person does not confirm one's own knowledge. Therefore, obtaining knowledge or hints from a third party is equivalent to cheating. Specifically, voice recognition is used to recognize the voice input into the microphone, and if the voice of someone other than the test taker is detected and the words contain content related to the test question or answer (for example, "gravity" or "number 1"), it is determined to be "advice from a third party."

In addition to these fraudulent acts, possession of certain specified items is also prohibited. For example, possession of "books" and "smartphones" is prohibited. Specified items are detected by image recognition. Furthermore, the presence of "third parties" is prohibited. Third parties are also detected by image recognition. People with different facial features than the test taker, people with different body shapes than the test taker, and people wearing clothing that is different from the test taker are determined to be third parties.

It also detects suspicious behavior that may be cheating. For example, if voice recognition detects the sound of turning pages, it is determined that the examinee is possibly turning the pages of a book and therefore suspicious behavior. If image recognition detects that the examinee's gaze has left the screen of the examinee terminal 100 and is moving back and forth from side to side, it is determined that the examinee is possibly reading a sentence and therefore suspicious behavior. Furthermore, if image recognition determines that the examinee's gaze has left the screen of the examinee terminal 100 and remained in the same place for a predetermined period of time or more, it is determined that the examinee is possibly looking at a smartphone, notes, etc. and therefore suspicious behavior.

The built-in web camera does not capture the sides or back of a laptop. Therefore, books or other items placed to the side or back of the laptop cannot be detected. Therefore, the reflected image from the examinee's eyes can be analyzed to detect objects or people that are to the side or back of the laptop. Specifically, a reflected image is extracted from the image of the examinee's eyes, and image recognition is performed on that reflected image. If a "book" or "smartphone" is detected from the reflected image in the examinee's eyes, this constitutes possession of a prohibited item. It would also constitute fraudulent "book browsing" or "smart browsing." If a third party is detected from the reflected image in the examinee's eyes, this is also a cause for concern.

As described above, if a prohibited item, fraudulent activity, suspicious activity, or a third party is detected, a notification is sent to the supervisor terminal 300 to alert the supervisor. The supervisor terminal 300 outputs the details of the alert by voice or display. For example, a message is sent saying, "A prohibited item, a smartphone, has been detected in examinee number 1. Please be on guard." The supervisor terminal 300 outputs this message by voice or displays it on the screen. In addition, video and audio of the examinee who is the target of caution are also sent to the supervisor terminal 300. The video of the examinee who is the target of caution is enlarged and displayed on the supervisor terminal 300. This screen is called the examinee enlarged screen. The examinee enlarged screen will be described later in relation to FIG. 3(B). On the examinee enlarged screen, the video and audio from which the prohibited item was detected can be played back. In addition, the supervisor and the examinee can have a video conversation.

If an examinee needs to use the restroom or is feeling unwell, the examinee may obtain permission from the supervisor to leave the room. The examinee may also ask the supervisor if he/she has any questions about the exam questions or answer sheets. To handle such cases, the online exam server 200 also detects the examinee calling out to the supervisor. For example, if the voice recognition recognizes certain words such as "Excuse me," "Teacher," or "I have a question," it is determined that the examinee has called out to the supervisor. Also, if the image recognition determines that the examinee's hand is raised and that the examinee's gaze is directed toward the examinee terminal 100, and any voice (for example, "um" or "Yes") is detected, it is determined that the examinee has called out to the supervisor.

When an examinee is detected calling out to the supervisor, the video and audio of the examinee who called out are sent to the supervisor terminal 300. The video of the examinee who called out is enlarged and displayed on the supervisor terminal 300 as an examinee enlargement screen. In addition, the supervisor and the examinee can have a phone call with video.

FIG. 3A is a screen diagram showing an example of a supervisor screen 310. As shown in FIG.
The supervisor terminal 300 is equipped with a browser. The browser of the supervisor terminal 300 displays a supervisor screen 310, which is a web page. The supervisor screen 310 is provided with a display area for each examinee (hereinafter referred to as an "examinee display area 312"), and the images received from each examinee terminal 100 are displayed in each examinee display area 312. In this example, examinee display areas 312 of 4 rows and 5 columns are provided. In other words, 20 examinees are taking the test at the same time. The voices of each examinee are also output simultaneously from the speaker of the supervisor terminal 300. The supervisor monitors the state of everyone on this supervisor screen 310.

FIG. 3B is a screen diagram showing an example of an examinee enlargement screen 320. As shown in FIG.
For example, when a prohibited item, fraudulent activity, suspicious activity, or a third party is detected and an examinee needs to be watched, the supervisor screen 310 is switched to an examinee enlarged screen 320. The examinee enlarged screen 320 has an enlarged display area 322, in which an image received from the examinee terminal 100 of the examinee who is the target of watching is enlarged and displayed.

If the supervisor wishes to check the video that caused the detection of a prohibited item, etc., he or she clicks the play button 324. The video that caused the detection is then enlarged and displayed in the enlarged display area 322. The video that caused the detection is recorded on the online examination server 200. If the supervisor determines that there is no problem, he or she clicks the close button 328 to close the examinee enlarged screen 320 and switch to the supervisor screen 310.

If the supervisor wishes to listen to the examinee or give the examinee a warning, he or she clicks on the talk button 326. This allows the examinee and supervisor to have a video call. When the call is over, the supervisor clicks on the close button 328 to close the examinee enlargement screen 320 and switch to the supervisor screen 310.

Also, if a call from an examinee is detected, the supervisor screen 310 is switched to the examinee enlarged screen 320. In the enlarged display area 322, an enlarged image received from the examinee terminal 100 of the examinee who made the call is displayed. If the examinee responds to the call, a video call with video between the examinee and the supervisor is immediately started. Therefore, the play button 324 and the call button 326 may be omitted.

FIG. 4 is a functional block diagram of the online examination server 200. As shown in FIG.
The online test server 200 includes a data processing unit 210, a communication unit 220, and a data storage unit 280. The communication unit 220 is responsible for communication processing via a network. The data storage unit 280 stores various data. The data processing unit 210 executes various processes based on the data acquired by the transmission unit 230 and the data stored in the data storage unit 280. The data processing unit 210 also functions as an interface between the communication unit 220 and the data storage unit 280.

The data processing section 210 includes a login processing section 212 , a supervisor screen generating section 214 , a monitoring section 216 , a call detection section 217 , an examinee enlarged screen generating section 218 , and a supervisor screen generating section 219 .
The login processing unit 212 executes login processing to authenticate the examinee and the supervisor. The supervisor screen generating unit 214 generates a supervisor screen 310 (FIG. 3(A)) in which an examinee's video is assigned to each examinee display area 312. The monitoring unit 216 executes monitoring processing of the examinees based on the video and audio received from each examinee terminal 100. The call detection unit 217 detects a call from the examinee to the supervisor based on the video and audio received from each examinee terminal 100. The examinee enlarged screen generating unit 218 generates an examinee enlarged screen 320 (FIG. 3(B)) that displays an enlarged image of the examinee. The supervisor screen generating unit 219 generates a screen that displays the supervisor's video.

The communication unit 220 includes a transmission unit 230 that transmits data and a reception unit 250 that receives data.
The transmitting unit 230 includes a login screen transmitting unit 232, a shooting guide screen transmitting unit 234, a standby screen transmitting unit 236, a test content distribution unit 238, a notification transmitting unit 240, a message transmitting unit 242, an alert notification unit 244, a call notification unit 245, a supervisor screen transmitting unit 246, an examinee enlarged screen transmitting unit 248 and a supervisor screen transmitting unit 249.
The login screen sending unit 232 sends data of the login screen to the examinee terminal 100 and the supervisor terminal 300. The photography guide screen sending unit 234 sends data of the photography guide screen to the examinee terminal 100. The standby screen sending unit 236 sends data of the standby screen to the examinee terminal 100. The test content distribution unit 238 distributes test content (image data of the test questions 112 and structured data of the answer column 114) to each examinee terminal 100. The notification sending unit 240 sends notifications such as a completion notification to the examinee terminal 100. The message sending unit 242 sends a message to instruct the examinee to the examinee terminal 100. The alert notification unit 244 sends a message to the supervisor terminal 300 including the number of the examinee who has been detected with a prohibited item or the like and the contents of the detection, and urging the supervisor to be alert. The call notification unit 245 sends a message to the supervisor terminal 300 conveying the number of the called examinee and the call. The supervisor screen sending unit 246 sends data of supervisor screen 310 (FIG. 3(A)) and the voice of the examinee to the supervisor terminal 300. The examinee enlarged screen sending unit 248 sends data of examinee enlarged screen 320 (FIG. 3(B)) and the voice of the examinee to the supervisor terminal 300. The supervisor screen sending unit 249 sends data of the supervisor screen and the voice of the supervisor to the examinee terminal 100.

The receiving unit 250 includes an access accepting unit 252 , an account receiving unit 254 , a video/audio receiving unit 256 , an answer data receiving unit 258 , and a request receiving unit 260 .
The access accepting unit 252 accepts access to the examinee's URL from the examinee terminal 100, and accepts access to the supervisor's URL from the supervisor terminal 300. The account receiving unit 254 receives the examinee's account (login ID and password) from the examinee terminal 100, and receives the supervisor's account (login ID and password) from the supervisor terminal 300. The video/audio receiving unit 256 receives the examinee's video captured by the camera of the examinee terminal 100 and the audio input to the microphone, and receives the examinee's video captured by the camera of the supervisor terminal 300 and the audio input to the microphone. The answer data receiving unit 258 receives answer data from the examinee terminal 100. The request receiving unit 260 receives requests such as a playback request, a call request, and a switch request from the supervisor terminal 300.

The data storage unit 280 includes a test information storage unit 282 , an examinee master storage unit 284 , a test content storage unit 286 , an answer data storage unit 288 , and an image/audio storage unit 290 .
The test information storage unit 282 stores information for managing tests as events. For example, the test name such as "Physics Final Test for Third-Year Students", the test start time and test end time, and the supervisor's account (login ID and password) are stored. The examinee master storage unit 284 stores the examinee master. The examinee master will be described later in relation to FIG. 5. The test content storage unit 286 stores the test content for each test (image data of the test questions 112 and structured data of the answer column 114). The answer data storage unit 288 stores the answer data collected from each examinee terminal 100 in association with the examinee. The video/audio storage unit 290 stores video and audio of prohibited items, third parties, and fraudulent or suspicious activities.

FIG. 5 is a data structure diagram of the examinee master.
The examinee master has a record for each examinee. The record stores the examinee number, the examinee's name, and the examinee's account (login ID and password).

FIG. 6 is a sequence diagram of an online test.
An examinee taking an online exam inputs the examinee's own URL, which has been notified to him/her in advance, into a browser. The browser of the examinee terminal 100 then accesses the examinee's own URL (S10).

When the access acceptance unit 252 of the online examination server 200 accepts access to the examinee's URL from the examinee terminal 100, the login screen transmission unit 232 transmits the data of the login screen to the examinee terminal 100 (S12).

When the examinee terminal 100 receives the login screen data, the browser of the examinee terminal 100 displays the login screen (S14). The login screen includes input areas for a login ID and password. The examinee inputs the login ID and password that have been notified to them in advance. The browser of the examinee terminal 100 accepts the input of the login ID and password (S16) and sends the input login ID and password, i.e., the account, to the online examination server 200 (S18).

When the account receiving unit 254 of the online examination server 200 receives the login ID and password, the login processing unit 212 executes login processing to authenticate the examinee (S20). If the received login ID and password match any of the login ID and password pairs registered in the examinee master, the examinee is identified and authentication is successful. Conversely, if the login ID and password pair do not match any of the login ID and password pairs, authentication fails. If authentication fails, the following processing is not performed. If authentication is successful, the shooting guide screen sending unit 234 sends the data of the shooting guide screen to the examinee terminal 100 (S22).

When the examinee terminal 100 receives the data of the photography guide screen, the browser of the examinee terminal 100 displays the photography guide screen (S24). The photography guide screen contains information encouraging the examinee to click the photography start button to photograph the surroundings. The surroundings refer to, for example, the surface of the desk, under the desk, around the desk, and above the desk. When the photography start button is clicked (S26), the built-in camera is started and photography begins, and audio is input into the microphone. The browser of the examinee terminal 100 starts photographing and transmits the captured video and audio to the online test server 200 (S28). This photographing and transmission of video and audio continues until the end of the test. The examinee follows the instructions on the photography guide screen to photograph the surroundings (S30), and the captured video is sent to the online test server 200.

The video/audio receiving unit 256 of the online test server 200 continuously receives video and audio from the examinee terminal 100. The monitoring unit 216 checks whether there are any prohibited possessions or third parties based on the video and audio before the test (S32). The monitoring unit 216 recognizes objects, the examinee's posture, the examinee's gaze, and people's voices and sounds using AI functions. For example, if prohibited possession items such as textbooks, reference books, notebooks, memos, or smartphones or tablet terminals are shown, it is determined to be inappropriate. In addition, if a third party other than the examinee is shown or a third party's voice is recognized, it is determined to be inappropriate. If it is determined to be inappropriate, a warning is notified to the supervisor terminal 300 so that the examinee and the supervisor can communicate online. Alternatively, the message sending unit 242 may send a message to the examinee terminal 100 instructing the examinee to remove the prohibited possessions or to instruct the third party to leave the venue.

The sequence shown in FIG.
The standby screen sending section 236 of the online examination server 200 sends the standby screen data to the examinee terminal 100 (S34).

When the examinee terminal 100 receives the data for the standby screen, the browser on the examinee terminal 100 displays the standby screen (S36). The standby screen shows the waiting time until the start of the test.

When the time for the exam to begin arrives, the exam content distribution unit 238 of the online exam server 200 distributes exam content, including image data of the exam questions 112 and structured data of the answer columns 114, to the examinee terminals 100 of each examinee (S38). A program is added to the exam content to instruct the OS (operating system) to have the browser occupy the entire screen.

When the examinee terminal 100 receives the test content, the browser of the examinee terminal 100 displays images of the test questions 112 and the answer column 114 according to the test content (S40). The browser of the examinee terminal 100 then executes a program added to the test content, and instructs the OS to have the browser occupy the entire screen. This causes the browser to expand to cover the entire screen, and other windows are no longer displayed. This makes it possible to prevent cheating by viewing information using the examinee terminal 100.

The browser on the examinee terminal 100 accepts the answer input into the answer field 114 (S42). The accepted answer is stored as internal data of the browser.

When the test begins, the monitoring unit 216 of the online test server 200 starts monitoring the examinee (S44). The monitoring process detects prohibited items, fraudulent behavior, suspicious behavior, or third parties, as described above.

When the monitoring unit 216 of the online test server 200 detects a prohibited item, a third party, or fraudulent or suspicious activity, it records the video and audio from which the detection occurred. Specifically, the video and audio are stored in the video/audio storage unit 290 from a predetermined time (e.g., 5 seconds) before the video shows the prohibited item until the prohibited item is no longer visible.

When the end time is reached, the notification sending unit 240 of the online examination server 200 sends an end notification to each examinee terminal 100 (S46).

When the examinee terminal 100 receives the end notification, the browser of the examinee terminal 100 sends the answer data to the online exam server 200 (S48). The browser of the examinee terminal 100 then ends the shooting and video transmission, and ends the entire process (S50). Note that a program is added to the test content that sends the answer data to the online exam server 200 when the end notification is received, and the browser of the examinee terminal 100 executes this program.

When the answer data receiving unit 258 of the online examination server 200 receives the answer data, it stores the received answer data in the answer data storage unit 288 in association with the examinee number (S52). Then, the monitoring unit 216 ends the monitoring process (S54).

8 and 9 are flow charts showing the process for supervisor support in the online test server 200. FIG.
When the login processing unit 212 accepts access to the supervisor's URL from the supervisor terminal 300, the access accepting unit 252 executes login processing to authenticate the supervisor, in the same way as in the case of an examinee (S60). If the authentication of the supervisor fails, the following processing is not performed.

When the supervisor authentication is successful, the supervisor screen generation unit 214 generates the supervisor screen 310. Specifically, the video of each examinee sent from the examinee terminal 100 is displayed in the examinee display area 312 corresponding to that examinee. The supervisor screen transmission unit 246 then transmits the data of the supervisor screen 310 to the supervisor terminal 300 together with the audio sent from the examinee terminal 100 (S62). The generation and transmission of the supervisor screen 310 is carried out continuously. The supervisor screen 310 is displayed on the browser of the supervisor terminal 300, and the audio of each examinee is output from the speaker.

If the monitoring unit 216 detects a prohibited item or a third party in the pre-exam check (S32 in FIG. 6), or detects a prohibited item, a third party, or fraudulent or suspicious activity in the monitoring process during the exam (S44 in FIG. 7) (Y in S64), the alert notification unit 244 will send a message including the number of the detected examinee and the details of the detection to the supervisor terminal 300, urging the supervisor to be on alert (S66). For example, a message stating "A smartphone, a prohibited item, has been detected in examinee number 1. Please be on alert" is sent and displayed on the supervisor terminal 300. The examinee's name may also be included in the message.

Furthermore, the examinee enlarged screen generating unit 218 generates an examinee enlarged screen 320 that displays an enlarged image of the examinee to be alerted. Specifically, the image of the examinee sent from the examinee terminal 100 is displayed in an enlarged display area 322. The examinee enlarged screen transmitting unit 248 then transmits the data of the examinee enlarged screen 320 to the supervisor terminal 300 together with the audio sent from the same examinee terminal 100 (S68). The generation and transmission of the examinee enlarged screen 320 is performed continuously. The examinee enlarged screen 320 showing the current state of the examinee to be alerted is displayed on the browser of the supervisor terminal 300, and the current audio of the examinee to be alerted is output from the speaker. The generation and transmission of the supervisor screen 310 may be interrupted while the examinee enlarged screen 320 is being transmitted.

When the request receiving unit 260 receives a playback request sent when the playback button 324 on the examinee enlarged screen 320 is clicked (Y in S70), the examinee enlarged screen generating unit 218 plays the video and audio of the detected subject recorded in the video/audio storage unit 290, and displays the played video in the enlarged area of the examinee enlarged screen 320. The supervisor screen transmitting unit 246 transmits the examinee enlarged screen 320 together with the played audio to the supervisor terminal 300 (S72). The examinee video of the detected subject is displayed on the examinee enlarged screen 320 in the browser of the supervisor terminal 300, and the audio of the detected subject (including surrounding sounds) is output from the speaker. This allows the supervisor to understand what the situation was. When playback of the recorded video and audio of the detected subject is completed, the system returns to the current video and audio relay state.

When the request receiving unit 260 receives a call request sent when the call button 326 on the examinee enlarged screen 320 is clicked (Y in S74), the video/audio receiving unit 256 receives the video and audio of the supervisor from the supervisor terminal 300, and the supervisor screen generating unit 219 generates a supervisor screen (not shown) that displays the video of the supervisor. Specifically, the video of the supervisor is displayed in the supervisor area of the supervisor screen. The supervisor screen transmitting unit 249 then transmits the data of the supervisor screen to the examinee terminal 100 together with the voice of the supervisor transmitted from the supervisor terminal 300 (S76). The supervisor screen is displayed by the browser of the examinee terminal 100, and the voice of the supervisor is output from the speaker of the examinee terminal 100. This allows the examinee and the supervisor to talk while viewing each other's video. This allows the supervisor to ask questions or give instructions to the examinee. For example, the supervisor may give instructions such as, "Please keep your smartphone out of reach."

When the request receiving unit 260 receives a switch request sent when the close button 328 on the examinee's enlarged screen 320 is clicked (Y in S78), the examinee's enlarged screen generating unit 218 finishes generating the examinee's enlarged screen 320, and the examinee's enlarged screen transmitting unit 248 finishes transmitting the data and audio for the examinee's enlarged screen 320. Then, the process returns to S62 and the supervisor's screen 310 is generated and transmitted again. By processing in this manner, the examinee's enlarged screen 320 displayed on the supervisor's terminal 300 browser is switched to the supervisor's screen 310.

Returning to the explanation of S64, if the monitoring unit 216 does not detect any prohibited items (N in S64), the process moves to S80 in FIG. 9, where the call detection unit 217 determines whether or not it has detected a call from the examinee.

When the call detection unit 217 detects a call from an examinee (Y in S80), the call notification unit 245 sends a notification to the supervisor terminal 300 containing the number of the examinee who made the call and a message conveying the call (S81). For example, a message saying "Examination candidate number 1 is calling you. Please speak to him/her" is sent and displayed on the supervisor terminal 300. The examinee's name may also be added to the message.

The examinee enlarged screen generating unit 218 generates an examinee enlarged screen 320 that displays an enlarged image of the examinee who has been called. Specifically, the image of the examinee who has been called, sent from the examinee terminal 100, is displayed in an enlarged display area 322. The examinee enlarged screen transmitting unit 248 then transmits the data of the examinee enlarged screen 320 to the supervisor terminal 300 together with the voice sent from the same examinee terminal 100 (S82). The generation and transmission of the examinee enlarged screen 320 is performed continuously. The examinee enlarged screen 320, which shows the current state of the examinee who has been called, is displayed on the browser of the supervisor terminal 300, and the voice of the examinee who has been called is output from the speaker. The generation and transmission of the supervisor screen 310 may be interrupted while the examinee enlarged screen 320 is being transmitted.

Furthermore, the video/audio receiving unit 256 receives the video and audio of the supervisor from the supervisor terminal 300, and the supervisor screen generating unit 219 generates a supervisor screen (not shown) that displays the video of the supervisor. Specifically, the video of the supervisor is displayed in the supervisor area of the supervisor screen. The supervisor screen transmitting unit 249 then transmits the supervisor screen to the examinee terminal 100 together with the voice of the supervisor transmitted from the supervisor terminal 300 (S84). The supervisor screen is displayed by the browser of the examinee terminal 100, and the voice of the supervisor is output from the speaker of the examinee terminal 100. This allows the called examinee and the supervisor to talk while viewing each other's video. This allows the supervisor to respond, for example, by asking "What's wrong?" and converse with the examinee.

When the request receiving unit 260 receives a switch request sent when the close button 328 on the examinee's enlarged screen 320 is clicked (Y in S86), the examinee's enlarged screen generating unit 218 finishes generating the examinee's enlarged screen 320, and the examinee's enlarged screen transmitting unit 248 finishes transmitting the examinee's enlarged screen 320 and audio. Then, the process returns to S62 and the supervisor's screen 310 is generated and transmitted again. By processing in this manner, the examinee's enlarged screen 320 displayed on the supervisor's terminal 300 browser is switched to the supervisor's screen 310.

[Modification 1]
The online examination server 200 may be configured to confirm that no applications other than the browser are running on the examinee terminal 100. The online examination server 200 may also be configured to confirm that no browsers other than the browser for the online examination are running. Furthermore, the online examination server 200 may be configured to confirm that multiple browsing is not being performed with one browser. Either of these is intended to prevent examinees from engaging in unauthorized browsing.

In S22, the shooting guide screen sending unit 234 of the online examination server 200 sends to the examinee terminal 100, in the browser of the examinee terminal 100, data of the shooting guide screen to which a program including an instruction to obtain a process list from the OS of the examinee terminal 100 and an instruction to transmit the obtained process list to the online examination server 200 is added.

In S24, the browser on the examinee terminal 100 that has received the data for the above-mentioned shooting guide screen displays the shooting guide screen, executes the above-mentioned program, and obtains a process list from the OS.

The process list includes the names of processes running on the examinee terminal 100. If the process is a browser, the current number of sessions (= number of views) is also included. The browser on the examinee terminal 100 sends the acquired process list to the online exam server 200.

The process list receiving unit (not shown) of the online test server 200 receives the process list.

The process determination unit (not shown) of the online exam server 200 determines whether the process list includes two or more browser processes. If it is determined that the process list includes two or more browser processes, the warning notification unit 244 sends a message notification including the detected examinee's number and the detection details to the supervisor terminal 300, urging the supervisor to be on guard. For example, a message saying "Multiple browsers have been detected for examinee number 1. Please be on guard" is sent and displayed on the supervisor terminal 300. The examinee's name may also be added to the message. Alternatively, if it is determined that the process list includes two or more browser processes, the message sending unit 242 may send an instruction message (for example, "Please close browsers other than the online exam browser") to the examinee terminal 100.

When the process list contains one browser process, the process determination unit (not shown) of the online examination server 200 determines whether the current number of sessions (= number of views) in the browser is two or more. When it is determined that the current number of sessions (= number of views) in the browser is two or more, the warning notification unit 244 sends a message notification including the detected examinee's number and the detection content to the supervisor terminal 300, urging the supervisor to be careful. For example, a message saying "Multiple browser views have been detected for examinee number 1. Please be careful" is sent and displayed on the supervisor terminal 300. The examinee's name may be added to the message. Alternatively, when it is determined that the current number of sessions (= number of views) in the browser is two or more, the message sending unit 242 may send a guidance message (for example, "Please stop viewing anything other than the online examination") to the examinee terminal 100.

The process determination unit (not shown) of the online test server 200 determines whether the process of a program that prohibits parallel operation during the test (hereinafter referred to as the "prohibited program") is included in the process list. The online test server 200 has a prohibited program list storage unit (not shown) that stores a list of prohibited programs. If it is determined that the process list includes a prohibited program process, the warning notification unit 244 sends a message notification to the supervisor terminal 300, including the number of the detected examinee and the detection content, to alert the supervisor. For example, a message is sent saying, "Examinee No. 1 has been detected as a process of "XXX" (the name of the prohibited program). Please be careful." and is displayed on the supervisor terminal 300. The examinee's name may be added to the message. Alternatively, if it is determined that the process list includes a prohibited program process, the message sending unit 242 may send a guidance message (for example, "Please stop 'XXX' (the name of the prohibited program).") to the examinee terminal 100. The online test server 200 may have an allowed program list storage unit (not shown) that stores a list of programs that are allowed to run in parallel during a test (hereinafter referred to as "allowed programs"). In this case, the process determination unit (not shown) may set programs other than the allowed programs as prohibited programs.

The same applies to the standby screen. In S34, the standby screen sending unit 236 of the online examination server 200 sends to the examinee terminal 100, in the browser of the examinee terminal 100, data of the standby screen to which a program including an instruction to obtain a process list from the OS of the examinee terminal 100 and an instruction to transmit the obtained process list to the online examination server 200 is added.

In S36, the browser of the examinee terminal 100 that has received the data for the standby screen displays the standby screen, executes the above program, obtains a process list from the OS, and sends it to the online examination server 200. The subsequent processing is the same as in the case of the shooting guide screen.

The same applies to the test content. In S38, the test content distribution unit 238 of the online exam server 200 transmits to the examinee terminal 100, in the browser of the examinee terminal 100, test content to which is added a program including an instruction to obtain a process list from the OS of the examinee terminal 100 and an instruction to transmit the obtained process list to the online exam server 200.

In S40, the browser of the examinee terminal 100 that has received the above-mentioned test content displays the image of the test question 112 and the answer column 114, and also executes the above-mentioned program to obtain a process list from the OS and send it to the online test server 200. The subsequent processing is the same as in the case of the shooting guide screen.

[Modification 2]
The rear of the examinee terminal 100 is a blind spot. Therefore, it is possible that an examinee may commit fraud by placing an external monitor (display) behind the examinee terminal 100 and using that monitor to have a third party look at the test questions and provide advice. As a countermeasure, it is possible to check whether multiple monitors are being used at the same time to prevent fraud.

The online examination server 200 transmits to the examinee terminal 100 data of a shooting guide screen to which is added a program including an instruction to obtain a list of devices used by the examinee terminal 100 and an instruction to transmit the obtained device list to the online examination server 200.

The online exam server 200 receives the device list from the examinee terminal 100, and if it determines that the device list contains two or more monitors, it sends a message to the supervisor terminal 300 such as "Two monitors have been detected for examinee number 1. Please be cautious." Alternatively, it may send a message such as "Please remove the external monitor" to the examinee terminal 100. Furthermore, the same processing may be performed on the standby screen and the exam content.

[Modification 3]
The supervisor screen (FIG. 3(A)) may be configured to display the answering progress of each examinee. For example, if there are 50 questions and 3 have been answered, "3/50" or "6%" may be displayed. If an examinee is answering at a faster or slower pace than usual, there may be some reason for his or her answering, so by keeping a close eye on that examinee, it may be possible to discover cheating. Also, the supervisor screen may be configured to distinguish between examinees answering at a fast pace and those answering at a slow pace.

In S38, when the test content distribution unit 238 of the online examination server 200 receives an answer input operation in the answer column in the browser of the examinee terminal 100, the test content to which a program including an instruction to transmit the question number and option number to the online examination server 200 as information identifying the content of the answer operation is added to the examinee terminal 100.

In S40, the browser of the examinee terminal 100 that has received the above-mentioned test content displays the image of the test question 112 and the answer column 114, and executes the above-mentioned program. Then, during the test, when the browser of the examinee terminal 100 accepts answer input in the answer column, it sends the question number and option number to the online test server 200.

The online examination server 200 has an answer history data storage unit (not shown) that stores answer history data. The answer history data manages the history of answer operations by each examinee. Specifically, the answer history data stores an option number in association with a question number. Furthermore, the option number is associated with the time when the examinee checked the option, that is, the time when the option number was received. In addition, the time it took to check the option after checking the previous option is also recorded. This time is considered to be the examinee's consideration time for the question. When the answer operation receiving unit (not shown) of the online examination server 200 receives the question number and option number as an answer operation, the progress management unit (not shown) of the online examination server 200 records the received option number, reception time, and consideration time in the answer history data in association with the received question number. If the user reselects an option, a new option number, reception time, and consideration time are additionally recorded. If multiple option numbers are recorded, the option number corresponding to the most recent reception time is valid.

The progress management unit of the online exam server 200 counts the number of answered questions, that is, the number of questions for which option numbers are recorded. The online exam server 200 then displays the answering progress status below the examinee's display area on the supervisor screen (Figure 3 (A)). For example, it displays it in a fraction format such as "3/50" or a percentage format such as "6%". The supervisor screen transmission unit 249 transmits the supervisor screen with the answering progress status for each examinee to the supervisor terminal 300.

The progress management unit of the online test server 200 also calculates an index of the answer pace. The index of the answer pace is calculated by "standard time required/examinee's consideration time". If the examinee answers at a fast pace, the index of the answer pace will be a large value, and if the examinee answers at a slow pace, the index of the answer pace will be a small value. The progress management unit may calculate the index of the answer pace for all questions that have been answered up to that point, or may calculate the index of the answer pace for each question. If all questions that have been answered are the target, the index of the answer pace is calculated by "total standard time required for answered questions/total consideration time for answered questions". The index of the answer pace is displayed as a number or a color that classifies levels. If the index of the answer pace exceeds a first reference value greater than 1 (for example, 1.2), blue is assigned. If the index of the answer pace falls below a second reference value less than 1 (for example, 0.8), red is assigned. If the answer pace indicator is equal to or greater than the second reference value and equal to or less than the first reference value, black is assigned. The supervisor screen generating unit 214 then frames each examinee display area 312 in a color corresponding to the examinee's answer pace indicator. The examinee enlarged screen generating unit 218 may also frame the image of the examinee enlarged and displayed on the examinee enlarged screen (FIG. 3(B)) in a color corresponding to the examinee's answer pace indicator.

[Modification 4]
The supervisor screen (FIG. 3(A)) or the examinee enlarged screen (FIG. 3(B)) may display the device type and operating environment of the examinee terminal 100. This information is used to determine whether there is any cheating (e.g., there is a behavior that does not match the operation specific to the environment).

For example, a display area for the user agent (browser name, model name, etc.) may be provided below the display area for each examinee on the supervisor screen (Figure 3 (A)), and the user agent acquired from the examinee terminal 100 may be displayed when the online examination server 200 receives access from each examinee terminal 100 to a URL for the examinee.

In addition, a display area for the user agent (browser name, model name, etc.) may be provided on the examinee enlarged screen (Figure 3 (B)), and the user agent acquired from the examinee terminal 100 may be displayed when the online examination server 200 receives access to the examinee's URL from each examinee terminal 100.

[Modification 5]
If the supervisor determines that the test was interrupted for unavoidable reasons, such as the detection of improper testing or fraud, the examinee may be allowed to extend the test time.

The enlarged examinee screen (Figure 3(B)) is provided with an input area for the extension time and an extension confirmation button. For example, if the supervisor wants to extend the exam time that ends at 3:00 for a specific examinee only, he or she can enter the extension time (for example, 5 minutes) on the enlarged examinee screen (Figure 3(B)) showing that examinee and click the extension confirmation button. This will change the exam end time for that examinee from 3:00 to 3:05.

A program including a command to transmit the input extension time when the supervisor terminal 300 receives input of the extension time and touches the extension confirmation button is added to the data of the examinee's enlarged screen. The browser of the supervisor terminal 300 displays the enlarged examinee screen and executes the program added to the data of the examinee's enlarged screen, and transmits the input extension time to the online examination server 200 when input of the extension time and clicking of the extension confirmation button are received.

When the extension time receiving unit (not shown) of the online examination server 200 receives the extension time from the supervisor terminal 300, it registers the received extension time in the extension time table. The extension time table stores the extension time in association with the examinee number displayed on the examinee enlarged screen.

In the process of S46, the end time determination unit (not shown) of the online exam server 200 determines the timing to end the exam for each examinee by adding the extension time to the standard exam end time to obtain an individual exam end time for each examinee. When it is determined that the time to end the exam has arrived for each examinee, the notification sending unit 240 of the online exam server 200 sends an end notification to the examinee terminal 100 of that examinee. Note that the default extension time is 0.

As an alternative method, the test may be continued provisionally even if the standard test time has been exceeded, and the grader may determine whether answers entered after the standard test time has been exceeded are valid or invalid.

[Other Modifications]
This embodiment and its modified examples may be applied to qualification examinations, final examinations for training, and the like.

In relation to FIG. 1, a network other than the Internet may be used. For example, a LAN (Local Area Network) may be used.

An external web camera may be used instead of the built-in web camera. Alternatively, a camera of another device such as a smartphone may be used. In this case, the examinee terminal 100 and the smartphone are associated in the online test server 200, and the video received from the smartphone is used as the video of the corresponding examinee terminal 100. When using a self-study booth with a surveillance camera, the video of the surveillance camera may be used. In addition, the built-in web camera, the external web camera, the camera of the other device, and the video of the surveillance camera may be used in combination as appropriate. In the case of an external web camera or a camera of another device, since it can be set in any direction, it is possible to capture the side or back of the examinee terminal 100 and monitor an area that is difficult to monitor with the built-in web camera. In addition, if the examinee cannot prepare a web camera, the school or cram school may lend the examinee an external web camera.

With reference to FIG. 2, this embodiment and its variations may be applied to essay-style questions instead of multiple-choice questions.

In relation to FIG. 3(A), when the examinee display area 312 is clicked on the supervisor screen 310, the screen may be switched to an examinee enlargement screen 320 (FIG. 3(B)) which displays an enlarged view of the examinee in the clicked examinee display area 312.

In relation to FIG. 3(B), in a call between an examinee and a supervisor, the examinee terminal 100 may output only the supervisor's voice without displaying the supervisor's image.

With reference to FIG. 6, if the test start time has not been determined, the test may start immediately after the pre-test check in S32.

You may want to conduct a preliminary test to check operation before conducting the actual test.

In relation to FIG. 7, an example has been shown in which a program is added to the test content to instruct the OS (operating system) to have the browser occupy the entire screen, but a program may be added to the shooting guide screen or standby screen to instruct the OS (operating system) to have the browser occupy the entire screen. In other words, before the test begins, a program is sent to the OS (operating system) to instruct the browser to occupy the entire screen, and the browser is made to execute it.

Instead of sending a completion notification from the online exam server 200 to the examinee terminal 100, the end of the exam may be determined by the browser on the examinee terminal 100. In this case, a program may be added to the exam content that determines when the exam end time has arrived on the examinee terminal 100, ends the exam, and transmits the answer data to the online exam server 200. The browser on the examinee terminal 100 may then execute this program.

The online test server 200 may have a scoring function.

The present invention is not limited to the above-described embodiment and modifications, and can be embodied by modifying the components without departing from the spirit of the invention. Various inventions may be formed by appropriately combining multiple components disclosed in the above-described embodiment and modifications. In addition, some components may be deleted from all the components shown in the above-described embodiment and modifications.

100 examinee terminal, 110 exam content screen, 112 exam questions, 114 answer column, 200 online exam server, 210 data processing unit, 212 login processing unit, 214 supervisor screen generation unit, 216 monitoring unit, 217 call detection unit, 218 examinee enlarged screen generation unit, 219 supervisor screen generation unit, 220 communication unit, 230 transmission unit, 232 login screen transmission unit, 234 shooting guide screen transmission unit, 236 standby screen transmission unit, 238 exam content distribution unit, 240 notification transmission unit, 242 message transmission unit, 244 alert notification unit, 245 call notification unit, 246 supervisor screen transmission unit, 248 examinee enlarged screen transmission unit, 249 supervisor screen transmission unit, 250 reception unit, 252 access reception unit, 254 account reception unit, 256 Video and audio receiving unit, 258 Answer data receiving unit, 260 Request receiving unit, 280 Data storage unit, 282 Test information storage unit, 284 Examinee master storage unit, 286 Examination content storage unit, 288 Answer data storage unit, 290 Video and audio storage unit, 300 Supervisor terminal, 310 Supervisor screen, 312 Examinee display area, 320 Examinee enlarged screen, 322 Enlarged display area, 324 Play button, 326 Talk button, 328 Close button

Claims (2)

An online test support device capable of communicating with an examinee terminal and a supervisor terminal via a network, comprising:
a video/audio receiving unit for continuously receiving video and audio of the examinee during the test from the examinee terminal;
a monitoring unit that detects prohibited items, fraudulent behavior, suspicious behavior, or third parties during the examination based on the examinee's video and audio;
a warning notification unit that transmits a warning notification to the supervisor terminal when the prohibited item, the fraudulent act, the suspicious act, or the third party is detected,
An online examination support device characterized in that the monitoring unit detects the prohibited items, the fraudulent behavior, the suspicious behavior, or the third party based on the reflected image of the examinee's eyes in the image of the examinee during the examination. A computer that can communicate with the examinee terminal and the supervisor terminal via a network.
A function of continuously receiving video and audio of examinees during the examination from the examinee terminal;
a monitoring function for detecting prohibited items, fraudulent behavior, suspicious behavior, or third parties during the examination based on the examinee's video and audio;
a function of transmitting a warning notice to the supervisor terminal when the prohibited item, the fraudulent act, the suspicious act, or the third party is detected;
A program characterized in that, in the monitoring function, the prohibited items, the fraudulent behavior, the suspicious behavior, or the third parties are detected based on the reflected image of the examinee's eyes in the image of the examinee during the test.

Images