JP7533668B2 - Information processing system, information processing device, information processing method, and program - Google Patents

Description

The present invention relates to an information processing system, an information processing device, an information processing method, and a program.

In the office, work is carried out using a variety of devices. By utilizing various devices and applications, it is expected that work efficiency will be improved.

One of these is a technology that automatically stores image data captured by a terminal device in a predetermined storage location. Specifically, for example, it is known that a dedicated application can be installed in a terminal device to cause the terminal device to read a QR code (registered trademark) and then store the captured image data in a storage location indicated by the QR code.

However, conventional technology requires advance configuration, such as installing a dedicated application on the terminal device. As a result, users who rarely use the above-mentioned functions must install applications and perform advance configuration in order to provide their terminal devices with functions that they use infrequently, which is a cumbersome procedure.

The present invention has been made in consideration of the above points, and aims to store image data in a specified storage destination using simple procedures.

The disclosed technology is an information processing system including an information processing device that accepts the submission of image data captured by an imaging function of a user terminal , and includes a receiving unit that accepts access from a browser provided in the user terminal based on a URL obtained by the user terminal by reading a code , a transmitting unit that transmits data to the browser provided in the user terminal after accepting the access, for causing the browser provided in the user terminal to execute a process to realize a service of activating the imaging function of the user terminal and uploading captured image data, and an image data storage unit that stores the image data captured by the imaging function and uploaded by the browser provided in the user terminal based on the data, in association with identification information of the user who submitted the image data and information indicating that the image data has been submitted .

Image data can be stored in a specified location with simple steps.

FIG. 1 illustrates an example of a configuration of an information processing system according to a first embodiment. FIG. 2 illustrates an example of a hardware configuration of a server device according to the first embodiment; FIG. 2 illustrates an example of a hardware configuration of a user terminal according to the first embodiment; FIG. 2 illustrates an example of a hardware configuration of an intermediary device according to the first embodiment; FIG. 1 is a diagram for explaining an overview of a first embodiment. FIG. 2 is a diagram illustrating an example of a functional configuration of each device of the first embodiment. 11 is a sequence diagram illustrating an example of a process executed in response to activation of the intermediation device according to the first embodiment. FIG. FIG. 2 illustrates an example of the configuration of a device information storage unit according to the first embodiment; FIG. 2 illustrates an example of a configuration of a registration information storage unit according to the first embodiment; FIG. 2 illustrates an example of a configuration of an application information storage unit according to the first embodiment; 4A to 4C are diagrams illustrating generation and assignment of passcodes according to the first embodiment. FIG. 11 is a diagram illustrating an example of a passcode displayed on the output device according to the first embodiment. 11 is a sequence diagram illustrating an example of a processing procedure for uploading image data from a student terminal to a server device according to the first embodiment. FIG. FIG. 2 illustrates an example of the configuration of an account information storage unit according to the first embodiment; FIG. 4 is a diagram illustrating a display example on a student terminal according to the first embodiment. FIG. 1 is a diagram illustrating a usage scene of an information processing system according to a first embodiment. FIG. 4 is a diagram illustrating an example of a lesson information storage unit of the first embodiment; FIG. 2 is a diagram illustrating an example of an answer sheet information storage unit according to the first embodiment; FIG. 4 illustrates an example of a blackboard information storage unit according to the first embodiment; FIG. 4 illustrates an example of an installation information storage unit according to the first embodiment; FIG. 4 illustrates an example of a passcode history storage unit according to the first embodiment; FIG. 4 illustrates an example of a display history storage unit of the first embodiment; FIG. 11 illustrates an example of a process for displaying a list of attendance on a teacher terminal according to the first embodiment; FIG. 4 is a diagram illustrating a display example of a teacher terminal according to the first embodiment. FIG. 11 is a diagram for explaining an overview of a second embodiment.

(First embodiment)
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment will be described below with reference to the accompanying drawings. Fig. 1 is a diagram showing an example of the configuration of an information processing system.

In the information processing system 1 shown in FIG. 1, the server device 10 and the user environment E1 are capable of communicating with each other via a wide-area network N1 such as the Internet. However, the network N1 may also be a network that is accessible within a specified range, such as an intranet.

The user environment E1 is a system environment in an organization such as a company or an educational institution such as a school in which one or more output devices 50 and one or more intermediary devices 20 are installed. The output device 50 is a device that displays an input image on a display unit, and may be, for example, a projector or an electronic whiteboard. In the user environment E1, each output device 50 is connected to a corresponding intermediary device 20. That is, there is a one-to-one correspondence between the output device 50 and the intermediary device 20. The output device 50 and the intermediary device 20 are connected via an interface that complies with a standard capable of transmitting images, such as HDMI (registered trademark) (High-Definition Multimedia Interface). For example, a computer such as an HDMI (registered trademark) dongle or stick PC may be used as the intermediary device 20.

For example, the output device 50 and the intermediary device 20 may be connected by a cable corresponding to the interface (e.g., an HDMI (registered trademark) cable, etc.). Alternatively, a connector corresponding to the interface of the intermediary device 20 and a connector for the interface of the output device 50 may be directly connected. For example, the intermediary device 20 may be connected to the output device 50 by inserting the intermediary device 20 into a connector of the output device 50. Alternatively, the intermediary device 20 and the output device 50 may be connected by wireless communication or via a network.

By connecting the output device 50 and the intermediary device 20 as described above, the intermediary device 20 can send the image to be displayed to the output device 50.

The intermediary device 20 is connected to the network N1 via a LAN or the like in the user environment E1. The intermediary device 20 may be wirelessly connected to a LAN or the like in the user environment E1. The intermediary device 20 has an internal web browser, and uses the web browser to execute processing in response to a request to execute processing related to image data sent from the server device 10, thereby controlling the output device 50 (causing the output device 50 to output the results of the execution of the processing).

Specifically, in this embodiment, the intermediary device 20 causes the output device 50 to output (display) image data. In other words, the intermediary device 20 mediates the output (display) of an image by the output device 50 for data transmitted from the server device 10.

In addition, in this embodiment, the intermediary device 20 causes the output device 50 to output (display) specific information for identifying the output device 50. This specific information can be obtained only when the user of the user terminal 40 is in the vicinity of the output device 50, and is information that changes over time.

In this embodiment, when image data is transmitted (uploaded) from the user terminal 40 to the server device 10, the user terminal 40 adds specific information to the image data to be uploaded.

This allows the server device 10 to manage the specific information as information indicating the location and time of day of the user terminal 40 when the image data was uploaded. In other words, according to this embodiment, the server device 10 can manage the uploaded image data in association with information indicating the location and time of day when the image data was captured.

In addition, when a QR code or the like is read by the user terminal 40, the server device 10 of this embodiment causes the user terminal 40 to activate an imaging function and transmit the captured image data and specific information to a storage destination associated with the QR code.

Therefore, in this embodiment, captured image data can be sent to a specified storage destination (upload destination) simply by holding the user terminal 40 over the QR code.

The user terminals 30, 40 are information processing terminals carried by each user in the user environment E1. For example, a smartphone, a tablet terminal, a PC, or a mobile phone may be used as the user terminals 30, 40. The user terminals 30, 40 can be connected to the network N1 without going through a LAN or the like in the user environment E1 (for example, via a mobile communication network). However, the user terminals 30, 40 may also be connected to a network in the user environment E1.

In this embodiment, for example, when a designation is received from the user terminal 30 regarding image data uploaded from the user terminal 40 to the server device 10 via the network N1, the image data designated via the intermediary device 20 may be displayed on the output device 50.

The server device 10 is one or more computers that execute processes to enable output by the output device 50 of image data specified from the user terminal 30, 40 through simple operations using the user terminal 30, 40.

The server device 10 is one or more computers that execute a process of storing image data captured by the user terminals 30 and 40 in a preset storage destination through simple operations using the user terminals 30 and 40. The server device 10 may be installed in the user environment E1.

Figure 2 is a diagram showing an example of the hardware configuration of a server device. The server device 10 in Figure 2 has a drive device 100, an auxiliary storage device 102, a memory device 103, a CPU 104, and an interface device 105, which are all interconnected by a bus B.

The program that realizes the processing in the server device 10 is provided by a recording medium 101 such as a CD-ROM. When the recording medium 101 storing the program is set in the drive device 100, the program is installed from the recording medium 101 via the drive device 100 into the auxiliary storage device 102. However, the program does not necessarily have to be installed from the recording medium 101, but may be downloaded from another computer via a network. The auxiliary storage device 102 stores the installed program as well as necessary files, data, etc.

When an instruction to start a program is received, the memory device 103 reads out the program from the auxiliary storage device 102 and stores it. The CPU 104 executes functions related to the server device 10 in accordance with the program stored in the memory device 103. The interface device 105 is used as an interface for connecting to a network.

Figure 3 is a diagram showing an example of the hardware configuration of a user terminal. In this embodiment, the user terminals 30 and 40 have the same hardware configuration, and in Figure 3, the hardware configuration of the user terminal 30 is described as an example.

In FIG. 3, the user terminal 30 has a CPU 301, a ROM 302, a RAM 303, a touch panel 304, an auxiliary storage device 305, a short-range wireless communication device 306, a digital camera 307, etc.

The ROM 302 and the auxiliary storage device 305 store programs and the like installed in the user terminal 30. When an instruction to start a program is received, the RAM 303 reads out and stores the program from the ROM 302 or the auxiliary storage device 305. The CPU 301 realizes functions related to the user terminal 30 according to the program stored in the RAM 303.

The touch panel 304 is an electronic component that has both an input function and a display function, and displays information and receives input from the user. The touch panel 304 includes an output device 311 and an input device 312.

The output device 311 is a liquid crystal display or the like, and is responsible for the display function of the touch panel 304. The input device 312 is an electronic component including a sensor that detects the contact of a contact object with the output device 311. The contact object refers to an object that contacts the contact surface (surface) of the touch panel 304. Examples of such objects include a user's finger and a dedicated or general pen. The touch panel 304 does not necessarily have to be provided, and the user terminal 30 may be provided with the output device 311 and the input device 312 separately. The output device 311 may be externally connected to the user terminal 30. The input device 312 is not limited to a sensor that detects contact, and may also include electronic components such as a hardware key, a keyboard, and a mouse.

The short-range wireless communication device 306 is hardware for performing short-range wireless communication. In this embodiment, the short-range wireless communication device 306 reads information stored in an NFC tag. That is, in this embodiment, the short-range wireless communication device 306 is preferably an NFC reader. The digital camera 307 is a general digital camera with an imaging function, and may be built into the user terminal 30 as an electronic component, or may be externally connected to the user terminal 30.

The user terminals 30 and 40 of this embodiment may not have, for example, a touch panel 304, a digital camera 307, or a short-range wireless communication device 306. The output device 311 of the user terminals 30 and 40 of this embodiment may be a display, and the input device 312 may be a keyboard, a pointing device, or the like.

Figure 4 is a diagram showing an example of the hardware configuration of an intermediary device. The intermediary device 20 in Figure 4 has an auxiliary storage device 201, a memory device 202, a CPU 203, a communication interface 204, and an image interface 205, etc.

The programs that realize the processing in the intermediary device 20 are installed in the auxiliary storage device 201. The auxiliary storage device 201 stores the installed programs as well as necessary files, data, etc.

When an instruction to start a program is received, the memory device 202 reads out the program from the auxiliary storage device 201 and stores it. The CPU 203 executes functions related to the intermediary device 20 in accordance with the program stored in the memory device 202. The communication interface 204 is a physical interface for connecting to a network. The image interface 205 is a physical interface for transmitting images to the output device 50.

Figure 5 is a diagram for explaining an overview of this embodiment. Figure 5 shows a case where the information processing system 1 of this embodiment is introduced in an educational setting such as a school, and the user terminal 30 is used mainly by teachers, and the user terminal 40 is used mainly by students. In the following description, the user terminal 30 is referred to as the teacher terminal 30, and the user terminal 40 is referred to as the student terminal 40.

Specifically, FIG. 5 shows a case where a test is given during a lecture, and image data of the test answer sheets is stored in the server device 10 so that the teacher can view them. The background to this usage scenario is explained below.

Generally, completed answer sheets are submitted to teachers for grading, and are returned to students only after grading has been completed. For this reason, if students want to grade their own answers, they need to remember the test questions and what they wrote on their answer sheets, but it is often difficult to remember the details of the answer sheets.

In addition, if a teacher wants students to review the test questions after the test is over, the teacher needs to grade the papers promptly and return the graded answer sheets to the students, but it is not always possible to grade the papers promptly.

For this reason, in educational settings, immediately after the test, copies (photographs or copies) of the answer sheets with the answers written on them are made and the completed answer sheets are returned to the students. However, the task of making copies of all students' answer sheets is extremely cumbersome and places a burden on teachers.

Therefore, in this embodiment, a student simply captures an image of his or her completed answer sheet using the student terminal 40, and the captured image data is sent to a storage location designated in advance by the teacher.

In the information processing system 1 of this embodiment, the teacher terminal 30 requests the server device 10 to generate specific information (step S1). In response to the request, the server device 10 generates the specific information and requests the intermediary device 20 to execute a process to output the specific information (step S2).

Upon receiving the request to execute the process, the intermediary device 20 displays the specific information 51 on the output device 50 (step S3).

The output device 50 in this embodiment is, for example, a display device installed in a lecture room where lectures are held. Specifically, the output device 50 may be, for example, an electronic whiteboard that displays images and documents for viewing by students and teachers together.

In addition, in this embodiment, when the student terminal 40 is held over the QR code 52 that has been attached to the answer sheet P in advance, the QR code reading function is activated and the QR code 52 is read (step S4). In the following description, the QR code attached to (associated with) the answer sheet may be referred to as the answer QR code.

The answer sheet QR code 52 may be issued by the information processing system 1 for each educational institution, for example. Also, the answer sheet QR code 52 has embedded therein information that identifies the storage destination of the image data transmitted from the student terminal 40.

When the student terminal 40 reads the answer sheet QR code 52, it accesses the server device 10 (step S5) and receives an instruction to start the imaging function from the server device 10 (step S6).

When the student terminal 40 receives an instruction to activate the imaging function, it displays an input screen for inputting specific information 51, and when the specific information 51 is input by the student, it activates the camera function and displays a screen for capturing an image of the answer sheet P. Then, when the student terminal 40 receives an instruction from the student to capture an image of the answer sheet P, it captures an image of the answer sheet P (step S7).

Next, the student terminal 40 adds the input specific information 51 to the image data of the captured answer sheet P and transmits it to the storage location indicated by the answer sheet QR code 52 (step S8).

The server device 10 stores the image data received from the student terminal 40 in the specified storage location (step S9).

In this embodiment, the specific information output from the server device 10 in response to an instruction from the teacher terminal 30 is added to the image data of the image captured by the student terminal 40 and stored in the server device 10, thereby associating the image data with the specific information. In other words, according to this embodiment, the teacher who instructed the server device 10 to output the specific information and the student who transmitted the image data can be associated and managed.

In addition, in this embodiment, the student terminal 40 realizes a function of transmitting captured image data to a specified storage destination in response to an instruction from the server device 10. Therefore, according to this embodiment, there is no need to install a dedicated application, and no procedures such as pre-settings are required, and image data can be stored in a specified storage destination with simple procedures.

In addition, in this embodiment, all image data of the answer sheet captured by the student terminal 40 is automatically stored in a specified storage location.

Therefore, when this embodiment is applied, when returning completed answer sheets to students, teachers do not need to make copies of the answer sheets, reducing the burden on teachers. In addition, when this embodiment is applied, students can obtain their own completed answer sheets immediately after the end of the test, which can be used for self-grading, review, etc.

In addition, in FIG. 5, the subject of the image captured by the student terminal 40 is the answer sheet P, but this is not limited to this. In this embodiment, if a QR code 53 is attached in advance to a whiteboard WB or the like installed in a lecture room, image data of the blackboard written on the board during a lecture can be sent to a specified storage destination using a similar mechanism. In the following description, the QR code attached to (associated with) the whiteboard WB may be referred to as the blackboard QR code.

Therefore, for example, if a student uses a whiteboard WB or the like to make a presentation or write an answer to a question during a lecture, the student terminal 40 can read the blackboard QR code 53 attached to the whiteboard WB and capture an image of the whiteboard WB, and the image data of the writing on the whiteboard WB can be sent to a specified storage destination.

The specific information 51 may be any information assigned to identify the output device 50, and may be composed of any information such as numbers, letters, symbols, figures, etc. The specific information 51 may be displayed on the output device 50 as a two-dimensional code such as a QR code (registered trademark). The specific information 51 may be a beacon signal or the like transmitted from the output device 50 or a transmitter or the like associated with the output device 50. The specific information 51 may be transmitted by wireless communication from the output device 50 or a transmitter or the like associated with the output device 50.

In the following explanation, the specific information will be described as a passcode, which is an example of specific information. Details of the specific information will be described later.

Figure 6 is a diagram showing an example of the functional configuration of each device. In Figure 6, the teacher terminal 30 has a control unit (operating system unit) 31, a browser unit 32, etc. Each of these units is realized by processing that causes the CPU 301 to execute one or more programs installed in the teacher terminal 30.

The control unit 31 starts the browser unit 32 in response to an operation from the user of the teacher terminal 30. The browser unit 32 is, for example, a general web browser, and executes processing according to HTML (HyperText Markup Language) data and scripts (for example, JavaScript (registered trademark)). In addition, when the browser unit 32 starts up, it transmits an initial access URL to the server device 10.

At this time, the browser unit 32 also transmits the registration ID, which is added to the initial access URL as optional information, to the server device 10 along with the initial access URL. The registration ID is identification information that identifies the service, and is associated in advance with the application that realizes the service.

The browser unit 32 also accesses an application associated with the registration ID among the applications held by the server device 10 in accordance with a redirect request from the server device 10 in response to access to the initial access URL. The redirect request is a response from the server device 10 in response to access to the initial access URL.

The browser unit 32 obtains data (HTML data, scripts, etc.) indicating a request to execute processing on the teacher terminal 30 from the accessed application.

The initial access URL refers to the URL that the teacher terminal 30 should access first when accessing the server device 10 for the first time.

The student terminal 40 of this embodiment has a control unit (operating system unit) 41, a browser unit 42, etc. Each of these units is realized by a process in which one or more programs installed in the student terminal 40 are executed by the CPU of the student terminal 40.

The control unit 41 starts the browser unit 42 in response to an operation from the user of the student terminal 40. The browser unit 42 is, for example, a general web browser, and displays various screens, etc.

The intermediary device 20 includes a communication control unit 21, a browser management unit 22, and a browser unit 23. Each of these units is realized by a process executed by the CPU 203 of one or more programs installed in the intermediary device 20.

The communication control unit 21 connects a two-way communication path (establishes a communication session) with the communication unit 11 of the server device 10, and functions as an end point on the intermediary device 20 side of the communication path (communication session). By communicating via the communication path (communication session), the intermediary device 20 can notify the server device 10 of the state of the intermediary device 20, and can receive a notification from the server device 10 that image data that the intermediary device 20 should display on the output device 50 has been input to the server device 10. Inputting image data to the server device 10 means that image data is uploaded to the server device 10 from the teacher terminal 30 or the student terminal 40.

The browser management unit 22 starts the browser unit 23 in kiosk mode. Kiosk mode refers to a mode in which the use of the intermediary device 20 is limited to displaying web pages. Note that the kiosk mode is merely an example, and other modes that allow the display of web pages may be used.

The browser unit 23 is, for example, a general web browser, and executes processing according to HTML data, scripts, etc.

When the browser unit 23 is started, it accesses the initial access URL. At this time, the server device 10 assigns the identification information of the browser unit 23 (hereinafter referred to as the "browser ID") to the initial access URL as optional information.

The browser unit 23 accesses an application associated with the browser ID among the applications held by the server device 10 in accordance with a redirect request made in response to access to the initial access URL. The browser unit 23 obtains data (HTML data, script, etc.) indicating a processing execution request to the intermediary device 20 from this application.

The server device 10 has a communication unit 11, an application determination unit 12, an input application group 13, an output application 14, a specific information allocation unit 15, and a storage control unit 16. Each of these units is realized by a process in which one or more programs installed in the server device 10 are executed by the CPU 104.

The server device 10 also has an app information storage unit 121, a device information storage unit 122, an account information storage unit 123, a registration information storage unit 124, a lesson information storage unit 125, an answer information storage unit 126, a blackboard information storage unit 127, an installation information storage unit 128, a passcode history storage unit 129, and a display history storage unit 130. Each of these storage units can be realized, for example, using the auxiliary storage device 102, or a storage device that can be connected to the server device 10 via a network.

The communication unit 11 performs processing for establishing communication between the server device 10 and the intermediary device 20, and communication between the server device 10 and the teacher terminal 30 and the student terminal 40. In other words, the communication unit 11 is an example of a transmitting unit that transmits information and a receiving unit that receives information in the server device 10.

The application determination unit 12 corresponds to the initial access URL. In response to an access to the initial access URL, the application determination unit 12 determines the application corresponding to the option information (registration ID or browser ID) assigned to the initial access URL by referring to the registration information storage unit 124.

When the application determination unit 12 determines the application corresponding to the option information, it sends a response including a redirect request including a URL for this application to the source of the access to the initial access URL.

The input application group 13 and the output application 14 are examples of applications that the server device 10 has.

The input application group 13 is a group of applications that execute processes according to the purpose, and each application transmits HTML data and scripts, etc. to the teacher terminal 30 for executing processes according to the purpose.

The input app group 13 in this embodiment includes, for example, a teacher portal app that causes the teacher terminal 30 to execute a process to display a menu of a portal screen for teachers, and an attendance display app that causes the teacher terminal 30 to display the output status of students.

The input application group 13 also includes a camera application (hereinafter, camera application). The camera application is an application that realizes a service that activates the camera function of the student terminal 40 and transmits the captured image data to the server device 10 when an answer sheet QR code or blackboard QR code is read. The input application group 13 also includes a schedule application that causes the teacher terminal 30 to execute a process to display a subject input screen that accepts the input of subjects.

The output application 14 includes an application for outputting the passcode generated by the specific information allocation unit 15. Specifically, the output application 14 may be, for example, HTML data and a script for causing the intermediary device 20 to draw a passcode. The output application 14 may also cause the output device 50 to execute a process for transmitting the passcode via wireless communication, or may cause the output device 50 or a transmitter associated with the output device 50 to execute a process for transmitting a beacon signal.

The output application 14 also includes an application for causing the intermediary device 20 to acquire (download) and draw image data stored in the answer information storage unit 126 and the blackboard information storage unit 127. Specifically, the output application 14 transmits HTML data, scripts, and the like to the intermediary device 20 for causing the intermediary device 20 to acquire and draw the image data.

The specific information allocation unit 15 generates a passcode and displays the passcode on the output device 50 via the intermediary device 20. In this embodiment, the specific information allocation unit 15 generates passcodes so that the passcodes displayed on the output device 50 are different from one another. The generation of passcodes by the specific information allocation unit 15 will be described later.

The storage control unit 16 stores in each memory unit image data uploaded to the server device 10 by the input application group 13, a passcode output from the output device 50 via the intermediary device 20 by the output application 14, and the like. The details of the storage control unit 16 will be described later.

The application information storage unit 121 stores information (e.g., URL, etc.) about each application (input application group 13, output application 14 in this embodiment) that the server device 10 has.

The account information storage unit 123 stores identification information of users who can use applications on the server device 10.

The device information storage unit 122 stores information indicating the status of each intermediary device 20 placed in the user environment E1.

The registration information storage unit 124 stores, for each registration ID, identification information of the application that executes the input process of image data, identification information of the application that executes the output process of image data, and identification information of the browser unit 23 of the intermediary device 20 to which the image data is input.

The lesson information storage unit 125 stores information about lessons. Specifically, the lesson information storage unit 125 includes information identifying the type of lecture, the lecture room, the lecture time, and the teacher, information identifying image data captured during the lecture, and the like.

The answer information storage unit 126 and the blackboard information storage unit 127 are examples of an image data storage unit in which image data is stored.

The answer information storage unit 126 stores, for example, image data of answer sheets captured on the student terminal 40. The blackboard information storage unit 127 stores image data of blackboards and whiteboards installed in lecture rooms, etc.

In the answer sheet information storage unit 126 and the blackboard information storage unit 127, the passcode assigned to the stored image data, information identifying the student who captured the image data, etc. are stored together with the image data.

The installation information storage unit 128 stores information indicating the browser ID that displayed the passcode during the lecture.

The passcode history storage unit 129 stores information indicating the history of passcodes output via the output application 14. The display history storage unit 130 stores information indicating the history of image data displayed on the output device 50 by the browser unit 23 of the intermediary device 20.

Details of each of the above mentioned storage units will be given later.

The following describes the processing procedure executed in the information processing system 1. FIG. 7 is a sequence diagram for explaining an example of the processing procedure executed in response to the start-up of the intermediary device of the first embodiment. Specifically, FIG. 7 shows the processing procedure up to displaying the passcode on the output device 50.

When the power of the intermediary device 20 is turned on by a user such as a teacher (step S701), the communication control unit 21 establishes a communication path with the communication unit 11 of the server device 10 for asynchronously receiving a request from the communication unit 11 (step S702). At this time, the communication control unit 21 notifies the communication unit 11 of a communication ID, which is identification information of the communication control unit 21 itself (the communication control unit 21). The communication unit 11 updates the device information storage unit 122 based on the notified communication ID (hereinafter referred to as the "target communication ID").

Figure 8 is a diagram showing an example of the configuration of the device information storage unit. In Figure 8, the device information storage unit 122 stores a communication ID, address information, status information, browser ID and browser status, passcode, etc., in association with a tenant ID.

The tenant ID is identification information of the person (tenant) who has signed a contract to use the service provided by the server device 10. For example, the user environment E1 may correspond to one tenant.

The communication ID is identification information of the communication control unit 21 of each intermediary device 20 located in the tenant associated with the tenant ID. If the intermediary device 20 has only one communication control unit 21, the communication ID may be identification information that identifies the intermediary device 20.

The address information is the local IP address of the intermediary device 20. The status information is information indicating whether the communication control unit 21 related to the communication ID is connected to the server device 10 (a state in which a communication path is established) or not ("not connected").

The browser ID is identification information of the browser unit 23 corresponding to the communication control unit 21 related to the communication ID. In this embodiment, the browser ID is identification information of the browser unit 23 included in the same intermediary device 20 as the communication control unit 21 related to the communication ID.

The browser status is information that indicates the startup status of the browser unit 23 related to the browser ID. For example, if the target communication ID notified to the communication unit 11 is "Eg001-01", the status information corresponding to that communication ID in the device information storage unit 122 is changed to "Connected" as shown in FIG. 8.

The passcode is generated by the specific information allocation unit 15 when a communication path with the intermediary device 20 is established, and is associated with the communication ID (intermediary device 20). Note that if there are multiple browser IDs associated with the communication ID, a passcode may be generated for each browser ID.

Next, the communication control unit 21 searches for the browser management unit 22 using, for example, SNMP (Simple Network Management Protocol) to obtain the browser ID (step S703), and obtains the browser ID, which is identification information of the browser unit 23 that is managed by the browser management unit 22, from the discovered browser management unit 22 (step S704).

In this embodiment, an example is shown in which the intermediary device 20 includes a communication control unit 21 and a browser management unit 22, but the communication control unit 21 of the intermediary device 20 communicates with the browser units 32 of other intermediary devices 20 via the same network, so that multiple browser management units 22 and browser units 23 can be used. In order to make this possible, the browser management unit 22 is probed using SNMP or the like. Therefore, probing the browser management unit 22 is not necessarily required, and the destination (browser management unit 22) from which the communication control unit 21 obtains the browser ID may be set in advance.

Next, the communication control unit 21 sends a notification to the communication unit 11 that the browser unit 23 corresponding to the acquired browser ID (in this embodiment, the browser unit 23 of the intermediary device 20) has become available, specifying the browser ID of the browser unit 23 (hereinafter referred to as the "target browser ID") (step S705).

When the communication unit 11 receives this notification, it updates the device information storage unit 122 (Figure 8) based on the target browser ID specified in the notification. Specifically, in the device information storage unit 122, the value of the browser state corresponding to the target browser ID is updated from "power OFF" to "power ON."

Next, the communication control unit 21 requests the browser management unit 22 to start the browser unit 23 related to the target browser ID by specifying the target browser ID and the initial access URL (step S706). As described above, the initial access URL is the URL that the browser unit 23 should access first, and is set in advance in the browser management unit 22.

In response to the request from the communication control unit 21, the browser management unit 22 starts the browser unit 23 related to the target browser ID in kiosk mode (step S707). At this time, the browser management unit 22 inputs the initial access URL to the browser unit 23. In response to the start-up in kiosk mode, the browser unit 23 sends an HTTP request to the input initial access URL (step S708). The HTTP request includes the target browser ID.

When the application determination unit 12 of the server device 10 receives the HTTP request, it sends a response (HTTP response) including a redirect request to the browser unit 23 (step S709).

The redirect request includes the URL of the application associated with the browser ID as the redirect destination. The redirect request also includes the communication URL and the target browser ID included in the HTTP request as notification information to the redirect destination. The communication URL is the URL of the communication control unit 21.

The application determination unit 12 refers to the registration information storage unit 124 and the application information storage unit 121 to identify the URL of the application associated with the target browser ID.

Figure 9 is a diagram showing an example of the configuration of the registration information storage unit. In Figure 9, the registration information storage unit 124 has the following information items: registration ID, In app ID, Out app ID, and browser ID, and the value of the item "registration ID" is stored in association with the values of the other items.

The In app ID is the ID of an application that controls the input of image data in the service corresponding to the registration ID (hereinafter referred to as the "app ID"). The Out app ID is the app ID of an application that controls the output of image data in the service corresponding to the registration ID.

In this embodiment, the application indicated by the In app ID associated with the registration ID in the registration information storage unit 124 is an application included in the input app group 13. Also, in this embodiment, the application indicated by the Out app ID associated with the registration ID in the registration information storage unit 124 is the output app 14.

For example, the registration ID "Tag_Ed" is associated with the In app ID "AP_EdPortal" and is not associated with an Out app ID. Therefore, it can be seen that the service corresponding to the registration ID "Tag_Ed" provides a service related to control of input of image data. Note that the In app ID "AP_EdPortal" indicates the app ID of an application included in the input app group 13 that executes the process of displaying the menu of the portal screen for teachers.

The registration ID "Tag_St" is associated with the In app ID "AP_Stcamera", but is not associated with the Out app ID. Therefore, it can be seen that the service corresponding to the registration ID "Tag_St" provides a service related to the control of the input of image data. In other words, in the case of a student terminal 40 that is only provided with the service corresponding to the registration ID "Tag_St", it does not have the function of causing the server device 10 to send a request to the intermediary device 20 to execute processing.

The In app ID "AP_Stcamera" indicates the app ID of an application included in the input app group 13 that starts the camera of the student terminal 40 and executes a process to send image data captured by the camera to a storage destination.

In addition, in FIG. 9, the registration ID "Tag_StPhotoCode" is associated with the In app ID "AP_StPhoto" and the Out app ID "AP_PhotoDoc", but is not associated with a browser ID.

In this embodiment, the registration ID, In app ID, and Out app ID are associated in this way, and if the browser ID is not associated, this indicates that the service is confirmed but the browser ID is not confirmed. In such a case, the service and browser ID are associated based on the passcode.

In the following description, information in the registration information storage unit 124 that includes the value of the item "Registration ID" and the values of other items is referred to as tag information.

FIG. 10 is a diagram showing an example of the configuration of the application information storage unit. In FIG. 10, the application information storage unit 121 stores an application ID, application type, URL, compatible browser, etc. for each application that the server device 10 has.

The app type indicates the type of application related to the app ID based on the relationship with image data. "In" indicates that it is an application that controls the input of image data (corresponding to the In app ID described above). "Out" indicates that it is an application that controls the output of image data (corresponding to the Out app ID described above). The URL is the URL of the application related to the app ID.

The supported browser indicates the type of browser that runs the application associated with the app ID. In the example of FIG. 10, the types of browser are a terminal browser indicating the browser section of the teacher terminal 30 and the student terminal 40, and a device browser indicating the browser section 23 of the output device 50.

The application determination unit 12 refers to the registration information storage unit 124 to identify the Out application ID associated with the target browser ID, and refers to the application information storage unit 121 to identify the URL associated with the Out application ID. Here, it is assumed that the target browser ID is "BROWSER1". In this case, the URL (hereinafter, "output application URL") of the application (output application 14) whose application ID is "AP_PhotoDoc" is identified.

The application determination unit 12 also automatically generates a communication URL of the communication control unit 21 related to the target communication ID based on the address information associated with the target browser ID in the device information storage unit 122 (Figure 8).

Next, the browser unit 23 sends (redirects) an HTTP request to the output application URL (i.e., the output application 14) that is the redirect destination in accordance with the redirect request (S710). The HTTP request includes the communication URL and browser ID that were included in the redirect request.

In response to the HTTP request, the output application 14 transmits to the browser unit 23 a response including a script for causing the browser unit 23 to connect to the communication URL included in the HTTP request, and display data for causing the browser unit 23 to render a user interface for displaying a passcode (S711). Note that the script and the display data are examples of data indicating a request to the intermediary device 20 to execute processing. For example, the script may be a program in another format, and the display data may be data in another format.

When the browser unit 23 receives the response, it executes the script included in the response and establishes a communication path with the communication control unit 21 identified by the communication URL (S712). This communication path is a communication path for the communication control unit 21 to transmit the notification received from the server device 10 to the browser unit 23. A websocket may be used for this communication path.

Next, the browser unit 23 renders a screen (hereinafter referred to as the "display screen") based on the display data included in the response in a predetermined area (e.g., video memory) of the memory device 103 (S713). For example, the display screen is a screen on which the passcode generated by the server device 10 is displayed. The rendered content (display screen) by the browser unit 23 is output to the output device 50 via an interface such as HDMI (registered trademark), and is output (displayed) by the output device 50.

Next, the server device 10 generates and assigns, by the specific information allocation unit 15, a passcode that does not overlap for a certain period of time to the group of browser IDs associated with the tenant ID, and delivers a passcode notification that associates the browser ID with the passcode to the communication control unit 21 of the intermediary device 20 at regular intervals (S714). At this time, the specific information allocation unit 15 stores the generated passcode in the device information storage unit 122 (Figure 8) in association with the browser ID.

In this embodiment, the fixed period is, for example, several days, and the fixed interval is, for example, several minutes (for example, 15 minutes).

When the communication control unit 21 receives the passcode notification, it notifies the browser unit 23, which is identified by the browser ID associated with the passcode, of the passcode (S715). The browser unit 23 displays the passcode on a portion of the display screen of the output device 50 (S716).

In the example of FIG. 8, two browser IDs are associated with the communication ID "Eg001-01." In this case, the passcode corresponding to the browser ID "BROWSER1" whose startup state is "powered on" is displayed on the output device 50 by the intermediary device 20.

Below, the generation and assignment of passcodes by the specific information assignment unit 15 of this embodiment will be described with reference to FIG. 11. FIG. 11 is a diagram for explaining the generation and assignment of passcodes.

The passcode in this embodiment is, for example, a four-digit number. The specific information allocation unit 15 in this embodiment generates and assigns a passcode for each browser ID (intermediary device 20) associated with a tenant ID. Specifically, the specific information allocation unit 15 generates a random four-digit number and assigns it to the intermediary device 20 as the passcode.

In addition, for example, when there are multiple intermediary devices 20 (intermediary devices 20 in the user environment E1) associated with the tenant ID, the specific information allocation unit 15 ensures that the passcodes assigned to each intermediary device 20 do not overlap. Furthermore, the specific information allocation unit 15 periodically changes the passcodes assigned to each intermediary device 20.

The example in Figure 11 shows a case where three intermediary devices 20, 20-1, 20-2, and 20-3, exist for one tenant ID.

In this case, for example, the specific information allocation unit 15 assigns the passcodes "1234", "2293", and "8341" to each intermediary device 20 for 15 minutes from 10:00. Also, the specific information allocation unit 15 assigns the passcodes "3256", "5671", and "4252" to each intermediary device 20 for 15 minutes from 10:15.

In this manner, in this embodiment, a different passcode is assigned to each intermediary device 20, and the passcode assigned to the intermediary device 20 is changed periodically. Therefore, according to this embodiment, the time and location at which the image data was captured can be identified based on the passcode assigned to the image data sent from the student terminal 40.

Figure 12 is a diagram showing an example of a passcode display on an output device. The passcode 51 notified from the server device 10 is displayed on the screen of the output device 50.

Next, the process of uploading image data from the student terminal 40 to the server device 10 will be described with reference to FIG. 13. FIG. 13 is a sequence diagram for explaining an example of the process of uploading image data from the student terminal to the server device in the first embodiment.

In the student terminal 40 of this embodiment, the control unit 41 detects that the student terminal 40 has been pointed at the answer sheet QR code by the student (user) (step S1301).

Next, the student terminal 40 reads the answer sheet QR code (step S1302) and obtains the registration ID and initial access URL embedded in the answer sheet QR code (step S1303).

When the student terminal 40 reads the answer sheet QR code, it launches the browser unit 42 and connects to the initial access URL embedded in the QR code (step S1304).

When the browser unit 42 is started, it automatically sends an HTTP request to the application determination unit 12 corresponding to the initial access URL embedded in the answer QR code (step S1305). In addition to the registration ID acquired from the answer QR code, the HTTP request includes account information as optional information.

In this manner, in this embodiment, the answer QR code is embedded with a registration ID, which is identification information that identifies the service provided by the server device 10, and an initial access URL that corresponds to the application determination unit 12. In other words, it can be said that the answer QR code in this embodiment is embedded with information that identifies the server device 10, which is the storage destination where image data captured on the student terminal 40 is stored.

The account information is information including the student's user ID and the tenant ID of the user environment E1, or information capable of identifying the user ID and tenant ID. For example, cookies, etc. may be used as the account information.

If the student terminal 40 is already logged in, when the application determination unit 12 of the server device 10 receives the HTTP request, it sends an HTTP request (redirect) to the browser unit 42 (step S1306). This HTTP request includes a camera URL (i.e., the camera application 13-1). The camera application 13-1 is one of the applications included in the input application group 13.

When the browser unit 42 receives the HTTP request (redirect), it proceeds to step S1314, which will be described later.

In addition, if the student terminal 40 is not already logged in, when the application determination unit 12 receives the HTTP request, it sends an HTTP request (redirect) including the login URL (i.e., login application 13-2) to the browser unit 42 (step S1307).

When the browser unit 42 receives the HTTP request, it requests the login application 13-2 to display the login screen (step S1308). In response to the display request, the login application 13-2 transmits display data for displaying the login screen to the browser unit 42 (step S1309).

The browser unit 42 displays a login screen based on the display data (step S1310).

When the browser unit 42 accepts the input of account information on the login screen (step S1311), it transmits a login request to the server device 10 in which the input account information is associated with the registration ID read from the answer sheet QR code (step S1312).

The server device 10, via the application determination unit 12, refers to the account information storage unit 123, performs login processing, and makes an HTTP request (redirect) to the URL associated with the registration ID (step S1313). In this case, the URL associated with the registration ID is the camera URL (i.e., the camera application 13-1).

Here, the account information storage unit 123 will be described with reference to FIG. 14. FIG. 14 is a diagram showing an example of the configuration of the account information storage unit in the first embodiment.

In this embodiment, the account information storage unit 123 has the following information items: tenant ID, user ID, and password.

In this embodiment, a common user ID is assigned to students, and a user ID is assigned to each teacher. Passwords are determined according to each user ID.

Returning to FIG. 13, the browser unit 42 receives the HTTP request including the camera URL and connects to the camera application 13-1 (step S1314).

The camera application 13-1 sends a response to the browser unit 42, which includes display data of an input screen for inputting the class number, the class number input on the input screen, and a script for executing a process for transmitting the captured image data to the server device 10 (step S1315).

In other words, the server device 10 activates the imaging function of the student terminal 40 using the camera application 13-1 associated with the registration ID received from the student terminal 40, and sends to the student terminal 40 a request to execute a process to upload image data captured by the imaging function. In other words, the browser unit 42 obtains the answer reading application (the input class number and a script for executing a process to transmit the captured image data to the server device 10) from the camera application 13-1. The browser unit 42 activates the answer reading application and displays an input screen for the student number, class number, and passcode (step S1316).

When the browser unit 42 accepts input of the student number, class number, and passcode on the input screen (step S1317), it stores the student number, class number, and passcode (step S1318).

Next, the browser unit 42 accepts an operation on the start button to capture an image of the answer sheet (step S1319) and displays the camera operation screen of the student terminal 40 (step S1320).

When the browser unit 42 receives an operation of the image capture button (step S1321), it instructs the control unit 41 to capture image data (step S1322). The control unit 41 passes the image data captured by the camera to the browser unit 42 (step S1323).

The browser unit 42 assigns the registration ID, student number, class number, and passcode to the image data and transmits it to the communication unit 11 of the server device 10 (step S1324).

The image data received by the communication unit 11 is stored in the answer information storage unit 126, etc. by the storage control unit 16.

Now, with reference to FIG. 15, an example display of the student terminal 40 will be described. FIG. 15 is a diagram showing an example display of the student terminal of the first embodiment. FIG. 15(A) shows an example of a login screen displayed in step S1310 of FIG. 13. FIG. 15(B) shows an example of an input screen displayed in step S1316 of FIG. 13. FIG. 15(C) shows an example of a camera operation screen displayed in step S1320 of FIG. 13.

The screen 151 in FIG. 15(A) has input fields 151a and 151b into which the user ID and password are respectively entered.

In this embodiment, the user ID and password entered into the student terminal 40 are common and assigned to each tenant ID, but this is not limited to this. The user ID and password may be set for each individual student who is the user of the student terminal 40. In this case, the user ID and password for each student may be stored as account information in the account information storage unit 123.

Screen 152 shown in FIG. 15(B) has input fields 152a, 152b, and 152c in which a student number, a class number, and a passcode are respectively entered. The student number is, for example, a number given to each individual student. The student number may be determined, for example, for each lecture that a student takes. In this case, for example, the student number may be assigned based on the order in which students enter the lecture room where the lecture is held.

In this embodiment, if a user ID is assigned to each individual student, the user ID and student number are linked, so there is no need to input the student number on screen 152. Therefore, in that case, input field 152a is not required.

The class number is the name of the lecture that the student is taking, etc. If the class number is embedded in the answer sheet QR code 52, the input field 152b is not displayed on the screen 152. The passcode is entered by the student by visually checking the passcode displayed on the output device 50.

Note that the class number and passcode may be required to be entered only when capturing an image of an answer sheet, and may not be required to be entered when capturing an image of a whiteboard WB.

When the start button 152d on the screen 152 is operated, the browser unit 42 of the student terminal 40 transitions the display to the captured image screen. In other words, the start button 152d is an operation button for transitioning the display of the student terminal 40 to the captured image screen.

The screen 153 shown in FIG. 15(C) is an example of an imaging screen in which the camera is activated and an image 153a of a completed answer sheet P is displayed. When the operation button 153b on the screen 153 is operated, the image data of the captured image of the answer sheet P is sent to the storage destination indicated by the answer QR code.

Next, the processing of the storage control unit 16 of the server device 10 will be described. Below, a usage scenario of the information processing system 1 when explaining the storage of data by the storage control unit 16 will be described. FIG. 16 is a diagram illustrating a usage scenario of the information processing system of the first embodiment.

The user environment E1-1 shows an educational site where the information processing system 1 has been introduced. In the lecture room A001, which constitutes the user environment E1-1, an output device 50 and whiteboards WB1 and WB2 are installed, and a lecture titled "Mathematics A_01" is being given by a teacher who is the user of the teacher terminal 30.

The teacher's user ID for this lecture is "tanaka@". In the example of FIG. 16, a user ID is given to each individual student, and the lecture titled "Mathematics A_01" is attended by a student with user ID "tokiwa@" who is the user of student terminal 40-1, a student with user ID "saito@" who is the user of student terminal 40-2, and a student with user ID "ando@" who is the user of student terminal 40-3. Other students are also participating in the lecture titled "Mathematics A_01".

In the example of FIG. 16, a request to display a passcode is made from the teacher terminal 30 to the server device 10, and the passcode 51 is displayed on the output device 50 via the intermediary device 20.

In the following explanation, for example, in this lecture titled "Mathematics A_01," answer sheets are distributed to students in the lecture room at the beginning of the lecture, and students make presentations using whiteboards WB1 and WB2 and take a test.

An answer sheet QR code 52 and a blackboard QR code 53 are attached to the answer sheet and the whiteboards WB1 and WB2 in advance. The answer sheet QR code 52 contains an embedded registration ID associated with the camera application 13-1 included in the input application group 13 and a URL corresponding to the application determination unit 12.

In addition, the answer sheet QR code 52 may have information embedded therein indicating that it is a QR code corresponding to an answer sheet, and the blackboard QR code 53 may have information embedded therein indicating that it is a QR code corresponding to a whiteboard WB.

For example, the blackboard QR code 53 may have embedded therein a registration ID that identifies an application that performs processing to associate image data with the teacher's user ID and store it, regardless of which terminal is used to capture the image of the whiteboard WB.

In the example of Figure 16, the teacher requests the submission of image data of whiteboards WB1 and WB2 on which the contents of the presentation are written, and requests the students who have distributed answer sheets to submit image data of the completed answer sheets, and the teacher requests that each image data be submitted within the lecture time.

A student who is attending the lecture and is the user of student terminal 40-1, and a student who is the user of student terminal 40-2, hold student terminals 40-1 and 40-2 over the answer QR codes 52 on answer sheets P1 and P2, respectively.

When the student terminals 40-1 and 40-2 read the answer sheet QR code 52, they activate the camera function according to the processing procedure described in FIG. 13. Then, after accepting the input of each student's account information and passcode 51, the student terminals 40-1 and 40-2 accept an image capture operation, capture images of the answer sheets P-1 and P-2, and send the captured image data to the server device 10.

Furthermore, a student who has given a presentation using the whiteboards WB1 and WB2 holds his or her own student terminal 40 over the blackboard QR code 53 on the whiteboards WB1 and WB2. When the student terminal 40 reads the blackboard QR code 53, it activates the camera function according to the processing procedure described in FIG. 13. When it receives an image capture operation, it captures an image of the whiteboards WB1 and WB2 and transmits the captured image data to the server device 10.

In this embodiment, when uploading image data of a whiteboard WB, a passcode does not need to be entered.

The student who is the user of student terminal 40-3 who received the answer sheet leaves lecture room A001 after receiving the answer sheet, writes his/her answers on the answer sheet in another location, and then holds student terminal 40-3 over QR code 52.

In this case, the student cannot see the passcode displayed on the output device 50, so he or she sends image data of the completed answer sheet P3, but without entering a passcode, to the server device 10.

Below, the storage of image data by the storage control unit 16 of the server device 10 is described with reference to Figures 17 to 20.

Figure 17 is a diagram showing an example of the lesson information storage unit of the first embodiment. The lesson information storage unit 125 of this embodiment has the following information items: tenant ID, lesson number, lecture room number, start time, lesson duration, teacher, and content ID.

The lesson number is information that uniquely identifies a lecture and may be the lecture name. The lecture room number is information that identifies the lecture room used for the lecture and may be the lecture room name. The start time indicates the start time of the lecture identified by the lecture number, and the lesson time indicates the lesson time of the lecture identified by the lecture number. The teacher is the user ID of the teacher giving the lecture identified by the lesson number, and the content ID indicates the type of image data associated with the lecture identified by the lesson number.

Of the information items contained in the lesson information storage unit 125, the values of the items other than the "content ID" item are stored based on a predetermined timetable, etc. The "content ID" item value is stored according to the type of image data received by the storage control unit 16 of the server device 10 from the student terminal 40.

In the following description, the information stored in the lesson information storage unit 125 may be referred to as lesson information.

In Figure 17, it can be seen that a lecture titled "Mathematics A_01" will be given by a teacher with user ID "tanaka@" in lecture room "A001" from 10:00 on 10/25 for 60 minutes.

In the example of FIG. 17, the lecture name "Mathematics A_01" is associated with the content IDs "Answer_Mathematics A01," "WB_Mathematics A01," and "Display_Mathematics A01." In other words, it can be seen that three types of image data are associated with the lecture name "Mathematics A_01."

The content ID "Answer_Math A01" indicates that the type of image data is image data of an answer sheet. The content ID "WB_Math A01" indicates that the type of image data is image data of a whiteboard. The content ID "Display_Math A01" is information associated with the browser ID that displayed the passcode during the lecture titled "Math A_01".

When the storage control unit 16 of this embodiment receives image data of an answer sheet and a class number from the student terminal 40, it stores "Answer_Math A01" as the value of the item "Content ID" corresponding to the class number in the class information storage unit 125. Then, the storage control unit 16 associates the content ID value "Answer_Math A01" with the image data received in the answer information storage unit 126 and stores it.

In addition, when the storage control unit 16 receives image data of the whiteboard WB from the student terminal 40, it stores "WB_Mathematics A01" as the value of the item "Content ID" in the lesson information storage unit 125, and stores the received image data in the blackboard information storage unit 127.

In addition, when the storage control unit 16 of this embodiment causes the output device 50 to display a passcode via the intermediary device 20 during a lecture, it stores "Display_Mathematics A01" as the value of the item "Content ID" in the lesson information storage unit 125, and stores the browser ID of the intermediary device 20 in the installation information storage unit 128.

Figure 18 is a diagram showing an example of an answer information storage unit of the first embodiment. The answer information storage unit 126 of this embodiment includes the following information items: content D, user ID, student number, file ID, upload time, and passcode. In the following description, the information stored in the answer information storage unit 126 may be referred to as answer information.

The answer information storage unit 126 stores image data of the answer sheet captured by the student terminal 40. The user ID in the answer information storage unit 126 indicates the account information assigned to the image data, and the file ID indicates identification information that identifies the image data. Also, in the answer information storage unit 126, the upload time indicates the time when the image data was uploaded, and the passcode indicates the passcode assigned to the image data.

In the example of FIG. 18, image data of an answer sheet with a content ID of "Answer_Mathematics A01" is stored. Specifically, in the example of FIG. 18, image data of answer sheets uploaded from the student terminals 40 of the student with user ID "tokiwa@", the student with user ID "saito@", and the student with user ID "ando@" is stored.

Here, the answer information containing the user ID "ando@" has a passcode of "0000", indicating that no passcode was entered when the image data was sent.

Figure 19 is a diagram showing an example of a blackboard information storage unit in the first embodiment. The blackboard information storage unit 127 has the following information items: content ID, user ID, file ID, and date. In the following description, the information stored in the blackboard information storage unit 127 may be referred to as blackboard information.

In the blackboard information storage unit 127, the file ID is identification information that identifies the image data of the whiteboard WB, and the date indicates the date and time when the image data was captured.

In the example of Figure 19, image data of a whiteboard WB with a content ID of "WB_Mathematics A01" is stored.

Figure 20 is a diagram illustrating an example of the installation information storage unit of the first embodiment. The installation information storage unit 128 associates content IDs and browser IDs as information items.

In the example of FIG. 20, the content ID "Display_Mathematics A01" is associated with the browser ID "BROWSER1." Therefore, from FIG. 20, it can be seen that in the lecture titled "Mathematics A01," the passcode was displayed by the intermediary device 20 having the browser indicated by "BROWSER1."

In this way, the storage control unit 16 of this embodiment can store image data uploaded from the student terminal 40 by type of imaged object based on information previously stored in the lesson information storage unit 125.

The storage control unit 16 of this embodiment also stores information indicating the history of passcodes displayed on the output device 50 by the intermediary device 20 in the passcode history storage unit 129. Figure 21 is a diagram showing an example of the passcode history storage unit of the first embodiment.

In this embodiment, the passcode history storage unit 129 has the following information items: date and time, browser ID, and passcode. In the example of FIG. 21, it can be seen that the passcode displayed for the browser ID "BROWSER1" changes at 15-minute intervals.

The storage control unit 16 of this embodiment also stores information indicating the history of image data displayed via the intermediary device 20 in the display history storage unit 130. Figure 22 is a diagram showing an example of the display history storage unit of the first embodiment.

The display history storage unit 130 in this embodiment has the following information items: date and time, browser ID, user ID, and file ID. The date and time indicates the date and time when the image data identified by the file ID was displayed on the output device 50 via the intermediary device 20 identified by the browser ID. The user ID indicates the user ID associated with the user terminal that made a request to the intermediary device 20 to display the image data.

In this way, the storage control unit 16 of this embodiment stores the passcode and image data in association with the browser unit 23 of the intermediary device 20 that displays the passcode and image data.

Next, the operation of the teacher terminal 30 in the information processing system 1 will be described. The server device 10 of this embodiment refers to the information stored in each of the above-mentioned storage units and causes the teacher terminal 30 to display information indicating the attendance information of students in each lecture.

Figure 23 illustrates an example of a processing procedure for displaying a list of attendance on a teacher terminal in the first embodiment.

In the teacher terminal 30 of this embodiment, the control unit 31 detects that the teacher has pressed a URL shortcut icon displayed on the teacher terminal 30 (step S2301).

The URL shortcut icon displayed on the teacher terminal 30 is embedded with an initial access URL for connecting to the server device 10 and a registration ID "Tag_Ed" indicating the service provided to the teacher terminal 30. In other words, the URL shortcut icon is embedded with tag information including the initial access URL and the registration ID. The registration ID "Tag_Ed" is associated with the app ID "AP_EdPortal" in the registration information storage unit 124.

When the teacher terminal 30 detects that the URL shortcut icon has been pressed, it launches the browser unit 32 and connects to the initial access URL embedded in the URL shortcut icon (step S2302).

When the browser unit 32 is started, it automatically sends an HTTP request to the application determination unit 12 corresponding to the initial access URL embedded in the URL shortcut icon (step S2303). In addition to the registration ID, the HTTP request includes account information including the teacher's user ID and the tenant ID of the user environment E1.

When the application determination unit 12 of the server device 10 receives the HTTP request, it performs authentication on the account information included in the HTTP request. If the authentication is successful, steps S2304 and onward are executed. The authentication is performed, for example, based on whether or not the account information included in the HTTP request is registered in the account information storage unit 123.

If the authentication is successful, the application determination unit 12 sends a response (HTTP response) including a redirect request to the browser unit 32 (step S2304).

Then, in response to the redirect request, the browser unit 32 sends an HTTP request (redirect) to the teacher portal URL (i.e., the teacher portal app 13-3) that is the redirect destination (step S2305).

In response to the HTTP request, the teacher portal app 13-3 sends a response to the browser unit 32 of the teacher terminal 30, which includes display data for an input screen for inputting the class number and a script for executing a process for sending the class number input on the input screen to the server device 10 (step S2306).

When the browser unit 32 receives this response, it generates an input screen for the class number based on the display data, displays the input screen on the output device 311, and upon receiving the input of the class number, notifies the attendance display application 13-4 of the class number (step S2307).

The attendance display application 13-4 sends display data to the browser unit 32 to cause the browser unit 32 to render a screen showing the attendance status of students for the class indicated by the class number (step S2308). The browser unit 32 displays an attendance screen showing the attendance status based on this display data (step S2309).

Below, a display example on the teacher terminal 30 of this embodiment will be described with reference to FIG. 24. FIG. 24 is a diagram showing a display example on the teacher terminal of the first embodiment.

The screen 241 shown in FIG. 24 is the attendance screen displayed on the teacher terminal 30 in step S2309 of FIG. 23.

Screen 241 displays information 242 about the lecture identified by the class number, and information 243 showing the student attendance status for the lecture identified by the class number.

The information 243 indicating the attendance status includes the following information items: user ID, student number, answer submission, lecture attendance, attendance, and supplementary information.

The value of the item "Answer Submission" indicates whether image data of an answer sheet has been submitted. Specifically, the value of the item "Answer Submission" indicates whether image data that corresponds to the lecture name shown in information 242 and also corresponds to the user ID has been stored in the answer information storage unit 126.

The value of the item "Lecture attendance" indicates whether or not a lecture was attended. Specifically, the value of the item "Lecture attendance" indicates whether or not the upload time of image data corresponding to the lecture name and the user ID in the answer information storage unit 126 matches the time when the passcode was displayed.

The value of the "Attendance" item indicates whether the student corresponding to the user ID attended the lecture and submitted an answer sheet. The value of the "Additional Information" item indicates additional information regarding the attendance determination.

In this embodiment, the server device 10 causes the teacher app 13-3 to refer to the lesson information storage unit 125 shown in FIG. 17, the answer sheet information storage unit 126 shown in FIG. 18, and the passcode history storage unit 129 shown in FIG. 21.

The teacher application 13-3 extracts answer information including the class number and the corresponding user ID from the answer information storage unit 126, and determines whether the upload time and passcode included in each answer information are within the class time and match the passcode displayed on the output device 50 at the upload time. The teacher application 13-3 then reflects the results in the values of the items "lecture attendance," "attendance," and "supplementary column" of the information 243 indicating the attendance status.

In the example of Figure 24, the passcode of the answer information containing the user ID "ando@" does not match the passcode displayed at the time of upload, so the value of the item "Lecture Attendance" corresponding to the user ID "ando@" is set to "X."

In this way, according to this embodiment, the passcode can be used to determine whether the image data is uploaded from a position where the passcode displayed on the output device 50 can be seen.

In addition, in this embodiment, the passcode is dynamically changed. Furthermore, in this embodiment, a passcode history storage unit 129 is provided in which information indicating the display history of the passcode is stored. Therefore, in this embodiment, the passcode can be used to determine the time period in which image data was uploaded.

In other words, the passcode of this embodiment can be used as information to identify the location where the image data was uploaded and the time period during which the image data was uploaded. In other words, the passcode can be used as information to determine whether the image data was uploaded in a lecture room during a lecture.

In this embodiment, the passcode is a four-digit number displayed on the output device 50 via the intermediary device 20, but is not limited to this.

In this embodiment, instead of a passcode, a password or the like notified orally or otherwise by the faculty giving the lecture may be used. Also, in this embodiment, instead of a passcode, a QR code may be displayed on the output device 50. In this case, the student enters the passcode by reading the QR code with the student terminal 40.

In this case, the QR code displayed on the output device 50 may be used as the answer QR code to be affixed to the answer sheet. In that case, the QR code displayed on the output device 50 may be embedded with information similar to that of the answer QR code to be affixed to the answer sheet.

In addition, in this embodiment, the passcode is displayed on the output device 50 and is input into the student terminal 40, but the method of acquiring the passcode by the student terminal 40 is not limited to this. The passcode may be transmitted, for example, from a device associated with the server device 10 by wireless communication or the like. Specifically, for example, the passcode may be transmitted as a beacon signal.

In this case, the student terminal 40 does not display a passcode input field as shown on screen 152 in FIG. 15(B). In this case, the student terminal 40 may obtain the passcode by receiving the passcode transmitted when the start button 152d is operated to transition to a screen for photographing the answer sheet.

In addition, in this embodiment, the information contained in the answer QR code affixed to the answer sheet is the registration ID and initial access URL, and the account information, student number, and class number are input by the student into the student terminal 40, but this is not limited to this.

In this embodiment, the answer sheet QR code may be embedded with a registration ID, an initial access URL, and account information, for example, in cases where common account information is provided to all students.

Furthermore, in this embodiment, the answer sheet QR code may also have the class number embedded in addition to the record ID, initial access URL, and account information.

In this way, the more information is embedded in the answer sheet QR code, the less information the student needs to input into the student terminal 40, reducing the effort required for students to input information.

In this embodiment, the user environment is described as being an educational site, but is not limited to this. The user environment may be, for example, a company conference room, or any other environment in which it is required to add information indicating that the image data captured by the user terminal was captured under certain specific conditions. Here, the certain specific condition is that the user terminal is in a position where it can obtain a passcode that changes over time, and the information indicating the certain condition is a passcode (specific information).

Second Embodiment
The second embodiment will be described below with reference to the drawings. The second embodiment differs from the first embodiment in that a passcode is not required when uploading image data. Therefore, in the second embodiment below, differences from the first embodiment will be described, and components having the same functional configuration as the first embodiment will be given the same reference numerals as in the first embodiment, and descriptions thereof will be omitted.

Figure 25 is a diagram for explaining an overview of the second embodiment. In this embodiment, when uploading image data of a completed answer sheet P from a student terminal 40, input of a passcode is not required.

In this embodiment, when the student terminal 40 reads the answer QR code 52 attached to the answer sheet P, the student terminal 40 displays the input screen 154 on the student terminal 40 by a procedure similar to the processing procedure shown in FIG. 13. The screen 154 corresponds to the input screen displayed in step S1316 in FIG. 13.

In this embodiment, since a passcode is not required, the screen 154 displays a field 154a for entering a student number and a field 154b for entering a class number.

When the student number and class number are entered on screen 154, the student terminal 40 uploads the image data to the server device 10A using a procedure similar to the processing procedure from step S1317 onwards in Figure 13.

In this embodiment, since a passcode is not entered, the image data is assigned the student number and class number and uploaded to the server device 10A.

The server device 10A has, for example, an image data storage unit 125A that stores image data. In the image data storage unit 125A of this embodiment, a folder F1 is provided for each class number, and under that, a folder F1 is provided for each date and time when the lecture indicated by the class number was held. Then, under folder F2, a folder F3 is provided for each student number. Folders F1, F2, and F3 are storage areas provided within the image data storage unit 125A.

In this embodiment, when image data with a class number and student number assigned thereto is uploaded from a student terminal 40, the server device 10A references the class number and student number via the storage control unit 16.

Then, the storage control unit 16 stores the image data in the image data storage unit 125A in folder F1 corresponding to the class number assigned to the image data, in folder F2 with a date corresponding to the date and time the image data was uploaded, and in folder F3 corresponding to the student number.

In other words, the storage control unit 16 stores the image data in the class information storage unit 125A for each group classified by class number, date, and student number.

The date and time when the image data is uploaded is the date and time when the server device 10A received the image data.

Therefore, in this embodiment, a student simply holds his/her student terminal 40 over the answer sheet QR code 52, enters his/her student number and class number on the displayed input screen 154, and captures an image of the answer sheet P, and the image data of the answer sheet P is stored in the folder F3 of the corresponding student number.

Therefore, according to this embodiment, captured image data can be uploaded to a specific storage destination in a simple procedure without any prior configuration of the student terminal 40.

In this embodiment, folders F2 and F3 are provided under folder F1, which is provided for each class number, but this is not limited to this. In the image data storage unit 125A, only folders F1 and F2 may be provided.

In this embodiment, the class number and date are group identification information for grouping image data. In this embodiment, group identification information is added to the image data and uploaded to the server device 10A, so that the uploaded image data can be stored in a folder for each group.

Therefore, according to this embodiment, for example, when a teacher wants to select desired image data from the image data stored in the image data storage unit 125A, he or she can easily select the desired image data by simply opening the folder in which the corresponding image data is stored.

In addition, according to this embodiment, when image data is uploaded, it is automatically stored in a specified folder. Therefore, according to this embodiment, after uploading the image data, it is not necessary to organize the image data, such as by dividing the image data stored in the image data storage unit 125A into folders.

In this embodiment, the class number and student number are entered by the student into the student terminal 40, but this is not limited to this.

In this embodiment, for example, the answer sheet P has a section 54 for entering a student number and a section 55 for entering a class number. The student terminal 40 may convert the handwritten characters entered in each of the sections 54 and 55 from the image data of the answer sheet P into text data using an OCR (Optical Character Recognition) function or the like, and add the text data to the image data.

In addition, in this embodiment, the student number and class number may be input from the input screen 154 and may also be read from the entry fields 54 and 55. Then, if the input student number and class number match the student number and class number read from the entry fields 54 and 55, the student number and class number may be added to the image data.

In addition, in this embodiment, if students are given common account information, the account information and class number may be embedded in the answer sheet QR code 52. In this case, students only need to enter their student number, reducing the effort required for students to enter information.

In this embodiment, the user environment is described as an educational site, but the user environment is not limited to an educational site. The user environment may be, for example, a corporate conference room.

In addition, in this embodiment, the answer sheet QR code 52 is affixed to the answer sheet P, which is the object to be imaged, but this is not limited to this. The QR code corresponding to the answer sheet QR code 52 does not need to be affixed to the object to be imaged, as long as it is associated with the object to be imaged.

Specifically, for example, before capturing an image of a certain object, a prepared QR code with an embedded registration ID and initial access URL may be read by the user terminal, and after the camera function is started on the user terminal, the object whose image is captured within a predetermined time may be regarded as the object associated with the QR code.

In addition, the server device 10, the intermediary device 20, the output device such as the output device 50, and the user terminals 30 and 40 in the above embodiment may each be constructed by a single computer, or may be constructed by multiple computers in which each part (function or means) is divided and arbitrarily assigned.

The functions of the embodiments described above can be realized by one or more processing circuits. In this specification, the term "processing circuit" includes a processor programmed to execute each function by software, such as a processor implemented by an electronic circuit, and devices such as an ASIC (Application Specific Integrated Circuit), DSP (digital signal processor), FPGA (field programmable gate array), and conventional circuit modules designed to execute each function described above.

The present invention has been described above based on each embodiment, but the present invention is not limited to the requirements shown in the above embodiments. These points can be changed without departing from the spirit of the present invention, and can be appropriately determined according to the application form.

REFERENCE SIGNS LIST 1 Information processing system 10 Server device 11 Communication unit 12 Application determination unit 13 Input application group 14 Output application 15 Specific information allocation unit 16 Storage control unit 20 Intermediary device 21 Communication control unit 22 Browser management unit 23 Browser unit 30 Teacher terminal (user terminal)
31, 41 Control unit 32, 42 Browser unit 40 Student terminal (user terminal)
50 Output device 121 Application information storage unit 122 Device information storage unit 123 Account information storage unit 124 Registration information storage unit 125 Lesson information storage unit 126 Answer information storage unit 127 Blackboard information storage unit 128 Installation information storage unit 129 Passcode history storage unit 130 Display history storage unit

Patent No. 6098193

Claims (13)

An information processing system including an information processing device that accepts submission of image data captured by an imaging function of a user terminal ,
a receiving unit that receives access based on a URL obtained by reading the code from a browser included in the user terminal;
a transmission unit that transmits data to a browser included in the user terminal after receiving the access, for executing a process to realize a service of activating an image capturing function of the user terminal and uploading captured image data;
An information processing system having an image data storage unit that stores image data captured by the imaging function and uploaded by a browser provided on the user terminal based on the data, in association with identification information of the user who submitted the image data and information indicating that the image data has been submitted. The receiving unit is
2. The information processing system according to claim 1 , further comprising: a browser included in the user terminal , and the user terminal receives identification information for identifying the service , the identification information being acquired by reading a code by the user terminal. The information processing system according to claim 2, wherein the identification information is information embedded in a two-dimensional code. the receiving unit receives information for identifying a user of the user terminal together with the image data;
4. The information processing system according to claim 3, wherein the image data is stored in the image data storage unit with information for identifying the user and a date and time when the image data was received added thereto. The information for identifying the user is
5. The information processing system according to claim 4, wherein the information is embedded in the two-dimensional code. The transmission unit is
receiving the identification information, transmitting to the user terminal display data for displaying an input screen for information specifying a storage destination of the image data, and a request for executing a process for transmitting the information input on the input screen to the information processing device;
The receiving unit is
receiving information inputted on the input screen for specifying a storage destination of the image data;
The information processing system according to claim 1 , wherein the uploaded image data is stored in a storage area in the image data storage unit that is specified by the information specifying the storage destination. 7. The information processing system according to claim 1, wherein the data is a script for executing a process for implementing a service for uploading the captured image data. The information processing system according to claim 1 , wherein the image data is image data obtained by capturing an image of an answer sheet. An information processing system including a terminal and an information processing device capable of communicating with the terminal,
The terminal has a browser,
The information processing device includes:
a receiving unit that receives access from the browser of the terminal based on a URL obtained by the terminal reading the code ;
a transmission unit that transmits to the terminal data for causing a browser included in the terminal to execute a process for realizing a service of activating an imaging function of the terminal and uploading captured image data after the access is accepted ,
The browser of the terminal displays a screen for accepting an operation for activating an imaging function of the terminal based on the data transmitted by the transmission unit, and uploads image data captured by the imaging function activated by accepting the operation to the information processing device;
The information processing system further includes an image data storage unit that stores the uploaded image data in association with identification information of the user who submitted the image data and information indicating that the image data has been submitted . The information processing system according to any one of claims 1 to 9 ,
When held over a two-dimensional code associated with an object to be imaged, the device reads information embedded in the two-dimensional code and transmits the information to the information processing device. An information processing device that accepts submission of image data captured by an imaging function of a user terminal ,
a receiving unit that receives access based on a URL obtained by reading the code from a browser included in the user terminal;
a transmission unit that transmits data to a browser included in the user terminal after receiving the access, for executing a process to realize a service of activating an image capturing function of the user terminal and uploading captured image data;
An information processing device having an image data storage unit that stores image data captured by the imaging function and uploaded by a browser provided on the user terminal based on the data, in association with identification information of the user who submitted the image data and information indicating that the image data has been submitted . An information processing method for an information processing system including an information processing device that accepts submission of image data captured by an imaging function of a user terminal, comprising:
receiving an access based on a URL obtained by reading the code from a browser included in the user terminal;
After receiving the access, transmit data to a browser included in the user terminal for executing a process for implementing a service of activating an image capturing function of the user terminal and uploading captured image data;
An information processing method in which image data captured by the imaging function and uploaded by a browser provided on the user terminal based on the data is stored in an image data storage unit in association with identification information of the user who submitted the image data and information indicating that the image data has been submitted . An information processing device that accepts submission of image data captured by an imaging function of a user terminal ,
receiving an access based on a URL obtained by reading the code from a browser included in the user terminal;
After receiving the access, transmit data to a browser included in the user terminal for executing a process for implementing a service of activating an image capturing function of the user terminal and uploading captured image data;
An information processing program that executes a process in which image data captured by the imaging function and uploaded by a browser provided on the user terminal based on the data is stored in an image data storage unit in association with identification information of the user who submitted the image data and information indicating that the image data has been submitted.

Images