JP7654958B2 - Information processing system and program - Google Patents

Description

The present invention relates to an information processing system and a program.

So-called cloud computing technology has been known for some time, in which a server device (information processing device) executes a predetermined process, such as a game process, in response to a request from a user device and transmits the results of that process to the user device (for example, Patent Document 1).

JP 2020-092877 A

However, with conventional cloud computing technology, the user device and the server device are connected via a communication network, which causes problems with network delays. In addition, when using cloud computing technology to input data received from the user device into an inference model, particularly a trained model, for inference processing, installation costs for a high-performance server device capable of performing the inference processing, as well as operational costs such as electricity bills and maintenance labor costs, are incurred.

The present invention was made in consideration of these problems, and its purpose is to provide an information processing system and program that can reduce network delays and costs when using cloud computing technology.

In order to solve the above problem, the information processing system according to the first aspect of the present invention is an information processing system including a server device capable of communicating with a user device that acquires data, and information processing devices installed at multiple locations, and includes a measurement means for measuring a communication speed between the user device and the information processing devices at the multiple locations, and a selection means for selecting one or more information processing devices at the multiple locations from the information processing devices at the multiple locations as information processing devices to be communicatively connected to the user device based on the measurement result of the measurement means, and instructing the user device to communicatively connect to the selected information processing device, and the information processing device communicatively connected to the user device inputs the data received from the user device into an inference model, and transmits the output result from the inference model to the user device.

In addition, in the information processing system according to the second aspect of the present invention, the selection means acquires the operation status of the information processing devices installed at the multiple locations, and selects one or more information processing devices at the multiple locations based on the acquired operation status and the measurement results.

In addition, in the information processing system according to the third aspect of the present invention, the user device is a mobile device that can be moved, the selection means selects information processing devices at two or more locations from among the information processing devices at the multiple locations, and the user device outputs the output result that is received earliest from among the output results received from the information processing devices at the two or more locations.

In addition, in the information processing system according to the fourth aspect of the present invention, the selection means selects information processing devices at two or more locations from among the information processing devices at the multiple locations, and the user device outputs an output result in which the content of the output result received from each of the information processing devices at the two or more locations matches the content of the other output results the most among the output results.

In addition, in the information processing system according to the fifth aspect of the present invention, the selection means selects information processing devices at two or more locations from among the information processing devices at the multiple locations, and the user device switches between outputting the output result received earliest from the information processing devices at the two or more locations, or outputting the output result whose content received from the information processing devices at the two or more locations matches the content of the other output results the most among the output results, based on the control content of the user device 12.

In addition, in the information processing system according to the sixth aspect of the present invention, the server device includes a storage means for storing a plurality of bases linked to each region, and the measurement means extracts one base from among the plurality of bases for each region, measures the communication speed between the information processing device of each extracted base and the user device, and extracts the region linked to the base that shows the fastest communication speed among the measurement results, and measures the communication speed between the information processing device of the plurality of bases linked to the extracted region and the user device.

In addition, in the information processing system according to the seventh aspect of the present invention, the information processing device selected by the selection means acquires detection results from detection devices installed on the street in response to a request from the user device, and outputs analysis results based on the detection results to the user device.

In addition, in the information processing system according to the eighth aspect of the present invention, the information processing device acquires the inference model by communicating with the outside after being selected by the selection means.

In addition, in the information processing system according to a ninth aspect of the present invention, the user device is a mobile device that can be moved, the measurement means measures the communication speed multiple times, the selection means selects information processing devices at the two or more locations based on the latest measurement results of the measurement means at predetermined time intervals, and the server device is equipped with an extraction means that extracts information processing devices whose communication speed with the user device has become faster than a threshold value based on the multiple measurement results as candidates for communication connection with the user device, and transmits the inference model to the extracted information processing device before a communication connection with the user device is established.

In addition, in the information processing system according to a tenth aspect of the present invention, the information processing device includes a game device that executes a game when a value medium is paid.

The program according to an eleventh aspect of the present invention causes a computer capable of communicating with a user device that acquires data to function as a measurement means for measuring a communication speed between the user device and information processing devices at multiple locations that are capable of inferentially processing the data, and a selection means for selecting information processing devices at two or more locations from among the information processing devices at the multiple locations as information processing devices that will communicate with the user device based on the measurement results of the measurement means, and for instructing the user device to communicate with the selected information processing devices.

According to the present invention, when using cloud computing technology, it is possible to suppress network delays and reduce costs.

1 is a block diagram showing an example of an overall configuration of an information processing system according to a first embodiment. 2 is a diagram illustrating an example of a hardware configuration of a server device illustrated in FIG. 1 . FIG. 2 is a diagram illustrating an example of a hardware configuration of a user device illustrated in FIG. 1 . 2 is a diagram illustrating an example of a hardware configuration of the arcade game device illustrated in FIG. 1. 1 is a block diagram showing a functional configuration of an information processing system according to a first embodiment. 4 is a flowchart showing an example of a flow of information processing in the information processing system according to the first embodiment. 10 is a flowchart showing an example of a flow of information processing in an information processing system according to a second embodiment. 13 is a flowchart showing an example of the flow of information processing in an information processing system according to a third embodiment. FIG. 13 is a block diagram showing an example of an overall configuration of an information processing system according to a fourth embodiment. 13 is a flowchart showing an example of a flow of information processing in an information processing system according to a fourth embodiment.

Below, several embodiments of the present invention will be described with reference to the attached drawings. To facilitate understanding of the description, the same components and steps in each drawing will be given the same reference numerals as much as possible, and duplicate descriptions will be omitted.

First Embodiment
First, the first embodiment will be described.

---Overall composition---
FIG. 1 is a block diagram showing an example of the overall configuration of an information processing system 1A according to the first embodiment.

As shown in FIG. 1, the information processing system 1A according to the first embodiment includes a server device 10, a user device 12, and a number of existing commercial game devices 14 (commercial game devices 14A, 14B, 14C, etc.) that serve as information processing devices. These devices are connected to each other so that they can communicate with each other via a communication network NT such as the Internet or a telephone line.

The server device 10 matches the user device 12 with the commercial game device 14. Specifically, the server device 10 selects one or more commercial game devices 14 from among the multiple commercial game devices 14 as targets for inference processing of the image data acquired by the user device 12.

The user device 12 is a device that can be used by a user U, and is a device that acquires image data using a camera or the like and transmits it to the arcade game device 14. The user device 12 includes fixed devices that cannot move by themselves, and mobile devices that can move. Examples of fixed devices include factory inspection equipment and robots, hospital inspection equipment, medical equipment, and computers at research institutes. Examples of mobile devices include aircraft including small unmanned aerial vehicles (drones), cars including self-driving cars, trains, ships, etc.

The commercial game device 14 is an example of an information processing device, and is a so-called arcade game machine that is installed in multiple bases S (base A, base B, base C, etc.) in multiple regions in Japan's prefectures. In addition, one or more commercial game devices 14 are installed in one base S. This commercial game device 14 executes a game in which the game is played directly on the commercial game device 14 when a value medium such as coins, points, cash, electronic money, or credit card is paid. In addition, in the first embodiment, when a communication connection with the user device 12 is established, the commercial game device 14 inputs image data received from the user device 12 into an inference model, specifically, a learned model determined by machine learning, and transmits the output result from the learned model to the user device 12. Note that, although the commercial game device 14 has been described as an example of an information processing device, other examples of the information processing device include a server device. For example, when the information processing device is a server device, the base is a server center. In addition, the following describes a case where the inference model is a trained model, but the inference model may not be a trained model and may be constructed by a normal program. In addition, the arcade game device 14 may receive from the user device 12, instead of image data, feature point data processed by the user device 12 from the image data, or detection data detected by a sensor provided in the user device 12. In this case, when a communication connection with the user device 12 is established, the arcade game device 14 inputs the feature point data and detection data received from the user device 12 into a trained model determined by machine learning, and transmits the output result from the trained model to the user device 12.

---Hardware configuration---
FIG. 2 is a diagram illustrating an example of a hardware configuration of the server device 10 illustrated in FIG.

As shown in FIG. 2, the server device 10 includes a control device 20, a communication device 26, and a storage device 28. The control device 20 is mainly configured with a CPU (Central Processing Unit) 22 and a memory 24.

In the control device 20, the CPU 22 executes a predetermined program stored in the memory 24 or the storage device 28, etc., to function as various functional means. Details of these functional means will be described later.

The communication device 26 is configured with a communication interface for communicating with an external device. The communication device 26 transmits and receives various information between the user device 12, for example.

The storage device 28 is composed of a hard disk or the like. This storage device 28 stores various programs and information necessary for executing processing in the control device 20, as well as information on the processing results.

The server device 10 can be realized using an information processing device such as a dedicated or general-purpose server computer. The server device 10 may be composed of a single information processing device, or may be composed of multiple information processing devices distributed over the communication network NT. Also, FIG. 2 shows only a part of the main hardware configuration of the server device 10, and the server device 10 may be equipped with other configurations that are generally equipped in a server.

Figure 3 is a diagram showing an example of the hardware configuration of the user device 12 shown in Figure 1.

As shown in FIG. 3, the user device 12 includes a CPU 32, a memory 34, an input device 36, a communication device 38, a camera 40, and a control target 42.

The CPU 32 controls the control object 42 based on, for example, the control parameters.

Memory 34 stores various data and programs.

The input device 36 inputs user operation information to the user device 12.

The communication device 38 is configured with a communication interface for communicating with an external device. The communication device 38 transmits and receives various information between the arcade game device 14, for example.

The camera 40 captures images of subjects around the user device 12 and acquires the image data.

The control object 42 is provided according to the type of user device 12. Examples of the control object 42 include a display device, a sound output device, a propeller, a brake mechanism, etc.

Figure 4 is a diagram showing an example of the hardware configuration of the commercial game device 14 shown in Figure 1.

As shown in FIG. 4, the arcade game machine 14 includes a coin shooter 50, a CPU 52, a memory 54, a display device 56, a sound output device 58, an input device 60, and a communication device 62. The arcade game machine 14 may also include an electronic payment device capable of making electronic payments together with or in place of the coin shooter 50.

The coin shooter 50 accepts coin payments from the user.

The CPU 52 executes the game.

The memory 54 stores an AI (Artificial Intelligence)-equipped application (hereinafter referred to as an "AI-equipped app") that includes the game program of the game and a trained model. The AI-equipped app may be stored in the memory 54 via a portable storage medium or a communication network NT, etc.

The display device 56 displays the game screen of the game.

The sound output device 58 outputs the game sounds of the game.

The input device 60 inputs operation information from the game player.

The communication device 62 is configured with a communication interface for communicating with an external device. The communication device 62 transmits and receives various information between the user device 12, for example.

---Functional configuration---
FIG. 5 is a block diagram showing the functional configuration of the information processing system 1A according to the first embodiment.

As shown in FIG. 5, the server device 10 has, as its functional configuration, a storage means 70, an authentication means 72, a measurement means 74, a selection means 76, and an extraction means 78. These functional configurations are realized by the control device 20 executing a program. The user device 12 has a control means 80 and an image acquisition means 82. These functional configurations are realized by the CPU 32 executing a program. The arcade game device 14 has a first execution means 90 and a second execution means 92. These functional configurations are realized by the CPU 52 executing a program. At least one of the functional configurations of the measurement means 74, the selection means 76, and the extraction means 78 may be provided in the user device 12.

The storage means 70 has a function of storing, for example, a base table 70A, user information 70B, and an AI-equipped application 70C. In the base table 70A, a plurality of bases S, connection information such as an IP (Internet Protocol) address for communicating with the commercial game device 14 of each base S, and the operating status of the commercial game device 14 are registered in association with each other for each region, for example, for each prefecture. The operating status is acquired by the server device 10 periodically inquiring of the commercial game device 14, and is updated to the latest information. The user information 70B includes, for example, authentication information such as a user ID and password, a user name, and contact information. The AI-equipped application 70C includes a trained model determined by machine learning, and inputs image data into the trained model to perform inference processing. This AI-equipped application 70C is provided for each type of user device 12.

When the authentication means 72 receives a login request from the user device 12, it has the function of executing an authentication process based on the information contained in the login request and the authentication information of the user information 70B.

The measurement means 74 has a function of periodically or randomly measuring the communication speed between the user device 12 and the commercial game devices 14 at the multiple bases S multiple times. Specifically, the measurement means 74 extracts one base from the multiple bases S for each region, measures the communication speed between the commercial game device 14 at each extracted base S and the user device 12, extracts the region linked to the base S that shows the fastest communication speed among the measurement results, and measures the communication speed between the commercial game device 14 at the multiple bases S linked to the extracted region and the user device 12.

The selection means 76 has a function of selecting one or more commercial game devices from among the commercial game devices 14 at the multiple bases S as information processing devices to be connected to the user device 12 based on the measurement results of the measurement means 74, and instructing the user device 12 to connect to the selected commercial game devices. The selection means 76 may also acquire the operating status of the commercial game devices 14 installed at the multiple bases S, and select the commercial game devices 14 at one or more bases based on the acquired operating status and the measurement results. If the user device 12 is a mobile device that can be moved, the selection means 76 may select information processing devices at two or more bases at predetermined time intervals based on the latest measurement results of the measurement means 74. However, in the first embodiment, a case will be described in which the selection means 76 selects the commercial game device 14 at one base.

When the user device 12 is a mobile device that can be moved, the extraction means 78 has a function of extracting, based on the results of multiple measurements, an arcade game device 14 whose communication speed with the user device 12 is faster than a threshold value as a candidate for communication connection with the user device 12, and transmitting the AI-equipped app 70C to the extracted arcade game device 14 before a communication connection with the user device 12 is established.

The control means 80 has the function of controlling the control object 42 based on control parameters, etc.

The image acquisition means 82 has the function of controlling the camera 40 to acquire images of the user device 12 itself or its surroundings.

The first execution means 90 has the function of executing a game when a value medium is paid.

After being selected by the selection means 76, the second execution means 92 acquires the AI-equipped app 70C by communicating with the outside. Examples of the outside include the server device 10 and other server devices on the communication network NT. Next, when the second execution means 92 connects to the user device 12 for communication, it executes the AI-equipped app 70C. Specifically, the second execution means 92 inputs the image data received from the user device 12 into the trained model included in the AI-equipped app 70C and transmits the output result from the trained model to the user device 12.

---Information processing flow---
6 is a flowchart showing an example of the flow of information processing in the information processing system 1A according to the first embodiment. Note that the contents and order of the following processing can be changed as appropriate.

(Step SP10)
The user device 12 transmits a login request including the user ID, password, IP address, etc. of the user U to the server device 10. Then, the process proceeds to step SP12.

(Step SP12)
The server device 10 receives a login request from the user device 12. In response to this, the authentication means 72 of the server device 10 executes authentication processing based on the user ID and password included in the login request and the user information 70B. If this authentication processing is successful, the process proceeds to step SP14. If the authentication processing fails, an error is output to the user device 12, and the series of processing shown in FIG. 5 ends.

(Step SP14)
The measurement means 74 of the server device 10 extracts one base from the multiple bases S for each region. When a base representing each region is registered in the base table 70A, the measurement means 74 extracts one representative base from the multiple bases S for each region based on the base table 70A. Then, the process proceeds to step SP16.

(Step SP16)
The measuring means 74 acquires the IP addresses of the arcade game devices 14 at each extracted base from the base table 70A as connection information for each of them. Next, the measuring means 74 outputs (transmits) to the user device 12 a measurement instruction for measuring the communication speed between the arcade game device 14 at one base extracted for each region and the user device 12. Note that this measurement instruction includes the IP addresses of the arcade game devices 14 at each base acquired by the measuring means 74. Then, the process proceeds to step SP18.

(Step SP18)
The user device 12 receives the measurement instruction from the server device 10. In response to this, the user device 12 measures the communication speed between the user device 12 and each of the arcade game devices 14 at one of the bases extracted for each region, based on each IP address included in the measurement instruction. Next, the user device 12 transmits the communication speed measurement results to the server device 10. Then, the process proceeds to step SP20.

(Step SP20)
The server device 10 receives the measurement results from the user device 12. In response to this, the measurement means 74 extracts one area linked to the location that showed the fastest communication speed among the received measurement results. Then, the process proceeds to step SP22.

(Step SP22)
The measurement means 74 acquires, from the base table 70A, the IP addresses of the commercial game devices 14 at the multiple bases S associated with the extracted region as connection information for each of them. Next, the measurement means 74 outputs (transmits) to the user device 12 a measurement instruction to measure the communication speed between the commercial game devices 14 at the multiple bases S associated with the region and the user device 12. Note that this measurement instruction includes each of the IP addresses acquired by the measurement means 74. Then, the process proceeds to step SP24.

(Step SP24)
The user device 12 receives the measurement instruction from the server device 10. In response to this, the user device 12 measures the communication speed between the user device 12 and each of the arcade game devices 14 at the multiple bases S associated with one area, based on each IP address included in the measurement instruction. Next, the user device 12 transmits the communication speed measurement results to the server device 10. Then, the process proceeds to step SP26.

(Step SP26)
The server device 10 receives the measurement results of the communication speed from the user device 12. In response to this, the selection means 76 of the server device 10 selects an arcade game device at one base from among the arcade game devices 14 at multiple bases S associated with one region, based on the received measurement results. Specifically, the selection means 76 selects the arcade game device 14 at the base S that shows the measurement result with the fastest communication speed among the measurement results. Then, the process proceeds to step SP28.

(Step SP28)
The selection means 76 acquires the operation status of the commercial game device 14 of the base S selected by the selection means 76 from the base table 70A. Next, the selection means 76 judges whether the acquired operation status indicates availability, that is, whether the commercial game device 14 of one base S is available. If the judgment is affirmative, the process proceeds to step SP30, and if the judgment is negative, the process returns to step SP26. When returning to step SP26, the selection means 76 selects an commercial game device of one base from among the commercial game devices 14 of the multiple bases S associated with one region, excluding the commercial game device 14 of the base S once selected.

(Step SP30)
The selection means 76 transmits (outputs) a connection instruction to the user device 12 so as to connect for communication with the arcade game device 14 at the selected one of the bases S. This connection instruction includes the IP address of the arcade game device 14 at the selected one of the bases S. Then, the process proceeds to step SP32.

(Step SP32)
The user device 12 receives a connection instruction from the server device 10. In response to this, the user device 12 establishes a communication connection with the arcade game device 14 at one base S selected by the selection means 76, based on the IP address included in the received connection instruction. Next, the user device 12 transmits an execution request for the AI-equipped application, including the device ID of the user device 12, to the arcade game device 14 with which the communication connection has been established. Then, the process proceeds to step SP34.

(Step SP34)
The arcade game device 14 receives the execution request from the user device 12. In response to this, the arcade game device 14 transmits an application request including the device ID included in the execution request to the server device 10. Then, the process proceeds to step SP36.

(Step SP36)
The server device 10 receives an application request from the commercial game device 14. In response to this, the server device 10 acquires from the storage means 70 an AI-equipped application 70C corresponding to the device ID included in the application request, i.e., corresponding to the type of the user device 12, and transmits the acquired AI-equipped application 70C to the requesting commercial game device 14. Then, the process proceeds to step SP38.

(Step SP38)
The commercial game machine 14 receives the AI-equipped application 70C from the server device 10. In response to this, the commercial game machine 14 starts installing the AI-equipped application 70C and stores it in a storage means (not shown). Then, the process proceeds to step SP40.

(Step SP40)
The arcade game machine 14 transmits a preparation completion notification indicating that preparation is complete to the user device 12. Then, the process proceeds to step SP42.

(Step SP42)
The user device 12 receives the preparation completion notification from the arcade game device 14. In response to this, the user device 12 transmits the image data acquired by the image acquisition means 82 to the arcade game device 14. Then, the process proceeds to step SP44.

(Step SP44)
The arcade game device 14 receives image data from the user device 12. In response to this, the second execution means 92 of the arcade game device 14 inputs the received image data into the trained model of the AI-equipped application 70C to execute the inference process. Then, the process proceeds to step SP46.

(Step SP46)
The arcade game device 14 transmits the output result of the trained model to the user device 12. Then, the process proceeds to step SP48.

(Step SP48)
The user device 12 receives the output result from the arcade game device 14. In response to this, the control means 80 of the user device 12 controls the control object 42 based on the output result. For example, the control means 80 of the user device 12 performs display control of the output result on a display device serving as the control object 42.

If image data is acquired multiple times, the processes in steps SP42 to SP48 may be executed repeatedly. Also, if the user device 12 is a mobile device, the processes in steps SP14 to SP48 may be executed repeatedly to maintain a communication connection with any of the arcade game devices 14.

---effect---
As described above, in the first embodiment, an information processing system 1A including a server device 10 capable of communicating with a user device 12 that acquires image data and an arcade game device 14 installed at a plurality of bases S includes a measurement means 74 that measures a communication speed between the user device 12 and the arcade game devices 14 at the plurality of bases S, and a selection means 76 that selects an arcade game device at one or more bases from among the arcade game devices 14 at the plurality of bases S as an information processing device that is to be communicatively connected to the user device 12 based on a measurement result of the measurement means 74, and instructs the user device 12 to communicatively connect to the selected arcade game device. Then, the arcade game device 14 that is communicatively connected to the user device 12 inputs image data received from the user device 12 into a trained model determined by machine learning, and transmits an output result from the trained model to the user device 12.
According to this configuration, based on the measurement result of the communication speed, one or more commercial game devices at the bases S are selected from among the commercial game devices 14 at the bases S for communication connection with the user device 12, so that by selecting an commercial game device with a faster communication speed than that of the user device 12 and the server device 10, for example, it is possible to suppress network delays when exchanging image data and its analysis results (output results) by communication. Furthermore, since the server device 10 does not need to be high-performance enough to perform inference processing of image data, installation costs can be suppressed.

In addition, in the first embodiment, the selection means 76 acquires the operating status of the commercial game devices 14 installed at the multiple bases S, and selects commercial game devices at one or more bases from among the commercial game devices 14 at the multiple bases S based on the acquired operating status and measurement results.
According to this configuration, the commercial game device 14 inputs image data into a learned model and executes processing, thereby preventing the commercial game device 14 from being unable to execute existing processing such as a game.

In addition, in the first embodiment, the server device 10 is equipped with a memory means 70 that links and stores multiple bases S for each region, and the measurement means 74 extracts one base from the multiple bases S for each region, measures the communication speed between the commercial game device 14 at each extracted base S and the user device 12, extracts the region linked to the base S that shows the fastest communication speed among the measurement results, and measures the communication speed between the commercial game device 14 at the multiple bases S linked to the extracted region and the user device 12.
According to this configuration, it is possible to reduce the burden on the user device 12 and the arcade game device 14 when measuring the communication speed.

In the first embodiment, the information processing device includes a gaming device that executes a game when a value medium is paid.
According to this configuration, existing game devices can be effectively utilized, thereby reducing operational costs.

Second Embodiment
Next, a second embodiment will be described. The second embodiment differs from the first embodiment in that the selection means 76 selects commercial game devices 14 at two or more bases and instructs the user device 12 to connect to each of the selected commercial game devices 14 for communication. In addition, in the second embodiment, it is preferable that the user device 12 is a mobile device that can be moved. Note that the configuration according to the second embodiment is the same as the configuration according to the first embodiment.

Figure 7 is a flowchart showing an example of the flow of information processing in the information processing system according to the second embodiment. Note that the content and order of the following processing can be changed as appropriate. Also, it is assumed that the processing of steps SP10 to SP24 shown in Figure 6 has been executed before the following step SP70. Also, the following description is given assuming that the AI-equipped app 70C has already been installed in the arcade game device 14, but as in the first embodiment, the AI-equipped app 70C may be installed after being selected by the selection means 76.

(Step SP70)
The server device 10 receives the measurement results of the communication speed from the user device 12. In response to this, the selection means 76 of the server device 10 selects the commercial game devices at two or more bases, for example, three bases, from among the commercial game devices 14 at the multiple bases S associated with one region, based on the received measurement results. Specifically, the selection means 76 selects the commercial game devices 14 at the three bases S in descending order of communication speed in the measurement results. Then, the process proceeds to step SP72.

(Step SP72)
The selection means 76 acquires the operation status of the commercial game devices 14 at the three bases S selected by the selection means 76 from the base table 70A. Next, the selection means 76 judges whether the acquired operation status indicates availability, that is, whether each of the commercial game devices 14 at the three bases S is available. If the judgment is affirmative, the process proceeds to step SP74, and if the judgment is negative, the process returns to step SP70. When returning to step SP70, the selection means 76 selects the commercial game devices at the three bases from the commercial game devices 14 at the multiple bases S associated with one region, excluding the commercial game devices 14 that are not available.

(Step SP74)
The selection means 76 transmits (outputs) a connection instruction to the user device 12 so as to connect to communication with the arcade game devices 14 at the selected three bases S. This connection instruction includes the IP addresses of the arcade game devices 14 at the selected three bases S. Then, the process proceeds to step SP76.

(Step SP76)
The user device 12 receives a connection instruction from the server device 10. In response to this, the user device 12 establishes a communication connection with the three arcade game devices 14 (e.g., the arcade game devices 14A, 14B, and 14C) at the bases S selected by the selection means 76, based on the IP addresses included in the received connection instruction. Then, the process proceeds to step SP76.

(Step SP78)
The user device 12 transmits the image data acquired by the image acquisition means 82 to each of the arcade game devices 14A-14C. Then, the process proceeds to steps SP80, SP86, and SP92, respectively. Note that the order of the processes in the following steps SP80-96 is appropriately changed depending on the communication speed between the user device 12 and each of the arcade game devices 14A-14C. In the following, it is assumed that the arcade game device 14B has the fastest communication speed, followed by the arcade game device 14A, and then the arcade game device 14C.

(Step SP80)
The arcade game device 14B receives image data from the user device 12. In response to this, the second execution means 92 of the arcade game device 14B inputs the received image data into the trained model of the AI-equipped application 70C to execute the inference process. Then, the process proceeds to the process of step SP82.

(Step SP82)
The arcade game device 14B transmits the output result of the trained model to the user device 12. Then, the process proceeds to step SP84.

(Step SP84)
The user device 12 receives the output result from the arcade game device 14 B. Here, the control means 80 of the user device 12 controls the display of the output result of the arcade game device 14 B that was received earliest among the output results received from the arcade game devices 14 A to 14 C at the three bases S.

(Step SP86)
When the image data is transmitted in step SP78, the arcade game device 14A receives the image data from the user device 12. In response to this, the second execution means 92 of the arcade game device 14A inputs the received image data into the trained model of the AI-equipped application 70C to execute the inference process. Then, the process proceeds to the process of step SP88.

(Step SP88)
The arcade game device 14A transmits the output result of the trained model to the user device 12. Then, the process proceeds to step SP90.

(Step SP90)
The user device 12 receives the output result from the arcade game device 14 A. Here, the user device 12 determines that the output result has already been received, and erases the newly received output result.

(Step SP92)
When the image data is transmitted in step SP78, the arcade game device 14C receives the image data from the user device 12. In response to this, the second execution means 92 of the arcade game device 14C inputs the received image data into the trained model of the AI-equipped application 70C to execute the inference process. Then, the process proceeds to step SP94.

(Step SP94)
The arcade game device 14C transmits the output result of the trained model to the user device 12. Then, the process proceeds to step SP96.

(Step SP96)
The user device 12 receives the output result from the arcade game device 14C. Here, the user device 12 determines that the output result has already been received, and erases the newly received output result.

As described above, in the second embodiment, the user device 12 is a mobile device that can be moved, the selection means 76 selects commercial game devices at two or more bases from among the commercial game devices 14C at the multiple bases S, and the user device 12 outputs the output result received earliest from among the output results received from the commercial game devices at the two or more bases.
According to this configuration, even if emergency control such as collision avoidance control or braking control is required due to the movement of the user device 12, the output result received first is output on a first-come, first-served basis, i.e., the output result that was received first is output, and emergency control can be performed immediately based on the output result.

Third Embodiment
Next, a third embodiment will be described. The third embodiment differs from the second embodiment in that the user device 12 outputs the output result that has the greatest number of matches with the contents of other output results among the output results received from the arcade game devices 14 of two or more bases S, that is, the output results of the user device 12 are handled by majority vote rather than on a first-come-first-served basis. Note that the configuration of the third embodiment is the same as that of the first embodiment.

Figure 8 is a flowchart showing an example of the flow of information processing in the information processing system according to the third embodiment. Note that the content and order of the following processing can be changed as appropriate. Also, it is assumed that the processing of steps SP10 to SP24 shown in Figure 6 has been executed before the following step SP70. Also, the following description is given assuming that the AI-equipped app 70C has already been installed in the arcade game device 14, but as in the first embodiment, the AI-equipped app 70C may be installed after being selected by the selection means 76.

(Step SP100)
When the image data is transmitted in step SP78, the arcade game device 14B receives the image data from the user device 12. In response to this, the second execution means 92 of the arcade game device 14B inputs the received image data into the trained model of the AI-equipped application 70C to execute the inference process. Then, the process proceeds to step SP102.

(Step SP102)
The arcade game device 14B transmits the output result of the trained model to the user device 12. Then, the process proceeds to step SP104.

(Step SP104)
The user device 12 receives the output result from the arcade game device 14 B. In response to this, the user device 12 stores the received output result.

(Step SP106)
When the image data is transmitted in step SP78, the arcade game device 14A receives the image data from the user device 12. In response to this, the second execution means 92 of the arcade game device 14A inputs the received image data into the trained model of the AI-equipped application 70C to execute the inference process. Then, the process proceeds to the process of step SP108.

(Step SP108)
The arcade game device 14A transmits the output result of the trained model to the user device 12. Then, the process proceeds to step SP110.

(Step SP110)
The user device 12 receives the output result from the arcade game device 14 A. In response to this, the user device 12 stores the received output result.

(Step SP112)
When the image data is transmitted in step SP78, the arcade game device 14C receives the image data from the user device 12. In response to this, the second execution means 92 of the arcade game device 14C inputs the received image data into the trained model of the AI-equipped application 70C to execute the inference process. Then, the process proceeds to the process of step SP114.

(Step SP114)
The arcade game device 14C transmits the output result of the trained model to the user device 12. Then, the process proceeds to step SP116.

(Step SP116)
The user device 12 receives the output result from the arcade game device 14C. In response to this, the user device 12 stores the received output result. Then, the process proceeds to step SP118.

(Step SP118)
Next, the control means 80 of the user device 12 judges whether a predetermined number of output results (e.g., three) have been stored, and if the judgment is affirmative, executes majority voting processing. That is, the control means 80 extracts the output result (the most numerous output result) in which the contents of the output results received from the arcade game devices 14A-14C at the three bases S match the contents of the other output results the most. The reason for using majority voting here is that even if the trained models of the arcade game devices 14A-14C are the same, the output results may differ for each arcade game device. Note that the trained models may differ for each arcade game device 14A-14C. Then, the processing proceeds to step SP120.

(Step SP120)
The control means 80, for example, controls the display of the most numerous output results.

As described above, in the third embodiment, the selection means 76 selects commercial game devices at two or more bases from among the commercial game devices 14 at the multiple bases S, and the user device 12 outputs the output result in which the content of the output result received from each of the commercial game devices 14 at the two or more bases has the greatest number of matches with the content of other output results among the output results.
According to this configuration, although the output results of the trained model transmitted from the commercial game devices at two or more locations may differ from each other, the accuracy of the output result can be improved by outputting the output result whose content received from each commercial game device 14 matches the content of the other output results the most among the output results. As a result, the technology according to the third embodiment is suitable for situations requiring high accuracy in analyzing image data, such as diagnosing patients in medical settings and controlling the quality of products in production settings.

<Fourth embodiment>
Next, a fourth embodiment will be described. The fourth embodiment is different from the first embodiment in that the arcade game device 14 receives data not only from the user device 12 but also from detection devices installed on the street, such as cameras, temperature sensors, humidity sensors, photoelectric sensors, and gyro sensors. Note that the configuration of the fourth embodiment, which is not described below, is the same as the configuration of the first embodiment.

Figure 9 is a block diagram showing an example of the overall configuration of an information processing system 1B according to the fourth embodiment.

As shown in FIG. 9, the information processing system 1B includes a server device 10 and a plurality of arcade game devices 14, as in the first embodiment. The information processing system 1B also includes one or a plurality of mobile devices as user devices 12, such as an autonomous vehicle 12A used by user U1 and a small unmanned aerial vehicle 12B used by user U2. The information processing system 1B also includes a plurality of detection devices 100 installed on the street, such as cameras 100A, 100B, and 100C. These detection devices 100 are capable of communicating with the arcade game device 14 via the communication network NT. The detection devices 100 can detect (photograph) data (e.g., image data) of the street surroundings, including obstacles such as pedestrians 102A, and transmit the detection results to the arcade game device 14.

Figure 10 is a flowchart showing an example of the flow of information processing in the information processing system 1B according to the fourth embodiment. Note that the content and order of the following processing can be changed as appropriate.

(Step SP200)
A mobile device serving as the user device 12, for example, the autonomous vehicle 12A, periodically transmits a peripheral information request including the current position information of the autonomous vehicle 12A to the arcade game device 14A that is connected to the mobile device 12. Then, the process proceeds to step SP202. This peripheral information request may be transmitted to the server device 10.

(Step SP202)
The arcade game device 14A receives a peripheral information request from the autonomous vehicle 12A. In response to this, the arcade game device 14A acquires connection information of the detector devices 100 in the vicinity of the position indicated by the position information from the outside, for example, the server device 10, based on the position information included in the peripheral information request. Next, the arcade game device 14A transmits a transmission request of image data to the detector devices 100 in the vicinity of the position, for example, the cameras 100A to 100C, based on the acquired connection information. Then, the process proceeds to the processes of steps SP204, 212, and 216, respectively. Note that the order of the processes of the following steps SP204 to 218 is appropriately changed depending on the communication speed between each of the arcade game devices 14A and the cameras 100A to 100C. In the following, it is assumed that the camera 100B has the fastest communication speed, followed by the camera 100A, and then the camera 100C.

(Step SP204)
The camera 100B receives a transmission request from the arcade game machine 14A. In response to this, the camera 100B transmits image data automatically captured by the camera 100B to the arcade game machine 14A. Then, the process proceeds to step SP206.

(Step SP206)
The arcade game device 14A receives image data from the camera 100B. Here, the second execution means 92 of the arcade game device 14A inputs the image data of the camera 100B that was received earliest among the image data received from each of the three cameras 100A to 100C into the trained model of the AI-equipped application 70C corresponding to the camera 100B, and executes the inference process. Then, the process proceeds to the process of step SP208.

(Step SP208)
The arcade game device 14A transmits the output result (processing result) of the trained model to the autonomously driven car 12A. Then, the process proceeds to step SP210.

(Step SP210)
The autonomously driven car 12A receives the output result from the arcade game device 14A. Next, the control means 80 of the autonomously driven car 12A controls the control target 42, such as the brakes, based on the received output result.

(Step SP212)
After step SP202, the camera 100A receives a transmission request from the autonomous vehicle 12A. In response to this, the camera 100A transmits image data automatically captured by the camera 100A to the arcade game device 14A. Then, the process proceeds to step SP214.

(Step SP214)
The arcade game machine 14A receives image data from the camera 100A. Here, the arcade game machine 14A determines that the image data has already been received, and deletes the newly received image data.

(Step SP216)
After step SP202, the camera 100C receives a transmission request from the autonomous vehicle 12A. In response to this, the camera 100C transmits image data automatically captured by the camera 100C to the arcade game device 14A. Then, the process proceeds to step SP218.

(Step SP218)
The arcade game device 14A receives image data from the camera 100C. Here, the arcade game device 14A determines that the image data has already been received, and deletes the newly received image data.

As described above, in the fourth embodiment, the commercial game device 14A selected by the selection means 76 acquires detection results from a detection device 100 installed on the street in response to a request from a user device 12, and outputs analysis results based on the detection results to the user device 12.
According to this configuration, for example, the user device 12 can perform control using analysis results based on image data of areas that are blind spots from the user device 12, thereby enabling more accurate control.

<Modification>
The present invention is not limited to the above-described embodiment. In other words, even if a person skilled in the art appropriately modifies the above-described embodiment, the same will be included in the scope of the present invention as long as the features of the present invention are included. In addition, the elements of the above-described embodiment and the modified examples described below can be combined to the extent technically possible, and the combination of these elements will be included in the scope of the present invention as long as the features of the present invention are included.

For example, in the first embodiment, the selection means 76 is provided in the server device 10, but it may be provided in the user device 12. In this case, the server device 10 transmits the base table 70A of the arcade game device 14 to the user device 12.

In the above first embodiment, the information processing device is described as an arcade game device 14, but it may also be a server device in the same location that is connected to the arcade game device 14.

In the second and third embodiments, the output results are handled on a first-come, first-served basis or by majority rule. However, the user device 12 may switch between outputting the output result received earliest from the output results received from the commercial game devices 14 at two or more bases S (first-come, first-served basis) or outputting the output result received from the commercial game devices 14A at two or more bases S, the content of which matches the content of the other output results the most (majority rule), based on the current control content of the user device 12. For example, in a manufacturing line or the like, when the control content of the user device 12 is defective product detection, speed is required, so the user device 12 switches to output the output result received earliest from the commercial game devices 14 at two or more bases S. When the control content of the user device 12 is quality check, accuracy is required, so the user device 12 switches to output the output result received from the commercial game devices 14A at two or more bases S, the content of which matches the content of the other output results the most. Also, for example, in a doctor's examination, when the control content of the user device 12 is image processing such as noise removal, speed is required, so the user device 12 switches to output the output result received earliest from among the output results received from the commercial game devices 14 at two or more bases S. Also, when the control content of the user device 12 is a disease name diagnosis, accuracy is required, so the user device 12 switches to output the output result whose content received from the commercial game devices 14A at two or more bases matches the content of the other output results the most.
According to the above configuration, even in a situation where speed or accuracy is required, the handling of the output results can be automatically switched to obtain an appropriate output. The user device 12 may also combine the first-come-first-served method and the majority vote. For example, assuming that the user device 12 receives 10 output results, the user device 12 may perform a majority vote among the top five output results in the first-come-first-served order.

In the fourth embodiment, the case where the autonomous vehicle 12A transmits a peripheral information request to the commercial game device 14A with which it is connected for communication has been described, but the server device 10 may determine which commercial game device 14 the autonomous vehicle 12A will connect to and instruct the autonomous vehicle 12A accordingly.

In addition, in the fourth embodiment, a case has been described in which the commercial game device 14A acquires connection information of the detection device 100 in the vicinity of the position indicated by the location information, but the combination of the commercial game device 14A and the detection device 100 is predetermined, and the commercial game device 14A may acquire various data, such as image data, from the predetermined detection device 100.
In the fourth embodiment, the case has been described in which the commercial game device 14A receives a peripheral information request from the autonomous vehicle 12A, but the server device 10 may receive the peripheral information request from the autonomous vehicle 12A without receiving the peripheral information request. In this case, the server device 10 that receives the peripheral information request may determine which commercial game device 14A the autonomous vehicle 12A should connect to. The commercial game device 14A may acquire image data from a camera that is connected in advance, and transmit an output result (processing result) of the learned model to the autonomous vehicle 12A.

1A, 1B: information processing system, 10: server device, 12: user device, 14: arcade game device (information processing device), 74: measuring means, 76: selection means

Claims (11)

An information processing system including a server device capable of communicating with a user device that acquires data, and information processing devices installed at a plurality of locations,
The server device includes:
a measurement unit that outputs a measurement instruction to the user device to measure a communication speed between the user device and the information processing devices at the plurality of locations, and receives a measurement result of the communication speed;
a selection means for selecting one or more information processing devices at locations from among the information processing devices at the plurality of locations as information processing devices to be communicatively connected to the user device based on a measurement result of the measurement means, and instructing the user device to communicatively connect to the selected information processing device;
Equipped with
An information processing device communicatively connected to the user device inputs the data received from the user device into an inference model, and transmits an output result from the inference model to the user device.
Information processing system. the selection means acquires operation statuses of the information processing devices installed at the plurality of locations, and selects one or more information processing devices at the plurality of locations based on the acquired operation statuses and the measurement results.
The information processing system according to claim 1 . the user device is a mobile device capable of being moved;
the selection means selects information processing devices at two or more locations from the information processing devices at the plurality of locations;
the user device outputs the output result that is received earliest from among the output results received from the information processing devices at the two or more locations.
3. The information processing system according to claim 1 or 2. the selection means selects information processing devices at two or more locations from the information processing devices at the plurality of locations;
the user device outputs an output result in which the content of the output result received from each of the information processing devices at the two or more locations matches the content of other output results the most among the output results.
3. The information processing system according to claim 1 or 2. the selection means selects information processing devices at two or more locations from the information processing devices at the plurality of locations;
the user device switches between outputting the output result received earliest from the information processing devices at the two or more locations, or outputting the output result whose content matches the most with other output results among the output results received from the information processing devices at the two or more locations, based on the control content of the user device;
3. The information processing system according to claim 1 or 2. The server device includes a storage means for storing a plurality of bases in association with each region,
the measurement means extracts one base from among the plurality of bases for each region, outputs a measurement instruction to the user device to measure a communication speed between an information processing device of each extracted base and the user device, and receives a measurement result of the communication speed, and extracts a region linked to a base showing a measurement result with the fastest communication speed among the measurement results, outputs a measurement instruction to the user device to measure a communication speed between the information processing device of the plurality of bases linked to the extracted region and the user device, and receives a measurement result of the communication speed.
6. An information processing system according to claim 1. The information processing device selected by the selection means acquires a detection result from a detection device installed on a street in response to a request from the user device, and outputs an analysis result based on the detection result to the user device.
7. An information processing system according to claim 1. After the information processing device is selected by the selection means, the information processing device acquires the inference model by communicating with an external device.
3. The information processing system according to claim 1 or 2. the user device is a mobile device capable of being moved;
the measurement means outputs an instruction to the user device to measure the communication speed a plurality of times and receives measurement results of the communication speed;
the selection means selects the information processing devices at the two or more locations based on the latest measurement result of the measurement means at predetermined time intervals;
The server device includes an extraction means for extracting an information processing device whose communication speed with the user device becomes faster than or equal to a threshold based on the results of the multiple measurements as a candidate for communication connection with the user device, and transmitting the inference model to the extracted information processing device before a communication connection with the user device is established.
The information processing system according to claim 8. the information processing device includes a gaming device that executes a game when a value medium is paid;
10. An information processing system according to any one of claims 1 to 9. A computer capable of communicating with a user device that acquires data,
a measurement means for outputting a measurement instruction to the user device to measure a communication speed between the user device and an information processing device located at a plurality of locations and capable of performing inference processing on the data, and receiving a measurement result of the communication speed;
a selection means for selecting, based on a measurement result of the measurement means, two or more information processing devices at locations from among the information processing devices at the plurality of locations as information processing devices to be communicatively connected to the user device, and instructing the user device to communicatively connect to the selected information processing devices;
A program to function as a

Images