JP7556782B2 - Information processing device and information processing method - Google Patents

Description

The present invention relates to an information processing device and an information processing method.

Various technologies have been proposed for calculating the number of passengers who board and disembark on vehicles such as buses (see, for example, Patent Document 1). In these conventional technologies, cameras are installed at the boarding and disembarking entrances, and the number of passengers (number of passengers) is calculated using images of the passengers captured by the cameras.

JP 2014-219913 A

There is a technology that detects passenger information, such as the passenger's age and gender, based on the above-mentioned captured images of the passengers. However, the conventional technology leaves room for improvement in terms of improving the accuracy of such passenger information.

The present invention has been made in consideration of the above, and aims to provide an information processing device and information processing method that can improve the accuracy of passenger information.

In order to solve the above problems and achieve the object, the present invention provides an information processing device comprising a first detection unit, a second detection unit, and a storage processing unit. The first detection unit is configured to be able to detect passenger information relating to passengers of the vehicle based on an image captured by a first camera provided at the entrance of the vehicle. The second detection unit is configured to be able to detect the passenger information relating to the passengers based on an image captured by a second camera provided at the exit of the vehicle. When the passenger information is detected by the first detection unit and the second detection unit, respectively, the storage processing unit stores in the storage unit the passenger information detected based on an image captured by one of the first and second cameras, which has more favorable imaging conditions.

The present invention can improve the accuracy of passenger information.

FIG. 1A is a diagram showing an overview of an information processing method according to an embodiment. FIG. 1B is a diagram for explaining passenger information stored in the storage unit. FIG. 2 is a block diagram showing an example of the configuration of an information processing system equipped with a bus terminal device. FIG. 3 is a block diagram showing an example of the configuration of the entrance terminal device. FIG. 4 is a diagram showing an example of passenger information. FIG. 5 is a diagram showing an example of the imaging situation information. FIG. 6 is a block diagram showing an example of the configuration of an exit terminal device. FIG. 7 is a diagram showing an example of passenger information. FIG. 8 is a diagram showing an example of the imaging situation information. FIG. 9 is a block diagram illustrating an example of the configuration of the management server. FIG. 10 is a diagram illustrating an example of a processing sequence executed by the information processing system. FIG. 11 is a flowchart showing a processing procedure executed by a bus terminal device according to the modified example.

Hereinafter, an embodiment of the information processing device and information processing method disclosed in the present application will be described in detail with reference to the attached drawings. Note that the present invention is not limited to the embodiment described below.

(Embodiment)
<Overview of information processing method by information processing device>
First, an overview of an information processing method by an information processing device according to an embodiment will be described below with reference to Fig. 1A etc. Fig. 1A is a diagram showing an overview of the information processing method according to an embodiment.

The information processing method according to the embodiment can perform processes such as detecting passenger information related to passengers on a vehicle and storing it in a storage unit, and calculating the number of passengers. Note that, in the following description, a bus 1 is used as an example of a vehicle, but the type of vehicle is not limited to this. In other words, the vehicle may be other types of vehicles, such as a railroad car, an airplane, or a ship.

As shown in FIG. 1A, a bus 1 is equipped with a bus terminal device 10, which functions as an information processing device. Specifically, the bus terminal device 10 includes an entrance terminal device 10a and an exit terminal device 10b.

The entrance terminal device 10a is installed at the entrance 2a of the bus 1. The entrance terminal device 10a is equipped with a first camera 11a. For example, the first camera 11a is installed at the entrance 2a of the bus 1 and inside the bus 1 (inside the bus), and captures passenger images of passengers who board the bus 1. The entrance terminal device 10a can detect passengers by detecting facial information from the passenger images.

The exit terminal device 10b is installed at the exit 2b of the bus 1. The exit terminal device 10b is equipped with a second camera 11b. For example, the second camera 11b is installed at the exit 2b of the bus 1 and inside the bus 1 (inside the bus), and captures images of passengers getting off the bus 1. The exit terminal device 10b can detect passengers by detecting facial information from the captured images of passengers getting off.

The bus terminal device 10 can then calculate the number of passengers based on the passenger information about boarding passengers detected by the boarding terminal device 10a and the passenger information about disembarking passengers detected by the disembarking terminal device 10b. The calculation of the number of passengers will be described later.

The passenger information includes various information about passengers, such as the passenger's age and sex, the bus stop where the passenger boarded the bus, and the bus stop where the passenger disembarked. Therefore, the bus terminal device 10 stores such passenger information, and the bus operator can take various appropriate measures regarding the bus 1 by analyzing the passenger information stored in the bus terminal device 10. For example, the bus operator can change the content of in-vehicle advertisements and announcements according to the passenger information, or adjust the operation plan according to the passenger information to operate the bus 1 efficiently.

However, the conventional technology has room for improvement in terms of improving the accuracy of passenger information. To be more specific, in the conventional technology, the boarding terminal device 10a detects passenger information (hereinafter sometimes referred to as "first passenger information") based on images of passengers boarding the bus captured by the first camera 11a. The exiting terminal device 10b detects passenger information (hereinafter sometimes referred to as "second passenger information") based on images of passengers disembarking captured by the second camera 11b. In the conventional technology, the above-mentioned first passenger information is stored in the memory unit 30b, and then information that is missing in the first passenger information (for example, information on the bus stop where the passenger disembarked) is supplemented with the second passenger information.

Here, the imaging conditions are different between the first camera 11a and the second camera 11b described above, but in the conventional technology, such differences in imaging conditions were not taken into consideration, which could result in a decrease in the accuracy of passenger information.

Therefore, the bus terminal device (information processing device) 10 according to this embodiment is configured to improve the accuracy of passenger information.

Specifically, the boarding terminal device 10a of the bus terminal device 10 first acquires passenger image images of passengers (passengers) boarding the bus 1 from the first camera 11a (step S1).

Next, the entrance terminal device 10a detects the first passenger information based on the passenger image captured by the first camera 11a (step S2). Next, the entrance terminal device 10a outputs the detected first passenger information to the exit terminal device 10b (step S3).

The exit terminal device 10b stores the first passenger information output from the entrance terminal device 10a in the memory unit 30b (step S4).

Next, the exit terminal device 10b acquires from the second camera 11b an image of a passenger (a passenger getting off) getting off the bus 1 (step S5). Next, second passenger information is detected based on the image of a passenger taken by the second camera 11b (step S6).

Here, the exit terminal device 10b stores the detected second passenger information in the memory unit 30b, but in this embodiment, the information is stored according to the difference in the imaging conditions between the first camera 11a and the second camera 11b.

First, the imaging conditions of the cameras 11a and 11b will be specifically described. The first camera 11a is installed at a position at the entrance 2a that does not interfere with boarding, for example, a lower position on the handrail at the entrance 2a that is not used. In addition, since passengers board the train by climbing the stairs at the entrance 2a, for example, their heads tend to move up and down and left and right. Therefore, it may be difficult for the first camera 11a to capture images of passengers' faces from the front, making it difficult to obtain facial information. In addition, since the first camera 11a captures images from inside the train toward the outside, it is easily affected by the external environment, for example, due to backlighting, which may cause the passenger's face in the passenger image to become dark, making it difficult to obtain facial information. Due to these various factors, the imaging conditions of the first camera 11a can be said to be relatively unfavorable.

On the other hand, the second camera 11b only needs to capture images of passengers moving toward the exit 2b, so it can be installed, for example, facing from the exit 2b into the interior of the vehicle, at about the height of the passenger's face. Also, since passengers only move inside the vehicle toward the exit 2b, for example, their heads often do not move much in the vertical or horizontal directions. Therefore, the second camera 11b can easily capture images of passengers' faces from the front, making it easy to obtain facial information. Also, since the second camera 11b is installed inside the vehicle and captures images facing the interior of the vehicle, it is less susceptible to the effects of the external environment described above. Therefore, it can be said that the imaging conditions of the second camera 11b are more advantageous than those of the first camera 11a.

Therefore, the accuracy of the second passenger information detected based on the image captured by the second camera 11b, which has favorable imaging conditions, is likely to be higher than the accuracy of the first passenger information detected based on the image captured by the first camera 11a, which has unfavorable imaging conditions.

Therefore, the exit terminal device 10b according to this embodiment is configured to preferentially store the second passenger information, which is more accurate than the first passenger information, in the storage unit 30b. In detail, when the exit terminal device 10b detects the first passenger information and the second passenger information, it stores in the storage unit 30b the passenger information (second passenger information) detected based on the image captured by the camera (here, the second camera 11b) with the more favorable imaging conditions out of the first camera 11a and the second camera 11b (step S7).

The processing of step S7 will be described in detail with reference to FIG. 1B. FIG. 1B is a diagram for explaining the passenger information stored in memory unit 30b. FIG. 1B shows the relationship between the data items included in the passenger information and the terminal device that detected the data (information) of the corresponding data item. Note that the contents of the data items included in the passenger information shown in FIG. 1B are merely examples and are not limited to these.

In addition, in FIG. 1B, the left diagram shows passenger information in memory unit 30b before the second passenger information is detected and in which the first passenger information is stored in the processing of step S4, and the right diagram shows passenger information in memory unit 30b after the second passenger information is detected and in which the second passenger information is stored in the processing of step S7.

As shown in the left diagram of FIG. 1B, the exit terminal device 10b first stores the first passenger information detected by the entrance terminal device 10a in the memory unit 30b. Note that the first passenger information is information about passengers (passengers) boarding the bus 1, and does not include information about the bus stop where the passenger disembarked.

Then, when the second passenger information is detected and both the first and second passenger information are detected, the exit terminal device 10b stores the passenger information (second passenger information) detected based on the image captured by the one camera with favorable imaging conditions (here, the second camera 11b) in the storage unit 30b, in other words, updates it using the second passenger information. Note that the above-mentioned imaging conditions and the one camera with favorable imaging conditions are set in advance, but are not limited to this.

As an example, as shown in the right diagram of FIG. 1B, the exit terminal device 10b overwrites the data items "age" and "gender" that were the first passenger information detected by the entrance terminal device 10a with the second passenger information detected by the exit terminal device 10b.

The second passenger information is information about passengers (disembarking passengers) getting off bus 1, so it does not include information about the bus stop where the passenger boarded the bus, but does include information about the bus stop where the passenger disembarked. Therefore, the data item "bus stop where the passenger boarded the bus" remains the first passenger information, and the data item "bus stop where the passenger disembarked" stores the second passenger information.

In this manner, in this embodiment, the passenger information (second passenger information) detected based on the image captured by the second camera 11b, which has favorable imaging conditions, is stored in the memory unit 30b, thereby improving the accuracy of the passenger information.

For example, if the data items "age" and "gender" were left as the first passenger information after the second passenger information was detected, there is a risk that the accuracy of the passenger information would decrease; however, by overwriting the first passenger information with the second passenger information, which is more accurate than the first passenger information as described above, the accuracy of the passenger information (e.g., the data items "age" and "gender") can be improved.

<Configuration of Information Processing System>
Next, the configuration of an information processing system including a bus terminal device (information processing device) 10 according to the embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing an example of the configuration of an information processing system 100 including the bus terminal device 10.

As shown in FIG. 2, the information processing system 100 includes the above-mentioned bus terminal device 10, a management server 200, a bus operator terminal device 300, and a user terminal device 400, which are communicatively connected via a communication network N such as the Internet.

As described above, the bus terminal device 10 includes an entrance terminal device 10a and an exit terminal device 10b. The entrance terminal device 10a and the exit terminal device 10b are connected to each other so that they can communicate with each other via short-range wireless communication such as Wi-Fi (registered trademark), but this is not limited thereto, and they may be connected to each other so that they can communicate with each other via a communication network N or the like in addition to or instead of short-range wireless communication. The detailed configuration of the entrance terminal device 10a will be described later using FIG. 3 and other figures. The detailed configuration of the exit terminal device 10b will be described later using FIG. 6 and other figures.

The management server 200 is a server device that manages passenger information, including information on the number of passengers on the bus 1, transmitted from the bus terminal device 10. The management server 200 can provide passenger information, etc. to the bus operator terminal device 300. The management server 200 can also calculate the congestion level of the bus 1 based on the information on the number of passengers on the bus 1, and provide congestion level information indicating the calculated congestion level to the user terminal device 400. The detailed configuration of the management server 200 will be described later with reference to FIG. 9.

The bus operator terminal device 300 is a terminal device used by the bus operator who operates the bus 1. The bus operator terminal device 300 may be, for example, a PC (Personal Computer), a smartphone, a tablet terminal, etc., but is not limited to these. Passenger information and the like is transmitted from the management server 200 to the bus operator terminal device 300 and displayed thereon. This enables the bus operator to, for example, change the content of in-vehicle advertisements and in-vehicle announcements in accordance with passenger information, etc., and to create an operation plan for the bus 1 in accordance with passenger information, etc.

The user terminal device 400 is a terminal device used by a user who uses the bus 1, or more precisely, a user who is about to use the bus 1. The user terminal device 400 may be, for example, a smartphone, a tablet terminal, or a PC, but is not limited to these. The congestion degree information of the bus 1 is transmitted from the management server 200 to the user terminal device 400 and displayed. This allows the user to check, for example, the congestion degree of the bus 1 before boarding. In FIG. 2, two user terminal devices 400 are shown for the sake of simplicity, but the number is not limited to this and may be one or three or more.

<Configuration of boarding gate terminal device>
Next, the configuration of the entrance terminal device 10a will be described with reference to Fig. 3 and other figures. Fig. 3 is a block diagram showing an example of the configuration of the entrance terminal device 10a. Note that in each block diagram including Fig. 3, only components necessary for explaining the features of this embodiment are shown as functional blocks, and descriptions of general components are omitted.

In other words, each component shown in a block diagram such as FIG. 3 is a functional concept, and does not necessarily have to be physically configured as shown. For example, the specific form of distribution and integration of each functional block is not limited to that shown, and all or part of it can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

As shown in FIG. 3, the entrance terminal device 10a includes a first camera 11a, a positioning unit 12a, a control unit 20a, and a storage unit 30a. Note that the entrance terminal device 10a may be a smartphone or a tablet terminal, but is not limited to these.

The first camera 11a is a camera equipped with, for example, a lens and an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor). The first camera 11a is provided at the boarding entrance 2a (see FIG. 1A) of the bus 1 and inside the bus 1 (inside the bus). In detail, the first camera 11a is provided at a position where an image including at least the face of a passenger boarding the bus from the boarding entrance 2a can be captured from inside the bus. The first camera 11a captures a passenger image of the passenger and outputs the captured passenger image to the control unit 20a.

The positioning unit 12a acquires position information (e.g., latitude and longitude) of the bus 1. For example, the positioning unit 12a receives radio waves transmitted from a GPS (Global Positioning System) satellite, acquires position information of the bus 1 based on the received radio waves, and outputs the acquired position information to the control unit 20a. Note that the positioning unit 12a may output the position information of the bus 1 acquired when the bus 1 is stopped at a bus stop as the position information of the bus stop at which the bus 1 is stopped.

The control unit 20a includes an acquisition unit 21a, a detection unit 22a, a registration unit 23a, and an output unit 24a, and includes, for example, a computer having a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), input/output ports, and various other circuits.

The computer's CPU functions as the acquisition unit 21a, detection unit 22a, registration unit 23a, and output unit 24a of the control unit 20a, for example, by reading and executing a program stored in the ROM.

In addition, at least some or all of the acquisition unit 21a, detection unit 22a, registration unit 23a, and output unit 24a of the control unit 20a can be configured with hardware such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

The memory unit 30a is a memory unit configured with a storage device such as a non-volatile memory or a data flash. The memory unit 30a stores passenger information 31a, imaging status information 32a, various programs, and the like.

Passenger information 31a is information about passengers (passengers) riding on bus 1. Here, passenger information 31a will be described with reference to FIG. 4. FIG. 4 is a diagram showing an example of passenger information 31a. As shown in FIG. 4, passenger information 31a includes items such as "passenger ID," "passenger image," "characteristic points," "gender," "age," "age group," "whether or not a mask was worn," "boarding stop," and "disembarking stop," and each item is associated with each other.

"Passenger ID" is identification information that identifies a passenger. "Passenger image" is information on a captured image of a passenger. Note that in the example shown in FIG. 4, for convenience, "passenger image" is described abstractly as "image E01," but specific information is stored in "image E01." Below, other information may also be described abstractly.

"Feature points" are feature point information of the passenger's face captured in the passenger image, and are an example of face information. Feature point information includes, for example, the positions of feature points such as the eyes (inner corners, outer corners, etc.), nose, and mouth on the passenger's face captured in the passenger image, but is not limited to this.

"Gender" is information indicating the gender of the passenger shown in the passenger image. "Age" is information indicating the age of the passenger shown in the passenger image, and "Age group" is information indicating the age group of the passenger. "Mask presence/absence" is information indicating whether the passenger shown in the passenger image is wearing a mask. Note that the above-mentioned information such as gender, age, age group, and mask presence/absence are examples of passenger attribute information.

"Boarding stop" is information indicating the stop where the passenger (passenger) boarded the bus. "Disembarking stop" is information indicating the stop where the passenger disembarked. Note that the memory unit 30a of the boarding terminal device 10a stores information about passengers (passengers) boarding the bus 1, and does not store information about the disembarking stop.

The "first accuracy" is information indicating the accuracy of passenger information, including attribute information, detected based on the passenger image. The "first accuracy" is calculated, for example, by the detection unit 22a, which will be described later.

In the example shown in Figure 4, the data for a passenger identified by passenger ID "P01" indicates that the passenger image is "Image E01", the feature point is "Feature point F01", the gender is "Male", the age is "Age G01", the age group is "Adult", the presence or absence of a mask is "None", the bus stop where the passenger boarded is "Bus stop H01", and the first certainty is "Certainty I01".

Returning to the explanation of FIG. 3, the imaging situation information 32a is information indicating the imaging conditions of the first camera 11a and the situation when the passenger image was captured by the first camera 11a.

Now, the imaging situation information 32a will be described with reference to FIG. 5. FIG. 5 is a diagram showing an example of the imaging situation information 32a. As shown in FIG. 5, the imaging situation information 32a includes items such as "situation ID," "installation position of the first camera," "installation angle of the first camera," "bus stop," "date and time," and "weather," and each item is associated with each other.

The "situation ID" is identification information that identifies the imaging situation information. The "installation position of the first camera" is information that indicates the position where the first camera 11a is installed at the entrance 2a. The "installation position of the first camera" includes, but is not limited to, information such as the location where the first camera 11a is installed (e.g., a handrail or seat inside the vehicle) and the height at which the first camera 11a is installed.

The "installation angle of the first camera" is information indicating the angle at which the first camera 11a is installed. The "installation angle of the first camera" is, for example, the mounting angle of the first camera 11a relative to the boarding entrance 2a, but is not limited to this and may include other information such as the angle of view of the first camera 11a.

"Stop" is information indicating the stop at which the passenger image was taken. "Date and time" and "Weather" are information indicating the date and time when the passenger image was taken, and information indicating the weather, respectively.

In the example shown in FIG. 5, the data of the imaging situation identified by the situation ID "J01" indicates that the installation position of the first camera 11a is "Position K01", the installation angle of the first camera 11a is "Angle L01", the bus stop is "Bus Stop M01", the date and time is "Date and Time N01", and the weather is "Sunny".

The imaging conditions of the first camera 11a are the "installation position of the first camera" and the "installation angle of the first camera" among the above items, and are set (registered) in advance in the memory unit 30a, but are not limited to this. In other words, the imaging conditions of the first camera 11a may be either the "installation position of the first camera" or the "installation angle of the first camera", or may include other information such as "bus stop", "date and time", and "weather", and can be set arbitrarily.

Returning to the explanation of FIG. 3, the acquisition unit 21a of the control unit 20a acquires passenger captured images of passengers (passengers) boarding the bus 1 from the first camera 11a. For example, the acquisition unit 21a acquires passenger captured images when the bus 1 is stopped at a bus stop, but the timing of acquisition is not limited to this. The acquisition unit 21a outputs the acquired passenger captured images to the detection unit 22a.

The detection unit 22a can detect passenger information related to the passenger (passenger) based on the passenger image. The detection unit 22a is an example of a first detection unit.

For example, the detection unit 22a detects facial information (more specifically, facial feature point information) of the passenger (passenger) from the passenger image capture image. For example, the detection unit 22a extracts feature points such as the eyes (inner corner, outer corner, etc.), nose, mouth, and contour from the passenger image capture image, and detects the positions of the extracted feature points as feature point information. The detection unit 22a outputs the detected feature point information to the registration unit 23a together with the passenger image capture image.

The detection unit 22a detects attribute information of the passenger from the passenger image. For example, the detection unit 22a detects attribute information such as gender, age, age group, and whether or not the passenger is wearing a mask based on feature point information in the passenger image. The detection unit 22a then outputs the detected attribute information to the registration unit 23a.

The detection unit 22a can also calculate a first accuracy indicating the accuracy of the passenger information including attribute information detected based on the passenger image. For example, the detection unit 22a can calculate an accuracy (here, the first accuracy) indicating the accuracy of the passenger information based on various information such as the number of feature points detected based on the passenger image and the clarity of the captured image. For example, the detection unit 22a calculates the first accuracy so that the more feature points are detected, the higher the first accuracy becomes. The detection unit 22a outputs information indicating the calculated first accuracy to the registration unit 23a.

The detection methods for the feature point information and attribute information, and the calculation methods for the accuracy of passenger information, can be set arbitrarily.

The registration unit 23a registers (stores) the feature point information and attribute information detected by the detection unit 22a, and information indicating the calculated first accuracy together with the passenger image in the storage unit 30a as passenger information 31a (see FIG. 4). At this time, the registration unit 23a may add information on the bus stop where the passenger image was captured, i.e., the bus stop where the passenger boarded, to the passenger information 31a based on the position information of the bus 1 from the positioning unit 12a.

The registration unit 23a may also register information indicating the imaging conditions, such as the bus stop at which the passenger image was captured, the date and time, and the weather, in the storage unit 30a as imaging condition information 32a (see FIG. 5). Note that the information indicating the weather, etc. is obtained from an external server (not shown) and registered, but is not limited to this.

The output unit 24a accesses the memory unit 30a and outputs passenger information 31a to the exit terminal device 10b. Note that the output unit 24a executes the output process from when the bus 1 departs from the bus stop and the registration process etc. are completed in the registration unit 23a until the bus arrives at the next bus stop, but the output timing is not limited to this.

<Configuration of Exit Terminal Device>
Next, the configuration of the exit terminal device 10b will be described with reference to Fig. 6 etc. Fig. 6 is a block diagram showing an example of the configuration of the exit terminal device 10b.

As shown in FIG. 6, the exit terminal device 10b includes a second camera 11b, a positioning unit 12b, a control unit 20b, and a storage unit 30b. Note that the exit terminal device 10b may be, but is not limited to, a smartphone or a tablet terminal.

The second camera 11b is a camera equipped with, for example, a lens and an imaging element such as a CCD or CMOS. The second camera 11b is provided at the exit 2b of the bus 1 (see FIG. 1A) and inside the bus 1 (inside the bus). In detail, the second camera 11b is provided at a position where it is possible to capture an image from inside the bus that includes at least the face of passengers disembarking from the exit 2b. The second camera 11b captures an image of the passengers disembarking and outputs the captured image to the control unit 20b.

The positioning unit 12b acquires the position information of the bus 1 based on radio waves transmitted from a GPS satellite, for example, and outputs the acquired position information to the control unit 20b. Note that the positioning unit 12b may output the position information of the bus 1 acquired when the bus 1 is stopped at a bus stop as the position information of the bus stop where the bus 1 is stopped.

The control unit 20b includes an acquisition unit 21b, a detection unit 22b, a matching unit 23b, a registration unit 24b, a calculation unit 25b, and a transmission unit 26b, and includes, for example, a computer having a CPU, ROM, RAM, input/output ports, etc., and various circuits.

The computer's CPU functions as the acquisition unit 21b, detection unit 22b, matching unit 23b, registration unit 24b, calculation unit 25b and transmission unit 26b of the control unit 20b, for example, by reading and executing a program stored in the ROM.

In addition, at least some or all of the acquisition unit 21b, detection unit 22b, matching unit 23b, registration unit 24b, calculation unit 25b and transmission unit 26b of the control unit 20b can be configured with hardware such as an ASIC or FPGA.

The memory unit 30b is a memory unit configured with a storage device such as a non-volatile memory or a data flash. The memory unit 30b stores passenger information 31b, imaging status information 32b, boarding and alighting counter 33b, various programs, and the like.

Passenger information 31b is information about passengers (including boarding and disembarking passengers) on bus 1. Here, passenger information 31b will be described with reference to FIG. 7. FIG. 7 is a diagram showing an example of passenger information 31b. As shown in FIG. 7, passenger information 31b includes items such as "passenger ID", "disembarking passenger image", "characteristic points", "gender", "age", "age group", "whether or not a mask was worn", "boarding stop", "disembarking stop", "history information" and "second accuracy", and each item is associated with each other.

"Passenger ID" is identification information that identifies a passenger. Note that in Figure 7, a passenger with passenger ID "P01" indicates that the passenger is the same person (same passenger) as the passenger with passenger ID "P01" in the passenger information 31a shown in Figure 4.

"Image of disembarking passenger" is information on the captured image of the disembarking passenger. "Feature points" is information on facial feature points. Such feature point information includes, for example, the positions of feature points such as the eyes, nose, and mouth on the face of the disembarking passenger captured in the captured image of the disembarking passenger, but is not limited to this.

"Gender" is information indicating the gender of the person who appears in the image of the person who alights. "Age" is information indicating the age of the person who appears in the image of the person who alights, and "Age group" is information indicating the age group of the person who alights. "Mask or not" is information indicating whether the person who appears in the image of the person who alights is wearing a mask.

"Boarding stop" is information that indicates the stop where the passenger boarded. "Disembarking stop" is information that indicates the stop where the passenger (disembarking person) disembarked.

"History information" is history information that indicates passenger information before it is updated. More specifically, as described above, first passenger information detected based on the images of passengers boarding the train is stored in the memory unit 30b of the exit terminal device 10b, and when second passenger information is subsequently detected based on the images of passengers disembarking, the second passenger information is preferentially stored, i.e., passenger information 31b is updated (see FIG. 1B). The above-mentioned "history information" is information that indicates passenger information before it is updated, and more specifically, it is information that indicates the first passenger information that has been overwritten (update history information).

The history information includes all or part of the overwritten first passenger information. That is, for example, the history information "History Q01" includes the first passenger information including attribute information such as the feature point being "Feature Point F01", the gender being "Male", the age being "Age G01", the age group being "Adult", and the presence or absence of a mask being "No".

The "second accuracy" is information indicating the accuracy of the passenger information, including attribute information, detected based on the image of the passenger getting off. The "second accuracy" is calculated, for example, by the detection unit 22b, which will be described later.

In the example shown in Figure 7, the data of the alighting passenger identified by the alighting passenger ID "Q01" indicates that the alighting passenger image is "Image E11", the feature point is "Feature point F11", the gender is "Male", the age is "Age G11", the age group is "Adult", the presence or absence of a mask is "None", the boarding stop is "Stop H01", the alighting stop is "Stop H11", the history information is "History Q01", and the second certainty is "Reliability R01".

Returning to the explanation of Figure 6, the imaging situation information 32b is information that indicates the imaging conditions of the second camera 11b and the situation when the disembarking passenger image was captured by the second camera 11b.

Here, we will explain the imaging situation information 32b. Figure 8 is a diagram showing an example of the imaging situation information 32b. As shown in Figure 8, the imaging situation information 32b includes items such as "situation ID," "installation position of the second camera," "installation angle of the second camera," "bus stop," "date and time," and "weather," and each item is associated with each other.

The "situation ID" is identification information that identifies the imaging situation information. The "installation position of the second camera" is information that indicates the position where the second camera 11b is installed at the exit 2b. The "installation position of the second camera" includes, but is not limited to, information such as the location where the second camera 11b is installed (e.g., a handrail or seat inside the vehicle) and the height at which the second camera 11b is installed.

The "installation angle of the second camera" is information indicating the angle at which the second camera 11b is installed. The "installation angle of the second camera" is, for example, the mounting angle of the second camera 11b relative to the exit 2b, but is not limited to this and may include other information such as the angle of view of the second camera 11b.

"Stop" is information indicating the stop at which the image of the disembarking passenger was captured. "Date and time" and "Weather" are information indicating the date and time and the weather when the image of the disembarking passenger was captured, respectively.

In the example shown in FIG. 8, the data of the imaging situation identified by the situation ID "S01" indicates that the installation position of the second camera 11b is "Position T01", the installation angle of the second camera 11b is "Angle U01", the bus stop is "Bus Stop M01", the date and time is "Date and Time N01", and the weather is "Sunny".

The imaging conditions of the second camera 11b are the "installation position of the second camera" and the "installation angle of the second camera" among the above items, and are set (registered) in advance in the memory unit 30a, but are not limited to this. In other words, the imaging conditions of the second camera 11b may be either the "installation position of the second camera" or the "installation angle of the second camera", or may include other information such as "bus stop", "date and time", and "weather", and can be set arbitrarily.

Returning to the explanation of Figure 6, boarding and alighting counter 33b is a counter that counts the current number of passengers on bus 1.

The acquisition unit 21b of the control unit 20b acquires passenger information (first passenger information) output from the entrance terminal device 10a, and outputs the acquired first passenger information to the registration unit 24b. The registration unit 24b registers the first passenger information in the storage unit 30b as passenger information 31a (see FIG. 7). The acquisition unit 21b may register the first passenger information in the storage unit 30b.

The acquisition unit 21b also acquires, from the second camera 11b, an alighting passenger image captured of a passenger (alighter) getting off the bus 1. For example, the acquisition unit 21b acquires an alighting passenger image when the bus 1 is stopped at a bus stop, but the acquisition timing is not limited to this. The acquisition unit 21b outputs the acquired alighting passenger image to the detection unit 22b.

The detection unit 22b can detect passenger information related to passengers (disembarking passengers) based on the disembarking passenger image. The detection unit 22b is an example of a second detection unit.

For example, the detection unit 22b detects facial information (more specifically, facial feature point information) of passengers (disembarking passengers) from the image of the disembarking passengers. For example, the detection unit 22b extracts feature points such as the eyes, nose, mouth, and contours from the image of the disembarking passengers, and detects the positions of the extracted feature points as feature point information. The detection unit 22a outputs the detected feature point information together with the image of the disembarking passengers to the matching unit 23b and the registration unit 24b.

The detection unit 22b detects attribute information of disembarking passengers from the captured image of the disembarking passengers. For example, the detection unit 22a detects attribute information such as gender, age, age group, and whether or not a mask is worn based on feature point information in the captured image of the disembarking passengers. The detection unit 22a then outputs the detected attribute information to the matching unit 23b and the registration unit 23a.

The detection unit 22b can also calculate a second accuracy indicating the accuracy of the passenger information including attribute information detected based on the image of the disembarking passengers. For example, the detection unit 22b can calculate the second accuracy of the passenger information based on various information such as the number of feature points detected based on the image of the disembarking passengers. For example, the detection unit 22b calculates the second accuracy so that the more feature points are detected, the higher the second accuracy becomes. The detection unit 22b outputs information indicating the calculated second accuracy to the registration unit 24b.

The matching unit 23b matches the passenger information, which is the first passenger information stored in the memory unit 30b, with the second passenger information detected by the detection unit 22b. In detail, the matching unit 23b checks whether the boarding passenger indicated by the first passenger information and the disembarking passenger indicated by the second passenger information are the same passenger.

For example, the matching unit 23b performs a comparison to determine whether the characteristic information and attribute information of the disembarking passenger in the second passenger information match or approximately match the characteristic information and attribute information of the passenger in the first passenger information. If the characteristic information, etc. of the disembarking passenger matches or approximately matches the characteristic information, etc. of the passenger, the matching unit 23b outputs to the registration unit 24b a comparison result indicating that the passenger indicated in the first passenger information and the disembarking passenger indicated in the second passenger information are the same passenger.

When a matching result indicating that the disembarking passenger indicated in the second passenger information is the same as the boarding passenger indicated in the first passenger information is input, the registration unit 24b registers (stores) the second passenger information in the memory unit 30b as passenger information 31b (see FIG. 7). The registration unit 24b is an example of a storage processing unit.

In other words, for example, when the first passenger information and the second passenger information are detected for the same passenger, the registration unit 24b stores in the memory unit 30b the passenger information (second passenger information) detected based on the captured image of one of the first camera 11a and the second camera 11b, which has more favorable imaging conditions (here, the second camera 11b). In other words, the registration unit 24b updates (overwrites) the first passenger information stored in the memory unit 30b with the second passenger information detected based on the disembarking passenger captured image of the second camera 11b, which has more favorable imaging conditions.

In this manner, in this embodiment, the accuracy of the passenger information can be improved by storing in the memory unit 30b passenger information (second passenger information) detected based on the image captured by the second camera 11b, which has favorable imaging conditions. In other words, by overwriting the passenger information in the memory unit 30b with the second passenger information, which is more accurate than the first passenger information, as described above, the accuracy of the passenger information in the memory unit 30b can be improved.

When the registration unit 24b stores the second passenger information including the feature point information and attribute information in the memory unit 30b, the registration unit 24b registers information indicating the calculated second accuracy together with the disembarking passenger image as passenger information 31b (see FIG. 7) in the memory unit 30a. The registration unit 24b may also add information on the bus stop where the disembarking passenger image was captured, i.e., the bus stop where the disembarking passenger disembarked, to the passenger information 31b based on the position information of the bus 1 from the positioning unit 12b.

The registration unit 24b may also store the passenger information (first passenger information) before the update in the storage unit 30b as history information. In detail, when the registration unit 24b stores passenger information (first passenger information) detected based on an image (image of passengers getting off) from one camera (second camera 11b) in the storage unit 30b that stores passenger information (first passenger information) detected based on an image (image of passengers getting on) from one camera (second camera 11b) different from the other camera (first camera 11a) that has more favorable imaging conditions, the registration unit 24b may store the passenger information (first passenger information) before the update in the storage unit 30b as history information.

In this way, by storing the history information in the storage unit 30b, it is possible to improve the imaging conditions of the first camera 11a, for example. That is, for example, the registration unit 24b may calculate the difference between the passenger information (second passenger information) stored in the storage unit 30b and the history information (first passenger information), and if the calculated difference is equal to or greater than a predetermined value set in advance, output a notification that the installation position of the first camera 11a may not be appropriate. Note that the information used as the difference described above can be set arbitrarily, and as an example, the difference between the first accuracy and the second accuracy can be used. Also, the predetermined value is set to a value indicating that the first passenger information and the second passenger information are relatively far apart, but is not limited to this and can be set to any value.

In more detail, when there is a relatively large difference between the first passenger information and the second passenger information, in other words, when the first passenger information deviates from the highly accurate second passenger information, the installation position and installation angle of the first camera 11a may not be appropriate. Therefore, in this embodiment, by storing the history information in the memory unit 30b, it becomes possible to output the above-mentioned notification. Then, for example, the bus operator can appropriately change the installation position and installation angle of the first camera 11a in response to such a notification, which results in improved imaging conditions for the first camera 11a.

Conversely, if there is no relatively large difference between the first passenger information and the second passenger information, in other words, if the first passenger information does not deviate from the highly accurate second passenger information, it becomes possible to estimate that the installation position, installation angle, etc. of the first camera 11a are appropriate.

The registration unit 23a may also register information indicating the imaging conditions, such as the bus stop at which the disembarking passenger image was captured, the date and time, and the weather, in the memory unit 30b as imaging condition information 32b (see FIG. 5).

In this way, by storing the imaging situation information 32a of the first camera 11a and the imaging situation information 32b of the second camera 11b, for example, if there is no relatively large difference between the first passenger information and the second passenger information, it becomes possible to estimate that the imaging situation, including the current installation position and installation angle of each camera 11a, 11b, the date, time, and weather, is appropriate.

In addition, by storing the history information in the memory unit 30b, it is also possible to check changes in passenger behavior, for example, if a passenger who boarded the vehicle without a mask disembarks wearing a mask.

The calculation unit 25b calculates the number of passengers on the bus 1 based on the passenger information 31b and the like. For example, when first passenger information including face information and attribute information of passengers is newly registered in the passenger information 31b, the calculation unit 25b adds one to the number of passengers, more specifically, increments the boarding and alighting counter 33b.

In addition, when second passenger information including information on disembarking passengers that matches or nearly matches the characteristic point information or attribute information of passengers is registered in passenger information 31b, calculation unit 25b estimates that passengers with such characteristic point information have disembarked from bus 1, and calculates the current number of passengers on bus 1 by subtracting one disembarking passenger from the number of passengers; more specifically, it decrements boarding and alighting counter 33b.

Note that the calculation unit 25b executes the calculation process between when the bus 1 departs from a bus stop and when it arrives at the next bus stop, but the timing of the calculation is not limited to this.

The transmitting unit 26b transmits passenger information including some or all of the passenger information 31b and information on the number of passengers on the bus 1, which is the value of the boarding/alighting counter 33b, to the management server 200.

Note that the transmission unit 26b executes the transmission process from when the bus 1 departs from the bus stop and the calculation process etc. are completed by the calculation unit 25b until the bus 1 arrives at the next bus stop, but the timing of transmission is not limited to this.

<Management server configuration>
Next, the configuration of the management server 200 will be described with reference to Fig. 9. Fig. 9 is a block diagram showing an example of the configuration of the management server 200.

As shown in FIG. 9, the management server 200 includes a communication unit 201, a control unit 210, and a storage unit 220. The communication unit 201 is a communication interface that is connected to the communication network N for two-way communication, and transmits and receives information between the bus terminal device 10, the bus operator terminal device 300, the user terminal device 400, etc.

The control unit 210 includes an acquisition unit 211, a congestion degree calculation unit 212, and a provision unit 213, and includes, for example, a computer having a CPU, ROM, RAM, input/output ports, etc., and various circuits.

The computer's CPU functions as the acquisition unit 211, congestion degree calculation unit 212, and provision unit 213 of the control unit 210, for example, by reading and executing a program stored in the ROM.

In addition, at least some or all of the acquisition unit 211, congestion degree calculation unit 212, and provision unit 213 of the control unit 210 can be configured with hardware such as an ASIC or FPGA.

The memory unit 220 is configured with a storage device such as a non-volatile memory or a data flash. The memory unit 220 stores passenger information 221, bus information 222, various programs, and the like.

Passenger information 221 is information about passengers on bus 1 transmitted from exit terminal device 10b. As described above, passenger information 221 includes some or all of passenger information 31b and information on the number of passengers on bus 1, which is the value of boarding and alighting counter 33b.

Bus information 222 is information about bus 1. Bus information 222 includes, for example, capacity information indicating the capacity of bus 1, but is not limited to this, and may also include other information such as operation plan information for bus 1. Note that bus information 222 is pre-stored in storage unit 220, but is not limited to this, and may be transmitted from an external terminal such as bus operator terminal device 300 and stored in storage unit 220.

The acquisition unit 211 of the control unit 210 acquires the information transmitted from the exit terminal device 10b and stores the acquired information in the memory unit 220 as passenger information 221.

The congestion degree calculation unit 212 calculates the congestion degree of bus 1, more specifically, the current congestion degree of bus 1. The congestion degree is an index value that indicates the degree of congestion on bus 1, and is a value that is indicated on several levels according to, for example, the number of passengers relative to the capacity of bus 1.

For example, the congestion degree calculation unit 212 calculates the current congestion degree of bus 1 based on information on the current number of passengers on bus 1 included in passenger information 221 and capacity information on bus 1 included in bus information 222. The congestion degree calculation unit 212 outputs congestion degree information indicating the calculated congestion degree to the provision unit 213.

The providing unit 213 can provide such congestion degree information to, for example, the user terminal device 400 or the bus operator terminal device 300 via the communication unit 201. The providing unit 213 can also provide passenger information 221 to, for example, the bus operator terminal device 300 via the communication unit 201.

<Control process of information processing system according to embodiment>
Next, a process procedure executed by the information processing system 100 including the bus terminal device 10 according to the embodiment will be described with reference to Fig. 10. Fig. 10 is a diagram showing an example of a process sequence executed by the information processing system 100 including the bus terminal device 10 according to the embodiment.

As shown in FIG. 10, first, the entrance terminal device 10a acquires a passenger image from the first camera 11a (step S10). Next, the entrance terminal device 10a detects passenger information (first passenger information) based on the passenger image (step S11). Next, the entrance terminal device 10a registers the detected passenger information in the storage unit 30a (step S12).

Then, the boarding terminal device 10a outputs the detected passenger information to the exiting terminal device 10b (step S13).

The exit terminal device 10b registers the passenger information output from the entrance terminal device 10a in the storage unit 30b (step S14). Next, the exit terminal device 10b acquires an image of the passenger disembarking from the second camera 11b (step S15). Next, the exit terminal device 10b detects passenger information (second passenger information) based on the image of the passenger disembarking (step S16).

Next, the exit terminal device 10b compares the passenger information (first passenger information) stored in the memory unit 30a with the passenger information (second passenger information) detected based on the image of disembarking passengers (step S17). For example, the exit terminal device 10b compares whether the feature information and attribute information of disembarking passengers in the second passenger information detected based on the image of disembarking passengers matches or substantially matches the feature information and attribute information of passengers in the first passenger information stored in the memory unit 30a.

Next, if the comparison result indicates that the disembarking passenger indicated in the second passenger information is the same as the boarding passenger indicated in the first passenger information, the exit terminal device 10b registers (updates) the second passenger information as passenger information in the memory unit 30b (step S18).

Next, the exit terminal device 10b calculates the number of passengers on the bus 1 based on the passenger information, etc. (step S19). Then, the exit terminal device 10b transmits the passenger information, including some or all of the passenger information and the number of passengers on the bus 1, to the management server 200 (step S20).

The management server 200 calculates the congestion level of the bus 1 based on information such as the number of passengers on the bus 1 (step S21). The management server 200 then provides the congestion level information, passenger information, and the like to the bus operator terminal device 300 and the user terminal device 400 (step S22).

As described above, the bus terminal device 10 (an example of an information processing device) according to the embodiment includes a detection unit 22a (an example of a first detection unit), a detection unit 22b (an example of a second detection unit), and a registration unit 24b (an example of a storage processing unit). The detection unit 22a is configured to detect passenger information (first passenger information) related to passengers of the vehicle based on a passenger image captured by a first camera 11a provided at the boarding entrance 2a of the bus 1. The detection unit 22b is configured to detect passenger information (second passenger information) related to passengers based on an alighting passenger image captured by a second camera 11b provided at the alighting entrance 2b of the bus 1. When passenger information (first and second passenger information) is detected by the detection unit 22a and the detection unit 22b, respectively, the registration unit 24b stores the passenger information (second passenger information) detected based on the image captured by one of the first camera 11a and the second camera 11b (here, the second camera 11b) with more favorable imaging conditions in the storage unit 30b. This allows for an embodiment to improve the accuracy of passenger information.

The second camera 11b is the camera with more favorable imaging conditions. In this way, the second camera 11b, which is installed at the exit 2b and can be installed in a position that makes it easier to capture images of passengers' faces and the like from the front compared to the entrance 2a, is the camera with more favorable imaging conditions. This makes it possible to ensure that the second passenger information detected by the image captured by the second camera 11b is highly accurate.

(Modification)
Next, a bus terminal device 10 according to a modified example will be described. In the above-described embodiment, when the first passenger information and the second passenger information are detected, the second passenger information detected based on the image captured by the second camera 11b is stored in the storage unit 30b. In the modified example, the present invention is not limited to this, and when a predetermined condition is satisfied, the first passenger information is stored in the storage unit 30b instead of the second passenger information.

To be more specific, as described above, the second camera 11b has favorable imaging conditions, and therefore the accuracy of the second passenger information detected based on the image captured by the second camera 11b is likely to be high. However, there may be some change in imaging conditions, including weather, in the second camera 11b, or the passenger may not be imaged from the front due to the passenger's posture. In such cases, the accuracy of the second passenger information may decrease. Therefore, in the modified example, when the accuracy of the second passenger information decreases, the first passenger information is stored in the memory unit 30b, in other words, the second passenger information is prohibited from being registered in the memory unit 30b.

As an example, the registration unit 24b can use the first accuracy and the second accuracy to determine whether or not to register the second passenger information in the storage unit 30b. For example, the registration unit 24b compares the first accuracy, which is the accuracy of the first passenger information, with the second accuracy, which is the accuracy of the second passenger information. Then, when the comparison result between the first accuracy and the second accuracy satisfies a predetermined condition set in advance, the registration unit 24b stores the first passenger information in the storage unit 30b. Note that the predetermined condition can be set arbitrarily, and can be, for example, a condition that the second accuracy is less than the first accuracy.

As a result, for example, if the accuracy of the second passenger information decreases, it is not registered in the memory unit 30b, making it possible to prevent the accuracy of the passenger information in the memory unit 30b from decreasing.

Next, the specific processing procedure in the bus terminal device 10 according to the modified example will be described with reference to FIG. 11. FIG. 11 is a flowchart showing the processing procedure executed by the bus terminal device 10 according to the modified example.

As shown in FIG. 11, the control unit 20a of the bus terminal device 10 (entrance terminal device 10a) calculates a first accuracy indicating the accuracy of the first passenger information detected based on the passenger image captured by the first camera 11a (step S100).

Next, the control unit 20b of the bus terminal device 10 (exit terminal device 10b) calculates a second accuracy indicating the accuracy of the second passenger information detected based on the image of the disembarking passenger captured by the second camera 11b (step S101).

Next, the control unit 20b compares the calculated first accuracy with the calculated second accuracy (step S102). Next, the control unit 20b determines whether the comparison result satisfies the above-mentioned predetermined condition (step S103).

If the control unit 20b determines that the comparison result does not satisfy the predetermined condition (step S103, No), the control unit 20b stores the second passenger information detected based on the image of the disembarking passenger captured by the second camera 11b in the memory unit 30b (step S104).

On the other hand, if the control unit 20b determines that the comparison result satisfies the predetermined condition (step S103, Yes), the control unit 20b stores the first passenger information detected based on the passenger image captured by the first camera 11a in the memory unit 30b (step S105).

In the above description, the second camera 11b is the camera with favorable imaging conditions, but this is not limited to the above. In other words, the first camera 11a may be the camera with favorable imaging conditions.

In addition, in the above, the boarding terminal device 10a, the exit terminal device 10b, and the management server 200 each perform various processes, but the devices on which the various processes are performed are not limited to those described above.

In other words, some or all of the processing performed in the entrance terminal device 10a may be performed in the exit terminal device 10b or the management server 200. Also, some or all of the processing performed in the exit terminal device 10b may be performed in the entrance terminal device 10a or the management server 200. Also, some or all of the processing performed in the management server 200 may be performed in the entrance terminal device 10a or the exit terminal device 10b.

Further advantages and modifications may readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details and representative embodiments shown and described above. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and equivalents thereof.

REFERENCE SIGNS LIST 1 Bus 10 Bus terminal device 10a Entrance terminal device 10b Exit terminal device 11a First camera 11b Second camera 22a Detection unit 22b Detection unit 24b Registration unit 100 Information processing system 200 Management server

Claims (6)

An information processing device including a control unit,
The control unit is
Detecting passenger information related to passengers of the vehicle based on an image captured by a first camera provided at an entrance of the vehicle;
Detecting the passenger information related to the passenger based on an image captured by a second camera installed at an exit of the vehicle;
When the passenger information is detected , the passenger information detected based on an image captured by one of the first camera and the second camera, which has more favorable imaging conditions, is stored in a storage unit .
Information processing device. The control unit is
when updating the passenger information detected based on an image captured by one of the first and second cameras by storing the passenger information detected based on an image captured by the other camera different from the one of the first and second cameras in the storage unit, the passenger information before the update is stored in the storage unit as history information .
The information processing device according to claim 1 . The second camera is the one of the cameras .
3. The information processing device according to claim 1 or 2. The control unit is
Calculating a first accuracy indicating an accuracy of the passenger information detected based on an image captured by the first camera;
Calculating a second accuracy indicating an accuracy of the passenger information detected based on the image captured by the second camera;
comparing the first accuracy with the second accuracy, and if a comparison result satisfies a predetermined condition, storing the passenger information detected based on an image captured by another camera different from the one camera in the storage unit ;
4. The information processing device according to claim 1. An information processing device having a control unit that stores in a memory unit first passenger information based on a first captured image of a passenger taken by a camera installed at the boarding entrance of the vehicle, and second passenger information based on a second captured image of the same passenger taken by a camera installed at the disembarking entrance of the vehicle, whichever is based on the captured image with more favorable imaging conditions. An information processing method performed by an information processing device,
Detecting passenger information related to passengers of the vehicle based on an image captured by a first camera provided at an entrance of the vehicle;
Detecting the passenger information related to the passenger based on an image captured by a second camera installed at an exit of the vehicle;
When the passenger information is detected , the passenger information detected based on an image captured by one of the first camera and the second camera, which has more favorable imaging conditions, is stored in a storage unit .
Information processing methods.

Images