JP7633196B2 - Information processing device, information processing method, and information processing program - Google Patents

Description

This disclosure relates to an information processing device, an information processing method, and an information processing program.

Conventionally, vehicle drivers have sought to improve the security of their vehicles parked in parking lots. The parking lot monitoring system described in Patent Document 1 uses a surveillance camera installed in the parking lot to capture an image of the parking state of a vehicle parked in the parking lot and generate a first image. The parking lot monitoring system also uses an in-vehicle camera mounted on the vehicle to capture an image of the parking state of the vehicle and generate a second image. The parking lot monitoring system monitors the vehicle using the first image and the second image as surveillance images.

JP 2021-118473 A

The parking lot monitoring system described in Patent Document 1 needs to acquire the second image captured by the vehicle-mounted camera as the monitoring image, but not all vehicles are equipped with vehicle-mounted cameras. Therefore, the parking lot monitoring system described in Patent Document 1 may not be able to adequately monitor the parking lot.

In recent years, there have also been systems that allow drivers to reserve parking spaces near their destination. When a parking space is available for reservation, drivers may want to know about the security of the parking space. In such cases, however, it is necessary to take into consideration the privacy of the vehicles parked in the parking space and the users, etc.

The present disclosure provides an information processing device, an information processing method, and an information processing program that can provide users with information about the status of a parking lot.

An information processing device according to one embodiment includes an acquisition unit that acquires image information related to images of parking lots at different times, a reception unit that accepts usage information related to searches and use of parking lots by users, a determination unit that identifies one of the image information acquired by the acquisition unit according to each stage of the user's search, reservation, and use of the parking lot based on the usage information accepted by the reception unit, and a provision unit that provides the image information identified by the determination unit to the user.

According to one aspect, based on usage information regarding the user's search and use of a parking lot, one of the image information items can be identified according to each stage of the user's search, reservation, and use of the parking lot, and the identified image information can be provided to the user.

FIG. 1 is a diagram for explaining an information processing device 1 according to an embodiment. FIG. 1 is a block diagram illustrating an information processing device 1 according to an embodiment. 1 is a flowchart illustrating an information processing method according to an embodiment.

One embodiment is described below.

[Overview of information processing device 1]
First, an overview of an information processing device 1 according to an embodiment will be described.
FIG. 1 is a diagram illustrating an information processing device 1 according to an embodiment.

The information processing device 1 may be configured, for example, as a monitoring device that monitors the parking lot P. The information processing device 1 may also be configured, for example, as a status providing device that provides various statuses in the parking lot P. The information processing device 1 may also be configured, for example, as a search and reservation device that is capable of searching for the parking lot P and performing reservation processing for the use of the parking lot P.
The information processing device may be a computer such as a server, a desktop, a laptop, or a tablet.

The information processing device 1 acquires image information generated by an imaging unit 21 disposed in the parking lot P. The imaging unit 21, for example, captures an image of the parking lot P to generate image information. The imaging unit 21 may, for example, capture images continuously over time or at predetermined timings. This allows the information processing device 1 to acquire image information generated at different times, for example. That is, the information processing device 1 can acquire image information relating to images of the parking lot P at different times, for example.

For example, when the information processing device 1 acquires image information, the information processing device 1 may store the image information in the storage unit 23 (see FIG. 2). In addition, for example, when the information processing device 1 acquires image information, the information processing device 1 may perform a predetermined process on an image based on the image information, and store the processed image (processed image information) in the storage unit 23.

The information processing device 1 may receive usage information related to the search and use of parking lot P from a user 101 (e.g., a user terminal 102, etc.) who wishes to use parking lot P. The usage information may include search information used when the user 101 searches for the parking lot P that he or she wishes to use, and reservation information used when the user 101 reserves the use of parking lot P. The usage information may also include various parking lot usage information related to the use of parking lot P when the user 101 actually uses the parking lot P.

For example, based on the usage information, the information processing device 1 identifies which stage the user 101 is at in terms of using the parking lot P. As an example, the information processing device 1 identifies which stage the user 101 is at based on the usage information from among multiple stages, such as a stage where the user 101 is searching for the parking lot P, a stage where the user 101 has reserved the parking lot P, and a stage where the user 101 is using the parking lot P.

The information processing device 1, for example, identifies image information corresponding to the identified stage as described above. Here, the storage unit 23 of the information processing device 1 may store correspondence information that associates the stage of the user 101's use of the parking lot P with image information corresponding to each stage. Alternatively, the storage unit 23 of the information processing device 1 may store image information that is associated with the stage of the user 101's use of the parking lot P. In other words, the information processing device 1 may be capable of identifying image information corresponding to each stage.

The information processing device 1 provides the image information identified as described above to the user 101 (e.g., the user terminal 102, etc.). That is, the information processing device 1 may provide the user 101 with image information that is identified according to the stage at which the user 101 uses the parking lot P (e.g., different image information for each stage of use, etc.).

[Details of information processing device 1]
Next, the information processing device 1 according to an embodiment will be described in detail.
FIG. 2 is a block diagram for explaining the information processing device 1 according to an embodiment.

The information processing device 1 includes, for example, an imaging unit 21, a communication unit 22, a storage unit 23, a display unit 24, and a control unit 11. The communication unit 22, the storage unit 23, and the display unit 24 may be an embodiment of the output unit. The control unit 11 includes, for example, an acquisition unit 12, a reception unit 13, a specification unit 14, a parking estimation unit 15, a behavior estimation unit 16, and a provision unit 17. The control unit 11 may be configured, for example, by a calculation processing device of the information processing device 1. The control unit 11 (for example, a calculation processing device) may realize the functions of each unit (for example, the acquisition unit 12, the reception unit 13, the specification unit 14, the parking estimation unit 15, the behavior estimation unit 16, and the provision unit 17) by, for example, appropriately reading and executing various programs stored in the storage unit 23, etc.

The imaging unit 21 may be, for example, a camera that captures images of the parking lot and the surroundings of the parking lot.
For example, one or more imaging units 21 are arranged in a parking lot. Here, for example, when multiple imaging units 21 are arranged in one parking lot, each imaging unit 21 may image the parking lot from a different direction or may image the parking lot with different wavelengths. The multiple imaging units 21 that image with different wavelengths may be, for example, an imaging unit 21 capable of imaging with visible light and an imaging unit 21 capable of imaging with wavelengths including infrared light. The imaging unit 21 capable of imaging with infrared light can image the situation of the parking lot even at night, for example.

The imaging unit 21 can capture, for example, still images or moving images. When capturing still images, the imaging unit 21 may capture images at predetermined timings. The predetermined timings may be various timings, such as at predetermined times and when a moving object is detected in the parking lot.
The moving object may be a person, an animal, a vehicle, etc. Here, the imaging unit 21 may, for example, arrange an object detection sensor in a parking lot, and capture an image of the parking lot when the object detection sensor detects an object (for example, a moving object, etc.). This enables the imaging unit 21 to capture an image of, for example, an object (for example, a moving object, etc.).

For example, when the imaging unit 21 captures a still image or a moving image, it generates image information and transmits it to the information processing device 1 (for example, the control unit 11, etc.).
The imaging unit 21 may transmit image information to, for example, a device (external device) (not shown) outside the information processing device 1. The external device may be, for example, a server. In this case, the information processing device 1 may acquire image information from the external device (for example, a server) continuously in time or at a predetermined timing.

The communication unit 22 is, for example, a communication interface capable of transmitting and receiving various information to and from a device (external device) external to the information processing device 1. The external device may be, for example, a server (not shown) and a user terminal 102. The user terminal 102 may be, for example, a terminal used by the user 101, and may be a desktop, a laptop, a tablet, a smartphone, etc.

The storage unit 23 may store, for example, various information and programs. Examples of the storage unit 23 may be a memory, a solid state drive, a hard disk drive, etc. The storage unit 23 may be, for example, a storage area and a server on the cloud.

The display unit 24 is, for example, a display capable of displaying various characters, symbols, images, etc.

The acquisition unit 12 acquires image information.
That is, the acquisition unit 12 acquires, for example, image information related to an image of a parking lot at different times. When acquiring at different times, for example, when a video is captured by the imaging unit 21, the video may be acquired. That is, the imaging unit 21 captures, for example, a video at different times (captures the video continuously in time). Therefore, the acquisition unit 12 can acquire, for example, video (image information) captured at different times (captured continuously in time).
Even when the imaging unit 21 captures still images at a predetermined timing, the multiple still images can be considered as still images captured at different times. Therefore, for example, in the case of still images, the acquisition unit 12 can acquire still images (image information) captured at different times (captured at a predetermined timing) by acquiring the still images at different times in the same manner as in the case of the above-mentioned moving images.
Furthermore, the acquisition unit 12 may, for example, acquire image information at different times, and may be capable of acquiring image information corresponding to each of a plurality of stages regarding the use of the parking lot by the user 101. As one example, the plurality of stages may be various stages, such as a stage in which the user 101 is searching for a parking lot, a stage in which the user 101 has reserved a parking lot, and a stage in which the user 101 is using the parking lot, as described above.

The reception unit 13 receives usage information related to the search and use of parking lots by the user 101. The usage information may include, for example, search information used when the user 101 searches for a parking lot that he or she wishes to use, and reservation information used when the user 101 reserves the use of the parking lot. The usage information may also include, for example, various parking lot usage information related to the use of the parking lot when the user 101 actually uses the parking lot.

The reception unit 13 may receive the usage information from, for example, a terminal (such as a user terminal 102) used by a parking lot user 101. The reception unit 13 may also receive the usage information from, for example, a management system (not shown) that manages devices arranged in the parking lot.
The reception unit 13 may, for example, receive a part of the usage information (for example, search information and reservation information, etc.) from the user terminal 102, or may receive the information from various other devices and terminals, etc., excluding the user terminal 102. The reception unit 13 may, for example, receive a part of the usage information (for example, parking lot usage information, etc.) from the management system, or may receive the information from various other devices and terminals, etc., excluding the management system.

The identification unit 14 identifies one of the image information acquired by the acquisition unit 12 according to each stage of the search, reservation, and use of the parking lot by the user 101 based on the usage information received by the reception unit 13. As an example, when the usage information includes search information, the identification unit 14 identifies it as the stage where the user 101 is searching for a parking lot (search stage). Similarly, as an example, when the usage information includes reservation information, the identification unit 14 identifies it as the stage where the user 101 has reserved the parking lot (reservation stage). Similarly, as an example, when the usage information includes parking lot usage information, the identification unit 14 identifies it as the stage where the user 101 is using the parking lot (usage stage).

For example, when the identification unit 14 identifies the search stage as described above, it may identify the first image information from among the image information generated by the imaging unit 21 arranged in the parking lot being searched. The first image information may be, for example, image information related to at least one of an image in which a vehicle using the parking lot and a user 101 are not captured, and an image in which a vehicle using the parking lot or a user 101 is captured but which has been subjected to privacy-conscious processing. The privacy-conscious processing may be, for example, a processing in which the user 101 is masked (masking processing) so that the individual user cannot be identified. Similarly, the privacy-conscious processing may be, for example, a processing in which the license plate (vehicle registration number plate) of the vehicle is masked (masking processing) so that the individual vehicles cannot be identified. The masking processing may be, for example, various processing such as a processing of adding blur, a processing of adding fill, and a processing of erasing from the image.
That is, for example, at the stage of searching for a parking lot by user 101, the identification unit 14 may identify image information (first image information) corresponding to at least one image selected from a group of images of parking lots in which no vehicle is recorded and images of parking lots in which the vehicle has been masked.
The first image information may be stored in the storage unit 23, for example, when an image that does not include a vehicle using the parking lot and the user 101 is acquired, or after the image has been subjected to the above-mentioned example of privacy-conscious processing in advance. In this case, the storage unit 23 may store the first image information in association with the parking lot from which the image based on the first image information is acquired.

For example, when the usage information received by the receiving unit 13 includes time information related to the planned time of use for using the parking lot, the identifying unit 14 may identify image information (first image information) such as the following. The identified image information may be, for example, at the stage of search and reservation by the user 101, image information corresponding to at least one image selected from a group of images based on the image information acquired by the acquiring unit 12. The images constituting the group may be, for example, images captured at a time corresponding to the planned time of use recorded in the time information, and images captured on a day of the week corresponding to the planned time of use.
That is, for example, when a user 101 searches for parking information by specifying the planned date and time of use (including concepts such as time of day and day of the week), the identification unit 14 identifies the first image information based on a past image taken during the time period or day of the week corresponding to the planned date and time of use.

As a specific example, when the date and time when the user 101 plans to use the parking lot is 10:00 a.m., the identification unit 14 may identify the first image information based on an image captured at a time relatively close to 10:00 a.m. or a time period including 10:00 a.m., among the image information based on images captured in advance in the parking lot. The relatively close time may be, for example, the time closest to 10:00 a.m., or may be another time considered to be close to 10:00 a.m. For example, the time closest to 10:00 a.m. is 9:50 a.m. when there are images captured at 9:20, 9:50, and 10:20 a.m. The time period may be, for example, a time period such as morning, afternoon, or night, or a time period for each predetermined time period (for example, 1 hour, 2 hours, 3 hours, 5 hours, 6 hours, and 8 hours).
As another specific example, when the date and time that user 101 plans to use the parking lot is Monday, the identification unit 14 may identify the first image information based on an image captured on Monday from among the image information based on images previously captured in the parking lot.
Furthermore, for example, when identifying the first image information as in the example described above, the identification unit 14 may identify image information (first image information) based on an image captured at the most recent time.

In addition, when the identification unit 14 identifies the reservation stage, for example as described above, the identification unit 14 may identify the second image information from the image information generated by the imaging unit 21 located in the reserved parking lot.
The second image information may be, for example, similar to the above-mentioned first image information, image information relating to at least one of an image that does not show a vehicle using the parking lot and a user 101, and an image that shows a vehicle using the parking lot or a user 101 but has been processed to protect privacy. That is, the identification unit 14 may identify image information (second image information) corresponding to at least one image selected from a group of images of parking lots in which no vehicle is recorded and images of parking lots in which a vehicle has been masked, for example, at the stage of reserving the parking lot by the user 101.

In addition, similar to the identification of the first image information described above, for example, when the usage information received by the reception unit 13 includes time information related to the planned time of use for using the parking lot, the identification unit 14 may identify image information (second image information) as follows. For example, at the stage of reservation by the user 101, the identified image information may be image information corresponding to at least one image selected from a group of images based on the image information acquired by the acquisition unit 12. The images constituting the group may be, for example, images captured at a time corresponding to the planned time of use recorded in the time information, and images captured on a day of the week corresponding to the planned time of use.

For example, when a reservation for use of a parking lot is made based on the usage information received by the reception unit 13, the identification unit 14 may identify image information (second image information) corresponding to the most recent image in terms of time among images based on the image information acquired by the acquisition unit 12 on the day of planned use based on the time information.
That is, for example, on the day when the user 101 completes the reservation of the parking lot (the reservation is established) and uses the parking lot, the identification unit 14 may identify image information (second image information) based on the most recent image among images taken in the parking lot. Alternatively, the identification unit 14 may identify the latest image information (e.g., image information updated every predetermined time) for every predetermined time (e.g., 5 minutes, 10 minutes, 15 minutes, 20 minutes, 30 minutes, and 1 hour).
In this case, the identifying unit 14 may identify image information (second image information) based on the most recent image, for example, prior to the start time of the date and time when the usage reservation is made.

For example, when the parking position used by the user 101 is a charging position where an electric vehicle can be charged, the identification unit 14 may identify image information (second image information) corresponding to an image including the reserved charging position among images based on image information acquired by the acquisition unit 12. That is, for example, when there is a charging position in the parking lot where an electric vehicle can be charged and the user 101 reserves the charging position, the identification unit 14 may identify second image information of an image generated by the imaging unit 21 capable of capturing an image of the charging position. In this case, for example, when the usage information (reservation information) includes information regarding the reservation of the charging position, the identification unit 14 may identify second image information related to the charging position. In addition, the identification unit 14 may identify second image information related to the charging position based on correspondence information that is previously associated with the charging position and image information generated by the imaging unit 21 capable of capturing an image of the charging position. The correspondence information may be stored, for example, in the storage unit 23.

In addition, when the identification unit 14 identifies the usage stage, for example as described above, the identification unit 14 may identify the third image information from the image information generated by the imaging unit 21 arranged in the parking lot being used.
The identification unit 14 may, for example, based on the usage information received by the reception unit 13, identify image information (third image information) that corresponds to the most recent image in terms of time, which is an image including the parking position of the vehicle in the parking lot, among images based on the image information acquired by the acquisition unit 12 during the use of the parking lot. That is, for example, when the parking lot usage information includes information regarding the parking position (the position where the vehicle is parked) used by the user 101, the identification unit 14 may identify the third image information of the image generated by the imaging unit 21 capable of imaging the parking position. In addition, the identification unit 14 may, for example, identify the third image information related to each parking position in the parking lot based on correspondence information that is previously associated with each parking position in the parking lot and the image information generated by the imaging unit 21 capable of imaging the parking position. The correspondence information may be stored in the storage unit 23, for example.

For example, when the time information includes a planned time of exit from the parking lot, the identification unit 14 may identify image information corresponding to an image including an exit from the parking lot among images based on image information acquired by the acquisition unit 12 after a predetermined time before the planned exit time. That is, when the usage information (at least one of the reservation information and the parking lot usage information) includes information regarding a planned time of exit from the parking lot, the identification unit 14 may identify third image information of an image generated by the imaging unit 21 capable of capturing an image of the parking lot exit after a predetermined time before the planned exit time. In this case, the identification unit 14 may identify the third image information related to the exit of the parking lot based on correspondence information that is previously associated with the exit of the parking lot and the image information generated by the imaging unit 21 capable of capturing the image of the exit. The correspondence information may be stored in the storage unit 23, for example. The predetermined time may be, for example, a time before the expected exit (for example, a time period, etc.) based on the planned exit time registered when making a reservation and when starting to use the parking lot. As a specific example, the predetermined time may be various times registered in advance, such as 10 minutes, 15 minutes, 20 minutes, 30 minutes, and 45 minutes. That is, for example, when the planned exit time is 11:00, the identification unit 14 may identify the third image information related to the parking lot exit from 20 minutes before the planned exit time (after 10:40), which is an example of the predetermined time.

The predetermined time may be set according to the time from the start time to the end time (exit time) when the reservation is made (planned parking time zone). As an example, if the planned parking time zone is relatively long, the predetermined time may be relatively long. Similarly, as an example, if the planned parking time zone is relatively short, the predetermined time may be relatively short.
As a more specific example, if the start time of using the parking lot is 8:00 and the end time is 9:00 (if the parking time period is one hour), the predetermined time may be relatively short, that is, 15 minutes. That is, in this case, the identification unit 14 may identify the third image information related to the exit of the parking lot after 8:45.
Similarly, as a more specific example, if the start time of using the parking lot is 8:00 and the end time is 11:00 (if the parking time period is 3 hours), the predetermined time may be relatively long and set to 45 minutes. That is, in this case, the identification unit 14 may identify the third image information related to the exit of the parking lot after 10:15.

For example, when the parking lot used by the user 101 is a parking lot where entry and exit are free during the specified time of the reservation, the identification unit 14 may identify image information (third image information) corresponding to an image including the reserved parking position among images based on image information acquired by the acquisition unit 12. That is, for example, when the parking lot is a parking lot where entry and exit are free during the reserved time period (within the specified time period from the start time to the end time), the identification unit 14 may identify the third image information of an image generated by the imaging unit 21 capable of imaging the reserved parking position during that time period (within the specified time). In this case, the identification unit 14 may identify, for example, the reserved time period and the parking position based on the usage information (for example, reservation information and parking lot usage information, etc.). Also, the identification unit 14 may identify the third image information related to each parking position in the parking lot based on the correspondence information that is previously associated with each parking position in the parking lot and the image information generated by the imaging unit 21 capable of imaging the parking position, as in the above-mentioned case.

For example, when the parking lot is in use, the identification unit 14 may identify image information (third image information) of an image in which the above-mentioned privacy-conscious processing has been applied to other vehicles other than the user's own vehicle and the user 101. The privacy-conscious processing may be the same processing as that used when identifying the above-mentioned first image information. That is, for example, when the user 101 is using the parking lot, the identification unit 14 may identify image information corresponding to an image of the parking lot in which the parking position of the user's own vehicle in the parking lot has been masked for other vehicles.
As an example of this case, the identification unit 14 may, for example, when using a parking lot, identify third image information of an image generated by the imaging unit 21 capable of imaging the parking position of the vehicle, and may also include a configuration in which other vehicles other than the vehicle itself and the user 101 in the image are subjected to the above-mentioned privacy-conscious processing.
The identification unit 14 may identify the parking position of the vehicle based on the usage information (e.g., reservation information and parking lot usage information, etc.) in the same manner as described above. In addition, the identification unit 14 may estimate that other vehicles are parked at positions other than the parking position of the vehicle.
The control unit 11 of the identification unit 14 or the like may be configured to be able to identify the parking position in the image in advance by using, for example, a publicly known technology, and may also be able to perform object recognition, person recognition, and the like. That is, the control unit 11 of the identification unit 14 or the like may be configured to identify an image (image information) of the parking position of the vehicle based on, for example, the usage information, and to recognize the vehicle, other vehicles, the user 101, and the like in the image. The control unit 11 of the identification unit 14 or the like may generate an image of the vehicle that takes privacy into consideration based on, for example, the result of the recognition. That is, the identification unit 14 may identify image information (third image information) related to the image of the vehicle that takes privacy into consideration.

In addition, the identification unit 14 may temporarily suspend the provision of image information to the user 101 of the vehicle, for example, when another vehicle and the user 101 are captured by the imaging unit 21.

The parking estimation unit 15 may estimate whether the electric vehicle that is the other vehicle is charging, for example, based on image information. That is, the parking estimation unit 15 may estimate whether a vehicle is parked at the charging position, based on image information acquired by the acquisition unit 12. The parking estimation unit 15 may estimate whether a vehicle (here, another vehicle, etc.) is parked at the charging position, for example, during a time other than the time period (from the start time to the end time) reserved by the user 101, for example, a time before that time period. In this case, the parking estimation unit 15 may estimate a vehicle (another vehicle, etc.) by identifying an image (image information) of the charging position using, for example, the above-mentioned correspondence information, and performing object recognition, etc. on the image.

When the user 101 uses the parking lot, the behavior estimation unit 16 may estimate whether there is a person behaving suspiciously in the parking lot based on a learned model that has previously learned suspicious behavior by people and the image information acquired by the acquisition unit 12. That is, the behavior estimation unit 16 may use the learned model to estimate whether a person behaving suspiciously (suspicious person) is recorded in the image information. In this case, the behavior estimation unit 16 may estimate a suspicious person by using, for example, image information acquired in real time and the most recent image information.

Here, the trained model described above may be, for example, a model that is generated by learning in advance non-suspicious behavior (normal behavior) of a person. In this case, the behavior estimation unit 16 may use the trained model to estimate whether a person not behaving normally, in other words, a suspicious person, has been recorded in the image information.

The providing unit 17 provides the image information identified by the identifying unit 14 to the user 101. That is, the providing unit 17 may provide the first to third image information identified as described above to the user 101, for example, via an output unit. Here, the output unit may be, for example, the communication unit 22, the storage unit 23, the display unit 24, etc.
That is, the providing unit 17 may transmit the first to third image information to the user terminal 102 used by the user 101, for example, via the communication unit 22. Alternatively, the providing unit 17 may transmit the first to third image information to a server (not shown), for example, via the communication unit 22.
The providing unit 17 may store the first to third image information in the storage unit 23, for example.
The providing unit 17 may, for example, display an image based on each of the first to third image information on the display unit 24 .
In this case, when the user terminal 102 accesses the storage unit 23 or the above-mentioned server, the information processing device 1 or the server may transmit the first to third image information to the user terminal 102. Alternatively, when the user terminal 102 accesses the information processing device 1, images based on the first to third image information, respectively, may be displayed on the display unit 24.

The providing unit 17 may provide charging information related to the result of estimation by the parking estimation unit 15. That is, the providing unit 17 may provide the charging information to the user 101 (e.g., the user terminal 102, etc.) via the output unit, for example, in the same manner as in the case of providing the image information described above. The charging information may be at least one estimation result by the parking estimation unit 15 selected from a group including a vehicle (other vehicle) parked at the charging position, a vehicle (other vehicle) not parked at the charging position, and an image (image information) of the charging position.

When the behavior estimation unit 16 estimates that there is a suspicious person, the providing unit 17 may provide suspicious person information regarding the presence of a suspicious person. In this case, when the providing unit 17 estimates that there is a suspicious person in the parking lot, for example, the providing unit 17 may immediately provide the suspicious person information via the output unit to at least one selected from a group of a user 101 currently using the parking lot, a user who plans to use the parking lot, a management company that manages the parking lot, a security company that guards the parking lot, and the police within the jurisdiction of the parking lot. The suspicious person information may be, for example, at least one estimation result by the behavior estimation unit 16 selected from a group of a suspicious person being present in the parking lot, an image (image information) of the parking lot, an image (image information) in which the suspicious person is recorded, and the like. For example, as a method of providing the estimation result by the behavior estimation unit 16, the providing unit 17 may perform at least one selected from a group of transmission using the communication unit 22, storage in the storage unit 23, and display on the display unit 24, as in the case of providing the image information described above.

The providing unit 17 may, for example, limit at least one of the time and the number of times image information is provided to the user 101. That is, when the user 101 uses the parking lot, the providing unit 17 may limit the time of providing image information to the user terminal 102 used by the user 101 to a predetermined time (upper limit time), or may limit the number of times the information is provided to a predetermined number (upper limit time). The providing time may be set, for example, when the image information is a video or the like. The providing time and the number of times the information is provided may be set, for example, according to. That is, the providing time and the number of times the information is provided may be set relatively longer as the parking lot usage time becomes relatively longer. Also, the providing time and the number of times the information is provided may be set relatively shorter as the parking lot usage time becomes relatively shorter. The parking lot usage time may, for example, be recorded in the usage information. That is, the usage information may include, for example, information on the time of entry into the parking lot (scheduled time of entry) and the time of exit from the parking lot (scheduled time of exit).

In addition, the information processing device 1 (e.g., the control unit 11, etc.) may control the information processing device 1 (e.g., the control unit 11, etc.) to provide image information to the user 101 (user terminal 102) when the reception unit 13 receives information that identifies the user 101, such as, for example, identification information when subscribing to a non-life insurance service, from the user terminal 102, etc.

[Information processing method]
Next, an information processing method according to an embodiment will be described.
FIG. 3 is a flowchart illustrating an information processing method according to an embodiment.

In step ST101, the acquisition unit 12 acquires image information related to images of the parking lot at different times. The acquisition unit 12 may acquire image information from an imaging unit 21 arranged in each parking lot, or may acquire image information generated by the imaging unit 21 via a server (not shown). For example, one or more imaging units 21 may be arranged in the parking lot.
The acquisition unit 12 may acquire image information so as to identify each imaging unit 21 (each image information) or an imaging range of the parking lot imaged by each imaging unit 21. In this case, the acquisition unit 12 may acquire image information in which identification information for identifying each imaging unit 21 is recorded, and may identify which parking lot (which area of the parking lot) is imaged by the acquired image information based on correspondence information that associates the identification information with the parking lot (imaging range of the parking lot).

In step ST102, the reception unit 13 receives usage information regarding the search, reservation, and use of a parking lot by the user 101.

In step ST103, the identification unit 14 identifies one of the image information acquired in step ST101 according to each stage of the user 101's parking lot search, reservation, and use based on the usage information received in step ST103.

For example, at the stage when the user 101 searches for a parking lot, the identification unit 14 may identify image information (first image information) corresponding to at least one image selected from a group of images of parking lots in which no vehicle is recorded and images of parking lots in which the vehicle has been masked.

For example, when the usage information received in step ST102 includes time information related to the planned time of use for the parking lot, the identification unit 14 may identify image information (first image information) such as the following. The identified image information may be, for example, at the stage of search and reservation by the user 101, image information corresponding to at least one image selected from a group of images based on the image information acquired in step ST101. The images constituting the group may be, for example, images captured at a time corresponding to the planned time of use recorded in the time information, and images captured on a day of the week corresponding to the planned time of use.

When the identification unit 14 identifies the reservation stage as described above, for example, it may identify the second image information from among the image information generated by the imaging unit 21 disposed in the reserved parking lot. That is, for example, at the stage of reserving the parking lot by the user 101, the identification unit 14 may identify image information (second image information) corresponding to at least one image selected from a group of images of the parking lot in which no vehicle is recorded and images of the parking lot in which the vehicle has been masked.

For example, when the usage information received in step ST102 includes time information related to the scheduled usage time, the identification unit 14 may identify image information (second image information) such as the following. The identified image information may be, for example, at the stage of reservation by the user 101, image information corresponding to at least one image selected from a group of images based on the image information acquired in step ST101. The images constituting the group may be, for example, images captured at a time corresponding to the scheduled usage time recorded in the time information, and images captured on a day of the week corresponding to the scheduled usage time.

For example, when a reservation for use of the parking lot is made based on the usage information received in step ST102, on the day of planned use based on the time information, the identification unit 14 may identify image information (second image information) corresponding to the most recent image in terms of time among the images based on the image information acquired in step ST101.

For example, when the parking position used by the user 101 is a charging position where an electric vehicle can be charged, the identification unit 14 may identify image information (second image information) corresponding to an image including the reserved charging position from among images based on the image information acquired in step ST101.

For example, based on the usage information received in step ST102, the identification unit 14 may identify image information (third image information) that corresponds to the most recent image in terms of time, among images based on the image information acquired in step ST101, during the stage when the parking lot is being used, which includes the parking position of the vehicle in the parking lot.

For example, when the time information includes a planned exit time for leaving the parking lot, the identification unit 14 may identify image information corresponding to an image including the exit of the parking lot from among images based on the image information acquired in step ST101, at or after a predetermined time before the planned exit time.

For example, when the parking lot used by the user 101 is a parking lot where entry and exit are free within the specified time period reserved for use, the identification unit 14 may identify image information (third image information) corresponding to an image including the reserved parking location from among the images based on the image information acquired in step ST101.

For example, when the user 101 uses a parking lot, the identification unit 14 may identify image information corresponding to an image of the parking lot in which other vehicles have been masked, including the parking position of the user's vehicle in the parking lot.

In step ST104, the parking estimation unit 15 may estimate whether a vehicle is parked at the charging position based on the image information acquired in step ST101.

In step ST105, when the user 101 uses the parking lot, the behavior estimation unit 16 may estimate whether there is a person behaving suspiciously in the parking lot based on a learned model that has previously learned suspicious behavior by people and the image information acquired in step ST101.

In step ST106, the providing unit 17 provides various information to, for example, the user 101 (for example, the user terminal 102) etc. That is, the providing unit 17 may provide, for example, the image information identified in step ST103 to the user 101. The providing unit 17 may provide, for example, charging information related to the result of the estimation in step ST104. For example, when the providing unit 17 estimates that a suspicious person is present in step ST105, it may provide suspicious person information related to the presence of a suspicious person.

Each unit of the information processing device 1 described above may be realized as a function of a computer's arithmetic processing device, etc. That is, the acquisition unit 12, the reception unit 13, the identification unit 14, the parking estimation unit 15, the behavior estimation unit 16, and the provision unit 17 (control unit 11) of the information processing device 1 may be realized as an acquisition function, a reception function, an identification function, a parking estimation function, a behavior estimation function, and a provision function (control function) by a computer's arithmetic processing device, etc.
The information processing program can cause a computer to realize each of the above-mentioned functions. The information processing program may be recorded in a non-transitory computer-readable recording medium, such as a memory, a solid-state drive, a hard disk drive, or an optical disk.
As described above, each unit of the information processing device 1 may be realized by a computer arithmetic processing device or the like. The arithmetic processing device or the like is configured by, for example, an integrated circuit or the like. Therefore, each unit of the information processing device 1 may be realized as a circuit constituting the arithmetic processing device or the like. That is, the acquisition unit 12, the reception unit 13, the identification unit 14, the parking estimation unit 15, the behavior estimation unit 16, and the provision unit 17 (control unit 11) of the information processing device 1 may be realized as an acquisition circuit, a reception circuit, an identification circuit, a parking estimation circuit, a behavior estimation circuit, and a provision circuit (control circuit) constituting the arithmetic processing device or the like of a computer.
The imaging unit 21, the communication unit 22, the storage unit 23, and the display unit 24 (output unit) of the information processing device 1 may be realized as an imaging function including the functions of an arithmetic processing device, a communication function, a storage function, and a display function (output function). The imaging unit 21, the communication unit 22, the storage unit 23, and the display unit 24 (output unit) of the information processing device 1 may be realized as an imaging circuit, a communication circuit, a storage circuit, and a display circuit (output circuit) by being configured by, for example, an integrated circuit. The imaging unit 21, the communication unit 22, the storage unit 23, and the display unit 24 (output unit) of the information processing device 1 may be realized as an imaging device, a communication device, a storage device, and a display device (output device) by being configured by, for example, a plurality of devices.

The information processing device 1 can include one or any combination of the above-mentioned multiple units.
In this disclosure, the term "information" is used, but the term "information" can be replaced with "data" and the term "data" can be replaced with "information."

[Aspects and Effects of the Present Embodiment]
Next, one aspect of this embodiment and the effects of each aspect will be described. Note that this embodiment is not limited to each aspect described below, and may be realized by appropriately combining each of the above-mentioned parts. Also, the effects described below are examples, and the effects of each aspect are not limited to those described below. Also, each aspect may, for example, achieve at least one of the effects described below.

(Aspect 1)
One embodiment of an information processing device includes an acquisition unit that acquires image information regarding images of parking lots at different times, a reception unit that accepts usage information regarding users' searches and use of parking lots, an identification unit that identifies one of the image information acquired by the acquisition unit according to each stage of the user's search, reservation, and use of the parking lot based on the usage information accepted by the reception unit, and a provision unit that provides the image information identified by the identification unit to the user.
The information processing device specifies image information according to a time axis of multiple stages from searching for a parking lot to using the parking lot. Therefore, since the information processing device uses image information generated by an imaging unit or the like disposed in the parking lot, the situation of the parking lot can be reliably provided to the user.
In addition, the information processing device can provide the status of the parking lot to the user even if the user can reserve the parking lot before using the parking lot. In this case, the information processing device selects (specifies) image information according to each stage of the user's search, reservation, and use of the parking lot, so that the privacy of the vehicle and the user using the parking lot can be taken into consideration.
Furthermore, since the information processing device can provide the user with the status of the parking lot, the user can use the parking lot with peace of mind, and an increase in the utilization rate of the parking lot can be expected.
In addition, the imaging unit that generates the image information can use, for example, a surveillance camera that is installed in advance in a parking lot. Therefore, the information processing device can use, for example, existing facilities, and can provide image information to users at a relatively low cost.

(Aspect 2)
In one embodiment of an information processing device, when the usage information received by the reception unit includes time information related to the planned time of use for using the parking lot, at the stage of search and reservation by the user, the identification unit may identify image information corresponding to at least one image selected from a group of images based on the image information acquired by the acquisition unit that were taken at a time corresponding to the planned time of use recorded in the time information and images taken on the day of the week corresponding to the planned time of use.
Depending on the parking lot, various conditions within the lot, including congestion, may change depending on the date and time. This allows the information processing device to provide the user with the status of the parking lot according to the date and time that the user plans to use the parking lot.

(Aspect 3)
In one embodiment of an information processing device, when a reservation for use of a parking lot is made based on the usage information received by the reception unit, the identification unit may identify image information that corresponds to the most recent image in terms of time among images based on the image information acquired by the acquisition unit on the day of planned use based on the time information.
This allows the information processing device to provide the user with the latest parking lot situation on the day the user plans to use the parking lot. That is, the information processing device can allow the user to grasp, for example, the current parking lot situation.

(Aspect 4)
In one embodiment of the information processing device, when the time information includes the planned exit time for leaving a parking lot, the identification unit may identify image information corresponding to an image including the exit of the parking lot among images based on the image information acquired by the acquisition unit, after a predetermined time before the planned exit time.
As a result, the information processing device can provide the user with the exit status near the time when the user is scheduled to leave the parking lot, thereby enabling the user to smoothly leave the parking lot. In other words, the information processing device provides the user with image information so that the user can take measures such as speeding up or delaying the exit depending on the congestion status of the exit, thereby improving user convenience.

(Aspect 5)
In one embodiment of the information processing device, the identification unit may, based on the usage information received by the reception unit, identify image information that corresponds to the most recent image in terms of time among images based on image information acquired by the acquisition unit during the stage when the parking lot is being used, which includes the parking position of the vehicle in the parking lot.
This allows the information processing device to provide the user with the status of the vehicle while parked, thereby providing the user with a sense of security so that the user can leave the vehicle without worry. Also, the information processing device can provide the user with the status of the vehicle parked in the parking lot (vehicle information recorded for the vehicle) in real time, for example, while the parking lot is in use. In other words, if the user is concerned about the status of the vehicle, the user can view an image of the current status of the vehicle by accessing the information processing device using a user terminal and viewing image information, or by receiving image information from the information processing device.

(Aspect 6)
In one embodiment of an information processing device, when the parking lot used by the user is a parking lot where entry and exit are free within the specified time period for which usage is reserved, the identification unit may identify image information corresponding to an image including the reserved parking location from among images based on the image information acquired by the acquisition unit.
This allows the information processing device to provide information (image information) that enables a user to determine whether or not he or she can easily re-enter a parking lot even after having once exited the parking lot.

(Aspect 7)
In one embodiment of the information processing device, the identification unit may, at the stage of a user searching for and reserving a parking space, identify image information corresponding to at least one image selected from a group of images of parking spaces in which no vehicle has been recorded and images of parking spaces in which the vehicle has been masked.
This allows the information processing device to provide users with image information that takes privacy into consideration, thereby reducing the possibility that the privacy of users who use the parking lot will be revealed to others. In other words, users can use the parking lot without worrying about their privacy.

(Aspect 8)
In one embodiment of the information processing device, when a user uses a parking lot, the identification unit may identify image information corresponding to an image of the parking lot in which other vehicles have been masked, and which includes the parking position of the user's vehicle in the parking lot.
This allows the information processing device to provide users with image information that takes privacy into consideration, thereby reducing the possibility that the privacy of users using the parking lot will be revealed to others. In other words, users can use the parking lot without worrying about their privacy.

(Aspect 9)
In one embodiment of the information processing device, when the parking position used by the user is a charging position where an electric vehicle can be charged, the identification unit may identify image information corresponding to an image that includes the reserved charging position from among images based on the image information acquired by the acquisition unit.
As a result, for example, when a user desires to immediately use a charging position, the information processing device can provide the user with information about the usage status of the charging position, thereby improving convenience for the user.

(Aspect 10)
An information processing device of one embodiment may include a parking estimation unit that estimates whether a vehicle is parked at a charging position based on image information acquired by the acquisition unit, and the providing unit may provide charging information regarding the result of the estimation by the parking estimation unit.
As a result, for example, when a user desires to immediately use a charging position, the information processing device can provide the user with information on the usage status of the charging position, thereby improving convenience for the user.

(Aspect 11)
An information processing device of one embodiment, when a user uses a parking lot, is equipped with a behavior estimation unit that estimates whether there is a person behaving suspiciously in the parking lot based on a learned model that has previously learned suspicious behavior by people and image information acquired by the acquisition unit, and when the behavior estimation unit estimates that there is a suspicious person, the providing unit may provide suspicious person information regarding the presence of a suspicious person.
This allows the information processing device to estimate suspicious people in the parking lot, so that users can use the parking lot with peace of mind.

(Aspect 12)
In one aspect of the information processing method, a computer executes an acquisition step in which image information regarding images of parking lots is acquired at different times, a reception step in which usage information regarding searches and use of parking lots by users is accepted, a determination step in which one of the image information acquired by the acquisition step is identified according to each stage of the user's search, reservation and use of the parking lot based on the usage information accepted by the reception step, and a provision step in which the image information identified by the determination step is provided to the user.
As a result, the information processing method can achieve the same effects as the information processing device according to the above-described aspect.

(Aspect 13)
One embodiment of an information processing program enables a computer to implement an acquisition function that acquires image information regarding images of parking lots at different times, a reception function that accepts usage information regarding users' searches and use of parking lots, a determination function that identifies one of the image information acquired by the acquisition function according to each stage of the user's search, reservation, and use of the parking lot based on the usage information accepted by the reception function, and a provision function that provides the image information identified by the determination function to the user.
As a result, the information processing program can achieve the same effects as the information processing device according to the above-described aspect.

REFERENCE SIGNS LIST 1 Information processing device 11 Control unit 12 Acquisition unit 13 Reception unit 14 Identification unit 15 Parking estimation unit 16 Behavior estimation unit 17 Provision unit 21 Imaging unit 22 Communication unit 23 Storage unit 24 Display unit 101 User 102 User terminal P Parking lot

Claims (13)

An acquisition unit that acquires image information relating to an image of the parking lot at different times;
A reception unit that receives information regarding a user's search for and use of a parking lot;
a determination unit that determines one of the pieces of image information acquired by the acquisition unit according to each stage of a user's search, reservation, and use of a parking lot based on the usage information received by the reception unit;
a providing unit that provides a user with the image information identified by the identifying unit;
An information processing device comprising: The information processing device of claim 1, wherein, when the usage information received by the reception unit includes time information regarding the planned time of use for using the parking lot, at the stage of search and reservation by the user, the identification unit identifies image information corresponding to at least one image selected from a group of images based on the image information acquired by the acquisition unit that were taken at a time corresponding to the planned time of use recorded in the time information and images that were taken on a day of the week corresponding to the planned time of use. The information processing device of claim 2, wherein when a reservation for use of a parking lot is made based on the usage information accepted by the acceptance unit, the identification unit identifies image information corresponding to the most recent image in terms of time among images based on the image information acquired by the acquisition unit on the day of planned use based on the time information. The information processing device of claim 2 or 3, wherein when the time information includes a planned exit time for leaving a parking lot, the identification unit identifies image information corresponding to an image including an exit of the parking lot among images based on the image information acquired by the acquisition unit, after a predetermined time before or after the planned exit time. The information processing device of any one of claims 1 to 4, wherein the identification unit, based on the usage information received by the reception unit, identifies image information corresponding to the most recent image in terms of time among images based on image information acquired by the acquisition unit during a stage in which the parking lot is being used, the image including the parking position of the vehicle in the parking lot. An information processing device as described in any one of claims 1 to 5, wherein the identification unit, when the parking lot used by the user is a parking lot where entry and exit are free within the specified time period for which use is reserved, identifies image information corresponding to an image including the reserved parking location among images based on the image information acquired by the acquisition unit. The information processing device described in any one of claims 1 to 6, wherein the identification unit, at the stage of searching for and reserving a parking space by a user, identifies image information corresponding to at least one image selected from a group of images of parking spaces where no vehicle is recorded and images of parking spaces where the vehicle has been masked. The information processing device according to any one of claims 1 to 7, wherein the identification unit, when a user uses a parking lot, identifies image information corresponding to an image of the parking lot in which other vehicles have been masked and which includes the parking position of the user's vehicle in the parking lot. The information processing device according to any one of claims 1 to 8, wherein the identification unit, when a parking position used by a user is a charging position where an electric vehicle can be charged, identifies image information corresponding to an image including the reserved charging position among images based on image information acquired by the acquisition unit. a parking estimation unit that estimates whether a vehicle is parked at a charging position based on the image information acquired by the acquisition unit,
The information processing device according to claim 9 , wherein the providing unit provides charging information related to a result of the estimation by the parking estimation unit. The system further includes a behavior estimation unit that, at the stage when a user uses the parking lot, estimates whether a person is behaving suspiciously in the parking lot based on a trained model that has previously trained suspicious behavior of a person and image information acquired by the acquisition unit;
The information processing device according to claim 1 , wherein the providing unit provides suspicious person information regarding the presence of a suspicious person when the behavior estimating unit estimates that a suspicious person is present. The computer
An acquisition step of acquiring image information relating to an image of a parking lot at different times;
A receiving step of receiving information regarding a user's search for and use of a parking lot;
a step of identifying one of the pieces of image information acquired in the acquisition step according to each stage of a user's search, reservation, and use of a parking lot based on the usage information received in the reception step;
a providing step of providing the image information identified by the identifying step to a user;
An information processing method for performing the above. On the computer,
An acquisition function for acquiring image information relating to images of the parking lot at different times;
A reception function for receiving information regarding a user's search for and use of a parking lot;
a determining function for determining which of the image information acquired by the acquiring function is selected according to each step of a user's search, reservation, and use of a parking lot based on the usage information received by the receiving function;
a providing function for providing a user with the image information specified by the specifying function;
An information processing program that realizes this.

Images