JP7819481B2 - Information processing device, information processing method, information processing program, and information processing system - Google Patents

Description

This disclosure relates to an information processing device, an information processing method, an information processing program, and an information processing system.

In recent years, with the spread of cloud computing (cloud services), various services can now be accessed via networks. Cloud services are provided in a variety of ways, including SaaS (Software as a Service) and PaaS (Platform as a Service).

Patent Document 1 discloses an information processing system that includes an external service setting information storage means that stores settings for using external services in association with users; a destination setting information storage means that stores destination setting information in which external services are set as data destinations in association with users; an identification means that identifies one or more users; and a transmission means that transmits data to a different external service destination for each of the one or more users based on the destination setting information associated with each of the identified one or more users. This reduces the effort required to select an external service as a destination when transmitting data related to an image to be displayed, even though the settings for use are required for each user.

Japanese Patent Application Laid-Open No. 2019-134399

The present invention aims to provide an information processing device, information processing method, information processing program, and information processing system that can properly delete and save data.

The information processing device according to claim 1 of the present invention comprises a setting means for setting an image transmitted from a photographing device and stored in a storage means as an image to be deleted from the storage means when a predetermined condition is met, and a transmission means for transmitting, to a communication terminal, input screen information relating to an input screen for inputting information for setting images to be excluded from the images to be deleted, and the setting means sets the images to be excluded from the images to be deleted in response to operations on the input screen displayed on the communication terminal based on the transmitted input screen information.

The present invention provides an information processing device, information processing method, information processing program, and information processing system that can properly delete and save data.

FIG. 1 is a diagram illustrating an example of the overall configuration of a communication system. FIG. 2 is a diagram illustrating an example of a hardware configuration of a communication terminal. FIG. 2 is a diagram illustrating an example of a hardware configuration of the imaging device. FIG. 2 illustrates an example of a hardware configuration of a management server. FIG. 1 illustrates an example of a functional configuration of a communication system. FIG. 10 is a conceptual diagram illustrating an example of an account management table. FIG. 10 is a conceptual diagram illustrating an example of a usage information management table. FIG. 10 is a conceptual diagram illustrating an example of an image information management table. FIG. 10 is a sequence diagram illustrating an example of a normal image saving process. FIG. 10 is a sequence diagram illustrating an example of a process for saving a time lapse image. FIG. 10 is a sequence diagram illustrating an example of a time lapse image management process. FIG. 10 is a flowchart illustrating an example of a normal image storage process. FIG. 10 is a flowchart showing an example of a process for storing a time lapse image. FIG. 10 is a flowchart illustrating an example of a setting process of a confirmation screen. FIG. 10 is a flowchart illustrating an example of a setting process for an input screen. FIG. 10 is a flowchart showing an example of a deletion exclusion process for a time lapse image. FIG. 10 is a flowchart showing an example of a process for deleting a time lapse image. FIG. 10 is a diagram showing an example of a confirmation screen. FIG. 10 is a diagram showing an example of an input screen. FIG. 10 is a diagram illustrating a functional configuration of a modified example of the communication system. FIG. 21 is a sequence diagram showing a process of saving a normal image in the modified example shown in FIG. 20. FIG. 21 is a sequence diagram showing a process of saving a time lapse image in the modified example shown in FIG. 20 . FIG. 10 is a diagram illustrating a functional configuration of a second modified example of the communication system. FIG. 10 is a sequence diagram showing a streaming process in a second modified example. FIG. 10 is a diagram showing an example of an input screen in a second modified example. FIG. 10 is a flowchart showing the processing of a messaging server in a second modified example. FIG. 10 is a flowchart showing processing of a streaming server in a second modified example. FIG. 10 is a flowchart showing processing by the imaging device in a second modified example. FIG. 10 is a diagram illustrating a functional configuration of an image capturing device in a third modified example of the communication system. FIG. 11 is a flowchart showing processing of the imaging device in the third modified example. FIG. 11 is a flowchart showing another process of the imaging device in the third modified example.

The following describes the embodiments of the invention with reference to the drawings. Note that in the description of the drawings, identical elements are designated by the same reference numerals, and duplicate explanations will be omitted.

●Embodiment●
Overview of the communication system First, an overview of the configuration of a communication system according to an embodiment will be described using Fig. 1. Fig. 1 is a diagram showing an example of the overall configuration of a communication system. The communication system 1 shown in Fig. 1 is a system that allows users to view the status of a distribution center in real time by participating in a predetermined service such as remote communication provided by a management server 50 and displaying, at a viewing center, captured images such as video images distributed from a remote distribution center.

Here, the specified services include interval photography mode (also referred to as time-lapse photography mode in this specification), remote conferences, remote lessons, remote medical examinations, meetings or consultations realized through communication between remote locations via the management system 5, or inspections, monitoring or patrols of remote locations.

Here, time-lapse photography mode refers to the continuous capture of multiple images under specified shooting conditions (including the shooting interval, number of shots, shooting period (start and end times of shooting), etc.). Furthermore, time-lapse service refers to a service that allows multiple images captured in time-lapse photography mode to be shared.

The time-lapse service may also have a time-lapse video function that creates a video using multiple images captured in time-lapse shooting mode. The time-lapse video function is a function that generates a video by connecting multiple images captured at regular intervals under specified shooting conditions, and when the video is played back at normal speed (1x speed), it becomes possible to view a video with time passing quickly, like a fast-forwarded video. The time-lapse video function makes it possible to view the situation at the distribution center like a fast-forwarded video, allowing users at the viewing center to easily and quickly grasp changes in the situation at the site over time.

As shown in FIG. 1, communication system 1 is an example of an information processing system, and includes a communication terminal 10 located at a viewing base, an imaging device 30 located at the site which is a distribution base, and a management server 50. The communication terminal 10, imaging device 30, and management server 50 that make up communication system 1 can communicate via a communication network 100. Communication network 100 is constructed using the Internet, a mobile communication network, a LAN (Local Area Network), etc. Note that communication network 100 may include not only wired communication networks, but also wireless communication networks such as 3G (3rd Generation), 4G (4th Generation), 5G (5th Generation), Wi-Fi (Wireless Fidelity) (registered trademark), WiMAX (Worldwide Interoperability for Microwave Access), or LTE (Long Term Evolution).

The communication terminal 10 is a computer such as a laptop PC (Personal Computer), smartphone, or tablet used by a user at a viewing location. For example, the communication terminal 10 undergoes user authentication by the management server 50 and then participates in a specific service provided by the management server 50. The communication terminal 10 displays images captured by a camera 30 installed at the distribution location, allowing the user to view the status of the distribution location.

Note that the communication terminal 10 is not limited to a notebook PC, smartphone, or tablet terminal, but may also be, for example, a desktop PC, a wearable terminal, an HMD (head mounted display), or an IWB (Interactive Whiteboard: an electronic whiteboard with interactive whiteboard functionality).

The camera device 30 is installed at a distribution base, such as an office or factory, and is a device that participates in a specific service provided by the management server 50. The camera device 30 is pre-registered with the management server 50, and when a service is started in response to a user request, it launches an installed application and participates in the service as a participant. The camera device 30 captures images of subjects, scenery, etc. within the distribution base, and transmits them via the management server 50 to communication terminals 10 participating in the service. The images captured by the camera device 30 may be video or still images, or both video and still images. The captured images may also include audio along with the images.

Here, the image capture device 30 is an example of a device that participates in the service provided by the management server 50. The device that participates in the service is not limited to an image capture device, but may also be a mobile object such as a video conferencing terminal, an IWB (Interactive Whiteboard: an electronic whiteboard with intercommunication capabilities), or a robot that moves within a distribution center.

Furthermore, the imaging device 30 is an example of a measurement device, and acquires captured images, which are an example of measurement data acquired by a measurement device. The distribution base where the imaging device 30 is installed is not limited to an office or factory, but may be, for example, an outdoor base such as a business office, construction site, substation, farm, rice field, plantation, cultivated land, road, intersection, or disaster site, or an indoor base such as a school, warehouse, commercial facility, hospital, real estate, or nursing home. In other words, the distribution base where the imaging device 30 is installed may be any base where there is a need to perform services such as remote conferences or inspections with users located at viewing bases. As will be described later, the communication system 1 may include multiple imaging devices 30.

The management server 50 is an example of an information processing device, and is a server computer that provides and manages services executed between the communication terminal 10 and the image capture device 30. The management server 50 manages and controls communication between the communication terminal 10 and the image capture device 30, and relays image data sent and received. The management server 50 also works with an external storage service that provides a first external storage 90 and a second external storage 91, and stores access information to the first external storage 90 and the second external storage 91. Here, the first external storage 90 and the second external storage 91 are examples of storage means that store images, which are an example of data; the first external storage 90 is an example of a first storage means, and the second external storage 91 is an example of a second storage means.

The management server 50 may be configured to distribute its functions across multiple computers. Furthermore, although the management server 50 will be described as a server computer located in a cloud environment, it may also be a server located in an on-premises environment.

The first external storage 90 and the second external storage 91 are storage services (or online storage) provided by an external service provider via the communication network 100. The first external storage 90 and the second external storage 91 are, for example, storage destinations for storing data files on the cloud, and users who subscribe to the external storage service can save and view data.

Hardware Configuration Next, the hardware configuration of each device or terminal constituting the communication system according to the embodiment will be described using Figures 2 to 4. Note that components may be added or deleted from the hardware configurations shown in Figures 2 to 4 as needed.

○Hardware configuration of communication terminal○
First, the hardware configuration of the communication terminal 10 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the hardware configuration of the communication terminal. The communication terminal 10 is constructed by a computer, and as shown in FIG. 2, includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a HD (Hard Disk) 104, a HDD (Hard Disk Drive) controller 105, a display 106, an external device connection I/F (Interface) 107, a network I/F 108, a bus line 110, a keyboard 111, a pointing device 112, a sound input/output I/F 113, a microphone 114, a speaker 115, a camera 116, a DVD-RW (Digital Versatile Disk The DVD-ROM drive 117 includes a DVD-ROM drive 118 and a media I/F 119 .

Of these, CPU 101 controls the overall operation of communication terminal 10. ROM 102 stores programs used to drive CPU 101, such as IPL (Initial Program Loader). RAM 103 is used as a work area for CPU 101. HD 104 stores various data, such as programs. HDD controller 105 controls the reading and writing of various data from HD 104 under the control of CPU 101. Display 106 is a type of display means that displays various information, such as a cursor, menu, window, text, or image. Note that display 106 may also be a touch panel display equipped with input means. External device connection I/F 107 is an interface for connecting various external devices. Network I/F 108 is an interface for data communication using communication network 100. Bus line 110 is an address bus, data bus, or the like, that electrically connects each component, such as CPU 101, shown in FIG. 2.

Furthermore, keyboard 111 is a type of input means equipped with multiple keys for inputting characters, numbers, various instructions, etc. Pointing device 112 is a type of input means for selecting or executing various instructions, selecting a processing target, moving a cursor, etc. Note that the input means may be not only keyboard 111 and pointing device 112, but also a touch panel, audio input device, etc. Sound input/output I/F 113 is a circuit that processes the input and output of audio signals between microphone 114 and speaker 115 under the control of CPU 101. Microphone 114 is a type of built-in sound collection means that inputs audio. Speaker 115 is a type of built-in output means that outputs audio signals. Camera 116 is a type of built-in imaging means that captures an object and obtains image data. Note that microphone 114, speaker 115, and camera 116 may not be built into communication terminal 10 but may be external devices. The DVD-RW drive 117 controls the reading and writing of various data from a DVD-RW 118, which is an example of a removable recording medium. Note that the removable recording medium is not limited to a DVD-RW, and may also be a DVD-R or Blu-ray (registered trademark) Disc. The media I/F 119 controls the reading and writing (storage) of data from a recording medium 121, such as a flash memory.

○Hardware configuration of the imaging device○
Next, the hardware configuration of the imaging device 30 will be described with reference to FIG. 3 . FIG. 3 is a diagram illustrating an example of the hardware configuration of the imaging device. FIG. 3 illustrates an example of an omnidirectional imaging device as the imaging device 30, which captures a subject, a landscape, or the like to acquire a omnidirectional image. Note that the imaging device 30 may be a camera that captures a normal planar image, such as a regular digital camera or a smartphone, or may be a wide-angle camera that can acquire a wide-angle image having a field of view equal to or greater than a predetermined value. In the following description, the imaging device 30 is described as an omnidirectional (omnidirectional) imaging device using two imaging elements, but the number of imaging elements may be two or more. Furthermore, the imaging device does not necessarily have to be a device dedicated to omnidirectional imaging; a regular digital camera, smartphone, or the like may have substantially the same functions as the imaging device 30 by attaching an omnidirectional imaging unit to it.

As shown in FIG. 3, the photographing device 30 is composed of a photographing unit 301, an image processing unit 304, a photographing control unit 305, a microphone 308, a sound processing unit 309, a CPU (Central Processing Unit) 311, a ROM (Read Only Memory) 312, an SRAM (Static Random Access Memory) 313, a DRAM (Dynamic Random Access Memory) 314, an operation unit 315, an input/output I/F (Interface) 316, a short-range communication circuit 317, an antenna 317a of the short-range communication circuit 317, an electronic compass 318, a gyro sensor 319, an acceleration sensor 320, and a network I/F 321.

Of these, the imaging unit 301 is equipped with wide-angle lenses (so-called fisheye lenses) 302a and 302b (hereinafter referred to as lenses 302 when there is no need to distinguish between them) each with an angle of view of 180° or more for forming a hemispherical image, and two imaging elements 303a and 303b corresponding to each lens. The imaging elements 303a and 303b each include an image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) sensor or a CCD (Charge Coupled Device) sensor that converts the optical image captured by lenses 302a and 302b into image data in the form of an electrical signal for output, a timing generation circuit that generates horizontal or vertical synchronization signals and pixel clocks for the image sensors, and a group of registers that set various commands or parameters required for the operation of the imaging elements.

The imaging elements 303a and 303b of the imaging unit 301 are each connected to the image processing unit 304 via a parallel I/F bus. Meanwhile, the imaging elements 303a and 303b of the imaging unit 301 are each connected to the imaging control unit 305 via a serial I/F bus (such as an I2C bus). The image processing unit 304, imaging control unit 305, and sound processing unit 309 are connected to the CPU 311 via bus 310. Also connected to the bus 310 are ROM 312, SRAM 313, DRAM 314, operation unit 315, input/output I/F 316, short-range communication circuit 317, electronic compass 318, gyro sensor 319, acceleration sensor 320, and network I/F 321.

The image processing unit 304 takes in the image data output from the image sensors 303a and 303b via a parallel I/F bus, performs predetermined processing on each piece of image data, and then synthesizes the image data to create equirectangular projection image data.

The imaging control unit 305 generally uses the I2C bus to set commands and other information in the registers of the imaging elements 303a and 303b, with the imaging control unit 305 acting as the master device and the imaging elements 303a and 303b acting as slave devices. Necessary commands and other information are received from the CPU 311. The imaging control unit 305 also uses the I2C bus to retrieve status data and other information from the registers of the imaging elements 303a and 303b and send it to the CPU 311.

In addition, the imaging control unit 305 instructs the imaging elements 303a and 303b to output image data when the shutter button on the operation unit 315 is pressed. Depending on the imaging device 30, the display may have a preview display function or a video display function (for example, the display of an external terminal such as a smartphone that communicates with the imaging device 30 using the short-range communication circuit 317). In this case, image data is output continuously from the imaging elements 303a and 303b at a predetermined frame rate (frames per minute).

As described below, the imaging control unit 305 also functions as a synchronization control means that cooperates with the CPU 311 to synchronize the output timing of image data from the imaging elements 303a and 303b. In this embodiment, the imaging device 30 is not provided with a display unit, but a display unit may be provided. The microphone 308 converts sound into sound (signal) data. The sound processing unit 309 takes in the sound data output from the microphone 308 via the I/F bus and performs predetermined processing on the sound data.

The CPU 311 controls the overall operation of the image capture device 30 and executes necessary processing. The ROM 312 stores various programs for the CPU 311. The SRAM 313 and DRAM 314 are work memories that store programs executed by the CPU 311 and data currently being processed. In particular, the DRAM 314 stores image data currently being processed by the image processing unit 304 and data of processed equirectangular projection images.

The operation unit 315 is a general term for various operation buttons, a power switch, a shutter button, and a touch panel that combines display and operation functions. The user operates the operation unit 315 to input various shooting modes, shooting conditions, etc.

The input/output I/F 316 is a general term for an interface circuit (such as a USB I/F) with external media such as an SD card or a personal computer. The input/output I/F 316 may be wireless or wired. The equirectangular projection image data stored in the DRAM 314 is recorded on external media via the input/output I/F 316, or transmitted to an external terminal (device) via the input/output I/F 316 as needed.

The short-range communication circuit 317 communicates with an external terminal (device) via an antenna 317a provided in the image capture device 30 using short-range wireless communication technologies such as NFC (Near Field Communication), Bluetooth (registered trademark), or Wi-Fi. The short-range communication circuit 317 can transmit equirectangular projection image data to the external terminal (device).

The electronic compass 318 calculates the orientation of the image capture device 30 from the Earth's magnetism and outputs orientation information. This orientation information is an example of related information (metadata) conforming to Exif and is used for image processing such as image correction of captured images. The related information also includes data such as the image capture date and time and the data size of the image data. The gyro sensor 319 is a sensor that detects angle changes (roll angle, pitch angle, yaw angle) associated with the movement of the image capture device 30. The angle changes are an example of related information (metadata) conforming to Exif and are used for image processing such as image correction of captured images. The acceleration sensor 320 is a sensor that detects acceleration in three axes. The image capture device 30 calculates the attitude (angle relative to the vertical direction) of its own device (image capture device 30) based on the angular velocity and acceleration detected by the gyro sensor 319 and acceleration sensor 320. The inclusion of the gyro sensor 319 and acceleration sensor 320 improves the accuracy of image correction in the image capture device 30.

For example, the image capture device 30 may have a zenith correction means (not shown) that performs zenith correction on the spherical image so that the zenith direction of the spherical image coincides or nearly coincides with the vertical direction, and a camera shake correction means (not shown) that corrects camera shake, and can improve the implementation and accuracy of zenith correction and camera shake correction based on angular velocity and acceleration. The zenith correction means and camera shake correction means may be included in the image processing unit 304. The network I/F 321 is an interface for performing data communication using a communication network 100 such as the Internet via a router or the like.

○Management server hardware configuration○
Next, the hardware configuration of the management server 50 will be described using Figure 4. Figure 4 is a diagram showing an example of the hardware configuration of the management server. Each piece of hardware configuration in the management server 50 is indicated by a reference number in the 500 series. The management server 50 is constructed by a computer, and as shown in Figure 4, includes a CPU 501, ROM 502, RAM 503, HDD 504, HDD controller 505, display 506, external device connection I/F 508, network I/F 509, bus line 510, keyboard 511, pointing device 512, DVD-RW drive 514, and media I/F 516.

Of these, the CPU 501 controls the overall operation of the management server 50. The ROM 502 stores programs used to drive the CPU 501, such as IPL. The RAM 503 is used as a work area for the CPU 501. The HDD 504 stores various data, such as programs. The HDD controller 505 controls the reading and writing of various data from the HDD 504 under the control of the CPU 501. The display 506 displays various information, such as a cursor, menus, windows, characters, or images. The display 506 may also be a touch panel display equipped with input means. The external device connection I/F 508 is an interface for connecting various external devices. The network I/F 509 is an interface for data communication using the communication network 100. The bus line 510 is an address bus, data bus, or the like, for electrically connecting the components, such as the CPU 501, shown in FIG. 4.

The keyboard 511 is a type of input device equipped with multiple keys for inputting characters, numbers, various instructions, etc. The pointing device 512 is a type of input device for selecting or executing various instructions, selecting a processing target, moving the cursor, etc. Note that the input device is not limited to the keyboard 511 and pointing device 512, and may also be a touch panel, a voice input device, etc. The DVD-RW drive 514 controls the reading and writing of various data from the DVD-RW 513, which is an example of a removable recording medium. Note that the removable recording medium is not limited to a DVD-RW, but may also be a DVD-R or Blu-ray Disc, etc. The media I/F 516 controls the reading and writing (storage) of data from the recording medium 515, such as a flash memory.

The above programs may be distributed by being recorded on a computer-readable recording medium in the form of an installable or executable file. Examples of recording media include CD-Rs (Compact Disc Recordable), DVDs (Digital Versatile Discs), Blu-ray Discs, SD cards, and USB memory. Recording media may also be provided domestically or internationally as program products. For example, the management server 50 executes the program according to the present invention to realize the processing method according to the present invention.

Functional Configuration Next, the functional configuration of the communication system according to the embodiment will be described with reference to Figures 5 to 8. Figure 5 is a diagram showing an example of the functional configuration of the communication system. Note that Figure 5 shows devices or terminals shown in Figure 1 that are related to the processing or operation described below.

○Functional configuration of communication terminal○
First, the functional configuration of communication terminal 10 will be described using Figure 5. Communication terminal 10 has a transmission/reception unit 11, a reception unit 12, a display control unit 13, a determination unit 14, and a storage/readout unit 19. Each of these units is a function or means realized when any of the components shown in Figure 2 operates in response to commands from CPU 101 in accordance with a communication terminal program loaded from HD 104 onto RAM 103. Communication terminal 10 also has a storage unit 1000 constructed using ROM 102, HD 104, or recording medium 121 shown in Figure 2.

The transmission/reception unit 11 is mainly realized by the processing of the CPU 101 on the network I/F 108, and transmits and receives various data or information to and from other devices or terminals via the communication network 100.

The reception unit 12 is mainly realized by the CPU 101's processing of the keyboard 111 or pointing device 112, and receives various selections or inputs from the user.

The display control unit 13 is mainly realized by the processing of the CPU 101, and accesses the management server 50 using a web browser to display various screen data on the display 106. Specifically, the display control unit 13 accesses the management server 50, for example, by launching and executing an application or browser installed on the communication terminal 10. The display control unit 13 then downloads a web application (web app) that includes at least HTML (HyperText Markup Language) and includes CSS (Cascading Style Sheets) or JAVA SCRIPT (registered trademark), and displays various image data generated by the web app on the display 106. The display control unit 13 displays image data generated by HTML5, including data in formats such as XML (Extensible Markup Language), JSON (JavaScript Object Notation), or SOAP (Simple Object Access Protocol), on the display 106.

The judgment unit 14 is realized by the processing of the CPU 101 and makes various judgments. The storage/reading unit 19 is realized mainly by the processing of the CPU 101 and stores various data (or information) in the storage unit 1000 and reads various data (or information) from the storage unit 1000.

○ Functional configuration of the imaging device ○
Next, the functional configuration of the photographing device 30 will be described using Figure 5. The photographing device 30 has a transmission/reception unit 31, a photographing control unit 33, and a storage/readout unit 39. Each of these units is a function or means realized when any of the components shown in Figure 3 operates in response to commands from the CPU 311 in accordance with a photographing device program loaded from the SRAM 313 to the DRAM 314. The photographing device 30 also has a storage unit 3000 constructed from the ROM 312, SRAM 313, and DRAM 314 shown in Figure 3. The storage unit 3000 stores the GUID (Globally Unique Identifier) of the photographing device itself.

The transmission/reception unit 31 is mainly realized by the processing of the CPU 311, and communicates various data or information with other devices or terminals. Furthermore, the transmission/reception unit 31 uses the network I/F 321 to communicate data with other devices or terminals via the communication network 100.

The photography control unit 33 is mainly realized by the processing of the CPU 311 on the photography unit 301, image processing unit 304, and photography control unit 305, and photographs subjects such as landscapes and acquires photographed image data.

The storage/readout unit 39 is mainly realized by the processing of the CPU 311, and stores various data (or information) in the storage unit 3000 and reads various data (or information) from the storage unit 3000. The storage unit 3000 also stores captured image data acquired by the capture processing performed by the capture control unit 33. The captured image data stored in the storage unit 3000 is associated with the capture time of the captured image as metadata.

○ Management server functional configuration ○
Next, the functional configuration of the management server 50 will be described using Figure 5. The management server 50 has a transmission/reception unit 51, a determination unit 52, a setting unit 54, and a storage/readout unit 59. Each of these units is a function or means realized when any of the components shown in Figure 4 operates in response to commands from the CPU 501 in accordance with a management server program loaded from the HDD 504 onto the RAM 503. The management server 50 also has a storage unit 5000 constructed using the ROM 502, HDD 504, or recording media 515 shown in Figure 4.

The transmission/reception unit 51 is mainly realized by the processing of the CPU 501 on the network I/F 509, and transmits and receives various data or information to and from other devices or terminals via the communication network 100.

The judgment unit 52 is realized by the processing of the CPU 501 and makes various judgments. The setting unit 54 is realized mainly by the processing of the CPU 501 and makes various settings.

The storage/readout unit 59 is mainly realized by the processing of the CPU 501, and stores various data (or information) in the storage unit 5000 and reads various data (or information) from the storage unit 5000. Note that the storage unit 5000 may be configured as an external storage device to the management server 50.

○Account management table○
6 is a conceptual diagram showing an example of an account management table. In the storage unit 5000, an account management DB 5001 configured by the account management table shown in FIG.

The account management table manages account information (account ID) that identifies accounts managed by the management server 50, the maximum number of images that can be stored in the first external storage 90 and the second external storage 91, and the maximum number of devices that can use the services provided by the management server 50. The account management table associates and stores the maximum number of images that can be stored and the maximum number of devices that can use the services provided by the management server 50 for each account.

○Business model issues○
At infrastructure development sites, construction sites, and the like, work and site conditions may need to be managed over a long period of time.

In recent years, cloud services have come to be offered in various formats, such as SaaS (Software as a Service) and PaaS (Platform as a Service).

In this embodiment, a cloud service for saving and sharing images can be suitably used. The terms of the cloud service contract may vary, and may include, for example, the "maximum number of images that can be saved," "maximum storage capacity for still images and videos," and "maximum number of users (number of devices) who can use the service."

The flat-rate usage fee may be determined based on usage conditions such as the maximum number of images that can be saved, the maximum storage capacity, and the maximum number of users (number of devices). A subscription system, in which a usage fee is charged for the right to use the service, may be considered for the flat-rate usage fee.

For example, if you were to take time-lapse photos at a construction site, the images you take would be saved sequentially, which could exceed the "maximum number of images that can be saved" and "maximum storage capacity" that are terms of use stipulated in the user agreement.

Specifically, for example, if the shooting conditions for time-lapse photography are "shooting intervals of 10 minutes, shooting period of 10 days," the number of images taken and saved will be 1,440. In this case, if the "maximum number of images that can be saved" in the usage conditions is 1,000, the time-lapse photography alone will exceed the limit of the storage conditions.

This means that images taken using normal photography other than time-lapse photography cannot be saved, and users will have to deal with issues such as deleting saved images to increase the remaining maximum number of images that can be saved, or reviewing their usage contract and changing to a plan that allows for more storage, which can make them hesitant to use time-lapse photography.

This embodiment provides an information processing device, information processing method, information processing program, and information processing system that can properly delete and save data.

○Usage Information Management Table○
7 is a conceptual diagram showing an example of a usage information management table. The usage information management table is a table for managing users and devices such as the image capture device 30 that can use the time lapse service provided by the management server 50. A usage information management DB 5002 configured by the usage information management table shown in FIG. 7 is created in the storage unit 5000.

The usage information management table manages the usage ID associated with the user identification information (user ID) or device identification information (model ID) for each account information (account ID). The usage IDs are set equal to the maximum number of usable devices for each account managed in the account management DB 5001 shown in Figure 6.

Image information management table
Fig. 8 is a conceptual diagram showing an example of an image information management table. The image management table is a table for managing images stored in the first external storage 90 and the second external storage 91. An image information management DB 5003 configured by the image information management table shown in Fig. 8 is constructed in the storage unit 5000.

The image information management table associates and manages image identification information (image ID) that identifies images stored in the first external storage 90 and the second external storage 91, a time lapse flag that indicates whether the time lapse service is being used, device identification information (model ID) registered for use with the time lapse service, the acquisition time of images captured using time lapse photography, and a deletion exclusion flag that indicates that images captured using time lapse photography should be excluded from deletion.

●Processing or operation of the embodiment ○Storage processing of normal images○
9 is a sequence diagram showing an example of a process for saving a normal image. The communication system 1 will be described assuming that the use of the first external storage 90 and the second external storage 91 is authorized.

The photographing control unit 33 of the photographing device 30 manually photographs an image when the user operates the operation unit 315 (step S1), and the transceiver unit 31 of the photographing device 30 transmits the account ID and the image to the first external storage 90 (step S2).

The first external storage 90 stores the image sent from the imaging device 30 (step S3) and sends the account ID and image ID to the management server 50 (step S4).

Here, the image ID sent by the first external storage 90 to the management server 50 may be attached to the image sent from the imaging device 30, or may be assigned by the first external storage 90 based on the image sent from the imaging device 30.

When the transmission/reception unit 51 of the management server 50 receives the account ID and image ID sent from the first external storage 90, the judgment unit 52 of the management server 50 obtains the account ID managed in the account management DB 5001 via the storage/readout unit 59, and determines whether the account ID sent from the first external storage 90 matches the account ID managed in the account management DB 5001.

The determination unit 52 of the management server 50 further obtains, via the storage/readout unit 59, the maximum number of images that can be stored managed in the account management DB 5001 and the number of images to be stored managed in the image information management DB 5003, and determines whether the number of images to be stored has reached the maximum number of images that can be stored (step S5). Details of the images to be stored managed in the image information management DB 5003 will be described later.

If the determination unit 52 of the management server 50 determines that the account ID sent from the first external storage 90 does not match the account ID managed in the account management DB 5001, or that the number of images to be saved managed in the image information management DB 5003 has reached the maximum number of images that can be saved, the transmission/reception unit 51 of the management server 50 sends the image ID to be deleted to the first external storage 90 (step S6).

When the first external storage 90 receives the image ID sent from the management server 50, it deletes the image corresponding to that image ID (step S7).

If the determination unit 52 of the management server 50 determines that the account ID sent from the first external storage 90 matches the account ID managed in the account management DB 5001 and that the number of images to be saved managed in the image information management DB 5003 has not reached the maximum number of images that can be saved, the setting unit 54 of the management server 50 stores the image ID in association with the account ID in the image information management DB 5003 via the storage/readout unit 59 (step S8).

○Time lapse image saving process○
FIG. 10 is a sequence diagram showing an example of a process for saving a time lapse image.

The transmitter/receiver 11 of the communication terminal 10 transmits to the management server 50 the account ID, the model ID of the image capture device 30 that will use the time lapse service, and time lapse ON information indicating registration for time lapse use (step S11).

All or part of the account ID, model ID, and time lapse ON information may be input from the reception unit 12 of the communication terminal 10, or may be obtained from the management server 50.

When the transmission/reception unit 51 of the management server 50 receives the account ID, model ID, and time lapse ON information transmitted from the communication terminal 10, the setting unit 54 of the management server 50 stores the model ID in association with the account ID in the usage information management DB 5002 via the storage/readout unit 59 (step S12).

The transmitter/receiver 11 of the communication terminal 10 transmits the account ID, time lapse ON information, and shooting conditions for the time lapse service to the shooting device 30 (step S13).

When the transmission/reception unit 31 of the photographing device 30 receives the account ID, time lapse ON information, and photographing conditions transmitted from the communication terminal 10, the photographing control unit 33 of the photographing device 30 automatically captures a time lapse image using the received photographing conditions (step S14), and the transmission/reception unit 31 of the photographing device 30 transmits the account ID, model ID, image, and image capture time to the second external storage 91 (step S15).

The shooting conditions received by the transmitter/receiver 31 of the image capture device 30 from the communication terminal 10 include conditions such as the shooting interval for time-lapse photography, the shooting period, and whether to blur people, but these conditions may also be obtained from the management server 50 rather than being received from the communication terminal 10.

Note that the sequence diagram shown in Figure 10 describes an example in which the photographing device 30 receives the account ID, time lapse ON information, and photographing conditions sent from the communication terminal 10, assuming that the photographing device 30 has an automatic photographing function (time lapse photographing function). However, if the photographing device 30 does not have the automatic photographing function, the photographing device 30 can receive an app related to the automatic photographing function sent from the communication terminal 10 and install that app.

Here, as shown in step S2 of FIG. 9 and step S14 of FIG. 10, the shooting control unit 33 of the shooting device 30 transmits images and other information to the first external storage 90 via the transceiver unit 31 when shooting manually, and transmits images and other information to the second external storage 91 via the transceiver unit 31 when shooting time-lapse images automatically.

Here, the imaging device 30 shown in Figure 10 may be a different imaging device from the imaging device 30 shown in Figure 9.

The second external storage 91 stores the image and its thumbnail image sent from the image capture device 30 (step S16), and transmits the account ID, model ID, image ID, and image capture time to the management server 50 (step S17).

Here, the thumbnail images stored in the second external storage 91 may be added to the images transmitted from the image capture device 30, or may be created by the second external storage 91 based on the images transmitted from the image capture device 30.

Furthermore, the image ID sent by the second external storage 91 to the management server 50 may be attached to the image sent from the imaging device 30, or may be assigned by the second external storage 91 based on the image sent from the imaging device 30.

When the transmission/reception unit 51 of the management server 50 receives the account ID, model ID, image ID, and image capture time sent from the second external storage 91, the determination unit 52 of the management server 50 obtains the account ID and model ID managed in the usage information management DB 5002 via the storage/readout unit 59, and determines whether the account ID and model ID sent from the second external storage 91 match the account ID and model ID managed in association with the usage information management DB 5002 (step S18).

If the determination unit 52 of the management server 50 determines that the account ID and model ID transmitted from the second external storage 91 do not match the account ID and model ID managed in association with the usage information management DB 5002, the transmission/reception unit 51 of the management server 50 transmits to the second external storage 91 the image ID to be deleted.
When the second external storage 91 receives the image ID transmitted from the management server 50, it deletes the image corresponding to the image ID (step S20).

If the determination unit 52 of the management server 50 determines that the account ID sent from the second external storage 91 matches the account ID managed in the usage information management DB 5002 and that the model ID sent from the second external storage 91 matches the model ID managed in the usage information management DB 5002, the setting unit 54 of the management server 50 stores the image ID, image acquisition time, and the initial value of the deletion exclusion flag of 0 in association with the account ID, time lapse flag of 1, and model ID in the image information management DB 5003 via the storage/reading unit 59 (step S21) (an example of a setting step).

○Time lapse image management processing○
FIG. 11 is a sequence diagram showing an example of a time lapse image management process.

The transmitter/receiver unit 11 of the communication terminal 10 sends a confirmation screen request along with the account ID to the management server 50 (step S31).

When the transmission/reception unit 51 of the management server 50 receives the confirmation screen request and account ID sent from the communication terminal 10, the setting unit 54 of the management server 50 obtains, via the storage/readout unit 59, the maximum number of images that can be saved and the maximum number of terminals that can be used managed in the account management DB 5001, the user ID and model ID managed in the usage information management DB 5002, and the number of images to be saved managed in the image information management DB 5003, and sets the confirmation screen (step S32). The transmission/reception unit 51 of the management server 50 then transmits confirmation screen information indicating the confirmation screen to the communication terminal 10 (step S33).

When the transmitter/receiver unit 11 of the communication terminal 10 receives the confirmation screen information sent from the management server 50, the display control unit 13 of the communication terminal 10 displays a confirmation screen on the display 106 based on the received confirmation screen information (step S34).

The transmitter/receiver 11 of the communication terminal 10 sends an input screen request along with the account ID and model ID to the management server 50 (step S35) (an example of a sending step).

When the transmission/reception unit 51 of the management server 50 receives the input screen request, account ID, and model ID sent from the communication terminal 10, the setting unit 54 of the management server 50 acquires, via the storage/readout unit 59, the image ID, acquisition time, and deletion exclusion flag for time lapse flag 1 managed in the image information management DB 5003 based on the received account ID and model ID (step S36).

The transmitter/receiver unit 51 of the management server 50 transmits to the second external storage 91 the account ID, the image ID acquired by the setting unit 54, and a thumbnail image request requesting a thumbnail image of the image ID (step S37).

When the second external storage 91 receives the thumbnail image request and image ID sent from the management server 50, it sends the image ID and the thumbnail image corresponding to that image ID to the management server 50 (step S38).

When the transmission/reception unit 51 of the management server 50 receives the thumbnail image and image ID transmitted from the second external storage 91, the setting unit 54 of the management server 50 sets an input screen based on the account ID and model ID received from the communication terminal 10, the thumbnail image and image ID received from the second external storage 91, and the acquisition time and deletion exclusion flag acquired from the image information management DB 5003 (step S36), and the transmission/reception unit 51 of the management server 50 transmits input screen information indicating the input screen to the communication terminal 10 (step S39).

When the transceiver 11 of the communication terminal 10 receives the input screen information transmitted from the management server 50, the display control unit 13 of the communication terminal 10 displays the input screen on the display 106 based on the received input screen information (an example of a display step), and the reception unit 12 of the communication terminal 10 receives the user's specified input operation on the displayed input screen (step S40).

When the user inputs information requesting an image of a specific image ID into the input screen, the reception unit 12 accepts the input of the request for an image of the specific image ID, and the transmission/reception unit 11 transmits the account ID and an image request for the input image ID to the second storage 91 (step S41).

When the second external storage 91 receives the image request, account ID, and image ID sent from the communication terminal 10, it sends the image with the image ID to the communication terminal 10 (step S42).

When the transceiver unit 11 of the communication terminal 10 receives the image transmitted from the second external storage 91, the display control unit 13 of the communication terminal 10 displays an input screen including the received image on the display 106 (step S40).

When the user inputs information into the input screen to set images with specific image IDs to be excluded from deletion, the reception unit 12 accepts the input of information to set images with specific image IDs to be excluded from deletion, and the transmission/reception unit 11 transmits the input information about the account ID and the input image ID to the management server 50 (step S43).

When the transmission/reception unit 51 of the management server 50 receives the account ID and image ID transmitted from the communication terminal 10, the setting unit 54 of the management server 50 stores a deletion exclusion flag of 1 for the image ID of the received account ID in the image information management DB 5003 via the storage/readout unit 59 (step S44) (an example of a setting step). The detailed processing of step S44 will be described later.

By sending input information for multiple image IDs in step S43, multiple images to be excluded from deletion can be set in step S44.

The setting unit 54 of the management server 50 deletes image IDs and data associated with image IDs that have been acquired 30 days ago from the image information management DB 5003 (step S45). Note that while the sequence diagram shown in FIG. 11 shows step S45 being executed following step S44, in reality, the setting unit 54 of the management server 50 executes step S45 in response to a timing that is predetermined within the management server 50.

The transmitter/receiver 51 of the management server 50 transmits the image ID and account ID to be deleted from the image information management DB 5003 to the second external storage 91 (step S46). Upon receiving the account ID and image ID transmitted from the management server 50, the second external storage 91 deletes the image corresponding to the image ID of the account ID (step S47).

○Normal image storage processing○
FIG. 12 is a flow diagram showing an example of a normal image storage process, which corresponds to steps S5, S6 and S8 in the sequence diagram shown in FIG.

The determination unit 52 of the management server 50 acquires the account ID managed in the account management DB 5001 via the storage/readout unit 59, and determines whether the account ID sent from the first external storage 90 matches a registered account ID managed in the account management DB 5001 (step S51).

If it is determined in step S51 that the account ID has been registered, the determination unit 52 of the management server 50 obtains the maximum number of images that can be stored managed in the account management DB 5001 and the number of images to be stored managed in the image information management DB 5003 via the storage/readout unit 59, and determines whether the number of images to be stored has reached the maximum number of images to be stored (step S52). The determination unit 52 may also determine whether the number of images to be stored managed in the image information management DB 5003 exceeds the maximum number of images to be stored when the image corresponding to the currently received image ID is added.

Here, the number of images to be saved managed in the image information management DB 5003 is the sum of normal images and time-lapse deletion excluded images.

A normal image is an image corresponding to an image ID for which there is no data in the time lapse flag shown in Figure 8, and a time lapse deletion exclusion image is an image corresponding to an image ID for which the deletion exclusion flag shown in Figure 8 is 1.

If it is determined in step S53 that the maximum number of images that can be stored has not been reached, the setting unit 54 of the management server 50 stores the image ID in the image information management DB 5003 in association with the account ID via the storage/read unit 59, and leaves the image corresponding to the image ID stored in the first external storage 90 (step S53).

If it is determined in step S51 that the account ID is not registered, or if it is determined in step S52 that the maximum number of images that can be stored has been reached, the transceiver unit 51 of the management server 50 transmits the image ID to be deleted and its account ID to the first external storage 90, and deletes the image corresponding to the image ID from the first external storage 90 (step S54).

If it is determined in step S52 that the maximum number of images that can be saved has been reached, the transceiver unit 51 of the management server 50 may send notification information to the communication terminal 10 informing that manually captured images cannot be saved.

Furthermore, if the judgment unit 52 of the management server 50 determines that the number of images to be saved managed in the image information management DB 5003 will reach the maximum number of images that can be saved when the image corresponding to the image ID received this time is added, the transmission/reception unit 51 of the management server 50 may send notification information to the communication terminal 10 in advance to notify that the next manually captured image will not be able to be saved.

Furthermore, the transceiver unit 51 of the management server 50 may transmit not only the above-mentioned notification information but also the above-mentioned cloud service contract information, contract partner web page link information, contract content change request information, etc. to the communication terminal 10.

According to this embodiment, using time-lapse photography will not immediately exceed the upper limit of the storage conditions stipulated in the service contract. However, this is effective in cases where, after it is determined in step S52 that the maximum number of images that can be saved has been reached, the user wishes to raise the upper limit of the storage conditions beyond that of the contracted plan.

○Time lapse image storage processing○
FIG. 13 is a flow diagram showing an example of a process for storing time lapse images, and corresponds to steps S18, S19, and S20 in the sequence diagram shown in FIG.

The determination unit 52 of the management server 50 acquires the account ID managed in the usage information management DB 5002 via the storage/readout unit 59, and determines whether the account ID sent from the second external storage 91 matches a registered account ID managed in the usage information management DB 5002 (step S61).

If it is determined in step S61 that the account ID has already been registered for use, the determination unit 52 of the management server 50 obtains, via the storage/readout unit 59, the model ID managed in the usage information management DB 5002 in association with the account ID determined to match in step S61, and determines whether the model ID transmitted from the second external storage 91 matches the registered model ID obtained from the usage information management DB 5002 (step S62).

If it is determined in step S62 that the model ID has been registered for use, the setting unit 54 of the management server 50 stores the image ID, image acquisition time, and the initial value of the deletion exclusion flag of 0 in association with the account ID, time lapse flag of 1, and model ID in the image information management DB 5003 via the storage/reading unit 59, and leaves the image corresponding to the image ID stored in the second external storage 91 (step S63).

If it is determined in step S61 that the account ID is not registered, or if it is determined in step S62 that the model ID is not registered, the transceiver unit 51 of the management server 50 transmits the image ID to be deleted and its account ID to the first external storage 90, and deletes the image corresponding to the image ID from the second external storage 91 (step S64).

○Confirmation screen setting process○
FIG. 14 is a flow diagram showing an example of a process for setting the confirmation screen, and corresponds to step S32 in the sequence diagram shown in FIG.

The setting unit 54 of the management server 50 obtains the maximum number of saved images and the maximum number of usable terminals corresponding to the received account ID from the management DB 5001 via the storage/reading unit 59 (step S71).

The setting unit 54 of the management server 50 obtains, via the storage/readout unit 59, the number of registered user IDs and the number of device IDs corresponding to the account ID sent from the communication terminal 10 from the usage information management DB 5002 (step S72).

The setting unit 54 of the management server 50 obtains the number of image IDs to be saved corresponding to the account ID sent from the communication terminal 10 from the image information management DB 5003 via the storage/reading unit 59 (step S73).

Here, the number of images to be saved managed in the image information management DB 5003 is the sum of normal images and time-lapse deletion excluded images.

A normal image is an image corresponding to an image ID for which there is no data in the time lapse flag shown in Figure 8, and a time lapse deletion exclusion image is an image corresponding to an image ID for which the deletion exclusion flag shown in Figure 8 is 1.

The configuration unit 54 of the management server 50 configures the confirmation screen based on the information acquired in steps S71 to S73 (step S74).

○ Input screen setting process ○
FIG. 15 is a flow diagram showing an example of the input screen setting process, which corresponds to step S36 in the sequence diagram shown in FIG.

The setting unit 54 of the management server 50 obtains the maximum number of sheets that can be saved corresponding to the received account ID from the account management DB 5001 via the storage/reading unit 59 (step S91).

The setting unit 54 of the management server 50 retrieves the image ID, acquisition time, and deletion exclusion flag for time lapse flag 1 corresponding to the received account ID and model ID from the image information management DB 5003 via the storage/readout unit 59 (step S92).

The setting unit 54 of the management server 50 sets the input screen based on the information obtained in steps S91 and S92 (step S93).

○Time lapse image deletion exclusion processing○
FIG. 16 is a flow diagram showing an example of the deletion exclusion process for time lapse images, and shows the details of step S44 in the sequence diagram shown in FIG.

The determination unit 52 of the management server 50 obtains the maximum number of images that can be saved corresponding to the received account ID from the account management DB 5001 via the storage/readout unit 59, and obtains the number of images to be saved corresponding to the received account ID from the image information management DB 5003, and determines whether the number of images to be saved has reached the maximum number of images to be saved (step S101). The determination unit 52 may also determine whether the number of images to be saved managed in the image information management DB 5003, when added to the image corresponding to the currently received image ID, exceeds the maximum number of images to be saved.

Here, the number of images to be saved managed in the image information management DB 5003 is the sum of normal images and time-lapse deletion excluded images.

A normal image is an image corresponding to an image ID for which there is no data in the time lapse flag shown in Figure 8, and a time lapse deletion exclusion image is an image corresponding to an image ID for which the deletion exclusion flag shown in Figure 8 is 1.

If it is determined in step S101 that the maximum number of images that can be stored has not been reached, the setting unit 54 of the management server 50 accepts the input information and stores the deletion exclusion flag 1 for the received image ID in the image information management DB 5003 via the storage/readout unit 59 (step S102).

If it is determined in step S101 that the maximum number of images that can be stored has been reached, the setting unit 54 of the management server 50 sets an error, does not accept the input information, and does not store the received image ID in the image information management DB 5003 (step S102).

In step S102, the setting unit 54 of the management server 50 sets an input screen including error information indicating that the input information was not accepted, and the transmission/reception unit 51 of the management server 50 may transmit input screen information including the error screen to the communication terminal 10. Here, the error screen includes notification information notifying that it is not possible to set images to be excluded from deletion targets.

Furthermore, the transceiver unit 51 of the management server 50 may transmit not only the above-mentioned notification information but also the above-mentioned cloud service contract information, contract partner web page link information, contract content change request information, etc. to the communication terminal 10.

According to this embodiment, using time-lapse photography will not immediately exceed the upper limit of the storage conditions stipulated in the service contract. However, this is effective in cases where, after it is determined in step S101 that the maximum number of images that can be saved has been reached, the user wishes to raise the upper limit of the storage conditions beyond that of the contracted plan.

○Time lapse image deletion process○
FIG. 17 is a flow diagram showing an example of a process for deleting a time lapse image, and corresponds to step S45 in the sequence diagram shown in FIG.

At a predetermined timing, the judgment unit 52 of the management server 50 acquires, via the storage/readout unit 59, image IDs and acquisition times for which the time lapse flag is set to 1 and the deletion exclusion flag is set to 0 and which are managed in the image information management DB 5003, and determines whether there are any image IDs for which 30 days have passed since acquisition (step S111).

If an image ID is found to be older than 30 days in step S111, the setting unit 54 of the management server 50 deletes the image ID and data associated with the image ID from the image information management DB 5003 (step S112).

○Confirmation screen○
FIG. 18 is a diagram showing an example of a confirmation screen corresponding to step S34 in the sequence diagram shown in FIG.

Based on the received confirmation screen information, the display control unit 13 of the communication terminal 10 causes the display 106 to display the confirmation screen 200 shown in FIG. 18.

The display control unit 13 displays a confirmation screen 200 including member number information 201 indicating the number of user IDs ("14") obtained from the usage information management DB 5002, model number information 202 indicating the number of model IDs ("3") obtained from the usage information management DB 5002, image number information 203 indicating the number of normal images ("7") obtained from the image information management DB 5003, image number information 204 indicating the number of time lapse deletion excluded images ("0") obtained from the image information management DB 5003, maximum member number information 205 indicating the maximum number of user devices ("20") obtained from the account management DB 5001, and maximum image number information 206 indicating the maximum number of saved images ("1000") obtained from the account management DB 5001.

Here, "Live View" displayed on the confirmation screen 200 is an example of the name "Time Lapse Service."

Furthermore, the "number of live view models" displayed in association with the model number information 202 is an example of the name for the "number of devices that can use the time lapse service" described in Figure 7.

The "number of locked live view images" displayed in association with the image count information 204 is an example of the name of the "images captured by time-lapse photography with deletion exclusion flags attached" described in Figure 9.

The display control unit 13 displays the member number information 201 to further include information indicating the remaining number of people (3) obtained by subtracting the number of user IDs (14) obtained from the usage information management DB 5002 and the number of device IDs (3) obtained from the usage information management DB 5002 from the maximum number of usable devices (20) obtained from the account management DB 5001.

The display control unit 13 displays the model number information 202 to further include information indicating the remaining number "3" obtained by subtracting the number of user IDs "14" obtained from the usage information management DB 5002 and the number of model IDs "3" obtained from the usage information management DB 5002 from the maximum number of user devices "20" obtained from the account management DB 5001.

Note that the remaining number of people in member number information 201 and the remaining number in model number information 202 are both determined based on maximum member number information 205, so the remaining number of people in member number information 201 and the remaining number in model number information 202 are the same value.

The display control unit 13 displays the image count information 203 to further include information indicating the remaining number of images (993 people) obtained by subtracting the number of normal images (7) obtained from the image information management DB 5003 and the number of time-lapse deletion excluded images (0) obtained from the image information management DB 5003 from the maximum number of images (1000) that can be saved obtained from the account management DB 5001.

The display control unit 13 displays the image count information 204 to further include information indicating the remaining number of images (993 people) obtained by subtracting the number of normal images (7) obtained from the image information management DB 5003 and the number of time-lapse deletion excluded images (0) obtained from the image information management DB 5003 from the maximum number of images (1000) that can be saved obtained from the account management DB 5001.

Note that the remaining number of images in image count information 203 and the remaining number of images in image count information 204 are both determined based on maximum image count information 206, so the remaining number of images in image count information 203 and the remaining number of images in image count information 204 will be the same value.

○Input screen○
FIG. 19 is a diagram showing an example of an input screen corresponding to step S40 in the sequence diagram shown in FIG.

Based on the received input screen information, the display control unit 13 of the communication terminal 10 displays the input screen 400 shown in Figure 19 on the display 106.

The display control unit 13 displays an input screen 400 including account information 401 indicating the account ID "A0001" that requested the input screen in step S35, model information 402 indicating the model ID "D02345" that requested the input screen in step S35, image information 410 indicating the image obtained from the second external storage 91 in step S42, thumbnail image information 410A-410H indicating the thumbnail image obtained from the second external storage 91 in step S38, acquisition time information 415, 415A-415H indicating the acquisition time of the image obtained from the image information management DB 5003, setting information 405A-405H indicating the deletion exclusion flag obtained from the image information management DB 5003, a change button 405 for changing the deletion exclusion flag, and a confirm button 420 for confirming the deletion exclusion flag.

The display control unit 13 displays the input screen 400 so that the acquisition time information 415A-415H is located above the thumbnail image information 410A-410H, the setting information 405A-405H is superimposed on the thumbnail image information 410A-410H, and the change button 405 is superimposed on the image information 410.

The display control unit 13 displays the thumbnail image information 410A-410H in order of most recent acquisition time from left to right. The display control unit 13 scrolls the thumbnail image information 410A-410H horizontally to display, for example, 60 thumbnail images.

The display control unit 13 initially displays the image corresponding to the thumbnail image information 410A with the most recent acquisition time as the image information 410.

Specifically, the transmitter/receiver 11 sends an image request to the second storage 91 for the account ID and the image ID with the most recent acquisition time, receives the image with the most recent acquisition time sent from the second storage 91, and the display controller 13 initially displays the received image as image information 410 and also initially displays the acquisition time of the received image as acquisition time information 415, and further highlights and displays acquisition time information 415A corresponding to the thumbnail image information 410A with the most recent acquisition time.

When the user operates any of the thumbnail image information 410A-410H, the reception unit 12 of the communication terminal 10 receives an instruction to operate any of the thumbnail image information 410A-410H. Figure 19 shows the state in which the user operates thumbnail image information 410D.

Then, as shown in steps S41 and S42 of FIG. 11, the transmitter/receiver 11 transmits to the second storage 91 an image request for the account ID and the image ID of the thumbnail image information 410D for which the operation instruction was accepted, receives the image transmitted from the second storage 91, and the display control unit 13 displays the received image as image information 410, displays the acquisition time of the received image as acquisition time information 415, and further highlights and displays the acquisition time information 415D of the image corresponding to the thumbnail image information 410D operated by the user.

When the user presses the change button 405 in the state shown in FIG. 19, the reception unit 12 receives a change instruction to change the deletion exclusion flag to 1 for the image displayed as image information 410 and shown in thumbnail image information 410D. Based on the reception of the change instruction, the display control unit 13 highlights and displays the change button 405 and setting information 405D.

When the user presses the Confirm button 420, the reception unit 12 receives a confirmation instruction to set the deletion exclusion flag for the image displayed as image information 410 and shown in thumbnail image information 410D to 1. Note that instead of providing the Confirm button 420, the configuration may be such that pressing the Change button 405 serves both as a change instruction to change the deletion exclusion flag to 1 and as a confirmation instruction to set the deletion exclusion flag to 1. This prevents the user from forgetting to press the Confirm button 420 and prevents operational errors.

Then, as shown in step S43 of FIG. 11, the transmitter/receiver 11 transmits input information to the management server 50 that sets the deletion exclusion flag to 1 for the account ID and image ID corresponding to the thumbnail image information 410D.

Here, the user may operate any of thumbnail image information 410A-410H and press the change button 405 for multiple pieces of thumbnail image information, and then press the confirm button 420. Note that when a change instruction to change the deletion exclusion flag to 1 is issued for multiple pieces of thumbnail image information by pressing the change button 405, a cancel button for canceling all change instructions at once may be displayed on the input screen 400. This allows the user to cancel change instructions for multiple pieces of thumbnail image information at once.

In this case, the reception unit 12 receives a confirmation instruction to set the deletion exclusion flag to 1 for each of the multiple images shown in each of the multiple thumbnail images, and the transmission/reception unit 11 transmits to the management server 50 input information that sets the deletion exclusion flag to 1 for each of the account ID and multiple image IDs corresponding to each of the multiple thumbnail images.

It is also possible to reset the deletion exclusion flag to 1 even after a confirmation instruction to set the deletion exclusion flag to 1 has been given. In this case, the user can reset the deletion exclusion flag to 1 for thumbnail image information for which the user operated any of thumbnail image information 410A-410H to set the deletion exclusion flag to 1 by pressing the change button 405 again. In this case, just as when changing the deletion exclusion flag to 1, the confirmation instruction can be given by pressing the confirm button 420, or pressing the change button 405 can be configured to both issue a change instruction to change the deletion exclusion flag to 1 and a confirmation instruction to reset the deletion exclusion flag. The deletion exclusion flag may also be reset to 1 for multiple thumbnail image information. Furthermore, the input screen 400 may have a function to display only thumbnail images with deletion exclusion flags, and a cancel specification button may be displayed on the input screen 400 to cancel the deletion exclusion flag by specifying a predetermined period from the image acquisition time information. Furthermore, the input screen 400 may have a function to display only thumbnail images with deletion exclusion flags.

Modified Example of the Embodiment
Fig. 20 is a diagram showing the functional configuration of a modified communication system. In the communication system 1 shown in Fig. 5, the image capturing device 30 communicates with the communication terminal 10 via the communication network 100. However, in the modified communication system 1 shown in Fig. 20, the image capturing device 30 is built into the communication terminal 10.

Figure 21 is a sequence diagram showing the process of saving a normal image in the modified example shown in Figure 20.

The photographing control unit 33 of the photographing device 30 built into the communication terminal 10 manually photographs an image when the user operates the operation unit 315 (step S201), and the transceiver unit 11 of the communication terminal 10 transmits the account ID and the image to the first external storage 90 (step S202). The remaining processing is the same as in the sequence diagram shown in Figure 9.

Figure 22 is a sequence diagram showing the process of saving time lapse images in the modified example shown in Figure 20.

The shooting control unit 33 of the imaging device 30 built into the communication terminal 10 automatically captures time-lapse images under predetermined shooting conditions (step S214), and the transceiver unit 11 of the communication terminal 10 transmits the account ID, model ID, image, and image capture time to the second external storage 91 (step S215). Other processing is the same as in the sequence diagram shown in Figure 10.

In the modified example of the communication system shown in Figures 20 and 21, the communication terminal 10 transmits and stores images captured manually or automatically by the imaging control unit 33 of the built-in imaging device 30 to the first external storage 90 and the second external storage 91. However, in a further modified example, the communication terminal 10 may transmit and store data such as images acquired from the outside to the first external storage 90 and the second external storage 91.

Furthermore, as another form of communication system, the communication system 1 may include an imaging device 30, which is an example of a measurement device capable of communicating via the communication network 100, and a communication terminal 10, and the communication terminal 10 may incorporate the functions of the management server 50. In this case, the first external storage 90 and the second external storage 91 may be configured to be able to communicate with the communication terminal 10 via the communication network 100, or may be built into the communication terminal 10 or connected by wire.

Second Modification
FIG. 23 is a diagram showing a functional configuration of a second modified example of a communication system.

The communication system 1 shown in FIG. 23 includes the components of the communication system 1 shown in FIG. 5, as well as a messaging server 92 that manages video streaming and a streaming server 93 that streams the video. Specifically, the messaging server 92 is an intermediary server that exchanges triggers for starting and ending streaming between the image capture device 30 and the management server 50.

Figure 24 is a sequence diagram showing streaming processing in the second variant.

When the image capture device 30 prepares to send and receive messages that manage video streaming, for example by plugging in a video capture function to the image capture control unit 33 (step S301), the image capture device 30's transmission/reception unit 31 transmits the account ID and model ID to the messaging server 92, and the messaging server 92 registers the image capture device 30 associated with the received model ID as waiting to receive a message (step S302).

Here, as described in FIG. 1, if the communication system 1 includes multiple image capture devices 30, the messaging server 92 can register the multiple image capture devices 30 as waiting to receive messages.

Meanwhile, when the user operates the input screen, the reception unit 12 of the communication terminal 10 receives a request to start streaming for the specified image capture device 30 (step S303), and the transmission/reception unit 11 of the communication terminal 10 transmits the request to start streaming, along with the account ID and the model ID of the specified image capture device 30, to the management server (step S304).

When the transmission/reception unit 51 of the management server 50 receives the streaming start request, account ID, and model ID sent from the communication terminal 10, the setting unit 54 of the management server 50 sets a streaming start notification (step S305), and the transmission/reception unit 51 transmits the streaming start notification and the account ID and model ID received in step S305 to the messaging server 92 (step S306).

The setting unit 54 of the management server 50 also sets a streaming video waiting notification (step S307), and the transceiver unit 51 transmits the streaming video waiting notification along with the account ID and model ID received in step S305 to the streaming server 93. The streaming server 93 then registers the image capture device 30 associated with the received model ID (step S308).

If the model ID received in step S306 matches the model ID registered in step S302, the messaging server 92 sets a streaming start notification for the image capture device 30 associated with that model ID (step S309), and sends the streaming start notification and model ID to the image capture device 30 associated with that model ID (step S310).

When the transmission/reception unit 31 of the image capture device 30 receives a streaming start notification from the messaging server 92, the image capture control unit 33 of the image capture device 30 starts capturing streaming video (step S311), and the transmission/reception unit 31 of the image capture device 30 transmits the account ID and model ID along with the video data to the streaming server 93 (step S312).

If the model ID received in step S312 matches the model ID registered in step S308, the streaming server 93 transmits the video data to the management server 50 (step S313).

When the transceiver unit 51 of the management server 50 receives the video data from the streaming server 93, it transmits the video data to the communication terminal 10 (step S314).

When the transceiver 11 of the communication terminal 10 receives the video data transmitted from the management server 50, the display control unit 13 of the communication terminal 10 displays the received video data on the display 106 (step S315).

Then, when the user operates the input screen, the reception unit 12 of the communication terminal 10 receives a request to end streaming for the specified image capture device 30 (step S316), and the transmission/reception unit 11 of the communication terminal 10 sends the account ID and the model ID of the specified image capture device 30 along with a streaming end notification to the management server (step S317).

When the transmission/reception unit 51 of the management server 50 receives the streaming end request, account ID, and model ID sent from the communication terminal 10, the setting unit 54 of the management server 50 sets a streaming end notification (step S319), and the transmission/reception unit 51 transmits the streaming end notification, the account ID received in step S317, and the model ID to the messaging server 92 (step S320).

If the model ID received in step S320 matches the model ID of the camera device 30 for which the streaming start notification was set in step S309, the messaging server 92 sets a streaming end notification for the camera device 30 associated with that model ID (step S321), and sends the streaming end notification and model ID to the camera device 30 associated with that model ID (step S322).

When the transceiver unit 31 of the image capture device 30 receives the streaming end notification, the image capture control unit 33 of the image capture device 30 ends video capture, and the transceiver unit 31 of the image capture device 30 ends transmission of video data to the streaming server 93 (step S323).

Figure 25 shows an example of the input screen for the second variant.

Figure 25 shows an example of the input screen corresponding to step S303 in the sequence diagram shown in Figure 24.

The display control unit 13 of the communication terminal 10 displays the input screen 400 shown in FIG. 25 in such a way that it further includes a video button 430 and a video display window 450 compared to the input screen 400 shown in FIG. 19.

The video display window 450 includes a video display section 451 and a video start/stop button 452.

When the user operates the video button 430, the reception unit 12 receives the operation instruction, and the display control unit 13 displays the video display window 450 on the input screen 400.

When the user operates the video start/stop button 452, a streaming start request is input to the image capture device 30 specified by the model ID displayed in the model information 402.

In step S315 of the sequence diagram shown in FIG. 24, the display control unit 13 displays the video data on the video display unit 451. Note that if the specified imaging device 30 has an error that prevents imaging, such as the device being turned off or not connected to communication, the video button 430 displayed on the input screen 400 may be displayed in half brightness or grayed out, so that the reception unit 12 will not accept operation instructions even if the video button 430 is operated. Also, if an error that prevents imaging has occurred, the input screen 400 may display a notification such as "Video cannot be started" to notify the user that an error has occurred.

Figure 26 is a flow diagram showing the processing of the messaging server in the second variant.

When the messaging server 92 receives the account ID and model ID from the camera device 30 (step S331), it registers the camera device 30 associated with the received model ID as waiting to receive a message (step S332).

When the messaging server 92 receives the account ID and model ID from the management server 50 (step S333), if the received model ID matches the model ID of the camera device 30 that is waiting to receive a message and was registered in step S332 (step S334), it sets a streaming start notification for the camera device 30 associated with that model ID and sends the streaming start notification to the camera device 30 associated with that model ID (step S335).

On the other hand, if the model ID received in step S333 does not match the model ID of the image capture device 30 that is waiting to receive a message and was registered in step S332, the messaging server 92 performs error processing, such as notifying the communication terminal 10 via the management server 50 (step S336).

Figure 27 is a flow diagram showing the processing of the streaming server in the second variant.

When the streaming server 93 receives the account ID and model ID from the management server 50 (step S341), it registers the image capture device 30 associated with the received model ID as waiting for streaming video (step S342).

When the streaming server 93 receives the video data and model ID from the image capture device 30 (step S343), if the received model ID matches the model ID of the image capture device 30 registered in step S342 (step S344), it transmits the streaming video data to the management server 50 (step S345).

On the other hand, if the model ID received in step S343 does not match the model ID of the image capture device 30 waiting for streaming video registered in step S342, the streaming server 93 performs error processing, such as notifying the communication terminal 10 via the management server 50 (step S346).

Figure 28 is a flow diagram showing the processing of the imaging device in the second variant.

The transmitter/receiver 31 of the image capture device 30 receives a notification from the messaging server 92 (step S351), and if the model ID received from the messaging server 92 matches the model ID of the image capture device 30 (step S352), and the received message is a streaming start notification (step S353), the image capture control unit 33 of the image capture device 30 starts capturing streaming video, and the transmitter/receiver 31 transmits video data to the streaming server 93 (step S354).

On the other hand, if the received message is a streaming end notification (step S355), the shooting control unit 33 of the image capturing device 30 ends shooting of the streaming video and automatically resumes shooting of time lapse images (step S356).

●Third Modification●
FIG. 29 is a diagram showing the functional configuration of an image capturing device in the third modified example of the communication system.

The imaging device 30 of the communication system 1 shown in Figure 29 is the imaging device 30 of the communication system 1 shown in Figure 5, to which a streaming control unit 35 with video imaging functionality has been plugged in.

The streaming control unit 35 performs some of the processing that was performed by the shooting control unit 33 in the second variant.

Figure 30 is a flow diagram showing the processing of the imaging device in the third variant.

The transmitter/receiver unit 31 of the image capture device 30 receives a notification from the messaging server 92 (step S361), and if the model ID received from the messaging server 92 matches the model ID of the image capture device 30 (step S362), and the received message is a streaming start notification (step S363), the streaming control unit 35 of the image capture device 30 starts capturing streaming video, and the transmitter/receiver unit 31 transmits video data to the streaming server 93 (step S364).

Figure 31 is a flow diagram showing other processing by the imaging device in the third variant.

The transmitter/receiver unit 31 of the image capture device 30 receives a notification from the messaging server 92 (step S371). If the model ID received from the messaging server 92 matches the model ID of the image capture device 30 (step S372) and the received message is a streaming end notification (step S373), the image capture control unit 33 of the image capture device 30 ends the capture of the streaming video and automatically resumes capturing time-lapse images (step S374).

In order to be able to perform the time-lapse photography described in the embodiment, a time-lapse photography function is plugged into the photography device 30. The relationship in this case with the video streaming function plug-in described in the second and third modified examples will be explained below.

First, when the image capture device 30 is capturing time-lapse images, the time-lapse image capture function plugin is activated (enabled). When the image capture device 30 receives a streaming start notification, it switches the plugin to be activated (enabled) and activates the video streaming function plugin. Then, when the image capture device 30 receives a streaming end notification, it switches the plugin to be activated and activates the time-lapse image capture function plugin.

In this way, when executing different functions, such as time-lapse photography and video streaming, based on the content of the received notification, the imaging device 30 controls the plug-in to be activated, allowing the desired function to be used.

Note that the time-lapse photography function plugin and the video streaming function plugin may be separate plugins, or they may both be included in a single plugin.

Furthermore, the control by which the image capture device 30 switches between plug-ins is not limited to the two plug-ins, the time-lapse image capture function plug-in and the video streaming function plug-in. For example, an update plug-in that checks whether the version of each plug-in installed in the image capture device 30 is the latest version could be considered.

In this case, after the imaging device 30 is powered on, the update plug-in is activated and queries a specified server to see if the plug-in installed on the imaging device 30 is the latest version. If the query finds that the latest version is available, the latest plug-in is downloaded from the specified server and installed. After that, the update plug-in is switched to a plug-in related to the imaging function, such as a time-lapse imaging function plug-in or a video streaming function plug-in.

The update plugin can also be used with the single-function plugins for time-lapse photography or video streaming. In other words, it is possible to use the update plugin to check for updates to the time-lapse photography plugin and then launch the time-lapse photography plugin, or to use the update plugin to check for updates to the video streaming plugin and then launch the video streaming plugin.

In this way, you can temporarily check streaming video even while capturing time-lapse images that you have already set up, which is useful in situations where you want to quickly check the situation at the scene in real time, such as when an earthquake occurs.

You can also set a maximum viewing time (time limit) for streaming videos. For example, if you set the maximum viewing time to 5 minutes, the app will automatically switch back to capturing time-lapse images 5 minutes after video streaming begins.

This will prevent mistakes like accidentally forgetting to end video streaming after viewing it and missing out on capturing time-lapse images.

Furthermore, if a maximum viewing time is set for a streaming video, the input screen 400 may display the viewing time or a countdown of the remaining time.

●Summary As described above, the management server 50, which is an example of an information processing device according to one embodiment of the present invention, comprises a setting unit 54, which is an example of a setting means, that sets images, which are an example of data stored in the second external storage 91, which is an example of a storage means and a second storage means, as targets to be deleted from the second external storage 91 when predetermined conditions are met, and a transceiver unit 51, which is an example of a transmission means, that transmits input screen information related to an input screen 400 for inputting information for setting images to be excluded from targets to be deleted to the communication terminal 10, and the setting unit 54 sets images to be excluded from targets to be deleted in accordance with operations on the input screen 400 displayed on the communication terminal 10 based on the transmitted input screen information.

This allows images to be stored in the second external storage 91 until certain conditions are met, and allows you to reserve images to be deleted from the second external storage 91 and images to continue to be stored in the second external storage 91 after the certain conditions are met, before the certain conditions are met.

In other words, this prevents desired images from being deleted without your knowledge, and allows images to be deleted and saved appropriately.

Here, the data stored in the second external storage 91 is not limited to still images, but may also be video, or measurement data such as vibration waveform data measured by a vibration sensor or three-dimensional distance data measured by LIDAR.

In addition, the images stored in the second external storage 91 may be transmitted and stored from a device other than the communication terminal 10, or may be transmitted and stored from the communication terminal 10.

The setting unit 54 sets an image, which is an example of measurement data transmitted from the imaging device 30, which is an example of a measurement device, and stored in the second external storage 91, as a target for deletion from the second external storage 91 when a predetermined condition is met.

In this case, images captured by the imaging device 30 are often saved to the second external storage 91 without the user's confirmation. However, in this embodiment, the user can use the input screen 400 to reserve images to be deleted from the second external storage 91 after certain conditions are met, and images to continue to be saved in the second external storage 91, before the certain conditions are met.

Here, the measurement device, such as the imaging device 30, may be integrated with the communication terminal 10.

The setting unit 54 sets an image stored in the second external storage 91 as a target for deletion from the second external storage 91 when a predetermined period of time has elapsed since the image was captured, as an example of when a predetermined condition is met.

This allows images to be stored in the second external storage 91 until a specified period of time has elapsed, and allows you to reserve images to be deleted from the second external storage 91 after the specified period has elapsed and images to continue to be stored in the second external storage 91 before the specified period has elapsed.

As another example of when a predetermined condition is met, the setting unit 54 may set images stored in the second external storage 91 as targets for deletion from the second external storage 91 when the number of images stored in the second external storage 91 exceeds a predetermined amount (e.g., 5,000 images). In this case, images are deleted in order starting with the oldest image capture date and time.

The setting unit 54 sets images that are automatically captured by the imaging device 30 in a predetermined imaging mode, transmitted from the imaging device 30, and saved in the second external storage 91 as images to be deleted.

In this case, images are often saved to the second external storage 91 without the user's confirmation, but in this embodiment, the user can use the input screen 400 to reserve images to be deleted from the external storage 91 after certain conditions are met, and images to continue to be saved in the second external storage 91, before the certain conditions are met.

The transmitter/receiver 51 transmits to the communication terminal 10 videos that are automatically captured by the imaging device 30 and are not saved in the second external storage 91.

The transmitter/receiver 51 does not send input screen information to the communication terminal 10 while transmitting video.

The setting unit 54 does not set images that are manually captured by the image capture device 30, transmitted from the image capture device 30, and stored in the first external storage 90, which is an example of a storage means and a first storage means, as targets for deletion.

The setting unit 54 does not set, as targets for deletion, images that have been manually captured by a camera other than the camera 30, transmitted from the camera, and stored in the first external storage 90.

The setting unit 54 sets the images to be excluded from deletion when the total of the number of images manually captured and saved in the first external storage 90 and the number of images to be excluded from deletion falls within a predetermined range.

This allows for appropriate setting of images to be excluded from deletion even when the amount of images that can be stored in the second external storage 91 and the first external storage 90 is limited to a range that includes an upper limit, such as the maximum number of images that can be stored. Note that the amount of images and the predetermined amount may be either the number of images or the capacity.

When the total reaches the maximum number of images that can be saved, which is an example of the upper limit of a predetermined amount range, the transceiver 51 transmits notification information to the communication terminal 10 informing the user that manually captured images cannot be saved and/or that images cannot be set to be excluded from deletion.

When the total reaches the maximum number of images that can be stored, the transmitter/receiver 51 sends information to the communication terminal to further increase the maximum number of images that can be stored.

The setting unit 54 associates the images stored in the second external storage 91 with the account information transmitted from the image capture device 30 and sets them as targets for deletion, and the transmission/reception unit 51 transmits input screen information related to the input screen 400 that includes the account information.

This means that even if images are set as targets for deletion for each account information, it is possible to reserve, for each account information, the images to be deleted from the second external storage 91 after a specified condition is met, and the images to be continuously stored in the second external storage 91, before the specified condition is met.

When the account information transmitted from the image capture device 30 matches the pre-stored account information, the setting unit 54 associates the images stored in the second external storage 91 with the account information and sets them as targets for deletion.

This allows you to set images to be deleted for each account.

When the account information and identification information identifying the image capture device 30 transmitted from the image capture device 30 match the account information and identification information previously stored in association with each other, the setting unit 54 sets the images stored in the second external storage 91 as targets for deletion in association with the account information.

This allows only images sent from a camera device 30 with identification information that has been previously stored in association with account information to be set as targets for deletion.

An information processing method according to one embodiment of the present invention includes a setting step of setting an image, which is an example of data transmitted from an imaging device 30, which is an example of a measurement device, and stored in a second external storage 91, which is an example of a storage means, as a target for deletion from the second external storage 91 when a predetermined condition is met, and a display step of displaying an input screen 400 for inputting information for setting images to be excluded from the targets for deletion, and the setting step includes processing for setting images to be excluded from the targets for deletion in accordance with an operation on the displayed input screen 400.

The information processing method further includes a transmission step of transmitting, to the communication terminal 10, input screen information relating to an input screen 400 for inputting information for setting images to be excluded from deletion targets, and the setting step includes processing for setting images to be excluded from deletion targets in response to operations on the input screen 400 displayed on the communication terminal 10 based on the transmitted input screen information.

An information processing system according to one embodiment of the present invention comprises a photographing device 30, an information processing device capable of communicating with the photographing device 30, and a communication terminal 10 capable of communicating with the information processing device. The information processing device comprises a setting unit 54 that sets images transmitted from the photographing device 30 and stored in second external storage 91 as images to be deleted from the second external storage 91 when a predetermined condition is met, and a transmission/reception unit 51 that transmits, to the communication terminal 10, input screen information relating to an input screen 400 for inputting information for setting images to be excluded from the images to be deleted. The setting unit 54 sets images to be excluded from the images to be deleted in response to operations on the input screen 400 displayed on the communication terminal 10 based on the transmitted input screen information.

The management server 50 according to one embodiment of the present invention includes a setting unit 54 that sets data stored in the second external storage 91 as data to be deleted from the second external storage 91 when predetermined conditions are met, and the setting unit 54 sets the data to be excluded from deletion in response to an operation on an input screen 400 for inputting information for setting data to be excluded from deletion.

In this case, the input screen 400 may be set and displayed on the communication terminal 10 side, or on the management server side.

●Additional Information●
Each function of the above-described embodiments can be realized by one or more processing circuits. Here, the term "processing circuit" in the present embodiment includes a processor programmed to perform each function by software, such as a processor implemented by an electronic circuit, as well as devices designed to perform each function described above, such as an ASIC (Application Specific Integrated Circuit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), an SOC (System on a Chip), a GPU (Graphics Processing Unit), and conventional circuit modules.

The various tables in the embodiments described above may also be generated through the learning effects of machine learning, and tables may not be required if data for each associated item is classified using machine learning. Here, machine learning is a technology that allows a computer to acquire human-like learning abilities, and refers to a technology in which a computer autonomously generates algorithms necessary for judgments such as data identification from training data that is previously acquired, and applies these to new data to make predictions. The learning method for machine learning may be any of supervised learning, unsupervised learning, semi-supervised learning, reinforcement learning, and deep learning, or may be a combination of these learning methods; the learning method for machine learning is not important.

So far, we have described an information processing device, information processing method, program, and information processing system according to one embodiment of the present invention, but the present invention is not limited to the above-described embodiment. Other embodiments can be added, modified, or deleted, etc., within the scope of what one skilled in the art can conceive. Any aspect that achieves the functions and effects of the present invention is within the scope of the present invention.

1. Communication system (an example of an information processing system)
10 Communication terminal 11 Transmitting/receiving unit 12 Receiving unit 13 Display control unit (an example of a display control means)
30. Imaging device (example of measuring device)
31 Transmitting/receiving unit 33 Shooting control unit 35 Streaming control unit 50 Management server (an example of an information processing device)
51 Transmitting/receiving unit (an example of a transmitting means)
54 Setting unit (an example of a setting means)
90 First external storage (storage means, an example of first storage means)
91 Second external storage (storage means, an example of second storage means)
92 Messaging server 93 Streaming server 200 Confirmation screen 400 Input screen 5000 Storage unit (an example of a storage means)

Claims (18)

a setting means for setting an image transmitted from the photographing device and stored in the storage means as an image to be deleted from the storage means when a predetermined condition is met;
a transmitting means for transmitting, to the communication terminal, input screen information relating to an input screen for inputting information for setting images to be excluded from the target for deletion;
Equipped with
The setting means
and setting images to be excluded from the deletion targets in accordance with an operation on the input screen displayed on the communication terminal based on the transmitted input screen information.
Information processing device. The setting means
2. The information processing apparatus according to claim 1, wherein the image stored in the storage means is set as a target for deletion from the storage means when a predetermined period of time has passed since the image was captured. The setting means
3. The information processing apparatus according to claim 1, wherein the image automatically captured by the photographing device, transmitted from the photographing device, and stored in the storage unit is set as the image to be deleted. The information processing device of any one of claims 1 to 3, wherein the transmission means transmits to the communication terminal a video automatically captured by the imaging device and not stored in the storage means. The information processing device of claim 4, wherein the transmission means does not transmit the input screen information to the communication terminal while transmitting the video. The setting means
6. The information processing apparatus according to claim 3, wherein an image that is manually photographed by the photographing device, transmitted from the photographing device, and stored in the storage means is not set as an image to be deleted. The setting means
An information processing device as described in any one of claims 3 to 5, wherein images manually photographed by another photographing device different from the photographing device, transmitted from the other photographing device, and stored in the storage means are not set as targets for deletion. The setting means
An information processing device as described in claim 6 or 7, wherein the images to be excluded from the deletion target are set so that the sum of the amount of images manually taken and stored in the storage means and the amount of images to be excluded from the deletion target is within a predetermined amount. If the sum reaches the upper limit of the range of the predetermined amount,
The transmitting means
The information processing apparatus according to claim 8 , further comprising: transmitting notification information to the communication terminal informing the user that the manually captured image cannot be saved or that the image to be excluded from the image to be deleted cannot be set. If the sum reaches the upper limit of the range of the predetermined amount,
The transmitting means
10. The information processing apparatus according to claim 8, wherein information for further increasing the upper limit value of the range of the predetermined amount is transmitted to the communication terminal. The setting means
the image stored in the storage means is associated with the account information transmitted from the photographing device and set as the image to be deleted;
11. The information processing apparatus according to claim 1, wherein the transmission means transmits the input screen information relating to the input screen including the account information. The setting means
12. The information processing device according to claim 11, wherein, when the account information transmitted from the photographing device matches pre-stored account information, the image stored in the storage means is set as a target for deletion in association with the account information. The setting means
13. The information processing device according to claim 12, wherein, when the account information transmitted from the photographing device and the identification information identifying the photographing device match the account information and the identification information stored in advance, the image stored in the storage means is set as the target for deletion in association with the account information. a setting step of setting an image transmitted from the photographing device and stored in the storage means as a target to be deleted from the storage means when a predetermined condition is met;
a transmitting step of transmitting, to the communication terminal, input screen information relating to an input screen for inputting information for setting images to be excluded from the target for deletion;
Equipped with
The setting step includes:
and a process of setting an image to be excluded from the target to be deleted in response to an operation on the input screen displayed on the communication terminal based on the transmitted input screen information.
Information processing methods. An information processing system including a photographing device, an information processing device capable of communicating with the photographing device, and a communication terminal capable of communicating with the information processing device,
The information processing device includes:
a setting means for setting an image transmitted from the photographing device and stored in a storage means as an image to be deleted from the storage means when a predetermined condition is met;
a transmitting means for transmitting, to the communication terminal, input screen information relating to an input screen for inputting information for setting images to be excluded from the images to be deleted;
Equipped with
The setting means
and setting images to be excluded from the deletion targets in accordance with an operation on the input screen displayed on the communication terminal based on the transmitted input screen information.
Information processing system. a setting means for setting data stored in the storage means as a target for deletion from the storage means when a predetermined condition is met;
a transmitting means for transmitting, to the communication terminal, input screen information relating to an input screen for inputting information for setting data to be excluded from the data to be deleted;
Equipped with
The setting means
and setting data to be excluded from the data to be deleted in response to an operation on the input screen displayed on the communication terminal based on the transmitted input screen information.
Information processing device. a setting step of setting data transmitted from the measurement device and stored in the storage means as a target to be deleted from the storage means when a predetermined condition is met;
a display step of displaying an input screen for inputting information for setting data to be excluded from the deletion target;
Equipped with
The setting step includes:
and a process of setting data to be excluded from the data to be deleted in response to an operation on the displayed input screen.
Information processing methods. A program for causing a computer to execute the information processing method according to claim 14 or 17 .