JP7735826B2 - Recording system, server device, worker device, and recording method - Google Patents

Description

This disclosure relates to a recording system, a server device, a worker device, and a recording method.

Universities, corporate research institutions, hospitals, health centers, and other medical institutions use a variety of items such as samples, reagents, and equipment for research and analysis. Managing the usage history, inventory information, and work information of the workers who perform these tasks is important for ensuring the quality of data obtained through research and analysis, as well as for confirming that items are being used and stored correctly and that there are no problems with the work. Meanwhile, with the development of science and technology, the number of items used in research and analysis is steadily increasing.

JP 2002-082120 A (Patent Document 1) discloses a system that assigns two-dimensional codes to sample containers and reads these codes to properly manage sample information. JP 2020-052602 A (Patent Document 2) discloses a system that records the usage history of equipment and can search for experiments related to specific materials.

Japanese Patent Application Laid-Open No. 2002-082120 Japanese Patent Application Laid-Open No. 2020-052602

In the fields of research and analysis, a variety of tasks using many items are performed through trial and error. Because these diverse tasks can potentially affect the quality of the results, it is desirable to record all tasks. However, depending on the nature of the research or analysis, speed is often required, and workers need to carry out multiple tasks in parallel. However, the systems disclosed in Patent Documents 1 and 2 were unable to properly record multiple tasks using many items while they were being performed.

This disclosure has been made to solve this problem, and its purpose is to provide a recording system, server device, worker device, and recording method that allows for the efficient progress of future work by recording worker work along with information on many items.

The recording system disclosed herein relates to a recording system that records work using items with identifiers attached. The recording system includes a photographing unit that photographs the work, a storage unit that records image data photographed by the photographing unit as video data, an extraction unit that extracts identifiers from the video data stored in the storage unit, an identification unit that identifies item information that can identify the item based on the identifier, and a processing unit that executes processing to associate and add the item information identified by the identification unit with time information indicating the time the identifier was read to the video data.

The server device according to the present disclosure relates to a server device that acquires video data of work using an item with an identifier. The server device includes a receiving unit that receives the identifier, time information indicating the time the identifier was read, and video data; an identifying unit that identifies item information that can identify the item based on the identifier; and a processing unit that executes processing to associate the item information identified by the identifying unit with the time information and add it to the video data.

The worker device according to the present disclosure relates to a worker device that records work performed using items with identifiers attached. The worker device includes a photographing unit that photographs the work, an extraction unit that extracts identifiers from video data photographed by the photographing unit, an identification unit that identifies item information that can identify the item based on the identifier, and a processing unit that executes processing to associate and add the item information identified by the identification unit with time information indicating the time the identifier was read to the video data.

The recording method disclosed herein relates to a recording method for recording work using an item with an identifier attached. The recording method includes the steps of: filming the work; extracting the identifier from the filmed video data; identifying item information that can identify the item based on the identifier; and adding, to the video data, the item information and time information indicating the time the identifier was read, in association with each other.

The recording system, server device, worker device, and recording method disclosed herein make it possible to record the work of workers along with information on many items without placing a burden on the workers.

1 is a diagram showing the overall configuration of a recording system according to a first embodiment; FIG. 2 is a diagram for explaining the flow of the recording system according to the first embodiment. 10A and 10B are diagrams for explaining the process of creating log-attached video data in the recording system according to the first embodiment. 10A and 10B are diagrams for explaining a process for creating work video data in the recording system according to the first embodiment. 10 is a flowchart illustrating a worker device setting process. 10 is a flowchart showing a server device setting process. FIG. 10 is a diagram showing the overall configuration of a recording system according to a second embodiment.

The present embodiment will be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are designated by the same reference numerals, and their description will not be repeated in principle.
First Embodiment
A recording system 1000 according to the first embodiment will be described with reference to Figures 1 to 4. Figure 1 is a diagram showing the overall configuration of the recording system 1000 according to the first embodiment. Figure 2 is a diagram for explaining the flow of the recording system according to the first embodiment. Figure 3 is a diagram for explaining the process of creating log-attached video data in the recording system according to the first embodiment. Figure 4 is a diagram for explaining the process of creating work video data in the recording system according to the first embodiment.

As shown in FIG. 1, the recording system 1000 includes a worker device 1 and a server device 2. In the recording system 1000, the worker device 1 and the server device 2 are connected via a network 4. The recording system 1000 is a system used, for example, in research institutions such as universities and companies, or in medical institutions such as hospitals and health centers.

The worker device 1 includes a small terminal device 10, a camera 31, a speaker 32, and a display 33. The small terminal device 10 is configured according to a general-purpose computer architecture. The small terminal device 10 may be a desktop computer, a laptop computer, a tablet computer, a mobile terminal such as a smartphone, or the like.

The small terminal device 10 comprises a processor 11, a main memory 12, a communication interface 13, an input/output interface 14, and storage 15. These components are connected via a bus. A camera 31, a speaker 32, and a display 33 are connected to the input/output interface 14.

Processor 11 is a computing entity (computer) that executes various processes according to various programs. Processor 11 is composed of, for example, at least one of a CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), GPU (Graphics Processing Unit), and MPU (Multi-Processing Unit). Processor 11 may also be composed of processing circuitry. Processor 11 reads programs stored in storage 15, expands them into main memory 12, and executes them.

The main memory 12 is composed of, for example, volatile storage devices such as RAM (Random Access Memory), DRAM (Dynamic RAM), and SRAM (Static Random Access Memory), and non-volatile devices such as ROM (Read Only Memory).

The communication interface 13 transmits and receives data (information) to and from other devices via a wired or wireless connection. In this embodiment, the communication interface 13 transmits and receives data (information) to and from the communication interface 23 of the server device 2 via wireless communication via the network 4, which uses a wireless LAN (Local Area Network).

The input/output interface 14 accepts input signals from the user via input devices such as a mouse, keyboard, buttons, and/or touch panel, identifier information such as a two-dimensional code input from the camera 31, and video data, and outputs output signals from the processor 11 to the speaker 32 and display 33.

Camera 31 functions as a camera that captures a series of tasks performed by a worker in research, analysis, etc. as multiple image data. A worker is someone who manually performs research, analysis, etc. using many items. Camera 31 is, for example, a wearable camera, such as a glasses-type camera that can be worn on the worker's head. Camera 31 transmits a collection of multiple image data sets to input/output interface 14 as video data. The video data obtained by camera 31 is transmitted to server device 2 via network 4.

The speaker 32 emits a sound to notify that the identifier has been read. The display 33 is a display device such as a liquid crystal display, plasma display, or organic EL (Electro Luminescence) display. The display 33 displays video data and the like on the screen under the control of the processor 11.

Storage 15 is composed of a non-volatile storage device such as a hard disk drive (HDD) or solid state drive (SSD). Storage 15 stores time information 151 when the identifier is read, identifier information 152 such as a two-dimensional code, video data 153 of a worker's work, etc.

Server device 2 is configured according to a general-purpose computer architecture. In this embodiment, server device 2 is a server device owned by a research institute such as a university or company, or a medical institution such as a hospital or health center. In order to meet the user's unique security requirements, server device 2 is preferably installed within a research institute building, a medical institution building, or the like. However, server device 2 may also exist on the cloud via a network.

The server device 2 includes a processor 21, a main memory 22, a communication interface 23, an input/output interface 24, and storage 25. These components are connected via a bus.

The processor 21 is a computing entity (computer) that executes various processes in accordance with various programs. The processor 21 is composed of, for example, at least one of a CPU, FPGA, GPU, and MPU. The processor 21 may also be composed of an arithmetic circuit. The processor 21 reads programs stored in the storage 25, expands them into the main memory 22, and executes them.

The main memory 22 is composed of, for example, volatile storage devices such as RAM, DRAM, and SRAM, or non-volatile devices such as ROM. The communication interface 23 transmits and receives data (information) to and from other devices via wired or wireless connections. In this embodiment, the communication interface 23 transmits and receives data (information) to and from the communication interface 13 of the worker device 1 via wireless communication via the network 4 using a wireless LAN. The input/output interface 24 accepts input signals from the user via buttons, a touch panel, etc., and outputs output signals from the processor 21 to various devices not shown.

Storage 25 is composed of, for example, a non-volatile storage device such as an HDD or SSD. Storage 25 stores sample information 251, reagent information 252, device information 253, time information 254, identifier information 255, video data 256, work information 257, log-attached video data 258, and work video data 259. Sample information 251 is information about samples used as materials or specimens for research and analysis. Reagent information 252 is information about reagents manufactured for the purpose of causing reactions in experiments. Device information 253 is information about devices used for research and analysis. Time information 254 is information indicating the time at which an identifier transmitted from worker device 1 was read. Identifier information 255 is information about an identifier, such as a two-dimensional code, attached to an item. Video data 256 is data obtained by filming the worker's work. Work information 257 is information that classifies video data 256 by worker's work. Log-attached video data 258 is data in which time information and product information of the item corresponding to the identifier are added to work video data 259 and video data 256. Work video data 259 is data in which work tags are added to the video data using work information 257.

Next, the flow of the recording system will be explained using Figure 2. As shown in Figure 2, a two-dimensional code 61 corresponding to sample 51 is attached to the surface of a petri dish containing sample 51 used for culturing. A two-dimensional code 62 corresponding to reagent 52 is attached to the surface of a test tube containing reagent 52 used for culturing. Two-dimensional codes 61 and 62 are printed on a sealant and then attached to each item. Two-dimensional codes 61 and 62 may also be printed directly on each item. Two-dimensional codes are also attached to devices such as analytical equipment (not shown).

The worker first activates the small terminal device 10 and the camera 31. The small terminal device 10 may be activated by turning on the camera 31 switch. After the camera 31 is activated, image capture begins automatically. Image capture may also be initiated by the worker operating the camera 31 or the small terminal device 10. The worker's work captured by the camera 31 is stored as video data 153 in the storage 15 of the worker device 1. The stored video data 153 is made up of multiple image data. For example, 30 frames of image data are stored in the storage 15 as one second of video data 153.

Video data 153 is transmitted from worker device 1 to server device 2 at regular intervals. The small terminal device 10 reads two-dimensional codes 61, 62 when image data relating to the two-dimensional codes 61, 62 has been stored continuously in the video data 153 for a predetermined period of time. The predetermined period is, for example, one second. The two-dimensional codes 61, 62 are read when the worker stares at the two-dimensional codes 61, 62 for one second or more. The two-dimensional codes 61, 62 may be read based on video data captured by fixed camera 310. The two-dimensional codes 61, 62 are converted into identifier information 152 and stored in storage 15. Time information 151 indicating when the two-dimensional codes 61, 62 were read is also stored in storage 15. The two-dimensional codes 61, 62 may be recognized in real time.

Time information 151 and identifier information 152 are transmitted from the worker device 1 to the server device 2. The server device 2 stores time information 254 and identifier information 255 corresponding to the time information 151 and identifier information 152 transmitted from the worker device 1. The server device 2 associates a log formed from the time information 254 and identifier information 255 with an ID list formed from the sample information 251, reagent information 252, and device information 253, and adds them to the video data 256.

Specifically, each of the item information identifying an item, namely, sample information 251, reagent information 252, and device information 253, is assigned an ID corresponding to identifier information 255. The server device 2 identifies which item was used in the work by comparing the identifier information 255 with the ID list.

The server device 2 stores the video data 153 transmitted from the worker device 1 as video data 256 in the storage 25. The server device 2 creates log-attached video data 258 in which item information is identified for the video data 256. The server device 2 creates work video data 259 based on the log-attached video data 258, to which work tags classifying each work are added.

The process of creating log-attached video data 258 will be described in detail using Figure 3. As shown in Figure 3, video data 153 captured using camera 31 or fixed camera 310 is transmitted to server device 2. Video data 153 is stored as video data 256 in storage 25 of server device 2. Server device 2 stores time information 151 and identifier information 152 transmitted from worker device 1 in storage 25 as time information 254 and identifier information 255 indicating the log.

The identifier information 255 is identified as any of the item information from the sample information 251, reagent information 252, and device information 253 in the ID list stored in the storage 25. The identified item information and time information 254 are associated and added to the video data 256. The display 33 displays the log-attached video data 258 created in this manner. As shown in Figure 3, the screen of the display 33 displays the captured video as well as the item information corresponding to the identifier read at each time.

The process of creating work video data 259 will be described in detail using Figure 4. As shown in Figure 4, the worker uses the calendar image 331 displayed on the display 33 to display the log-attached video data 258 saved for the day the work was performed. Specifically, when the worker aligns the mouse pointer with a date on the calendar image 331 and clicks, the log-attached video data 258 corresponding to that date is read out.

While playing back the log-attached video data 258, the worker inputs task information into the log-attached video data 258 and adds task tags. For example, a progress bar 71 is displayed that changes from left to right in accordance with the time axis of one piece of log-attached video data 258. A triangular image that allows the worker to determine the start and end times of a task is displayed on the progress bar 71. The worker determines the start and end times of a task by moving the triangular image with a mouse or the like. This creates a video bar 72 in which the start and end times of a task have been determined from the log-attached video data 258.

The worker further inputs work information 257, such as the experiment name and work content. As a result, the start time, end time, and work content are added as work information 257 to the video data showing one work in the log-attached video data 258. The worker repeats this process, dividing the log-attached video data 258 into each work and inputting work information to create work video data 259 with work tags.

The work video data 259 created in this way can be displayed on the display 33. As shown in Figure 4, work information 257, in which each work is numbered, is displayed on the screen of the display 33. By selecting one of the numbered works with a mouse or the like, the worker can display a video bar 72 and the work video data 259 for the period corresponding to that video bar 72.

Next, the processing executed in the worker device 1 will be described. Figure 5 is a flowchart showing the worker device setting processing set in the worker device 1. The worker device setting processing is executed by the processor 11 of the worker device 1 executing a program. The processor 11 functions as a processing unit that executes each process. The processor 11 calls the worker device setting processing, which is a subroutine, from the main routine at regular intervals. Below, each step in the flowchart will be simply referred to as "S".

In the worker device setting process, the processor 11 determines whether or not a power-off signal has been received from the camera 31 (S101). If the processor 11 has not received a power-off signal from the camera 31 (NO in S101), the processor proceeds to processing in S102. If the processor 11 has received a power-off signal from the camera 31 in S101 (YES in S101), the processor 11 notifies the server device 2 that work has been stopped (S111) and proceeds to processing in S112. In S112, the processor 11 determines whether or not there is unsent video data 153 in the storage 15. If there is video data 153 (YES in S112), the processor 11 transmits the video data 153 to the server device 2 (S110). If there is no video data 153 (NO in S112), the processor 11 returns to the main routine.

In S102, processor 11 determines whether or not the camera 31 is currently taking pictures. Whether or not taking pictures is currently taking pictures can be determined by whether or not image data (video data 153) is being received. If processor 11 determines that the camera 31 is currently taking pictures (YES in S102), it proceeds to processing in S106. If processor 11 determines that the camera 31 is not currently taking pictures (NO in S102), it determines whether or not a power-on signal from the camera 31 has been received (S103). If processor 11 has not received a power-on signal from the camera 31 in S103 (NO in S103), it returns processing to the main routine.

If the processor 11 receives a power-on signal from the camera 31 in S103 (YES in S103), it notifies the server device 2 of the start of work (S104). Next, the processor 11 records the image data captured by the camera 31 in the storage 15 as video data 153 (S105). Next, the processor 11 determines whether multiple image data containing an identifier are consecutive for one second or more (S106).

Specifically, processor 11 determines whether multiple pieces of image data recognized as image data containing identifiers such as two-dimensional codes 61, 62 have been extracted continuously for one second or more within video data 153 being recorded. If multiple pieces of image data containing identifiers have been extracted continuously for one second or more, processor 11 executes a process to read the identification data indicated by the identifiers. On the other hand, processor 11 does not read the identification data indicated by the identifiers even if multiple pieces of image data recognized as image data containing identifiers have been extracted continuously for less than one second. In this way, identifiers will not be read in for periods shorter than one second, and it is possible to avoid reading unnecessary identifiers.

If processor 11 determines that multiple image data containing an identifier are not consecutive for one second or more (NO in S106), it proceeds to processing in S109. If processor 11 determines that multiple image data containing an identifier are consecutive for one second or more (YES in S106), it transmits time information 151 indicating the time the identifier was read and identifier information 152 to server device 2 (S107). Next, processor 11 transmits a signal to speaker 32 to notify that the identifier has been read successfully (S108). This allows the worker to reliably recognize that the identifier has been read successfully by the sound.

The successful reading of the identifier may be communicated to the worker by means other than sound. For example, the successful reading of the identifier may be indicated by the light emitting means attached to the camera 31 emitting light, an image being displayed on a screen displayed within the field of view of the eyeglass-type wearable camera, or the vibration of a vibration element. The successful reading of the identifier may also be indicated by a combination of two or more of sound, light, a display on a screen, and vibration.

Next, processor 11 determines whether a certain period of time has passed since receiving video data 153 (S109). The certain period of time is a period of several minutes to several tens of minutes. For example, processor 11 determines in S109 whether video data 153 has been stored continuously for 10 minutes. If processor 11 determines in S109 that the certain period of time has not passed (NO in S109), it returns processing to the main routine.

If the processor 11 determines in S109 that a certain period of time has elapsed (YES in S109), it transmits the video data 153 to the server device 2 (S110) and returns processing to the main routine. Through the processing of S109 and S110, the video data 153 is recorded for a certain period of time and then transmitted to the server device 2, thereby reducing the processing burden on the worker device 1 compared to transmitting the video data 153 to the server device 2 at any time. Note that if the worker device 1 is capable of high-speed processing, it may be configured to transmit the video data 153 to the server device 2 at any time. The video data 153 may be a recording of the worker's entire work, from start to finish.

Next, we will explain the processing executed by the server device 2. Figure 6 is a flowchart showing the server device setting processing set in the server device 2. The server device setting processing is executed by the processor 21 of the server device 2 executing a program. The processor 21 functions as a processing unit that executes each process. The processor 21 calls the server device setting processing, which is a subroutine, from the main routine at regular intervals.

In the server device setting process, the processor 21 determines whether a work stop signal transmitted by the worker device 1 turning off the camera 31 has been received, thereby confirming whether the camera 31 has been turned off and the worker has stopped working (S201). If the processor 21 confirms that work has stopped in S201 (YES in S201), it registers the work end time (S209) and returns processing to the main routine.

If the processor 21 does not confirm that work has stopped in S201 (NO in S201), it determines whether it has received a work start signal transmitted by the worker device 1 by turning on the camera 31, thereby confirming whether the camera 31 has been turned on and the worker has started work (S202). If the processor 21 confirms that work has started in S202 (YES in S202), it registers the work start time (S210) and returns processing to the main routine.

If the processor 21 does not confirm the start of work in S202 (NO in S202), it determines whether it has received time information 151 and identifier information 152 transmitted from the worker device 1 (S203). If the processor 21 has not received time information 151 and identifier information 152 in S203 (NO in S203), it proceeds to processing in S205. If the processor 21 has received time information 151 and identifier information 152 in S203 (YES in S203), it identifies item information by comparing the sample information 251, reagent information 252, and device information 253 with the recorded identifier information 255 (S204).

Next, the processor 21 determines whether or not video data 153 has been received (S205). If the processor 21 has not received video data 153 in S205 (NO in S205), the processor 21 proceeds to processing in S207. If the processor 21 has received video data 153 in S205 (YES in S205), the processor 21 creates log-attached video data 258 using the recorded video data 256 (S206). The log-attached video data 258 is video data in which time information 254 when the identifier was read and item information corresponding to the identifier information 255 have been attached to the video data 256 as a log for the video data 256 stored in the storage 25.

The processor 21 then determines whether or not work information 257 has been received (S207). If the processor 21 has not received work information 257 in S207 (NO in S207), the processor 21 returns the process to the main routine. If the processor 21 has received work information 257 in S207 (YES in S207), the processor 21 creates work video data 259 (S208) and returns the process to the main routine. The work video data 259 is video data in which work tags, such as work content categorized by work, have been added to the log-attached video data 258 stored in the storage 25.

Here, conventionally, video recording and identifier reading were performed separately. For example, consider a case where an experiment uses reagents stored in a refrigerator and samples cultured in an incubator. In such a case, if the worker's work and identifier reading were performed separately, the work would need to be interrupted. Furthermore, if the reagents and samples were removed from the refrigerator or incubator for an extended period of time, performance would be degraded. According to this embodiment, the worker can read the identifier during the work process, thereby obtaining identifier information without burdening the worker and avoiding degradation of the performance of the reagents and samples.

According to this embodiment, it is possible to create log-attached video data 258 and work video data 259. Therefore, by checking the work video data 259 categorized by work, a worker can always confirm what items were used and when, enabling quality control and history management, as well as the effective progress of work in future research and analysis.
<Second Embodiment>
A recording system 2000 according to the second embodiment will be described with reference to Fig. 7. Fig. 7 is a diagram showing the overall configuration of the recording system 2000 according to the second embodiment. As shown in Fig. 2, the recording system 2000 is configured with only an operator device 1A, and does not include a server device 2 or a network 4, as compared to the recording system 1000 according to the first embodiment.

As shown in FIG. 7 , the worker device 1A differs from the worker device 1 of embodiment 1 in the storage 25. The storage 25 has the same configuration as the storage 25 included in the server device 2 of embodiment 1. In other words, the worker device 1A of embodiment 2 is configured to realize the functions of the server device 2 of embodiment 1 in a single device. The processor 11 of the worker device 1A also has the functions of the processor 21 included in the server device 2. The other components are the same as those of embodiment 1, so a description thereof will be omitted.

According to recording system 2000 including worker device 1A, it is possible to record the work of a worker together with information on many items using a single device without using network 4, without imposing a burden on the worker.
<Modification>
In the above-described embodiment, the items include samples, reagents, and devices. The items may also be materials, equipment, specimens, instruments, incubators, or any other items that can be used in the work.

In the above-described embodiment, the camera for capturing video and the camera for reading the two-dimensional code were described as being the same. However, it is also possible to provide separate cameras for capturing video and reading the two-dimensional code.

In the above-described embodiment, the identifier is described as a two-dimensional code. The identifier may also be a one-dimensional code such as a barcode, an AR marker, etc.

In the above-described embodiment, when creating the work video data 259, it may be possible to edit out incorrect work, etc., when editing the log-attached video data.

In the above-described embodiment, the work information 257 has been described as being provided by the worker. The work information 257 may also be provided by the worker device 1 or the server device 2. Specifically, the worker device 1 or the server device 2 may determine a change in work from the log-attached video data 258 and classify the work. Alternatively, the work information 257 may be provided by the worker via the network 4 from a small terminal device (desktop computer, laptop computer, tablet computer, smartphone, etc.) other than the small terminal device 10 that constitutes the worker device 1.

[Aspects]
It will be appreciated by those skilled in the art that the exemplary embodiments described above are examples of the following aspects.

(Section 1) One aspect of the recording system relates to a recording system that records work using items with identifiers attached. The recording system includes a photographing unit that photographs the work, a storage unit that records image data photographed by the photographing unit as video data, an extraction unit that extracts an identifier from the video data stored in the storage unit, an identification unit that identifies item information that can identify the item based on the identifier, and a processing unit that executes processing to associate and add the item information identified by the identification unit and time information indicating the time the identifier was read to the video data.

The recording system described in paragraph 1 allows workers' work to be recorded along with information on many items without placing a burden on the workers.

(Clause 2) The device further includes a display unit that displays associated item information and time information.

The recording system described in paragraph 2 allows workers to easily check on the display when an item was used during work.

(Section 3) The processing unit accepts data for adding task tags categorized by task, and performs processing to add the task tags to the video data.

The recording system described in paragraph 3 allows video data to be managed and stored for each task by adding task tags to the video data.

(Clause 4) The extraction unit extracts the identifier when image data indicating the identifier is recorded continuously within the video data for more than a predetermined period of time.

With the recording system described in paragraph 4, even if an identifier is unintentionally photographed by a worker during work, the identifier will not be extracted unless it has been continuously recorded for more than a specified period of time, thereby avoiding the extraction of unnecessary identifiers.

(Clause 5) The item includes at least one of a sample, a reagent, and an apparatus.

The recording system described in Section 5 allows the operator's work to be recorded along with information about samples, reagents, and equipment contained in many items without placing a burden on the operator.

(Item 6) The system further includes a notification unit that notifies the worker that an item identifier has been extracted.

The recording system described in paragraph 6 makes it easy to notify workers that an item's identifier has been extracted.

(Clause 7) The recording system includes a worker device and a server device. The worker device includes a photographing unit and an extraction unit. The server device includes an identification unit and a processing unit.

The recording system described in paragraph 7 uses a worker device and a server device to record the worker's work along with information on many items without placing a burden on the worker.

(Section 8) One aspect of the server device relates to a server device that acquires video data of work using an item with an identifier. The server device includes a receiving unit that receives the identifier, time information indicating the time the identifier was read, and video data; an identifying unit that identifies item information that can identify the item based on the identifier; and a processing unit that executes a process of associating the item information identified by the identifying unit with the time information and adding it to the video data.

The server device described in paragraph 8 makes it possible to record the work of workers along with information on many items without placing a burden on the workers.

(Item 9) One embodiment of a worker device relates to a worker device that records work performed using an item with an identifier attached. The worker device includes a photographing unit that photographs the work, an extraction unit that extracts an identifier from video data photographed by the photographing unit, an identification unit that identifies item information that can identify the item based on the identifier, and a processing unit that executes processing to associate and add the item information identified by the identification unit and time information indicating the time the identifier was read to the video data.

The worker device described in paragraph 9 makes it possible to record the worker's work along with information on many items without placing a burden on the worker.

(Clause 10) One aspect of the recording method relates to a recording method for recording work using an item to which an identifier is attached. The recording method includes the steps of: filming the work; extracting the identifier from the filmed video data; identifying item information that can identify the item based on the identifier; and adding, to the video data, the item information and time information indicating the time the identifier was read in association with each other.

The recording method described in paragraph 10 allows the worker's work to be recorded along with information on many items without placing a burden on the worker.

The embodiments disclosed herein should be considered in all respects to be illustrative and not restrictive. The scope of the present disclosure is indicated by the claims, not by the description of the above embodiments, and is intended to include all modifications within the meaning and scope of the claims.

1, 1A: Operator device, 2: Server device, 4: Network, 10: Small terminal device, 11, 21: Processor, 12, 22: Main memory, 13, 23: Communication interface, 14, 24: Input/output interface, 15, 25: Storage, 31: Camera, 32: Speaker, 33: Display, 51: Sample, 52: Reagent, 61, 62: Two-dimensional code, 71: Progress bar, 72: Video bar, 151, 254: Time information, 153, 256: Video data, 251: Sample information, 252: Reagent information, 253: Device information, 255: Identifier information, 257: Work information, 258: Video data with log, 259: Work video data, 310: Fixed camera, 331: Calendar image, 1000, 2000: Recording system.

Claims (9)

A recording system for recording work using items with identifiers in the field of research and analysis ,
A photography department that photographs the work,
a storage unit that records image data captured by the imaging unit as video data;
an extracting unit that extracts an identifier from the video data stored in the storage unit;
an identification unit that identifies item information that can identify the item based on the identifier;
a processing unit that executes a process of adding, to the video data, the item information identified by the identification unit and time information indicating the time when the identifier was read in association with each other;
a display unit that displays the video data on a screen together with the item information and the time information added by the processing unit . The recording system according to claim 1 , wherein the processing unit receives data for adding task tags classified for each task, and executes a process for adding the task tags to the video data. 3. The recording system according to claim 1, wherein the extracting section extracts the identifier when the image data indicating the identifier has been continuously recorded in the video data for more than a predetermined period of time. The recording system according to claim 1 , wherein the item includes at least one of a sample, a reagent, and an apparatus. The recording system according to claim 1 , further comprising a notification unit that notifies an operator that the identifier of the item has been extracted. the recording system includes a worker device and a server device;
the worker device includes the photographing unit and the extraction unit,
The recording system according to claim 1 , wherein the server device includes the specifying unit and the processing unit. A server device that acquires video data of work using items with identifiers in the field of research and analysis ,
a receiving unit that receives the identifier, time information indicating the time when the identifier was read, and the video data;
an identification unit that identifies item information that can identify the item based on the identifier;
a processing unit that executes a process of adding the item information identified by the identification unit and the time information to the video data in association with each other;
a storage unit that records the video data that is displayed together with the item information and the time information that are added by the processing unit . A worker device for recording work using an item with an identifier in the field of research or analysis ,
A photography department that photographs the work,
an extraction unit that extracts an identifier from video data captured by the imaging unit;
an identification unit that identifies item information that can identify the item based on the identifier;
a processing unit that executes a process of adding, to the video data, the item information identified by the identification unit and time information indicating the time when the identifier was read in association with each other;
a display unit that displays the video data on a screen together with the item information and the time information added by the processing unit . A recording method for recording work using an item with an identifier in the field of research or analysis , comprising:
Photographing the work;
extracting an identifier from the captured video data;
Identifying product information that can identify the product based on the identifier;
adding the item information and time information indicating the time when the identifier was read to the video data in association with each other;
and recording the video data displayed together with the item information and the time information .