JP7251217B2 - Communications system - Google Patents

Description

Embodiments of the present invention relate to communication systems.

Conventionally, a system has been proposed that can secure both a communication environment and a power supply by connecting cameras and lighting devices via a communication cable that can supply power (so-called PoE cable; Power over Ethernet; registered trademark). .

However, when data of captured images is transmitted/received to/from a higher-level device (server) or the like on such a network, the bandwidth of the network becomes tight.

Japanese Patent No. 4944490

The problem to be solved by the present invention is to reduce the tightness of the bandwidth of the network.

A communication system according to an example of an embodiment includes an imaging device and an illumination device. The illumination device illuminates a predetermined range and outputs image data received from the imaging device through optical wireless communication. A photographing device is associated in advance with a lighting device that outputs image data from the photographing device.

According to the communication system according to one example of the embodiment, the tightness of the network band is reduced.

FIG. 1 is a diagram illustrating a configuration example of a communication system according to an embodiment. FIG. 2 is a block diagram of the imaging device shown in FIG. FIG. 3 is a diagram showing an example of the data configuration of the association data shown in FIG. 2. As shown in FIG. FIG. 4 is a block diagram of the lighting device shown in FIG. FIG. 5 is a block diagram of the terminal device shown in FIG. 6 is a diagram showing an example of a display screen in the terminal device shown in FIG. 5. FIG. 7 is a diagram showing an example of a display screen in the terminal device shown in FIG. 5. FIG. FIG. 8 is a block diagram of the server shown in FIG. FIG. 9 is a sequence diagram illustrating an example of a processing procedure of communication processing according to the embodiment; FIG. 10 is a flow chart showing a processing procedure of association processing executed by the terminal device shown in FIG. 11 is a diagram showing another example of the data configuration of the association data shown in FIG. 2. FIG. FIG. 12 is a block diagram showing another configuration of the lighting device according to the embodiment. FIG. 13 is a block diagram showing another configuration example of the communication system according to the embodiment.

A communication system 1 according to an embodiment described below has an imaging device 10 and an illumination device 20 . The illumination device 20 illuminates a predetermined range and outputs image data received from the imaging device 10 by optical wireless communication. The photographing device 10 and the illumination device 20 that outputs image data from the photographing device 10 are associated in advance.

Also, the communication system 1 in the embodiment described below has a terminal device 30 . The terminal device 30 has a user interface (UI) section 34 . The UI unit 34 presents the state of correspondence between the photographing device 10 and the lighting device 20 .

Further, the UI unit 34 according to the embodiment described below receives input of information instructing association between the photographing device 10 and the lighting device 20 .

Further, the UI unit 34 according to the embodiment described below is used when presenting the correspondence state between the photographing device 10 and the lighting device 20, or when inputting information instructing the correspondence between the photographing device 10 and the lighting device 20. When accepting, a schematic diagram showing the positions of the photographing device 10 and the lighting device 20 is displayed on the screen.

Hereinafter, communication systems according to embodiments will be described with reference to the drawings. In the embodiments, the same parts are denoted by the same reference numerals, and overlapping descriptions are omitted.

[Embodiment]
First, a communication system according to this embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating a configuration example of a communication system according to an embodiment. As shown in FIG. 1, the communication system has a photographing device 10, a lighting device 20, a terminal device 30 and a server 40. One or more imaging devices 10 and one or more lighting devices 20 are provided. The photographing device 10 and the lighting device 20 are each connected to the hub 50 via a communication cable 60 . The hub 50 relays communication between the imaging device 10 and lighting device 20 and the server 40 via the network N. FIG.

The communication cable 60 can supply power of a predetermined standard. The communication cable 60 functions not only as a LAN (Local Area Network) cable, but also as a power cable that supplies power to the imaging device 10 and the lighting device 20 .

The hub 50 relays communication between the imaging device 10 and lighting device 20 and the network N. FIG. The hub 50 also converts power supplied from an external power source (not shown) into power of a predetermined standard, and supplies the power to each imaging device 10 and each lighting device 20 via a communication cable 60 .

The photographing device 10 generates image data of surroundings photographed at a predetermined frame rate. The imaging device 10 transmits the generated image data to the lighting device 20 via the communication cable 60 and hub 50 . The photographing device 10 and the lighting device 20 that outputs image data from the photographing device 10 are associated in advance, and the photographing device 10 transmits the image data to the previously associated lighting device 20 . For example, the imaging device 10 holds the IP address of the lighting device 20 associated in advance, and transmits the image data with this IP address as the destination.

The illumination device 20 has an LED light source composed of a plurality of LED elements, and illuminates a predetermined range by lighting the LED light source. The illumination device 20 receives image data from the pre-associated imaging device 10 . For example, the illumination device 20 receives image data addressed to itself. Alternatively, the illumination device 20 holds the IP address of the photographing device 10 associated in advance, and receives image data transmitted with this IP address as the transmission source. The illumination device 20 outputs the received image data to the terminal device 30 by optical wireless communication.

The terminal device 30 receives image data output from the lighting device 20 by optical wireless communication. The terminal device 30 transmits the received image data to the server 40 . The terminal device 30 communicates with the server 40 via a communication network including wireless communication and wired communication. For example, the photographing device 10 and the lighting device 20 are installed on the indoor ceiling, and the terminal device 30 is positioned below them.

The server 40 manages the communication system 1 . For example, the server 40 manages image data captured by the imaging device 10 . Moreover, the server 40 may control the lighting of the lighting device 20 based on the image data.

[Structure of imaging device]
Next, the configuration of the photographing device 10 will be described. FIG. 2 is a block diagram of the imaging device 10 shown in FIG. 2 also shows a hub 50 and a PoE connector 51 that connects the hub 50 and the communication cable 60 in addition to the photographing device 10. As shown in FIG.

The imaging device 10 has a connector 11 , a storage section 12 , a control section 13 and a camera 14 . The connector 11 is connected with the communication cable 60 and also with the signal wiring 111 and the power supply wiring 112 . A signal wiring 111 is a network wiring and is connected to the control unit 13 . The power wiring 112 is a power wiring for supplying electric power and is connected to the control unit 13 . The photographing device 10 operates by power supplied via the communication cable 60 to which the connector 11 connects. The imaging device 10 performs imaging according to the control signal notified via the communication cable 60 and transmits image data to the lighting device 20 via the communication cable 60 .

The storage unit 12 is a storage medium such as a non-volatile memory, and stores the association data 70 and the image data 80 captured by the camera 14 . The association data 70 is data that indicates the correspondence between the photographing device 10 and the lighting device that outputs the image data from the photographing device. FIG. 3 is a diagram showing an example of the data configuration of the association data 70 shown in FIG. 2. As shown in FIG. As shown in FIG. 3, the correspondence data 70 has a configuration in which the IP address of the lighting device 20 and the IP address of the photographing device 10 are associated with each other. For example, the serial number "1" indicates that the lighting device 20 with the IP address "123.234.45.50" is associated with the imaging device 10 with the IP address "123.234.45.51". In FIG. 3, the photographing device 10 stores correspondence relationships with lighting devices other than the lighting device corresponding to itself and with other photographing devices. may be stored, or only the correspondence of its own device may be stored. Also, one photographing device 10 may be associated with a plurality of lighting devices 20 , and one lighting device 20 may be associated with a plurality of photographing devices 10 .

The control unit 13 controls imaging processing and communication processing in the imaging device 10 . The control unit 13 receives the association data 70 transmitted from the server 40 and stores it in the storage unit 12 . The control unit 13 acquires image data 80 captured by the camera 14 . The control unit 13 refers to the association data 70 and acquires the IP address of the lighting device 20 associated with the own device. The control unit 13 transmits the image data 80 to the illumination device 20 associated with the own device via the signal wiring 111 , the communication cable 60 and the hub 50 .

The camera 14 includes a lens and an imaging device, generates image data 80 of the surroundings at a predetermined frame rate, and outputs the image data 80 to the control unit 33 . The image data 80 may be stored in the storage section 12 .

[Configuration of lighting device]
Next, FIG. 4 is a block diagram of the lighting device 20 shown in FIG. 4 also shows the hub 50 and the PoE connector 51 in addition to the lighting device 20. As shown in FIG.

The illumination device 20 has a connector 21 , a storage section 22 , a control section 23 and an illumination section 24 . The connector 21 is connected with the communication cable 60 and also with the signal wiring 211 and the power supply wiring 212 . A signal wiring 211 is a network wiring and is connected to the control unit 23 . The power wiring 212 is a power wiring for supplying electric power and is connected to the control unit 23 . The lighting device 20 operates by power supplied through the communication cable 60 to which the connector 21 connects. The lighting device 20 controls the lighting mode of the lighting section 24 according to the control signal notified via the communication cable 60 .

The storage unit 22 is a storage medium such as a non-volatile memory, and stores the association data 70 and the image data 80 received from the imaging device 10 .

The control unit 23 controls lighting processing and communication processing in the lighting device 20 . The control unit 23 receives the association data 70 transmitted from the server 40 and stores it in the storage unit 22 . The control unit 23 refers to the association data 70 and acquires the IP address of the imaging device 10 associated with its own device. The control unit 23 receives the image data 80 transmitted from the imaging device 10 associated with its own device. The control unit 23 causes the illumination unit 24 to output the received image data through optical wireless communication. For example, the illumination device 20 outputs the image data 80 by applying optical wireless communication (Light Fidelity) as the optical wireless communication.

The illumination unit 24 is an LED light source composed of a plurality of LED elements, and lights according to an instruction signal input from the control unit 23 . The lighting unit 24 outputs image data 80 to the terminal device 30 positioned below the lighting device 20, for example, using light from the LED elements as a medium.

[Configuration of terminal device]
Next, the configuration of the terminal device 30 will be described. FIG. 5 is a block diagram of the terminal device 30 shown in FIG. The terminal device 30 has a storage section 31 , an optical sensor 32 , a control section 33 , a UI section 34 and a communication section 35 .

The storage unit 31 is, for example, a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or an optical disc. Further, the storage unit 31 may be a semiconductor memory such as a random access memory (RAM) or a non-volatile memory in which data can be rewritten. The storage unit 31 stores an OS (Operating System) and various programs executed by the terminal device 30 . The storage unit 22 stores the association data 70 and the image data 80 received from the lighting device 20 .

The optical sensor 32 is an optical receiver composed of a photodiode or the like. The optical sensor 32 converts the received light into an electric signal and outputs the converted signal to the control unit 33 .

The control unit 33 controls each unit of the terminal device 30 . For example, the control unit 33 is an electronic circuit such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 33 also has an internal memory that stores programs defining various processing procedures and control data. The control unit 33 has an image processing unit 331 and a display control unit 332 .

The image processing unit 331 performs image processing to convert the signal output from the optical sensor 32 into image data 80 . The image processing section 331 stores the image data in the storage section 31 . Alternatively, the image processing section 331 transmits the image data 80 to the server 40 via the communication section 35 .

The display control unit 332 controls display of a display that constitutes the UI unit 34 . For example, the display control unit 332 displays, on the display of the UI unit 34, a screen indicating the state of correspondence between the photographing device 10 and the lighting device 20, a screen on which an instruction for associating the photographing device 10 and the lighting device 20 can be input. display.

The UI unit 34 provides various types of information to the user and receives input of instruction information from the user. The UI unit 34 may include, for example, a liquid crystal display, touch panel, mouse, keyboard, speaker, microphone, and the like.

The UI unit 34 presents the state of correspondence between the photographing device 10 and the lighting device 20 . 6 and 7 are diagrams showing examples of display screens in the terminal device 30 shown in FIG. The UI unit 34 displays the correspondence menu M1 shown in FIG. 6 on the display. The correspondence menu M1 includes a schematic diagram showing the positions of the photographing device 10 (camera) and the lighting device 20 . Specifically, the corresponding menu M1 includes a plan view of the area where the photographing device 10 and the lighting device 20 are installed. In this plan view, the photographing device 10 is indicated by a circular figure, and the illumination device 20 is indicated by a rectangular figure.

The correspondence menu M1 displays the photographing device 10 and the lighting device 20, which are associated in advance, in the same color. In the example of FIG. 6, the camera C1 and the lighting device L1 associated with the camera C1 are displayed in the same color (eg, red). Also, the camera C2 and the lighting device L2 associated with the camera C2 are displayed in the same color (eg, blue). The colors of the camera C1 and the lighting device L1 are set to different colors from the colors of the camera C2 and the lighting device L2.

Then, the user selects the change button U1 of the correspondence menu M1 when changing the correspondence between the photographing device 10 and the lighting device 20 . In this case, the UI unit 34 displays the setting menu M2 shown in FIG. 7 on the display. The UI unit 34 can accept input of instruction information for associating the photographing device 10 and the lighting device 20 according to the user's mouse operation on the setting menu M2.

For example, the user moves the cursor U2 onto the figure of the camera C1 and clicks it, then moves the cursor U2 onto the figure of the lighting device L2, clicks it, and selects the decision button U3. Accordingly, the UI unit 34 receives input of instruction information that instructs association between the camera C1 and the lighting device L2. In addition, the terminal device 30 can display the setting menu M2 at the time of initial setting and accept input of instruction information for associating the photographing device 10 with the lighting device 20 .

The communication unit 35 is a communication interface that transmits and receives various information to and from another device (for example, the server 40). In the communication unit 35, the terminal device 30 communicates with the server 40 via a communication network including wireless communication and wired communication. For example, the communication unit 35 transmits to the server 40 instruction information for instructing association between the imaging device 10 and the lighting device 20 whose input is received by the UI unit 34 .

[Server configuration]
Next, the configuration of the server 40 will be described. FIG. 8 is a block diagram of server 40 shown in FIG. The server 40 has a communication section 41 , a storage section 42 , a control section 43 and a UI section 44 .

The communication unit 41 is a communication interface that transmits and receives various information to and from other devices (for example, the imaging device 10, the lighting device 20, and the terminal device 30). The communication unit 41 communicates with the photographing device 10 and the lighting device 20 via the network N, the hub 50 and the communication cable 60 . The communication unit 41 communicates with the terminal device 30 via a communication network including wireless communication and wired communication.

The storage unit 42 is, for example, a storage device such as an HDD, SSD, or optical disk. Also, the storage unit 42 may be a semiconductor memory such as a RAM or a non-volatile memory in which data can be rewritten. The storage unit 42 stores the OS and various programs executed by the server 40 . The storage unit 42 stores association data 70 and image data 80 .

The control unit 43 controls each unit of the server 40 . For example, the control unit 43 is an electronic circuit such as a CPU or MPU or an integrated circuit such as an ASIC or FPGA, and has an internal memory that stores programs defining various processing procedures and control data. The control unit 43 manages image data 80 transmitted from the terminal device 30 . For example, the control section 43 stores the image data 80 in the storage section 42 . Further, the control unit 43 causes the display of the UI unit 44 to display the image data 80 when the administrator performs confirmation work. The controller 43 has an association controller 431 .

The association control unit 431 controls association between the imaging device 10 and the lighting device 20 . Based on the instruction information transmitted from the terminal device 30, which instructs the association between the imaging device 10 and the lighting device 20, the association control unit 431 establishes the association indicating the association between the imaging device 10 and the lighting device 20. create or update data 70; The association control unit 431 transmits the association data 70 to at least one of the imaging device 10 and the lighting device 20 and controls transmission of image data from the imaging device 10 to the lighting device 20 . The association control unit 431 transmits the association data 70 to the terminal device 30 .

The UI unit 44 provides various types of information to the user and receives input of instruction information from the user. The UI unit 44 may include, for example, a liquid crystal screen, a touch panel, a mouse, a keyboard, a speaker, a microphone, etc., or may be displayed on any device network-connected to the server via the communication unit 41.

Note that the server 40 may have a function of receiving input of instruction information for associating the photographing device 10 with the lighting device 20 . That is, the server 40 displays the correspondence menu M1 and the setting menu M2 on the display, presents the correspondence state between the photographing device 10 and the lighting device 20, and provides instruction information for associating the photographing device 10 and the lighting device 20. Input may be accepted. Further, the server 40 may be provided with the optical sensor 32 and the server 40 may receive the image data output from the lighting device 20 by optical wireless communication.

[Flow of communication processing]
Next, the flow of processing in the communication system 1 will be described. FIG. 9 is a sequence diagram illustrating an example of a processing procedure of communication processing according to the embodiment; As shown in FIG. 9, the photographing device 10 and the lighting device 20 acquire the correspondence data 70 from the server 40 (steps S1 and S2). The lighting device 20 performs lighting based on the control signal (step S3).

The photographing device 10 performs photographing processing (step S4), and transmits the photographed image data 80 to the illumination device 20 associated with the photographing device 10 via the communication cable 60 and hub 50 (step S5). The illumination device 20 that has received the image data 80 converts the image data 80 into optical wireless communication data (step S6), and outputs the image data 80 to the terminal device 30 by optical wireless communication (step S7).

The terminal device 30 receives the image data 80 output by optical wireless communication and performs image processing (step S8). The terminal device 30 transmits the image data 80 after image processing to the server 40 (step S9). The server 40 stores and manages the image data transmitted from the terminal device 30 in the storage unit 42 (step S10). Alternatively, the imaging device 10 may directly transmit the image data 80 to the server 40 and the server 40 may manage the image data of the imaging device 10 .

[Flow of matching process]
Next, the process of associating the photographing device 10 and the lighting device will be described. FIG. 10 is a flow chart showing a processing procedure of association processing executed by the terminal device 30 shown in FIG.

As shown in FIG. 10, the terminal device 30 displays, on the display of the UI unit 34, a screen (for example, a correspondence menu M1) indicating the correspondence state between the photographing device 10 and the lighting device 20 (step S21). When the user instructs to change the association between the photographing device 10 and the lighting device 20 (step S22: Yes), the terminal device 30 displays a setting screen (eg, setting menu M2) (step S23).

Then, when the terminal device 30 receives input of instruction information for associating the photographing device 10 and the lighting device 20 (step S24), the terminal device 30 receives instruction information for instructing the correspondence between the photographing device 10 and the lighting device 20. , to the server 40 (step S25). When the terminal device 30 is not instructed to change the association between the photographing device 10 and the lighting device 20 (step S22: No), or after the processing of step S25 is completed, the terminal device 30 ends the association processing.

As described above, in the communication system 1, the imaging device 10 outputs the image data 80 to the lighting device 20 associated in advance with the imaging device 10, and the lighting device 20 transmits the image data 80 received from the imaging device 10 by optical wireless communication. Output by communication. As described above, according to the communication system 1, the large amount of image data 80 is output not via the communication cable 60 but via optical wireless communication.

Therefore, according to the communication system 1, it is possible to reduce the tightness of the bandwidth of the network to which the photographing device 10 is connected. Since the communication between the lighting device 20 and the terminal device 30 is closed communication within a certain area, the communication system 1 can maintain high security. Further, since the communication system 1 outputs the image data 80 using optical wireless communication, high-speed and highly efficient communication is possible. Further, in the communication system 1, the imaging device 10 and the lighting device 20, which is the output destination of the image data 80, are associated in advance. can run to

In addition, since the communication system 1 presents the correspondence state between the photographing device 10 and the lighting device 20 to the user, the user can accurately recognize the correspondence state between the photographing device 10 and the lighting device 20 . Furthermore, the communication system 1 can also accept input of instruction information that instructs association between the imaging device 10 and the lighting device 20 . Therefore, the user can flexibly set or change the correspondence state between the photographing device 10 and the lighting device 20 . At this time, since the communication system 1 displays a schematic diagram showing the positions of the photographing device 10 and the lighting device 20 on the screen, the user can easily recognize the positional relationship between the photographing device 10 and the lighting device 20. can be done. In this way, by enabling the setting of the correspondence relationship between the photographing device 10 and the lighting device 20, the image data of the photographing device 10 installed at an arbitrary location can be output from the desired lighting device 20 by optical wireless communication. can.

In addition, in the communication system according to the embodiment, the case where the imaging device 10 and the lighting device 20 are associated on a one-to-one basis has been described as an example, but the present invention is not limited to this. FIG. 11 is a diagram showing another example of the data configuration of the association data 70 shown in FIG. As shown in FIG. 11 , a plurality of imaging devices 10 may be associated with one lighting device 20 .

Further, in the present embodiment, the case where the user instructs the correspondence between the photographing device 10 and the lighting device 20 has been described as an example. 10 and the lighting device 20 may be associated.

Further, in the present embodiment, the photographing device 10 and the lighting device 20 have been described as independent devices, but they may be integrated. FIG. 12 is a block diagram showing another configuration of the lighting device according to the embodiment.

A lighting device 20A shown in FIG. 12 has a camera unit 210 and a lighting unit 220 . The camera unit 210 is connected to the connector 221 by signal wiring 111 and power wiring 112 . The lighting device 20 is connected to the connector 221 by signal wiring 211 and power wiring 212 .

For this lighting device 20A, the camera unit 210 is given an IP address different from the IP address of the lighting unit 220, and the camera unit 210 and the lighting unit 220 are treated independently when they are associated. Therefore, the lighting unit 220 may be associated with the camera unit 210 in its own device, or may be associated with the camera unit 210 in another imaging device 10 or another lighting device 20A.

Moreover, when the imaging device and the lighting device are integrated, the imaging device and the lighting device may share a power source. In this case, the signal wiring and the power wiring may be branched from the power supply to the photographing device and the lighting device.

In the communication system 1, the terminal device 30 transmits image data received by optical wireless communication to the server 40, and the server 40 manages the data. is also possible. For example, when a camera is used as a motion sensor, the server 40 sets a sensing area and a non-sensing area for pixels, or divides the area into several areas and assigns them to different illumination. This work is performed while viewing the image. Therefore, the operator receives the image through the optical wireless communication, and performs setting work on the server 40 based on the received information.

Then, another example of this embodiment will be described. FIG. 13 is a diagram illustrating another example of the configuration of the communication system according to the embodiment; As shown in FIG. 13, in the communication system 1, a hub 50 is connected to a terminal device TD or PC.

In the communication system 1, the image data may be transmitted from the photographing device 10 to the terminal device TD or PC other than the lighting device 20 via PoE. That is, the communication system 1 can transmit the image data 80 from the imaging device 10 to other devices such as the lighting device 20, the terminal device TD, and the PC via PoE instead of via optical wireless communication. be. Of course, the communication system 1 is not limited to PoE, and can transmit the image data 80 between connected terminals.

Note that the terminal device TD may be the terminal device 30 in this embodiment. Moreover, in this embodiment, the terminal device 30 may be plural. Further, in this embodiment, the image data 80 may be a still image or a moving image.

While several embodiments of the invention have been described, these embodiments have been presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and modifications can be made without departing from the scope of the invention. These embodiments and their modifications are included in the scope and spirit of the invention, as well as the scope of the invention described in the claims and equivalents thereof.

1 communication system 10 imaging device 11, 21, 221 connector 12, 22, 31, 42 storage unit 13, 23, 33, 43 control unit 14 camera 20 lighting device 24 lighting unit 30 terminal device 34, 44 UI unit 35, 41 communication Section 40 Server 50 Hub 51 PoE Connector 60 Communication Cable 70 Association Data 80 Image Data 111, 211 Signal Wiring 112, 212 Power Supply Wiring 331 Image Processing Section 332 Display Control Section

Claims (5)

an imaging device;
a lighting device that illuminates a predetermined range and outputs image data received from the photographing device through optical wireless communication;
A communication system comprising:
The photographing device and a lighting device that outputs image data from the photographing device are associated in advance, the photographing device and the lighting device are connected to a hub via a communication cable, and the hub is connected via a network. relays communication between the photographing device and the lighting device and the server, and the photographing device is capable of transmitting data to the server via the hub, and not via the network but via the hub. a communication system for transmitting the image data to the lighting device . A terminal device having a user interface unit that presents a correspondence state between the photographing device and the lighting device;
A communication system according to claim 1, comprising: The user interface unit
Receiving input of information instructing association between the photographing device and the lighting device;
A communication system according to claim 2. The user interface unit
When presenting the correspondence state between the photographing device and the lighting device, or when accepting input of information instructing the correspondence between the photographing device and the lighting device, the position of the photographing device and the lighting device is determined. display a schematic diagram showing on the screen,
A communication system according to claim 2 or 3. The photographing device and the lighting device are
Connected with a communication cable that can supply power of the prescribed standard,
A communication system according to any one of claims 1 to 4.

Images