JP7649987B2 - Mating detection and judgment system, mating detection and judgment device, and mating detection and judgment method - Google Patents

Description

This disclosure relates to a mating detection and determination system, a mating detection and determination device, and a mating detection and determination method.

Patent Document 1 discloses a half-lock detection device that determines that the connector is properly mated if the analysis data, which is the peak value of the frequency and power frequency of the connector's natural vibration to be measured, includes master data, and determines that the connector is in a half-locked state if the analysis data does not include master data. The half-lock detection device performs a Fourier transform on measurement data obtained by measuring the acceleration applied to the connector when the connector is mated or removed using an acceleration sensor, and analyzes the data as sound pressure levels for each frequency. The half-lock detection device compares detection data obtained by detecting the frequency indicating the peak of the sound pressure level from the analyzed sound pressure level after Fourier transformation with master data, which is the natural frequency of the connector to be measured using a preset acceleration sensor, to determine whether the detection data includes the master data.

JP 2009-212044 A

The present disclosure has been devised in consideration of the above-mentioned conventional circumstances, and aims to provide a mating detection and determination system, a mating detection and determination device, and a mating detection and determination method that help prevent workers from mixing up connectors and make the mating work of connectors more efficient.

The present disclosure provides a mating detection and determination system that includes a device carried by a worker performing production and having a sensor capable of detecting a sensor signal when a connector mated in the production is mated, and a terminal device that is communicatively connected to the device and determines whether the connector is mated based on the sensor signal, the device transmits connector information selected by the worker to the terminal device, the terminal device stores a connector list including at least one connector information used in the production, compares the selected connector information with each of the connector information included in the connector list, and when it is determined that the connector list includes connector information that matches the selected connector information, begins determining whether the connector is mated.

The present disclosure also provides a mating detection and determination device that includes a storage unit that stores a connector list including information on at least one connector used in production, an acquisition unit that acquires connector information selected by a worker performing the production and a sensor signal when a connector to be mated in the production is mated, and a determination unit that determines whether the connector is mated based on the sensor signal acquired by the acquisition unit, and the determination unit compares the selected connector information with each of the connector information included in the connector list, and when it determines that the connector list contains connector information that matches the selected connector information, begins determining whether the connector is mated.

The present disclosure also provides a mating detection and determination method performed by a terminal device that determines whether a connector used in production is mated, which stores a connector list including information on at least one connector used in the production, acquires connector information selected by a worker performing the production, compares the selected connector information with each of the connector information included in the connector list, and, if it is determined that the connector information in the connector list matches the connector information selected, starts determining whether the connector is mated.

This disclosure helps prevent workers from mixing up connectors and makes connector fitting work more efficient.

FIG. 1 is a block diagram showing an example of the overall configuration of a fitting detection and determination system according to an embodiment; FIG. 1 is a block diagram showing an example of an internal configuration of a terminal device according to an embodiment; A diagram showing an example of a connector instruction screen FIG. 1 is a diagram illustrating an example of an audio signal. A flowchart showing an example of an operation procedure of a terminal device according to an embodiment.

(Background to this disclosure)
Connectors used in vehicles have a pair of mechanisms (e.g., a male connector and a female connector), and the pair of mechanisms can be mated to electrically connect the various electrical systems within the vehicle. After such connectors are mated by an operator, the operator checks whether the connectors are properly mated by checking for the presence or absence of a mating sound that is emitted when the connectors are mated and by visually checking the connectors. However, in recent years, with the electronicization of devices mounted on vehicles, the number of connectors used in the manufacture of each vehicle has increased, and there is a demand for more efficient mating of connectors.

However, the location where the connector mating work is performed is often within the vehicle frame, behind the front panel, or other locations where the worker cannot or find it difficult to visually check the mated state of the connector, posing an issue that the worker may not realize that he or she has mated the wrong connector.

As a method for determining whether such a connector is properly mated, Patent Document 1 discloses a method in which an acceleration sensor acquires a natural frequency corresponding to the natural frequency of the mating when the connector is mated, and based on the acquired natural frequency, the mating state of the connector is determined to be either a half-mated (half-locked) state or a mated state. However, a half-lock detection device that performs mating determination by detecting vibrations may detect the vibration of the worker's arm or the surrounding sounds (e.g., noise, mating sounds of similar connectors, etc.) and constantly perform mating determination of the connector based on the detected sounds, for example, when the worker's arm hits an obstacle during work, when ambient sounds (vibrations) similar to the mating sound of the connector are generated, or when work that generates similar or identical connector mating sounds (vibrations) is performed. Therefore, the half-lock detection device may constantly perform mating determination, which may increase the processing load required for mating determination processing or reduce the accuracy of mating determination.

Below, with reference to the drawings as appropriate, each embodiment that specifically discloses the configuration and operation of the mating detection and determination system, mating detection and determination device, and mating detection and determination method according to the present disclosure will be described in detail. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters and duplicate explanation of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to make it easier for those skilled in the art to understand. Note that the attached drawings and the following explanation are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

(Embodiment)
The overall configuration of a fit detection and determination system 100 according to the present embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing an example of the overall configuration of a fit detection and determination system 100 according to the embodiment.

The mating detection and determination system 100 is a system for determining whether or not a male connector and a female connector are mated during a mating operation of connectors, which are a pair of components. The mating detection and determination system 100 includes a database DB, a server S1, a terminal device P1, a speaker SP or a monitor MN, and a microphone MK or a camera CM.

Here, the term "mating" means that a pair of mechanical parts are at least physically in contact and fixed. The term "connector" refers to a part used to physically or electrically connect devices mounted on a vehicle or the like, and includes a connection part using a mechanism such as a latch. Specifically, the connector in this embodiment may include mechanical parts such as a door opening and closing mechanism and a general locking mechanism. Note that the mating detection and determination system 100 according to this embodiment described below will be described as an example of determining whether or not a pair of connectors are properly mated during the mating operation of a male connector (connector) and a female connector (connector). Note that proper mating refers to a state in which the pair of connectors are mated so as to be electrically connectable, and the mechanical parts are locked so as not to fall off due to vibration, etc.

The database DB is connected to each of the server S1 and the terminal device P1 so as to be able to communicate wirelessly or via wired communication, and transmits and receives data. The database DB stores production instruction data for each of a number of different production objects (e.g., vehicles, etc.). In the example shown in FIG. 1, the database DB is configured separately from both the server S1 and the terminal device P1, but it may also be configured integrally with either the server S1 or the terminal device P1. There may also be multiple databases DB.

The production instruction data referred to here is data including instructions related to the production work for producing the production object, and includes, for example, a connector list including information on one or more connectors used in the production of the production object, a connector image of a connector, and information on the content to be read aloud for determining whether the connector is correct or incorrect. Here, the identification information of the connector is the name, model number, number, etc. of the connector. The repeat instruction data may be the identification information of the connector.

Based on the control command sent from the server S1 or the terminal device P1, the database DB extracts production instruction data for the production object specified by the control command and sends it to the server S1 and the terminal device P1, respectively.

The server S1 is connected to the database DB and the speakers SP or monitors MN owned by each of the multiple workers so that they can communicate wirelessly or via wired communication, and transmits and receives data. The server S1 transmits production instruction data sent from the database DB to the speakers SP or monitors MN owned by the workers who produce the production objects indicated by the production instruction data. The server S1 includes a communication unit 10, a processor 11, and a memory 12.

In addition, if the speaker SP or monitor MN is mounted on a terminal that can be operated by a worker (e.g., a notebook PC (Personal Computer), a smartphone, a tablet terminal, etc.), the server S1 may identify the terminal on which the speaker SP or monitor MN is mounted and transmit the production instruction data to the identified terminal.

The communication unit 10 is connected to the database DB and the speakers SP or monitors MN carried by each of the multiple workers for wireless or wired communication, and transmits and receives data. The communication unit 10 outputs production instruction data sent from the database DB to the processor 11. In addition, the communication unit 10 transmits production instruction data to the speakers SP or monitors MN carried by the workers who produce the production object, based on the control command output from the processor 11.

The processor 11 is configured using, for example, a CPU (Central Processing Unit), a DSP (Digital Signal Processor) or an FPGA (Field Programmable Gate Array) and controls the operation of each part of the terminal device P1. The processor 11 works in cooperation with the memory 12 to comprehensively perform various processes and controls. Specifically, the processor 11 references the programs and data stored in the memory 12 and executes the programs to realize the functions of each part.

Based on the production instruction data transmitted from database DB, processor 11 refers to memory 12 and identifies the worker who will produce the production object indicated by the production instruction data, and the speaker SP or monitor MN owned by the worker. Processor 11 associates information about the speaker SP or monitor MN owned by the identified worker with the production instruction data used in the production of the production object, and outputs the association to communication unit 10. Communication unit 10 transmits the production instruction data to the corresponding speaker SP or monitor MN based on the information about the speaker SP or monitor MN.

The memory 12 has, for example, a RAM (Random Access Memory) as a work memory used when executing each process of the processor 11, and a ROM (Read Only Memory) that stores programs and data that define the operation of the processor 11. The RAM temporarily stores data or information generated or acquired by the processor 11. The ROM has written therein programs that define the operation of the processor 11. The memory 12 records information about each worker who produces each production object, information about the speakers SP or monitors MN that the workers possess, etc.

The terminal device P1 is realized by, for example, a PC, a notebook PC, a smartphone, a tablet terminal, etc. The terminal device P1 is connected to the database DB and a microphone MK or a camera CM carried by the worker so that wired or wireless communication is possible. The wireless communication here refers to communication via a wireless LAN (Local Area Network) such as Wi-Fi (registered trademark), for example.

The terminal device P1 acquires AV (Audio/Visual) matching data (e.g., audio signals, captured images, etc.) transmitted from the microphone MK or camera CM, and analyzes the acquired data related to the connector. As a result of the analysis, the terminal device P1 determines whether or not the correct connector has been selected in the fitting operation performed by the worker (i.e., whether or not there has been a mix-up of connectors). The terminal device P1 also generates a notification of the determination result as to whether or not the correct connector has been selected, and transmits it to the speaker SP or monitor MN.

The worker carries a speaker SP that can output the connector instruction content (e.g., connector name, model number, number, etc.) that is included in the production instruction data and indicates the connector to be used in the production of the production target, or a monitor MN that can display a connector instruction screen MN1 (see Figure 3). The worker starts the fitting work based on the connector instruction content output by the speaker SP or the connector instruction screen MN1 displayed on the monitor MN.

The speaker SP converts the judgment result notification (here, an audio signal) sent from the terminal device P1 into audio and outputs it. The monitor MN displays the judgment result notification (here, video data or image data) sent from the terminal device P1.

The worker also carries a microphone MK for picking up the worker's own voice repeating the connectors used in the fitting operation and for picking up the sound of the connectors being fitted (i.e., the vibrations that occur when the connectors are fitted), or a camera CM for capturing an image of the connector.

The microphone MK, as an example of a sensor, converts the picked up sound into an audio signal. The microphone MK associates the audio signal with identification information that can identify the microphone MK or the worker (e.g., microphone number, microphone name, microphone serial number, worker name, worker ID (identification), employee number, etc.) and transmits the associated audio signal to the terminal device P1. The microphone MK also converts the picked up sound of the connector mating (vibration) into an audio signal, and associates the audio signal with identification information that can identify the microphone MK or the worker and transmits the associated audio signal to the terminal device P1.

The camera CM is, for example, a solid-state imaging element such as a CCD (Charged-Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor), and converts the optical image formed on the imaging surface into an electrical signal. The camera CM associates a connector image of the target connector with identification information that can identify the camera CM or the worker (for example, camera number, camera name, camera serial number, worker name, worker ID, employee number, etc.), and transmits it to the terminal device P1.

The above-mentioned speaker SP, monitor MN, microphone MK, and camera CM may each be provided in, for example, a notebook PC, a smartphone, a tablet terminal, a smart watch, etc., and may be connected to the server S1 or the terminal device P1 so as to be capable of data communication.

The speaker SP or monitor MN and the microphone MK or camera CM may be realized by a combination of two or more different terminal devices or devices, and may be connected to the server S1 or the terminal device P1 so as to be capable of data communication. For example, the speaker SP and the microphone MK may be integrated as a bone conduction headset, headphones with a microphone, or the like. For example, the speaker SP, the monitor MN, the microphone MK, and the camera CM may each be realized by headphones (devices) connected to the server S1 or the terminal device P1 so as to be capable of data communication, and a terminal device such as a notebook PC, smartphone, tablet terminal, or smartwatch, which is similarly connected to the server S1 or the terminal device P1 so as to be capable of data communication.

The internal configuration of the terminal device P1 will be described with reference to FIG. 2. FIG. 2 is a block diagram showing an example of the internal configuration of the terminal device P1 according to the embodiment.

The terminal device P1 includes an image capture board 20, an audio IF (Inter Face) 30, a communication unit 40, a processor 41, a memory 42, a graphic memory 43, and a monitor 44. The terminal device P1 may also include a user interface (e.g., a mouse, a keyboard, a touch panel, a touch pad, etc.) operated by a person who operates the terminal device P1 (e.g., a worker, a manager who manages vehicle manufacturing, etc.). In such a case, the user interface accepts input operations by this person, converts the accepted input operations into electrical signals, and outputs the electrical signals to the processor 41.

The image capture board 20, which is an example of an acquisition unit, has a function of outputting a captured image of the connector transmitted from the camera CM to the processor 41. The image capture board 20 includes an input unit 21 and a frame buffer 22. Note that, while the image capture board 20 shown in FIG. 2 is shown as being built into the terminal device P1 as an example, it may be configured separately from the terminal device P1. In such a case, the image capture board 20 is connected externally (attached externally) to the terminal device P1 using, for example, HDMI (High-Definition Multimedia Interface) (registered trademark), USB (Universal Serial Bus), etc., and is connected to the communication unit 40 so as to be capable of wired communication.

The input unit 21 acquires the captured image of the connector sent from the camera CM and outputs it to the frame buffer 22.

The frame buffer 22 converts the captured image of the connector output from the input unit 21 into a data format that can be used by the processor 41 for various processes. The frame buffer 22 stores the captured image after the data format conversion and outputs it to the processor 41.

The audio IF 30, which is an example of an acquisition unit, has a function of outputting an audio signal transmitted from the microphone MK to the processor 41. The audio IF 30 includes an input unit 31, a conversion unit 32, and an audio buffer 33. Note that, although the audio IF 30 shown in FIG. 2 is shown as being built into the terminal device P1 as an example, it may be configured separately from the terminal device P1. In such a case, the audio IF 30 is connected externally (attached) to the terminal device P1 using, for example, HDMI (registered trademark), USB, etc., and is connected to the communication unit 40 so as to be able to communicate by wire.

The input unit 31 acquires the audio signal transmitted from the microphone MK and outputs the acquired audio signal to the conversion unit 32.

The conversion unit 32 converts the audio signal output from the input unit 31 into a data format that can be processed by the processor 41. The conversion unit 32 outputs the audio signal after the data format conversion to the audio buffer 33.

The audio buffer 33 stores the audio signal after data format conversion output from the conversion unit 32, and outputs it to the processor 41.

The processor 41, which is an example of a determination unit, is configured using, for example, a CPU, DSP, or FPGA, and controls the operation of each unit of the terminal device P1. The processor 41 works in cooperation with the memory 42 to comprehensively perform various processes and controls. Specifically, the processor 41 references the programs and data stored in the memory 42 and executes the programs to realize the functions of each unit.

The processor 41 performs image analysis processing on the captured image of the connector output from the image capture board 20, and identifies the connector shown in the captured image (i.e., the connector selected by the worker). The processor 41 also identifies the worker performing the connector fitting operation based on the identification information of the camera CM or the identification information of the worker associated with the captured image output from the image capture board 20.

Similarly, the processor 41 performs voice recognition processing on the audio signal output from the audio IF 30, recognizes the content read by the worker (e.g., the type of connector, model number, color, etc.), and identifies the connector selected by the worker. The processor 41 also identifies the worker performing the connector fitting work based on the identification information of the microphone MK or the worker identification information associated with the audio signal output from the audio IF 30.

Processor 41 refers to the production instruction data for the production work being performed by the identified worker based on the information of the identified worker. Processor 41 performs a matching process between the identified connector and one or more connectors included in the connector list of the production instruction data (i.e., a process for determining whether the connector selected by the worker is correct or incorrect).

If the processor 41 compares the identified connector (i.e., the connector selected by the worker) with one or more connectors included in the connector list as a result of the comparison and determines that there is no connector in the connector list that matches the identified connector, it generates a notification that the selected connector is incorrect and transmits the generated notification to the speaker SP or monitor MN carried by the worker. The speaker SP or monitor MN outputs the notification transmitted from the terminal device P1. The notification method may be audio output, image display, vibration, etc.

On the other hand, as a result of the comparison, the processor 41 compares the identified connector (i.e., the connector selected by the worker) with each of one or more connectors included in the connector list, and if it determines that there is a connector in the connector list that matches the identified connector, it starts a connector mating determination based on the audio signal transmitted from the microphone MK. The processor 41 analyzes the audio signal transmitted from the microphone MK and compares the vibration waveform of the connector mating sound (i.e., the vibration when the connector is mated) included in the audio signal with the audio waveform of the audio signal to determine whether the connector has been mated properly.

When the processor 41 determines that the connector is properly mated as a result of the mating judgment, it generates a notification that the connector is properly mated and transmits the generated notification to the speaker SP or monitor MN carried by the worker. Similarly, when the processor 41 determines that the connector is not properly mated as a result of the mating judgment, it generates a notification that the connector is not properly mated and transmits the generated notification to the speaker SP or monitor MN carried by the worker. The speaker SP or monitor MN outputs the notification transmitted from the terminal device P1. The notification method may be audio output, image display, vibration, etc.

The processor 41 associates the identification information capable of identifying the worker transmitted from the microphone MK with the audio signal or captured image and transmits them to the database DB. The database DB records the identification information capable of identifying the worker transmitted from the terminal device P1 and the audio signal or captured image as work history information for each worker or for each production instruction data. This allows the worker or production manager to confirm whether the worker who performed the work, inspection, etc. has various qualifications (e.g., work qualifications, inspection qualifications, etc.) based on the work history information recorded in the database DB, and to check whether any fraudulent work, inspection, etc. has been performed. The work history information may be recorded in the memory 42.

If the processor 41 determines that there is no connector in the connector list that matches the connector specified, the processor 41 transmits the production instruction data or information on the production object, the identification information of the worker who selected the incorrect connector, information on the incorrectly selected connector (e.g., the name, model number, number, etc. of the connector), information on the date and time when the work was performed (e.g., information on the date and time when the audio signal was picked up, or information on the date and time when the image was captured) in association with each other to the database DB. The database DB records the production instruction data or information on the production object transmitted from the terminal device P1, the identification information of the worker who selected the incorrect connector, information on the incorrectly selected connector, information on the date and time when the work was performed, etc. as work history information for each worker or for each production instruction data. This allows the mating detection and judgment system 100 to record work history information when an incorrect connector is selected. Therefore, the manager can use the work history information for each worker or for each production instruction data recorded in the database DB to improve the work process of the production work or to provide guidance to the workers.

Memory 42, an example of a storage unit, has, for example, a RAM as a work memory used when executing each process of processor 41, and a ROM for storing programs and data that define the operation of processor 41. Data or information generated or acquired by processor 41 is temporarily stored in the RAM. Programs that define the operation of processor 41 are written in the ROM. Memory 42 stores production instruction data, information about workers, information about microphones MK or cameras CM carried by workers, information about notification destinations of workers (speakers SP or monitors MN), and the like. Memory 42 may also store a trained model (not shown) used to determine the mating of connectors.

The graphic memory 43 is, for example, a VRAM (Video Random Access Memory) and functions as a memory used when executing image (screen) display processing. The graphic memory 43 executes display processing of images (for example, various notifications, etc.) generated and output by the processor 41, and displays them on the monitor 44.

The monitor 44 is configured using a display such as an LCD (Liquid Crystal Display) or an organic EL (Electroluminescence). The monitor 44 displays a screen including the connector image output from the graphic memory 43.

Next, referring to FIG. 3, an example of a connector instruction screen MN1 displayed on a monitor MN held by a worker will be described. FIG. 3 is a diagram showing an example of a connector instruction screen MN1. Note that the connector characteristic information, the position information where the connector is used, and the connector image shown in FIG. 3 are merely examples and are not limiting.

The connector instruction screen MN1 is displayed on the monitor MN to present (instruct) the worker with information on the connector characteristics to be used in production, information on the position where the connector will be used, etc. The worker selects the connector to be used in production, performs fitting work, etc. while looking at the connector instruction screen MN1 displayed on the monitor MN. The connector instruction screen MN1 shown in FIG. 3 includes, as an example, position information MSG1, read-aloud information MSG2, characteristic information MSG3, and a connector image IMG1.

Position information MSG1 indicates the position information where the connector is used (mated).

The read-out information MSG2 indicates the read-out content "Connect the A3 connector," which includes the connector name "A3 connector" as the connector's identification information. When the connector's correctness is judged using an audio signal, the microphone MK picks up the voice of the worker reading the read-out content through the worker's operation, generates an audio signal, and transmits it to the terminal device P1.

Feature information MSG3 indicates information that indicates features related to the connector's appearance (e.g., color, shape, number of terminals, etc.).

The connector image IMG1 is an image of the connector being used.

The sound picked up by the microphone MK will be described with reference to FIG. 4. FIG. 4 is a diagram illustrating an example of a sound signal. Note that the reading content shown in FIG. 4 is an example and is not limited to this.

The microphone MK picks up the voice of the worker, which is used to judge whether the connector selected by the worker is correct, and picks up the connector mating sound (i.e., the vibration when the connector is mated), which is used to judge whether the connector is mated. In the example shown in FIG. 4, the microphone MK picks up the voice of the worker reading out the contents to be used to judge whether the connector is correct, VO1 "A3 connector started", converts the picked up voice into an audio signal, and sends it to the terminal device P1. The microphone MK also picks up the connector mating sound VO2 "click", converts the picked up voice into an audio signal, and sends it to the terminal device P1. The microphone MK may pick up (record) various voices and send audio signals, etc., by the operator's operation.

The terminal device P1 performs voice recognition on the voice signal transmitted from the microphone MK and executes a process for determining whether the connector is correct or incorrect. For example, the terminal device P1 determines whether the read-out content recognized by voice recognition contains information about a specific connector (here, the connector name "A3 connector"), and determines whether the connector selected by the worker is correct or incorrect based on the determination result.

Next, an example of the operation procedure of the terminal device P1 according to the embodiment will be described with reference to FIG. 5. FIG. 5 is a flowchart showing an example of the operation procedure of the terminal device P1 according to the embodiment.

The terminal device P1 acquires production instruction data transmitted from the database DB, the production instruction data including a connector list of at least one connector to be used in production. The terminal device P1 executes reading of the acquired production instruction data (St1).

Based on the acquired production instruction data, the terminal device P1 extracts the identification information of the worker who will perform the production work indicated in the production instruction data (here, the connector fitting work). The terminal device P1 identifies the speaker SP or monitor MN corresponding to the extracted identification information of the worker, and transmits the production instruction data including the connector list to the identified speaker SP or monitor MN (St2). The processing of step St2 may be executed by the server S1.

The terminal device P1 goes into a standby state until it acquires AV matching data transmitted from the microphone MK or camera CM held by the worker (St3).

The terminal device P1 acquires either an audio signal or a captured image as AV matching data transmitted from a microphone MK or a camera CM held by the worker. When the terminal device P1 acquires an audio signal from the microphone MK, it performs voice recognition processing on the acquired audio signal (St4). Similarly, when the terminal device P1 acquires an image from the camera CM, it performs image recognition processing on the acquired image (St4).

The terminal device P1 identifies the connector selected by the worker based on the spoken content acquired by the voice recognition process (e.g., connector type, number, model number, serial number, etc.) and compares the identified connector with one or more connectors included in the connector list (St5). Similarly, the terminal device P1 identifies the connector selected by the worker based on the connector shown in the captured image acquired by the voice recognition process and compares the identified connector with one or more connectors included in the connector list (St5).

In the process of step St5, the terminal device P1 compares the identified connector (i.e., the connector selected by the worker) with each of one or more connectors included in the connector list, and if it determines that there is a connector in the connector list that matches the identified connector (St5, YES), it proceeds to the process of step St6 and enters a standby state until it obtains connector mating vibrations (St6). Here, the terminal device P1 may delete the matched connector from the connector list, or generate information about the matched connector and record it in association with the connector list.

On the other hand, in the processing of step St5, if the terminal device P1 compares the identified connector (i.e., the connector selected by the worker) with each of one or more connectors included in the connector list and determines that there is no connector in the connector list that matches the identified connector (St5, NO), it proceeds to the processing of step St7, generates a connector error notification to the effect that an incorrect connector has been selected, and transmits it to the speaker SP or monitor MN carried by the worker (St7).

The terminal device P1 analyzes the audio signal (specifically, the mating vibration based on the connector mating sound) transmitted from the microphone MK held by the worker, and determines whether the connector has been mated properly (i.e., whether it is in a mated state) based on the analyzed audio signal (St8).

If the terminal device P1 determines in the processing of step St8 that the connector is properly mated (i.e., in a mated state) (St8, YES), it generates a notification that the connector is in a mated state and transmits this to the speaker SP or monitor MN carried by the worker (St9).

On the other hand, if the terminal device P1 determines in the processing of step St8 that the connector is not properly mated (i.e., not in a mated state) (St8, NO), it generates a notification requesting re-mating of the connector and transmits it to the speaker SP or monitor MN carried by the worker (St10).

As described above, the mating detection and determination system 100 according to the embodiment includes one or more devices (one example of a device) that are carried by a worker performing production (i.e., the mating work of the connector) and have a microphone MK (one example of a sensor) that can detect a sensor signal (e.g., vibration such as mating vibration) when the connector is mated during production, and a terminal device P1 that is communicably connected to the one or more devices and determines whether the connector is mated based on the vibration when the connector is mated. The one or more devices transmit connector information selected by the worker to the terminal device P1. The terminal device P1 stores a connector list that includes at least one connector information used in production, and when it is determined that there is connector information that matches the connector information selected by the worker with each of the connector information included in the connector list by comparing the connector information selected by the worker with each of the connector information included in the connector list, it starts determining whether the connector is mated. Note that the one or more devices referred to here are devices that include at least the microphone MK.

As a result, when the mating detection and determination system 100 according to the embodiment determines that the connector selected by the worker is a connector included in the connector list used in production, it transitions to the connector mating determination process, thereby more efficiently suppressing connector mix-ups (selection errors) and supporting the connector mating work performed by the worker. In addition, since the mating detection and determination system 100 transitions to the connector mating determination process from the timing at which it is determined that the connector selected by the worker is a connector included in the connector list used in production, it is possible to shorten the time required to execute the mating determination process, effectively suppress the processing load required for the mating determination process, and more effectively suppress the detection of noise (vibrations) unnecessary for the mating determination process, such as environmental sounds generated around the worker and mating sounds of other connectors. Therefore, the mating detection and determination system 100 can improve the mating determination accuracy and make a series of mating operations, including the mating determination, more efficient by more effectively suppressing the execution of the mating process based on such noise.

As described above, when the terminal device P1 in the mating detection and determination system 100 according to the embodiment determines that there is no connector information in the connector list that matches the selected connector information, the terminal device P1 generates and outputs a notification that the selected connector is incorrect. This allows the terminal device P1 according to the embodiment to output a notification that the selected connector is incorrect, and more efficiently prevents connector mix-ups (selection errors) and supports the connector mating work performed by the worker.

Furthermore, as described above, when the terminal device P1 in the mating detection and determination system 100 according to the embodiment determines that the connector list contains connector information that matches the selected connector information, it further acquires vibrations (specifically, vibrations based on the mating sound when the connectors are mated) from one or more devices and determines whether the connectors are mated based on the acquired vibrations. As a result, when the mating detection and determination system 100 according to the embodiment determines that the connector selected by the worker is a connector included in the connector list used in production, it executes a mating determination process, thereby shortening the time required for the mating determination process and effectively reducing the processing load required for the mating determination process, and more effectively suppressing the detection of noise (vibrations) unnecessary for the mating determination process, such as environmental sounds occurring around the worker and mating sounds of other connectors.

As described above, in the mating detection and determination system 100 according to the embodiment, the microphone MK, which is an example of a sensor, is capable of detecting vibrations. One or more devices convert the voice of the worker picked up by the microphone MK into an audio signal and transmit it to the terminal device P1. The terminal device P1 performs a voice recognition process on the transmitted audio signal to obtain the selected connector information. As a result, the mating detection and determination system 100 according to the embodiment can perform a determination of whether the selected connector is correct or incorrect based on the worker's own reading voice, and therefore can more efficiently prevent connector mix-ups (selection errors).

As described above, one or more devices in the mating detection and determination system 100 according to the embodiment further includes a camera CM capable of capturing an image of the selected connector, and transmits an image of the connector captured by the camera CM to the terminal device P1. The terminal device P1 performs image recognition processing on the transmitted captured image to obtain information on the selected connector. This allows the mating detection and determination system 100 according to the embodiment to perform a correct/incorrect determination of the selected connector, thereby more efficiently preventing operators from mixing up connectors (selecting the wrong connector).

In addition, as described above, one or more devices in the mating detection and determination system 100 according to the embodiment further includes a monitor MN capable of displaying characteristic information or position information of the connector selected by the worker. As a result, the mating detection and determination system 100 according to the embodiment can more efficiently prevent the worker from mixing up connectors (selecting the wrong connector), and can more efficiently prevent errors in the work position of the mating work, thereby supporting the connector mating work performed by the worker.

In addition, as described above, one or more devices in the mating detection and determination system 100 according to the embodiment correspond the selected connector information to the worker information (e.g., the identification information of the worker) that can identify the worker, and transmit the corresponding information to the terminal device P1. When the terminal device P1 determines that the connector list contains connector information that matches the selected connector information, it records the corresponding connector information and the worker information. As a result, the mating detection and determination system 100 according to the embodiment can correspond the identification information of the worker to the connector information and record it as work history information. Therefore, based on the work history information recorded in the database DB, the worker or production manager can confirm whether the worker who performed the work, inspection, etc. has various qualifications (e.g., work qualifications, inspection qualifications, etc.) and check whether any improper work, inspection, etc. was performed.

In addition, as described above, one or more devices in the mating detection and determination system 100 according to the embodiment correspond the selected connector information to the worker information that can identify the worker, and transmit the corresponded information to the terminal device P1. If the terminal device P1 determines that there is no connector information in the connector list that matches the selected connector information, it records the connector information and the worker information in correspondence with each other. This allows the mating detection and determination system 100 according to the embodiment to record work history information when an incorrect connector is selected. Therefore, the manager can use the work history information for each worker or each production instruction data recorded in the database DB to improve the work process of the production work or to provide guidance to the workers.

As described above, the terminal device P1 according to the embodiment includes a memory 42 (an example of a storage unit) that stores a connector list including information on at least one connector used in production, an image capture board 20 or an audio IF 30 (an example of an acquisition unit) that acquires connector information selected by a worker performing production and vibrations (an example of a sensor signal) when a connector is mated in production, and a processor 41 (an example of a determination unit) that determines whether or not a connector is mated based on the vibrations acquired by the image capture board 20 or the audio IF 30. The processor 41 compares the selected connector information with each of the connector information included in the connector list, and when it determines that there is connector information in the connector list that matches the selected connector information, it starts determining whether or not the connector is mated.

As a result, when the terminal device P1 according to the embodiment determines that the connector selected by the worker is a connector included in the connector list used in production, it transitions to connector mating determination processing, thereby more efficiently suppressing connector mix-ups (selection errors) and supporting the connector mating work performed by the worker. In addition, since the terminal device P1 transitions to connector mating determination processing from the timing at which it determines that the connector selected by the worker is a connector included in the connector list used in production, it is possible to shorten the time required to execute the mating determination processing, effectively suppress the processing load required for the mating determination processing, and more effectively suppress the detection of noise (vibrations) unnecessary for the mating determination processing, such as environmental sounds generated around the worker and mating sounds of other connectors. Therefore, the terminal device P1 can improve the mating determination accuracy and make the series of mating operations, including the mating determination, more efficient by more effectively suppressing the execution of the mating processing based on such noise.

Although various embodiments have been described above with reference to the attached drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications, amendments, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also fall within the technical scope of the present disclosure. Furthermore, the components in the various embodiments described above may be combined in any manner as long as it does not deviate from the spirit of the invention.

This disclosure is useful in providing a mating detection and determination system, mating detection and determination device, and mating detection and determination method that can help prevent workers from mixing up connectors and make connector mating work more efficient.

10, 40 Communication unit 11, 41 Processor 12, 42 Memory 20 Image capture board 21, 31 Input unit 30 Audio IF
43 Graphic memory 44 Monitor CM Camera DB Database IMG1 Connector image MN Monitor MN1 Connector instruction screen MSG1 Position information MSG2 Read-out information MSG3 Feature information MK Microphone P1 Terminal device S1 Server SP Speaker

Claims (10)

a device carried by a worker performing production, the device having a sensor capable of detecting a sensor signal generated when a connector is mated during said production;
a terminal device that is communicatively connected to the device and determines whether the connector is fitted based on the sensor signal,
The apparatus comprises:
Transmitting connector information selected by the operator to the terminal device;
The terminal device
storing a connector list including information on at least one connector used in the production;
comparing the selected connector information with each of the connector information included in the connector list, and when it is determined that the connector information in the connector list matches the selected connector information, starting to determine whether the connectors are fitted.
Mating detection and judgment system. The terminal device
if it is determined that the connector list does not contain connector information that matches the selected connector information, a notification is generated and output to the effect that the selected connector is incorrect.
The fit detection and determination system according to claim 1 . The terminal device
When it is determined that the connector list contains connector information that matches the selected connector information, the sensor signal is further acquired from the device;
determining whether the connector is mated or not based on the acquired sensor signal;
The fit detection and determination system according to claim 1 . The sensor is a microphone capable of detecting vibrations,
The apparatus comprises:
converting the voice of the worker picked up by the microphone into an audio signal and transmitting the audio signal to the terminal device;
The terminal device
performing a voice recognition process on the transmitted voice signal to obtain the selected connector information;
The fit detection and determination system according to claim 1 . The apparatus comprises:
a camera capable of capturing an image of the selected connector;
A captured image of the connector captured by the camera is transmitted to the terminal device;
The terminal device
performing an image recognition process on the transmitted captured image to obtain the selected connector information;
The fit detection and determination system according to claim 1 . The apparatus comprises:
A monitor capable of displaying characteristic information or position information of the connector selected by the operator is further provided.
The fit detection and determination system according to claim 1 . The apparatus comprises:
transmitting the worker information capable of identifying the worker to the terminal device in association with the selected connector information;
The terminal device
When it is determined that the connector information matches the selected connector information in the connector list, the connector information and the worker information are recorded in association with each other.
The fit detection and determination system according to claim 1 . The apparatus comprises:
transmitting the worker information capable of identifying the worker to the terminal device in association with the selected connector information;
The terminal device
When it is determined that there is no connector information that matches the selected connector information in the connector list, the connector information and the worker information are recorded in association with each other.
The mating detection and determination system according to claim 1 . A storage unit that stores a connector list including information on at least one connector used in production;
an acquisition unit that acquires connector information selected by a worker performing the production and a sensor signal when the connector is mated in the production;
a determination unit that determines whether the connector is fitted based on the sensor signal acquired by the acquisition unit,
the determination unit compares the selected connector information with each of the connector information included in the connector list, and when it determines that the connector information in the connector list matches the selected connector information, starts determining whether the connectors are fitted.
Mating detection and judgment device. A method for detecting and determining whether a connector used in production is mated or not, the method being performed by a terminal device, comprising:
storing a connector list including information on at least one connector used in the production;
Acquire connector information selected by a worker performing said production;
comparing the selected connector information with each of the connector information included in the connector list, and when it is determined that the connector information in the connector list matches the selected connector information, starting to determine whether the connectors are fitted.
Mating detection judgment method.

Images