AU604783B2 - Control system - Google Patents

Description

AU-AI-81094/87 P T WORLD INELLECTUAL PROPERTY ORGANIZION INTERNATIONAL APPLICATION P I D DR T ATT COOPERATION TREATY (PCT) (51) International Patent Classification 4 (11) International Publication Number: WO 88/ 02958 H04H 7/00, G11B 27/02 Al (43) International Publication Date: 21 April 1988 (21.04.88) (21) International Application Number: PCT/AU87 00349 Published (22) International Filing Date: 16 October 1987 (16.10.87) With international search report.

(31) Priority Application Number: PH 8523 (32) Priority Date: 16 October 1986 (16.10.86) (33) Priority Country: AU (71)(72) Applicant and Inventor: BURTON, David [AU/ AU]; 8 Odessa Street, St. Kilda, VIC 3182 (74) Agent: EDWD. WATERS SONS; 50 Queen Street, Melbourne, VIC 3000 (AU).

U.B.J 2 JUN 1988 (81) Designated States: AT (European patent), AU, BE (European patent), CH (European patent), DE (European AUSA patent), FR (European patent), GB (European pa-

AUS

tent), IT (European patent), JP, KR, LU (European y 88 patent), NL (European patent), SE (European patent), AY 198

US.

PATENT OFFICE (54) Title: CONTROL SYSTEM (57) Abstract A control system for the manipulation of sounds, when playing or recording said sounds, said system monitoring one or more inputs representative of the status of hardware transducers, and converting 4 CON.SOL-, one or more of said inputs into digital input form, and storing said digital input in storage means 3) asso- AdoO P ciated with a time reference generated by a time refer- OI'T our ence means, said system being adapted to recall AUDO and display said digital input on visual display means, 2 and allow manipulation of said digital input by di- rect interaction with said visual display or by remote A C -ARCHV) interaction means, said manipulation optionally being a further input and/or an output to said hardware transducers.

1 3 57T0)RAGE WO 88/02958 PCT/AU87/00349 -1- CONTiOL SYSTEM The present invention relates to a control system and particularly an automated system for the sound engineer mixing sounds recorded on separate tracks or channels of a multi-track tape or other recording medium.

The combining or mixing of sound components in an aurally balanced way can be achieved by manipulations such as switching each track (channel) on or off as required and thereby minimizing noise from that channel, altering the volume of each track to achieve the desired balance, and optionally manipulating the sound through synthesizers, such as, for example mutes.

The most common apparatus used for this process is a console containing an array of potentiometers, known as faders, that alter the voltage applied to a voltage controlled amplifier and thus the sound volume from that amplifier, and also the voltage applied to synthesizers to alter the nature of the sound.

There is one main fader for each track of sound, and by switching the main fader into or out of the circui.t one also has control of'the presence of any track in the final mix.

According to early forms of the prior art, a multi-track tape is replayed and re-recorded on a second tape, the presence, nature, and volume of any one or more individual tracks being altered during the replaying so that the changes form part of the second tape recording.

Disadvantages with this method of operation were that it requires and uses a second or more tapes, and because change is made as at the same time as re-recording, there was a need to do the change correctly the first time.

As it was difficult, if not impossible, to alter all the tracks requiring change in any single taping, it was necessary to continue with further re-recordings. It was a further disadvantage with this procedure that it was not easy to tell if the maximum amplification and/or maximum synthesized manipulation of any track had been reached or wo 88/02958 was near alter th V central Si sound ef PCT/AU87/00349 2 Further, physical movement across the console to e faderscauses the engineer to move away from the position required for best perception of stereo fect.

I

ild To try and overcome some of these disadvantages, further developments in the prior art have included the addition of motors to each fader so that the manipulation of any particular track could be seen and compared to the maximum available gain for any fader.

This, however, has still had the disadvantage of requiring an engineer to be responsible for overseeing the whole console and having to move away from central position.

This system has also involved numerous tape re-recordings.

isr Most recent developments in the prior art have utilised a hardware key pad (micro-processor board) that allows an engineer to operate the console from a central position, the introduction of a memory noting the changes made in any track with respect to a clock reference (time code) and recalling the changes made as required.

Disadvantages with this system still exist, however, 'in that the operator is restricted to the logic of the pre-programmed hardware key pad and is still not readily able to determine whether the maximum gain of a particular fader has been reached or likely to be exceeded.

There is need for an operator to physically interact with the recording console. Further, the operator must still have high mixing skill levels even with these recent developments.

Towards overcoming the above disadvantages, there is provided according to the present invention, a control system for the manipulation of sounds, when playing or recording said sounds, said system monitoring one or more inputs representative of the status ofkhardware tranndueE-rs, and converting one or more of said inputs into digital input form, and storing said digital input in storage means associated with a time reference generated by time reference means, said system being adapted to recall and display said

I

I

S

9**

S

Sc I S4 i S .5.5 H S*S .1 S S 5* S 3 digital input in association with said time reference means on a visual display means, and allow manipulation of said digital input by direct interaction with said visual display means or by remote interaction means.

In a preferred embodiment: of the invention there is provided in association with said digital input, input identifying means, said input identifying means being optionally recalled and displayed with the recall and display of the associated digital input.

10 The control system connects the electronic hardware such as amplifiers, synthesizers and multitrack recorders to a programmable computer. The connection as such to a fader console is optional and not strictly necessary.

Inputs from the electronic hardware are 15 representative of their working status, for example, the voltage levels of voltage controlled amplifiers as stated above. The inputs are monitored by the computer of the control system scanning the inputs at a rate substantially faster than any change in hardware status whilst allowing 20 for the storage of the hardware statuses.

20 Conversion of the inputs into digital form is prefereably via a bus structure.

Storage of the input information is preferably in the memory of the computer on conventional floppy disc.

25 The time reference means is preferably a clock oscillation generated and controlled by the computer, synchronizing the position of a manipulation of sound within the overall musical piece.

The input identifying means comprises information preferably associated with a sequence of inputs, to identify those inputs as forming a particular passage or mix within a musical piece. Identification can preferably also include information on the musician or vocalist, the instrument(s) and any other indicia that assist in identifying the D particular passage or track over earlier mix attempts.

0# oS S S @5 *c S S. S SIr S *S WO 88/02958 PCT/AU87/00349 h -4- The visual display means is preferably a screen, said screen displaying input information preferably by graphical and/or colour means such that, when applicable, the maximum possible manipulation is also indicated. The screen display is preferably designed to display the input information in conjunction with input identifying means, as described above, so that the user of the system has visually before him all the information required to adequately 10 control the mixing process.

Preferably in association with said display is an indication of time from the time reference means.

The direct interaction with said visual display means is preferably by the user touching the screen. The remote interaction means preferably includes a mouse, light pen or other key pad device to alter the visual display.

It can be seen from all of the above, that the combines mass storage techniques and analog digital, digital i 20 analog conversions, extensive processing power and screen graphics to emulate the complete recording process.

The use of computer processing gives the further.

advantage of use of software menu type displays to assist in the use of the system through all the necessary stages in 25 the sound mixing process or operation. A preferred embodiment of the invention will be described with reference to the accompanying figures: Figure 1 is a physical layout of control system; Figures 2a, 2b and 2c show alternative block 30 circuit diagrams describing more fully the inputs and electronic connections between main parts of the control system; SFigures 3 is a screen display interface with studio 9 tape transport hardware.

Figure 4 is a tabulation of standard steps in the production of a final mix.

WO 88/02958 PCT/AU87/00349 5 Referring to Figure 1, there is shown a processor--I with storage fadilities 2 and 3 for long term (archive) and fast access mass storage respectively, connected to the control system console 4.

Hardware tiransdo kinputs, conversion into digital input and outputs of whatever nature are controlled by the processor I via the control system console which preferably is in the form of a flat T.V. type screen or screens displaying information in a manner shown by way of example in Figure 3. The screens are preferably of-the touch control type and may contain a window function enabling different types of displays to be simultaneously shown on the console on any one screen.

Referring next to Figures and the block diagrams depicted outline the connections between the main parts of the control system. It can be seen that the system operates through an external bus structure with, referring to Figure studio inputs entering from a switch interface board and analog digital analog board to the main central processing unit. The time code generator is also connected to the production studio and the external bus structure via an input/oucput port board. Following manipulations, outputs pass through an input/output port board and a lead interface board.

The use of the control system is preferably by way of command functions set up within a number of standard format type screen displays not shown.

The various operations associated with the sound mixing process include recording, playback, alteration, muting and focusing on specific passages of music for appropriate manipulation. These operations have been given command function names in the control system such as write, read, update, solo write, mute, with enter and leave commands for moving through each function together with a execute and clear command function.

WO 88/02958 PCT/AU87/00349 -6- These command functions enable easy operation of the control system assisted by a help function and mendisplays which direct the user when the need arises.

5 The use of the command functions is further described with reference to Figure 4 which shows a typical sequence of functions for operating the system in creating a mix,.

In operation, a sequence of sounds, such as music, is recorded with respect to a time code. Any changes to the sound made by the sound engineer is inputted into the control system against a time code reference being either real time or time with respect to the musical piece as a j| whole by storing the degree of change as a digital quantity against the time reference. This can be referred to as a first mix.

In the case of a fader adjustment, the change in A| voltage is stored and not the change in the sound of the i music as has been the case in the prior art.

Playback of the sound will include the changes made by the sound engineer as the processor monitors the il| information in its storage and repeats the changes occurring j at each time point.

Accordingly, the system provides the advantage of playback of the new mix without the need for any further recording of the sound on tape until the mix has been i finished to the satisfaction of the sound engineer.

SThis first mix can be referred to as a mix file and subsequent manipulators will generate a new mix file as j changes made by the sound engineer are stored. Old mix i files are not discarded unless specifically deleted and Specific sounds such as solo pieces or specific time intervals of music can be manipulated and entered into the mix (ie. a master mix file) as required.

Each mix file can be given a title and the title stored on a menu for recall purposes.

~I

i -u ,WO 88/02958 PCT/AU87/00349 -7- Updating the mix can be effected by executing commands such as (PLAY) (JOIN) (MIX) A (FROM) (time) (EXECUTE), or for example, (GO TO) (JOIN) (MIX) (AT) (CUE) (title such as solo) (EXECUTE). Refer again to Figure The cue function enables a specific point in a musical score to be reached by identifying that point as a cue or by a title rather than by a specific point in time.

Referring to Figure 4, one of the screen displays shows bar graphs, preferably in colour, representing amplifier level information. Fader adjustments, grouping of various tracks and muting can all be executed by direct screen control of the bar graphs. Preferably the bar graphs will change colour as the.y each approach the maximum voltage of the respective amplifiers so that a further visual cue is provided to the sound engineer monitoring the mix.

By using any form of cursor pointer device such as a mouse or by directly touching the screen any channel levels of the console may be adjusted. In the same. manner channels may be grouped together to allow one or more channels to be adjusted for level with the one movement from the system operator.

This form of interaction between the screen and the hardware may also be used to allow any channel to be soloed, muted, dynamics adjusted, equalisation of any channel to be adjusted and any adjustment effecting the processing of signals through the recording console.

With specific reference to the screen display of Figure 3, this display is typical of many of the screens and represents "graphic" buttons which interface with hardware and directly control equipment positioned around the recording facility. With this screen the computer can control all the necessary functions on studio tape transports, while the other screens cover control of other studio equipment.

By either directly touching the screen, or using the mouse to to point to the required control function, the operator of the system can directly access these functions.

i_ i PCT/AU87/00349 WO 88/02958 8 By inserting the computer into this control path the advantages of automating control are realised along with storing and recalling of complex control sequences and all with one action selection.

The modular nature of the control system provides the advantages of utilizing all hardware trnaduzeez-r in a studio environment and possibly upgrading their functioning by means of the programmable processor.

A further advantage of the system is the ability to effect maintenance by on-line modem interconnection to a remote maintenance team able to investigate and correct problems.

oo-

Claims (5)

1. 2. A control system as claimed in claim 1 wherein input identifying means are provided in association with said digital input, said input identifying means being ee0 adapted to be recalled and displayed with the recall and *seedisplay of the associated digital input. 0 03. A control system as claimed in claim 1 or claim 2 #0 wherein said electronic hardware including amplifiers, synthesizers and multitrack recorders are connected to a programmable computer. ease goo b06 0.0 o4. A control system as claimed in claim 3 wherein in the connection is also made to a fader console. A control system as claimed in any preceding claim wherein the inputs from the electronic hardware are representative of their working status, for example the voltage levels of voltage controlled amplifiers. x 1. .i I II LI I 10
2. 6. A control system as claimed in claim 3 or 4 wherein the computer monitors the inputs at a rate substantially faster than any change in hardware status whilst allowing for storage of said hardware status.
3. 7. A control system as claimed in claim 6 wherein the time reference means is a clock oscillator generated and controlled by said computer synchronising the position of a manipulation of sound within the overall musical piece.
4. 8. A control system as claimed in any one of claims 2 too* to 6 wherein the input identifying means includes fI *information associated with a sequence of inputs to identify tho&'e inputs as forming a particular passage or mix within a I .o musical piece.
5. 9. A control system as claimed in any preceding claim wherein the visual display means is a screen, said screen displaying input information by graphical or colour means .such that the maximum possible manipulation is indicated. DATED this 7th day of September, 1990 DAVID BURTON teoo WATERMARK PATENT TRADEMARK ATTORNEYS 2nd Floor "The Atrium" 290 Burwood Road HAWTHORN VICTORIA 3122 AUSTRALIA V r