Perceptual control theory (PCT) is a model of behavior based on the properties of negative feedback control loops. A control loop maintains a sensed variable at or near a reference value by means of the effects of its outputs upon that variable, as mediated by physical properties of the environment. In engineering control theory, reference values are set by a user outside the system. An example is a thermostat. In a living organism, reference values for controlled perceptual variables are endogenously maintained. Biological homeostasis and reflexes are simple, low-level examples. The discovery of mathematical principles of control introduced a way to model a negative feedback loop closed through the environment (circular causation), which spawned perceptual control theory. It differs fundamentally from some models in behavioral and cognitive psychology that model stimuli as causes of behavior (linear causation). PCT research is published in experimental psychology, neuroscience, ethology, anthropology, linguistics, sociology, robotics, developmental psychology, organizational psychology and management, and a number of other fields. PCT has been applied to design and administration of educational systems, and has led to a psychotherapy called the method of levels.
Principles and differences from other theories
editThe perceptual control theory is deeply rooted in biological cybernetics, systems biology and control theory and the related concept of feedback loops. Unlike some models in behavioral and cognitive psychology it sets out from the concept of circular causality. It shares, therefore, its theoretical foundation with the concept of plant control, but it is distinct from it by emphasizing the control of the internal representation of the physical world.[1]
The plant control theory focuses on neuro-computational processes of movement generation, once a decision for generating the movement has been taken. PCT spotlights the embeddedness of agents in their environment. Therefore, from the perspective of perceptual control, the central problem of motor control consists in finding a sensory input to the system that matches a desired perception.[1]
History
editPCT has roots in physiological insights of Claude Bernard and in 20th century in the research by Walter B. Cannon and in the fields of control systems engineering and cybernetics. Classical negative feedback control was worked out by engineers in the 1930s and 1940s,[2][3] and further developed by Wiener,[4] Ashby,[5] and others in the early development of the field of cybernetics. Beginning in the 1950s, William T. Powers applied the concepts and methods of engineered control systems to biological control systems, and developed the experimental methodology of PCT.[6][7]
A key insight of PCT is that the controlled variable is not the output of the system (the behavioral actions), but its input, that is, a sensed and transformed function of some state of the environment that the control system's output can affect. Because these sensed and transformed inputs may appear as consciously perceived aspects of the environment, Powers labelled the controlled variable "perception". The theory came to be known as "Perceptual Control Theory" or PCT rather than "Control Theory Applied to Psychology" because control theorists often assert or assume that it is the system's output that is controlled.[8] In PCT it is the internal representation of the state of some variable in the environment—a "perception" in everyday language—that is controlled.[9] The basic principles of PCT were first published by Powers, Clark, and MacFarland as a "general feedback theory of behavior" in 1960,[10] with credits to cybernetic authors Wiener and Ashby. It has been systematically developed since then in the research community that has gathered around it.[11] Initially, it was overshadowed by the cognitive revolution (later supplanted by cognitive science), but has now become better known.[12][13][14][15]
Powers and other researchers in the field point to problems of purpose, causation, and teleology at the foundations of psychology which control theory resolves.[16] From Aristotle through William James and John Dewey it has been recognized that behavior is purposeful and not merely reactive, but how to account for this has been problematic because the only evidence for intentions was subjective. As Powers pointed out, behaviorists following Wundt, Thorndike, Watson, and others rejected introspective reports as data for an objective science of psychology. Only observable behavior could be admitted as data.[17] Such behaviorists modeled environmental events (stimuli) as causing behavioral actions (responses). This causal assumption persists in some models in cognitive psychology that interpose cognitive maps and other postulated information processing between stimulus and response but otherwise retain the assumption of linear causation from environment to behavior, which Richard Marken called an "open-loop causal model of behavioral organization" in contrast to PCT's closed-loop model.[12]
Another, more specific reason that Powers observed for psychologists' rejecting notions of purpose or intention was that they could not see how a goal (a state that did not yet exist) could cause the behavior that led to it. PCT resolves these philosophical arguments about teleology because it provides a model of the functioning of organisms in which purpose has objective status without recourse to introspection, and in which causation is circular around feedback loops.[18]
Example
editA simple negative feedback control system is a cruise control system for a car. A cruise control system has a sensor which "perceives" speed as the rate of spin of the drive shaft directly connected to the wheels. It also has a driver-adjustable 'goal' specifying a particular speed. The sensed speed is continuously compared against the specified speed by a device (called a "comparator") which subtracts the currently sensed input value from the stored goal value. The difference (the error signal) determines the throttle setting (the accelerator depression), so that the engine output is continuously varied to prevent the speed of the car from increasing or decreasing from that desired speed as environmental conditions change.
If the speed of the car starts to drop below the goal-speed, for example when climbing a hill, the small increase in the error signal, amplified, causes engine output to increase, which keeps the error very nearly at zero. If the speed begins to exceed the goal, e.g. when going down a hill, the engine is throttled back so as to act as a brake, so again the speed is kept from departing more than a barely detectable amount from the goal speed (brakes being needed only if the hill is too steep). The result is that the cruise control system maintains a speed close to the goal as the car goes up and down hills, and as other disturbances such as wind affect the car's speed. This is all done without any planning of specific actions, and without any blind reactions to stimuli. Indeed, the cruise control system does not sense disturbances such as wind pressure at all, it only senses the controlled variable, speed. Nor does it control the power generated by the engine, it uses the 'behavior' of engine power as its means to control the sensed speed.
The same principles of negative feedback control (including the ability to nullify effects of unpredictable external or internal disturbances) apply to living control systems.[4] Implications of these principle are e.g. intensively studied by biological and medical cybernetics and systems biology.
The thesis of PCT is that animals and people do not control their behavior; rather, they vary their behavior as their means for controlling their perceptions, with or without external disturbances. This is harmoniously consistent with the historical and still widespread assumption that behavior is the final result of stimulus inputs and cognitive plans.[12][19]
The methodology of modeling, and PCT as model
editThe principal datum in PCT methodology is the controlled variable. The fundamental step of PCT research, the test for controlled variables, begins with the slow and gentle application of disturbing influences to the state of a variable in the environment which the researcher surmises is already under control by the observed organism. It is essential not to overwhelm the organism's ability to control, since that is what is being investigated. If the organism changes its actions just so as to prevent the disturbing influence from having the expected effect on that variable, that is strong evidence that the experimental action disturbed a controlled variable. It is crucially important to distinguish the perceptions and point of view of the observer from those of the observed organism. It may take a number of variations of the test to isolate just which aspect of the environmental situation is under control, as perceived by the observed organism.[20][21]
PCT employs a black box methodology. The controlled variable as measured by the observer corresponds quantitatively to a reference value for a perception that the organism is controlling. The controlled variable is thus an objective index of the purpose or intention of those particular behavioral actions by the organism—the goal which those actions consistently work to attain despite disturbances. With few exceptions, in the current state of neuroscience this internally maintained reference value is seldom directly observed as such (e.g. as a rate of firing in a neuron), since few researchers trace the relevant electrical and chemical variables by their specific pathways while a living organism is engaging in what we externally observe as behavior.[22] However, when a working negative feedback system simulated on a digital computer performs essentially identically to observed organisms, then the well understood negative feedback structure of the simulation or model (the white box) is understood to demonstrate the unseen negative feedback structure within the organism (the black box).[6]
Data for individuals are not aggregated for statistical analysis;[23] instead, a generative model is built which replicates the data observed for individuals with very high fidelity (0.95 or better)[clarification needed]. To build such a model of a given behavioral situation requires careful measurements of three observed variables:
qi | The input quantity, that aspect of the stimulus which the subject perceives and has been demonstrated to be controlling. |
qo | The output quantity, that aspect of the subject's behavior which affects the state of qi. |
d | The disturbance, a value summing the effects that any other influences in the environment have on the state of qi. In a controlled experiment one aims to have just one disturbing influence that is under the control of the investigator, but in naturalistic observation the situation is frequently more complex. |
A fourth value, the internally maintained reference r (a variable ′setpoint′), is deduced from the value at which the organism is observed to maintain qi, as determined by the test for controlled variables (described at the beginning of this section).
With two variables specified, the controlled input qi and the reference r, a properly designed control system, simulated on a digital computer, produces outputs qo that almost precisely oppose unpredictable disturbances d to the controlled input. Further, the variance from perfect control accords well with that observed for living organisms.[24] Perfect control would result in zero effect of the disturbance, but living organisms are not perfect controllers, and the aim of PCT is to model living organisms. When a computer simulation performs with >95% conformity to experimentally measured values, opposing the effect of unpredictable changes in d by generating (nearly) equal and opposite values of qo, it is understood to model the behavior and the internal control-loop structure of the organism.[18][10][25]
By extension, the elaboration of the theory constitutes a general model of cognitive process and behavior. With every specific model or simulation of behavior that is constructed and tested against observed data, the general model that is presented in the theory is exposed to potential challenge that could call for revision or could lead to refutation.
Mathematics
editTo illustrate the mathematical calculations employed in a PCT simulation, consider a pursuit tracking task in which the participant keeps a mouse cursor aligned with a moving target on a computer monitor.
The model assumes that a perceptual signal within the participant represents the magnitude of the input quantity qi. (This has been demonstrated to be a rate of firing in a neuron, at least at the lowest levels.)[25][26] In the tracking task, the input quantity is the vertical distance between the target position T and the cursor position C, and the random variation of the target position acts as the disturbance d of that input quantity. This suggests that the perceptual signal p quantitatively represents the cursor position C minus the target position T, as expressed in the equation p=C–T.
Between the perception of target and cursor and the construction of the signal representing the distance between them there is a delay of τ milliseconds, so that the working perceptual signal at time t represents the target-to-cursor distance at a prior time, t – τ. Consequently, the equation used in the model is
1. p(t) = C(t–τ) – T(t–τ)
The negative feedback control system receives a reference signal r which specifies the magnitude of the given perceptual signal which is currently intended or desired. (For the origin of r within the organism, see under "A hierarchy of control", below.) Both r and p are input to a simple neural structure with r excitatory and p inhibitory. This structure is called a "comparator".[25] The effect is to subtract p from r, yielding an error signal e that indicates the magnitude and sign of the difference between the desired magnitude r and the currently input magnitude p of the given perception. The equation representing this in the model is:
2. e = r–p
The error signal e must be transformed to the output quantity qo (representing the participant's muscular efforts affecting the mouse position). Experiments have shown that in the best model for the output function, the mouse velocity Vcursor is proportional to the error signal e by a gain factor G (that is, Vcursor = G*e). Thus, when the perceptual signal p is smaller than the reference signal r, the error signal e has a positive sign, and from it the model computes an upward velocity of the cursor that is proportional to the error.
The next position of the cursor Cnew is the current position Cold plus the velocity Vcursor times the duration dt of one iteration of the program. By simple algebra, we substitute G*e (as given above) for Vcursor, yielding a third equation:
3. Cnew = Cold + G*e*dt
These three simple equations or program steps constitute the simplest form of the model for the tracking task. When these three simultaneous equations are evaluated over and over with similarly distributed random disturbances d of the target position that the human participant experienced, the output positions and velocities of the cursor duplicate the participant's actions in the tracking task above within 4.0% of their peak-to-peak range, in great detail.
This simple model can be refined with a damping factor d which reduces the discrepancy between the model and the human participant to 3.6% when the disturbance d is set to maximum difficulty.
3'. Cnew = Cold + [(G*e)–(d*Cold)]*dt
Detailed discussion of this model in (Powers 2008)[24] includes both source and executable code, with which the reader can verify how well this simple program simulates real behavior. No consideration is needed of possible nonlinearities such as the Weber-Fechner law, potential noise in the system, continuously varying angles at the joints, and many other factors that could afflict performance if this were a simple linear model. No inverse kinematics or predictive calculations are required. The model simply reduces the discrepancy between input p and reference r continuously as it arises in real time, and that is all that is required—as predicted by the theory.[18][25]
Distinctions from engineering control theory
editIn the artificial systems that are specified by engineering control theory, the reference signal is considered to be an external input to the 'plant'.[8] In engineering control theory, the reference signal or set point is public; in PCT, it is not, but rather must be deduced from the results of the test for controlled variables, as described above in the methodology section. This is because in living systems a reference signal is not an externally accessible input, but instead originates within the system. In the hierarchical model, error output of higher-level control loops, as described in the next section below, evokes the reference signal r from synapse-local memory, and the strength of r is proportional to the (weighted) strength of the error signal or signals from one or more higher-level systems.[27]
In engineering control systems, in the case where there are several such reference inputs, a 'Controller' is designed to manipulate those inputs so as to obtain the effect on the output of the system that is desired by the system's designer, and the task of a control theory (so conceived) is to calculate those manipulations so as to avoid instability and oscillation. The designer of a PCT model or simulation specifies no particular desired effect on the output of the system, except that it must be whatever is required to bring the input from the environment (the perceptual signal) into conformity with the reference. In Perceptual Control Theory, the input function for the reference signal is a weighted sum of internally generated signals (in the canonical case, higher-level error signals), and loop stability is determined locally for each loop in the manner sketched in the preceding section on the mathematics of PCT (and elaborated more fully in the referenced literature). The weighted sum is understood to result from reorganization.
Engineering control theory is computationally demanding, but as the preceding section shows, PCT is not. For example, contrast the implementation of a model of an inverted pendulum in engineering control theory[28] with the PCT implementation as a hierarchy of five simple control systems.[29]
A hierarchy of control
editPerceptions, in PCT, are constructed and controlled in a hierarchy of levels. For example, visual perception of an object is constructed from differences in light intensity or differences in sensations such as color at its edges. Controlling the shape or location of the object requires altering the perceptions of sensations or intensities (which are controlled by lower-level systems). This organizing principle is applied at all levels, up to the most abstract philosophical and theoretical constructs.
The Russian physiologist Nicolas Bernstein[30] independently came to the same conclusion that behavior has to be multiordinal—organized hierarchically, in layers. A simple problem led to this conclusion at about the same time both in PCT and in Bernstein's work. The spinal reflexes act to stabilize limbs against disturbances. Why do they not prevent centers higher in the brain from using those limbs to carry out behavior? Since the brain obviously does use the spinal systems in producing behavior, there must be a principle that allows the higher systems to operate by incorporating the reflexes, not just by overcoming them or turning them off. The answer is that the reference value (setpoint) for a spinal reflex is not static; rather, it is varied by higher-level systems as their means of moving the limbs (servomechanism). This principle applies to higher feedback loops, as each loop presents the same problem to subsystems above it.
Whereas an engineered control system has a reference value or setpoint adjusted by some external agency, the reference value for a biological control system cannot be set in this way. The setpoint must come from some internal process. If there is a way for behavior to affect it, any perception may be brought to the state momentarily specified by higher levels and then be maintained in that state against unpredictable disturbances. In a hierarchy of control systems, higher levels adjust the goals of lower levels as their means of approaching their own goals set by still-higher systems. This has important consequences for any proposed external control of an autonomous living control system (organism). At the highest level, reference values (goals) are set by heredity or adaptive processes.
Reorganization in evolution, development, and learning
editIf an organism controls inappropriate perceptions, or if it controls some perceptions to inappropriate values, then it is less likely to bring progeny to maturity, and may die. Consequently, by natural selection successive generations of organisms evolve so that they control those perceptions that, when controlled with appropriate setpoints, tend to maintain critical internal variables at optimal levels, or at least within non-lethal limits. Powers called these critical internal variables "intrinsic variables" (Ashby's "essential variables").
The mechanism that influences the development of structures of perceptions to be controlled is termed "reorganization", a process within the individual organism that is subject to natural selection just as is the evolved structure of individuals within a species.[31]
This "reorganization system" is proposed to be part of the inherited structure of the organism. It changes the underlying parameters and connectivity of the control hierarchy in a random-walk manner. There is a basic continuous rate of change in intrinsic variables which proceeds at a speed set by the total error (and stops at zero error), punctuated by random changes in direction in a hyperspace with as many dimensions as there are critical variables. This is a more or less direct adaptation of Ashby's "homeostat", first adopted into PCT in the 1960 paper[10] and then changed to use E. coli's method of navigating up gradients of nutrients, as described by Koshland (1980).[32]
Reorganization may occur at any level when loss of control at that level causes intrinsic (essential) variables to deviate from genetically determined set points. This is the basic mechanism that is involved in trial-and-error learning, which leads to the acquisition of more systematic kinds of learning processes.[33]
Psychotherapy: the method of levels (MOL)
editThe reorganization concept has led to a method of psychotherapy called the method of levels (MOL). Using MOL, the therapist aims to help the patient shift his or her awareness to higher levels of perception in order to resolve conflicts and allow reorganization to take place.[34]
Neuroscience
editLearning
editCurrently, no one theory has been agreed upon to explain the synaptic, neuronal or systemic basis of learning. Prominent since 1973, however, is the idea that long-term potentiation (LTP) of populations of synapses induces learning through both pre- and postsynaptic mechanisms.[35][36] LTP is a form of Hebbian learning, which proposed that high-frequency, tonic activation of a circuit of neurones increases the efficacy with which they are activated and the size of their response to a given stimulus as compared to the standard neurone (Hebb, 1949).[37] These mechanisms are the principles behind Hebb's famously simple explanation: "Those that fire together, wire together".[37]
LTP has received much support since it was first observed by Terje Lømo in 1966 and is still the subject of many modern studies and clinical research. However, there are possible alternative mechanisms underlying LTP, as presented by Enoki, Hu, Hamilton and Fine in 2009,[38] published in the journal Neuron. They concede that LTP is the basis of learning. However, they firstly propose that LTP occurs in individual synapses, and this plasticity is graded (as opposed to in a binary mode) and bidirectional.[38] Secondly, the group suggest that the synaptic changes are expressed solely presynaptically, via changes in the probability of transmitter release.[38] Finally, the team predict that the occurrence of LTP could be age-dependent, as the plasticity of a neonatal brain would be higher than that of a mature one. Therefore, the theories differ, as one proposes an on/off occurrence of LTP by pre- and postsynaptic mechanisms and the other proposes only presynaptic changes, graded ability, and age-dependence.
These theories do agree on one element of LTP, namely, that it must occur through physical changes to the synaptic membrane/s, i.e. synaptic plasticity. Perceptual control theory encompasses both of these views. It proposes the mechanism of 'reorganisation' as the basis of learning. Reorganisation occurs within the inherent control system of a human or animal by restructuring the inter- and intraconnections of its hierarchical organisation, akin to the neuroscientific phenomenon of neural plasticity. This reorganisation initially allows the trial-and-error form of learning, which is seen in babies, and then progresses to more structured learning through association, apparent in infants, and finally to systematic learning, covering the adult ability to learn from both internally and externally generated stimuli and events. In this way, PCT provides a valid model for learning that combines the biological mechanisms of LTP with an explanation of the progression and change of mechanisms associated with developmental ability.[39][40][41][42][43]
Powers in 2008 produced a simulation of arm co-ordination.[24] He suggested that in order to move your arm, fourteen control systems that control fourteen joint angles are involved, and they reorganise simultaneously and independently. It was found that for optimum performance, the output functions must be organised in a way so as each control system's output only affects the one environmental variable it is perceiving. In this simulation, the reorganising process is working as it should, and just as Powers suggests that it works in humans, reducing outputs that cause error and increasing those that reduce error. Initially, the disturbances have large effects on the angles of the joints, but over time the joint angles match the reference signals more closely due to the system being reorganised. Powers suggests that in order to achieve coordination of joint angles to produce desired movements, instead of calculating how multiple joint angles must change to produce this movement the brain uses negative feedback systems to generate the joint angles that are required. A single reference signal that is varied in a higher-order system can generate a movement that requires several joint angles to change at the same time.[24]
Hierarchical organisation
editBotvinick in 2008[44] proposed that one of the founding insights of the cognitive revolution was the recognition of hierarchical structure in human behavior. Despite decades of research, however, the computational mechanisms underlying hierarchically organized behavior are still not fully understood. Bedre, Hoffman, Cooney & D'Esposito in 2009[45] proposed that the fundamental goal in cognitive neuroscience is to characterize the functional organization of the frontal cortex that supports the control of action.
Recent neuroimaging data has supported the hypothesis that the frontal lobes are organized hierarchically, such that control is supported in progressively caudal regions as control moves to more concrete specification of action. However, it is still not clear whether lower-order control processors are differentially affected by impairments in higher-order control when between-level interactions are required to complete a task, or whether there are feedback influences of lower-level on higher-level control.[45]
Botvinik in 2008[44] found that all existing models of hierarchically structured behavior share at least one general assumption – that the hierarchical, part–whole organization of human action is mirrored in the internal or neural representations underlying it. Specifically, the assumption is that there exist representations not only of low-level motor behaviors, but also separable representations of higher-level behavioral units. The latest crop of models provides new insights, but also poses new or refined questions for empirical research, including how abstract action representations emerge through learning, how they interact with different modes of action control, and how they sort out within the prefrontal cortex (PFC).
Perceptual control theory (PCT) can provide an explanatory model of neural organisation that deals with the current issues. PCT describes the hierarchical character of behavior as being determined by control of hierarchically organized perception. Control systems in the body and in the internal environment of billions of interconnected neurons within the brain are responsible for keeping perceptual signals within survivable limits in the unpredictably variable environment from which those perceptions are derived. PCT does not propose that there is an internal model within which the brain simulates behavior before issuing commands to execute that behavior. Instead, one of its characteristic features is the principled lack of cerebral organisation of behavior. Rather, behavior is the organism's variable means to reduce the discrepancy between perceptions and reference values which are based on various external and internal inputs.[46] Behavior must constantly adapt and change for an organism to maintain its perceptual goals. In this way, PCT can provide an explanation of abstract learning through spontaneous reorganisation of the hierarchy. PCT proposes that conflict occurs between disparate reference values for a given perception rather than between different responses,[13] and that learning is implemented as trial-and-error changes of the properties of control systems,[27] rather than any specific response being reinforced. In this way, behavior remains adaptive to the environment as it unfolds, rather than relying on learned action patterns that may not fit.
Hierarchies of perceptual control have been simulated in computer models and have been shown to provide a close match to behavioral data. For example, Marken[47] conducted an experiment comparing the behavior of a perceptual control hierarchy computer model with that of six healthy volunteers in three experiments. The participants were required to keep the distance between a left line and a centre line equal to that of the centre line and a right line. They were also instructed to keep both distances equal to 2 cm. They had 2 paddles in their hands, one controlling the left line and one controlling the middle line. To do this, they had to resist random disturbances applied to the positions of the lines. As the participants achieved control, they managed to nullify the expected effect of the disturbances by moving their paddles. The correlation between the behavior of subjects and the model in all the experiments approached 0.99. It is proposed that the organization of models of hierarchical control systems such as this informs us about the organization of the human subjects whose behavior it so closely reproduces.
Robotics
editPCT has significant implications for Robotics and Artificial Intelligence. W.T. Powers introduced the application of PCT to robotics in 1978, early in the availability of home computers.[48] [49] [50] [51] The comparatively simple architecture,[52] a hierarchy of perceptual controllers, has no need for complex models of the external world, inverse kinematics, or computation from input-output mappings. Traditional approaches to robotics generally depend upon the computation of actions in a constrained environment. Robots designed this way are inflexible and clumsy, unable to cope with the dynamic nature of the real world. PCT robots inherently resist and counter the chaotic, unpredictable disturbances to their controlled inputs which occur in an unconstrained environment. The PCT robotics architecture has recently been applied to a number of real-world robotic systems including robotic rovers,[53] balancing robot[54] and robot arms.[55] Some commercially available robots which demonstrate good control in a naturalistic environment use a control-theoretic architecture which requires much more intensive computation. For example, Boston Dynamics has said[56] that its robots use historically leveraged model predictive control.
Current situation and prospects
editThe preceding explanation of PCT principles provides justification of how this theory can provide a valid explanation of neural organisation and how it can explain some of the current issues of conceptual models.
Perceptual control theory currently proposes a hierarchy of 11 levels of perceptions controlled by systems in the human mind and neural architecture. These are: intensity, sensation, configuration, transition, event, relationship, category, sequence, program, principle, and system concept. Diverse perceptual signals at a lower level (e.g. visual perceptions of intensities) are combined in an input function to construct a single perception at the higher level (e.g. visual perception of a color sensation). The perceptions that are constructed and controlled at the lower levels are passed along as the perceptual inputs at the higher levels. The higher levels in turn control by adjusting the reference levels (goals) of the lower levels, in effect telling the lower levels what to perceive.[25][33]
While many computer demonstrations of principles have been developed, the proposed higher levels are difficult to model because too little is known about how the brain works at these levels. Isolated higher-level control processes can be investigated, but models of an extensive hierarchy of control are still only conceptual, or at best rudimentary.
Perceptual control theory has not been widely accepted in mainstream psychology, but has been effectively used in a considerable range of domains[57][58] in human factors,[59] clinical psychology, and psychotherapy (the "Method of Levels"), it is the basis for a considerable body of research in sociology,[60] and it has formed the conceptual foundation for the reference model used by a succession of NATO research study groups.[61]
Recent approaches use principles of perceptual control theory to provide new algorithmic foundations for artificial intelligence and machine learning.[62]
Selected bibliography
edit- Cziko, Gary (1995). Without miracles: Universal selection theory and the second Darwinian revolution. Cambridge, MA: MIT Press (A Bradford Book). ISBN 0-262-53147-X
- Cziko, Gary (2000). The things we do: Using the lessons of Bernard and Darwin to understand the what, how, and why of our behavior. Cambridge, MA: MIT Press (A Bradford Book). ISBN 0-262-03277-5
- Forssell, Dag (Ed.), 2016. Perceptual Control Theory, An Overview of the Third Grand Theory in Psychology: Introductions, Readings, and Resources. Hayward, CA: Living Control Systems Publishing. ISBN 978-1938090134.
- Mansell, Warren (Ed.), (2020). The Interdisciplinary Handbook of Perceptual Control Theory: Living Control Systems IV. Cambridge: Academic Press. ISBN 978-0128189481.
- Marken, Richard S. (1992) Mind readings: Experimental studies of purpose. Benchmark Publications: New Canaan, CT.
- Marken, Richard S. (2002) More mind readings: Methods and models in the study of purpose. Chapel Hill, NC: New View. ISBN 0-944337-43-0
- Pfau, Richard H. (2017). Your Behavior: Understanding and Changing the Things You Do. St. Paul, MN: Paragon House. ISBN 9781557789273
- Plooij, F. X. (1984). The behavioral development of free-living chimpanzee babies and infants. Norwood, N.J.: Ablex.
- Plooij, F. X. (2003). "The trilogy of mind". In M. Heimann (Ed.), Regression periods in human infancy (pp. 185–205). Mahwah, NJ: Erlbaum.
- Powers, William T. (1973). Behavior: The control of perception. Chicago: Aldine de Gruyter. ISBN 0-202-25113-6. [2nd exp. ed. = Powers (2005)].
- Powers, William T. (1989). Living control systems. [Selected papers 1960–1988.] New Canaan, CT: Benchmark Publications. ISBN 0-9647121-3-X.
- Powers, William T. (1992). Living control systems II. [Selected papers 1959–1990.] New Canaan, CT: Benchmark Publications.
- Powers, William T. (1998). Making sense of behavior: The meaning of control. New Canaan, CT: Benchmark Publications. ISBN 0-9647121-5-6.
- Powers, William T. (2005). Behavior: The control of perception. New Canaan: Benchmark Publications. ISBN 0-9647121-7-2. [2nd exp. ed. of Powers (1973). Chinese tr. (2004) Guongdong Higher Learning Education Press, Guangzhou, China. ISBN 7-5361-2996-3.]
- Powers, William T. (2008). Living Control Systems III: The fact of control. [Mathematical appendix by Dr. Richard Kennaway. Includes computer programs for the reader to demonstrate and experimentally test the theory.] New Canaan, CT: Benchmark Publications. ISBN 978-0-9647121-8-8.
- Powers, William. T., Clark, R. K., and McFarland, R. L. (1960). "A general feedback theory of human behavior [Part 1; Part 2]. Perceptual and Motor Skills 11, 71–88; 309–323.
- Powers, William T. and Runkel, Philip J. 2011. Dialogue concerning the two chief approaches to a science of life: Word pictures and correlations versus working models. Hayward, CA: Living Control Systems Publishing ISBN 0-9740155-1-2.
- Robertson, R. J. & Powers, W.T. (1990). Introduction to modern psychology: the control-theory view. Gravel Switch, KY: Control Systems Group.
- Robertson, R. J., Goldstein, D.M., Mermel, M., & Musgrave, M. (1999). Testing the self as a control system: Theoretical and methodological issues. Int. J. Human-Computer Studies, 50, 571–580.
- Runkel, Philip J[ulian]. 1990. Casting Nets and Testing Specimens: Two Grand Methods of Psychology. New York: Praeger. ISBN 0-275-93533-7. [Repr. 2007, Hayward, CA: Living Control Systems Publishing ISBN 0-9740155-7-1.]
- Runkel, Philip J[ulian]. (2003). People as living things. Hayward, CA: Living Control Systems Publishing ISBN 0-9740155-0-4
- Taylor, Martin M. (1999). "Editorial: Perceptual Control Theory and its Application," International Journal of Human-Computer Studies, Vol 50, No. 6, June 1999, pp. 433–444.
Sociology
edit- McClelland, Kent (1994). "Perceptual Control and Social Power". Sociological Perspectives. 37 (4): 461–496. doi:10.2307/1389276. JSTOR 1389276. S2CID 144872350.
- McClelland, Kent (2004). "The Collective Control of Perceptions: Constructing Order from Conflict". International Journal of Human-Computer Studies. 60: 65–99. doi:10.1016/j.ijhcs.2003.08.003.
- McClelland, Kent and Thomas J. Fararo, eds. (2006). Purpose, Meaning, and Action: Control Systems Theories in Sociology. New York: Palgrave Macmillan.
- McPhail, Clark. 1991. The Myth of the Madding Crowd. New York: Aldine de Gruyter.
References
edit- ^ a b Floegel, Mareike; Kasper, Johannes; Perrier, Pascal; Kell, Christian A. (30 March 2023). "How the conception of control influences our understanding of actions". Nature Reviews Neuroscience. 24 (5): 313–329. doi:10.1038/s41583-023-00691-z. PMID 36997716. S2CID 257857085.
- ^ Harold Black and the Negative-Feedback Amplifier, Ronald Kline, IEEE Control Systems Magazine, Aug 1993, Volume 13, Issue 4, Pages 82-85
- ^ Bennett, Stuart (June 1996). "A brief history of automatic control" (PDF). IEEE Control Systems Magazine. 16 (3): 17–25. doi:10.1109/37.506394. Archived from the original (PDF) on 9 August 2016. Retrieved 18 July 2016.
- ^ a b Cybernetics: Or Control and Communication in the Animal and the Machine. Paris: Hermann & Cie. 1948. 2nd revised ed. 1961, MIT Press, Cambridge, MA. ISBN 978-0-262-73009-9.
- ^ Ashby, William Ross (1952). Design for a Brain. London: Chapman & Hall.
- ^ a b c Runkel, Philip J. (1990). Casting nets and testing specimens: Two grand methods of psychology. New York: Praeger. p. 103. ISBN 978-0-275-93533-7.
- ^ Cziko, Gary (2000), The things we do: Using the lessons of Bernard and Darwin to understand the what, how, and why of our behavior, Cambridge, MA: MIT Press, p. 9, ISBN 978-0-262-03277-3
- ^ a b Astrom, Karl J.; Murray, Richard M. (2008). Feedback Systems: An Introduction for Scientists and Engineers (PDF). Princeton University Press. ISBN 978-0-691-13576-2.
- ^ For additional information about the history of PCT, see:
- ^ a b c Powers, William T.; Clark, R.K.; McFarland, R.L. (1960). "A general feedback theory of human behavior (Part I)". Perceptual and Motor Skills. 11 (1): 71–88. doi:10.2466/pms.1960.11.1.71. S2CID 145256548. and Powers, William T.; Clark, R.K.; McFarland, R.L. (1960). "A general feedback theory of human behavior (Part II)". Perceptual and Motor Skills. 11 (3): 309–323. doi:10.2466/pms.1960.11.3.309. S2CID 220712715. [Reprinted in Bertalanffy, Ludwig von; Rapoport, Anatol (1960), General Systems: Yearbook of the Society for General Systems Research, vol. 5, Ann Arbor, Michigan: Society for General Systems Research, pages 63-73, 75-83. Partial reprint in Smith, A. G. (1966). Communication and Culture. New York: Holt, Rinehart, and Winston.]
- ^ Archives of the Control Systems Group (CSG), also in the IAPCT Discourse forum.
- ^ a b c Marken, Richard S. (June 2009). "You say you had a revolution: Methodological foundations of closed-loop psychology". Review of General Psychology. 13 (2): 137–145. doi:10.1037/a0015106. S2CID 145458091.
- ^ a b Mansell, Warren (2011). "Control of perception should be operationalized as a fundamental property of the nervous system". Topics in Cognitive Science. 3 (2): 257–261. doi:10.1111/j.1756-8765.2011.01140.x. PMID 25164294.
- ^ Mansell, Warren; Carey, Timothy A. (28 November 2015). "A perceptual control revolution?". The Psychologist. The British Psychological Society. Retrieved 17 July 2016.
- ^ Mansell, Warren, ed. (2020). The Interdisciplinary Handbook of Perceptual Control Theory: Living Control Systems IV. Cambridge: Academic Press. ISBN 978-0128189481.
- ^ Powers, William T. (1978). "Quantitative analysis of purposive systems: Some spadework at the foundations of scientific psychology". Psychological Review. 85 (5): 417–435. doi:10.1037/0033-295X.85.5.417.
- ^ "The behaviorist asks: Why don't we make what we can observe the real field of psychology? Let us limit ourselves to things that can be observed, and formulate laws concerning only those things. Now what can we observe? We can observe behavior—what the organism does or says." Watson, J.B. (1924). Behaviorism. New York: People's Institute Publishing Company.
- ^ a b c Runkel, Philip J. (2003). People as living things. Hayward, CA: Living Control Systems Publishing. ISBN 978-0-9740155-0-7.
- ^ Miller, George; Galanter, Eugene; Pribram, Karl (1960). Plans and the structure of behavior. New York: Holt, Rinehart and Winston. ISBN 978-0-03-010075-8.
- ^ Runkel, Philip J. (2003). People as living things. Hayward, CA: Living Control Systems Publishing. pp. 77–79. ISBN 978-0-9740155-0-7.
- ^ Marken, Richard S. (2001). "Controlled variables: psychology as the center fielder views it". American Journal of Psychology. 114 (2): 259–281. CiteSeerX 10.1.1.554.9588. doi:10.2307/1423517. JSTOR 1423517. PMID 11430151.
- ^ See e.g. Henry Yin's works listed on Google Scholar.
- ^ See Runkel 1990[6] on the limitations of statistical methods and the value of individual performance data.
- ^ a b c d Powers, William T. (2008). Living Control Systems III: The fact of control. New Canaan, CT: Benchmark Publications. ISBN 978-0-9647121-8-8. [Mathematical appendix by Dr. Richard Kennaway. Includes computer programs for the reader to demonstrate and experimentally test the theory.]
- ^ a b c d e Powers, William T. (1973). Behavior: The Control of Perception. Wildwood House. ISBN 978-0-7045-0092-1.
- ^ Yin, Henry H. (18 November 2014). "How Basal Ganglia Outputs Generate Behavior". Advances in Neuroscience. 2014 (768313): 1–28. doi:10.1155/2014/768313.
- ^ a b Marken, Richard S.; William T., Powers (1989), "Levels of intention in behavior", in Hershberger, Wayne (ed.), Volitional Action, Advances in psychology, vol. 62, Amsterdam: Elsevier B.V., pp. 409–430, ISBN 978-0-444-88318-6
- ^ Documented e.g. at Miranda, José Luis Corona. 2009. Miranda, José Luis Corona. 2009. "Application of Kalman Filtering and PID Control for Direct Inverted Pendulum Control". M.A. Thesis, Chico State University, Chico, CA Archived 2016-03-04 at the Wayback Machine.
- ^ Documented at Powers, William T. & Richard Kennaway. (Edited by Dag Forssell.) 2004. "Inverted Pendulum". Hayward, CA: Living Control Systems., with downloadable source and executable code. A more detailed exposition of the differences between PCT and engineering control theory, with computer demonstrations and source code, is available at http://www.livingcontrolsystems.com/demos/multiple_control/multiple_control.zip. This is one of many computer demonstrations that are available, with source code, at www.livingcontrolsystems.com/demos/tutor_pct.html.
- ^ Bernstein, Nicolas. 1967. Coordination and regulation of movements. New York: Pergamon Press.
- ^ For an introduction, see the Byte articles on robotics and the article on the origins of purpose in this collection Archived 2007-06-04 at the Wayback Machine.
- ^ Koshland, Daniel. (1980). Bacterial chemotaxis as a model behavioral system. New York: Raven Press.
- ^ a b Cziko, Gary (1995). Without Miracles. MIT Press. ISBN 978-0-262-03232-2..
- ^ Mansell, Warren; Carey, Timothy A; Tai, Sara (2012). A transdiagnostic approach to CBT using method of levels therapy: distinctive features. The CBT distinctive features series. Milton Park, Abingdon, Oxon; New York: Routledge. doi:10.4324/9780203081334. ISBN 9780415507639. OCLC 774499959.
- ^ Bliss, T. V. P.; Lømo, T. (1 July 1973). "Long-lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path". The Journal of Physiology. 232 (2). Wiley: 331–356. doi:10.1113/jphysiol.1973.sp010273. ISSN 0022-3751. PMC 1350458. PMID 4727084.
- ^ Bliss, T. V.; Gardner-Medwin, A. R.; Lømo, T. (1973). "Synaptic plasticity in the hippocampal formation". Macromolecules and Behaviour. 193.
- ^ a b Hebb, Donald (1949). The organization of behavior: A neuropsychological theory. New York: Wiley & Sons.
- ^ a b c Enoki, Ryosuke; Hu, Yi-ling; Hamilton, David; Fine, Alan (2009). "Expression of Long-Term Plasticity at Individual Synapses in Hippocampus Is Graded, Bidirectional, and Mainly Presynaptic: Optical Quantal Analysis". Neuron. 62 (2). Elsevier BV: 242–253. doi:10.1016/j.neuron.2009.02.026. ISSN 0896-6273. PMID 19409269.
- ^ Plooij, Frans X. (1984). The behavioral development of free-living chimpanzee babies and infants. Norwood, N.J.: Ablex.
- ^ van de Rijt-Plooij, Hetty; Plooij, Frans (1987). "Growing independence, conflict and learning in mother-infant relations in free-ranging chimpanzees". Behaviour. 101 (1–3): 1–86. doi:10.1163/156853987x00378.
- ^ Plooij, Frans X. (2003), Heimann, M. (ed.), The trilogy of mind, vol. Regression periods in human infancy, Mahwah, New Jersey: Erlbaum, pp. 185–205
- ^ Plooij, Frans X.; van de Rijt-Plooij, Hetty (1990). "Developmental transitions as successive reorganizations of a control hierarchy". American Behavioral Scientist. 34: 67–80. doi:10.1177/0002764290034001007. S2CID 144183592.
- ^ van de Rijt-Plooij, Hetty; Plooij, Frans (October 22, 2013). The Wonder Weeks: How to Stimulate Your Baby's Mental Development and Help Him Turn His 10 Predictable, Great, Fussy Phases into Magical Leaps Forward. Arnhem, Netherlands: Kiddy World Publishing. p. 480. ISBN 978-9491882005.
- ^ a b Botvinick, Matthew M. (2008). "Hierarchical models of behavior and prefrontal function". Trends in Cognitive Sciences. 12 (5). Elsevier BV: 201–208. doi:10.1016/j.tics.2008.02.009. ISSN 1364-6613. PMC 2957875. PMID 18420448.
- ^ a b Bedre, Hoffman, Cooney & D'Esposito 2009[full citation needed]
- ^ Cools, A. R. (1985). "Brain and Behavior: Hierarchy of Feedback Systems and Control of Input". In Bateson, P. P. G.; Klopfer, Peter H. (eds.). Perspectives in Ethology. Boston, MA: Springer US. pp. 109–168. doi:10.1007/978-1-4757-0232-3_5. ISBN 978-1-4757-0234-7.
- ^ Marken, Richard S. (Aug 1986). "Perceptual organization of behavior: A hierarchical control model of coordinated action". Journal of Experimental Psychology: Human Perception and Performance. 12 (3): 267–276. doi:10.1037/0096-1523.12.3.267. PMID 2943855.
- ^ Powers, William T. (1978). "The Nature of Robots: Part I: Defining Behavior" (PDF). Byte: The Small Systems Journal. No. 4. Peterborough, NH: McGraw-Hill. pp. 132–144. Archived from the original (PDF) on June 4, 2007.
- ^ Powers, William T. (1978). "The Nature of Robots: Part II: Simulated Control Systems" (PDF). Byte: The Small Systems Journal. No. 4. Peterborough, NH: McGraw-Hill. pp. 134–152. Archived from the original (PDF) on June 4, 2007.
- ^ Powers, William T. (1978). " "The Nature of Robots: Part III: A closer look at human behavior". Byte: The Small Systems Journal. No. 4. Peterborough, NH: McGraw-Hill. pp. 94–116. Archived from the original (PDF) on June 4, 2007.
- ^ Powers, William T. (1978). "The Nature of Robots: Part IV: Looking for controlled variables" (PDF). Byte: The Small Systems Journal. No. 4. Peterborough, NH: McGraw-Hill. pp. 96–112. Archived from the original (PDF) on June 4, 2007.
- ^ Young, Rupert (Jun 2017). "A General Architecture for Robotics Systems: A Perception-Based Approach to Artificial Life". Artificial Life. 23 (2): 236–286. doi:10.1162/ARTL_a_00229. PMID 28513206.
- ^ Young, Rupert (Feb 27, 2015). HPCT Autonomous Rover (short version) (YouTube). Perceptual Robots.
- ^ Young, Rupert (Mar 9, 2016). Robot on a train (YouTube). Perceptual Robots.
- ^ Young, Rupert (Jul 1, 2016). Dynamic Visual Robot Arm Control (YouTube). Perceptual Robots.
- ^ "Starting on the Right Foot with Reinforcement Learning". bostondynamics.com. Boston Dynamics. March 19, 2024. Retrieved November 1, 2024.
The legged robots we've built at Boston Dynamics have historically leveraged Model Predictive Control (MPC), a control strategy that predicts and optimizes the future states of the robot in order to decide what action to take in the moment.
- ^ "A perceptual control revolution?". The Psychologist.
- ^ The June 1999 Issue of The International Journal of Human-Computer Studies contained papers ranging from tracking through cockpit layout to self-image and crowd dynamics.
- ^ PCT lies at the foundation of Component-Based Usability Testing.
- ^ For example: McClelland, Kent A. and Thomas J. Fararo, eds. 2006, Purpose, Meaning and Action: Control Systems Theories in Sociology, New York: Palgrave Macmillan. (McClelland is co-author of Chapter 1, "Control Systems Thinking in Sociological Theory," and author of Chapter 2, "Understanding Collective Control Processes."). McClelland, Kent, 2004, "Collective Control of Perception: Constructing Order from Conflict", International Journal of Human-Computer Studies 60:65-99. McPhail, Clark. 1991, The myth of the madding crowd New York: Aldine de Gruyter.
- ^ volume-28november-2015 Reports of these groups are available from the NATO Research and Technology Administration publications page: "NATO Research & Technology Organisation Scientific Publications". Archived from the original on 2010-06-23. Retrieved 2010-05-15.> under the titles RTO-TR-030, RTO-TR-IST-021, and RTO-TR-IST-059.
- ^ Monaco, Joseph D.; Hwang, Grace M. (27 December 2022). "Neurodynamical Computing at the Information Boundaries of Intelligent Systems". Cognitive Computation. 16 (5): 1–13. doi:10.1007/s12559-022-10081-9. PMC 11306504. PMID 39129840. S2CID 255222711.
External links
editArticles
edit- PCT for the Beginner by William T. Powers (2007)
- The Dispute Over Control theory by William T. Powers (1993) – requires access approval
- Demonstrations of perceptual control by Gary Cziko (2006)
Audio
edit- Interview with William T. Powers on origin and history of PCT (Part One – 20060722 (58.7M)
- Interview with William T. Powers on origin and history of PCT (Part Two – 20070728 (57.7M)
Videos
editWebsites
edit- The International Association for Perceptual Control Systems – The IAPCT website.
- PCTWeb – Warren Mansell's comprehensive website on PCT.
- Living Control Systems Publishing – resources and books about PCT.
- Mind Readings – Rick Marken's website on PCT, with many interactive demonstrations.
- Method of Levels – Timothy Carey's website on the Method of Levels.
- Perceptual Robots – The PCT methodology and architecture applied to robotics.
- ResearchGate Project – Recent research products.