| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
|
|
1 Department of Neurobiology, The Weizmann Institute
of Science, Rehovot 76100, Israel,
2 Department of Physics and
3 Graduate Program in Neurosciences, University of California at
San Diego, La Jolla, CA 92093 and
4 Institute for Theoretical
Physics, University of California at Santa Barbara, Santa Barbara, CA 93106, USA
Address correspondence to Ehud Ahissar, Department of Neurobiology, The Weizmann Institute of Science, Rehovot 76100, Israel, email: ehud.ahissar@weizmann.ac.il, or to David Kleinfeld, email: dk@physics.ucsd.edu.
| Abstract |
|---|
| Introduction |
|---|
Feedforward and recurrent computation schemes can be reconciled by
viewing information as being passed from one processing station to
another in a feedforward manner and processed at each station by
recurrent networks (Fig. 1a
). However, the
description of brain architecture is not complete without inclusion
of its third major component — large-scale feedback connections.
Feedback connections, which feed the output of the receiving
areas back to the transmitting areas, occur at all levels (Fig.
1b
). Cortico-thalamic
feedback connections are perhaps the most intensively studied example
of this kind. Feedback connections, however, occur not only between
cortex and thalamic nuclei, but also between cortex and brainstem,
between cortical areas that are connected via feedforward
connections, and from motor output nuclei back to the cortex; see
Kleinfeld et al. (Kleinfeld et al., 1999
) for a review
on the vibrissa sensorimotor system.
|
The architecture of closed-loop systems lies between that of feedforward and recurrent networks. Like in feedforward networks, but unlike in recurrent networks, the flow of information in closed-loop systems is well delineated. Like in recurrent networks, but unlike in feedforward networks, information flows in both directions, i.e. from input to output and back. Thus, closed-loop circuits provide a substrate for computations that cannot be done with purely feedforward or recurrent configurations. One example is iterative transformations from one set of neuronal variables to another, as may occur in the encoding and processing of sensory inputs.
Closed-loop dynamics can be found at all levels of neuronal function. At the molecular level, the activity of a biochemical process can be suppressed (negative feedback) or enhanced (positive feedback) by the end product of that process. Similarly, at the cellular level, the opening of ion channels is a function of the membrane potential, which in turn is affected by ion channel opening. At the circuit level, the activity of individual neurons influences neighboring cells, whose activity in turn modulates that of the original cell. At the system level, e.g. the level of cortical areas and sub-cortical nuclei, each neuronal circuit affects several other circuits whose output ultimately feeds back on the original circuit. At the behavioral level, sensory input guides the motor response, which in turn updates the input to the sensory system. We focus here on the circuit, system and behavioral levels.
| Computations Performed by Neuronal Closed Loops |
|---|
Closed loops provide an elegant solution to control problems that involve different types of variables, such as the control of mechanical variables by neuronal variables. To illustrate closedloop control, we will consider two schemes that are implemented by a ‘low-level’ loop, the stretch-reflex loop, under ‘high-level’ descending control.
| Examples of Motor Control by Closed Loops |
|---|
|
0 in Fig.
2b
in Fig. 2b
operation in Fig.
2b
/dt = G(
–
0). This signal, in turn,
drives the synergistic motor neurons and its negated form (mediated
by inhibitory interneurons) drives antagonist motor neurons. Under
steady-state conditions, the two muscle groups integrate the control
signal. For a sufficiently large gain (G in Fig. 2b
0.
A second feedback scheme, which is of relevance to our discussion
on the vibrissa sensorimotor system, considers the periodic
modulation of the angle of a joint. This control scheme makes
use of a descending signal that oscillates in time
(cos2pf0t in Fig. 2c
). The position of the
joint (cos[2
f0t +
] in Fig. 2c
) is mixed with the control
signal, as could occur by neurons or small networks of neurons that
use their threshold properties to multiply their inputs [X in Fig.
2b
; see Ahissar
(Ahissar, 1998
) and Ahrens
et al. (Ahrens et al., 2002
)]. The
spectrum of the mixed signal contains the difference between the
desired frequency and the actual frequency (f –
f0), as well as the sum of these frequencies. The
low (difference) frequencies are extracted from the mixed signal by
the low-pass filtering properties of the involved neurons. The final
signal contains a constant (Gsin
in Fig. 2c
), as well as a term, which
for small frequency differences (i.e. f
f0) is proportional to
the phase slippage [O{(f –
f0)t} in Fig. 2c
]. This final signal
is used to drive a local oscillator in the spinal cord (~ in
Fig. 2c
), for which the
oscillation frequency is a monotonic function of the input. For
open-loop gains (i.e. accumulated gain along the loop) around 1, the
frequency of the local oscillator will be driven to match that of the
control signal, so that under steady-state conditions f =
f0 and the final signal is a constant with no phase
slippage. Thus there is a constant phase difference,
, between the reference and spinal
oscillators, which is a monotonic function of (f –
f0)/G. By combining feedback schemes for
both position and oscillation control, a joint can oscillate around a
desired position, as is required for certain motor tasks, such as
walking.
Transformations from one variable to another are required not only for motor control, but also for sensory processing. Perceived entities are composed of a variety of physical variables of different types and dimensions. These physical variables should be transformed to neuronal variables. Hence, sensory acquisition and processing must employ a variety of transformations. The first transformations occur already at the level of the sensory receptors during transduction. These transformations are implemented by a variety of closed loops, mostly at the molecular and cellular levels. Later transformations usually transform featurebased codes to more abstract codes that are used for integration and motor control.
| Closed-loop Computations in the Vibrissa Sensorimotor System |
|---|
|
The existence of a central mechanism that ‘measures’ the input
periodicity was proposed by Mountcastle and colleagues in the 1960s
to explain their observations from the primate somatosensory system
(Talbot et al., 1968
). The
possibility that such a mechanism exists in rats was investigated by
testing the predictions of several potential mechanisms in
anesthetized rats (Ahissar et al., 1997
, 2000
, 2001a
; Sosnik et
al., 2001
) and
is reviewed elsewhere (Ahissar and Arieli, 2001
; Ahissar
and Zacksenhouse, 2001
). The results
of these experiments suggest that one of the two major
thalamocortical systems, the paralemniscal system, contains many
parallel loops that function as phase-locked loops (PLLs). A PLL is
an algorithm for temporal processing with periodical signals,
discovered by electrical engineers in the 1930s (Bellescize, 1932
) and is
considered to be an optimal temporal decoder. It can be implemented
by software, electronic circuits (Gardner, 1979
), single
neurons (Hoppensteadt, 1986
), or
neuronal circuits (Ahissar and Vaadia, 1990
; Ahissar,
1998
).
The elegance of the PLL emerges mainly from its adaptive operation,
which is a direct outcome of its closed-loop design (Gardner,
1979
; Ahissar,
1998
; Kleinfeld
et al., 1999
). One
implementation of a PLL was presented above to describe motor control
of the skeletal joint (Fig. 2c
). Other neuronal
implementations of PLLs could, in principle, occur all over the
nervous system. In particular, a sensory PLL for decoding vibrissal
temporally encoded information could be implemented across
thalamocortical loops, by using cortical oscillators, cortical
inhibitory neurons and thalamic ‘relay’ neurons, where the last
are hypothesized to function as phase detectors (Fig. 4
) (Ahissar
et al., 1997
; Ahissar and
Arieli, 2001
; Ahissar and
Zacksenhouse, 2001
). For such
implementations, which consist entirely of spiking neurons,
discrete-time representations are probably more appropriate than
continuous-time representations (Ahissar, 1998
). This is
particularly true for the vibrissal system, in which computations
involve neurons that fire one or few spikes per whisking cycle.
|
| Decoding by PLLs: Theory, Predictions and Tests |
|---|
, in the awake, whisking
animal. Second, many independent cortical oscillators exist in the
somatosensory cortex of anesthetized rodents, each exhibiting a
different spontaneous frequency and each oscillating independently
from the others when no sensory stimulus is applied (Ahissar et
al., 1997The equations of a discrete form of a linear PLL (Fig. 4
), in the
absence of noise, are:
![]() |
(1) |
![]() |
(2) |
D = 0, a is a constant,
and
D(n) is the temporal delay between the two inputs,
tosc and tbs (Fig. 4
![]() |
(3) |
Ti(n) is the period (1/frequency) of the input, and
To(n) is the period of the oscillator. The
latter period is given by
![]() |
(4) |
is a constant.
At steady-state,
D(n + 1) =
D(n) and thus the PLL is
locked [To = Ti, in equation
(2)
] and, from
equations (1)
and (4)
,
![]() |
(5) |

is the ‘open-loop
gain’ of the circuit.
Thus, with linear PLLs at steady-state,
D is linear with respect
to the term (Tc – Ti). The latency of
the cortical oscillator (tosc –
tstim, where tstim is stimulus onset time)
equals, from equation (3)
:
![]() |
(6) |
![]() |
(7) |
D + constant. This relationship, together with equation
(5)The first prediction is that steady-state response latencies, in
thalamus and cortex, should increase with increasing input
frequencies [fi = 1/Ti; for any given
Tc,
D will increase with decreasing
Ti, see equation (5)
]. This was indeed observed
in the thalamic and cortical stations of the paralemniscal
system, i.e. POm and layer 5a, respectively (Ahissar et al.,
2000
).
The steady-state response phases of POm and layer 5a neurons
increase with the stimulus frequency (Fig. 5a
). The response
phases increase not only due to the decreased stimulus period,
but also due to an explicit increase in response latencies, as
demonstrated by the distributions of onset latencies among these
neurons (Fig. 5b
).
|
According to the above results, temporal decoding in the paralemniscal
system is accomplished by sets of many parallel thalamocortical
PLLs, each with a different working range, i.e. a range of input
frequencies that can be decoded by that PLL. If this is the
case, then during natural whisking the spread of cortical phases
should exhibit the accumulation of the spreads of cortical
Tcs and of whisking frequencies. This is consistent
with cortical data from freely moving rats (Fee et al., 1997
). Cortical
neurons phase-lock to whisking movements with different phases
(Fig. 6
). While the ensemble
vector has a phase of about
/4 relative to the retracted phase of the mystacial EMG
activity, the entire population of single units cover the entire
range of possible phases (Fig. 6b
). The cortical phase
distribution observed during free whisking (Fig. 6b
) resembles that observed
in anesthetized rats during vibrissa stimulation at whiskingrange
frequencies, i.e. frequencies between 5 and 11 Hz (Fig. 5a
, right panel,
gray dots). In both cases, response phases distribute between 0
and 2
and response magnitudes
are larger at low response phases, consistent with the PLL
model.
|
|
| Further Predictions for Thalamocortical PLLs |
|---|
The last prediction depends on the actual set point of the
thalamocortical PLLs and thus is not a critical prediction (Ahissar,
1998
; Kleinfeld
et al., 1999
). Yet, the data
collected so far indicate thalamocortical set points for which such a
dependency is expected (Ahissar et al., 1997
; Ahissar and
Arieli, 2001
).
| Possible Alternative Mechanisms |
|---|
Another possibility is that vibrissa position is not encoded by
temporal cues. For example, different ganglion or brainstem neurons
might be associated with different phases along the whisking path,
such that the identity of the activated neuron indicates the position
(angle) of the vibrissa (a ‘labeled-line’ coding scheme). Or,
alternatively, population of neurons might encode vibrissa position
in their ensemble firing rate. Unfortunately, a systematic
investigation of the encoding of vibrissa position during whisking
has yet to be made. The existing data about stimulus encoding by
neurons of the trigeminal ganglion were collected during electrical
stimulations of the motor nerve (Zucker and Welker, 1969
) and during
passive mechanical deflections of the vibrissae (Gibson and Welker,
1983
; Lichtenstein
et al., 1990
; Shoykhet et
al., 2000
). In these
data, there are no signs of a labeled-line code as described above.
Yet, a population rate code might be constructed from neurons
exhibiting directional and amplitude dependency (Zucker and Welker,
1969
; Gibson
and Welker, 1983
; Shoykhet et
al., 2000
).
| Sensorimotor Servo Loop |
|---|
The first servo scheme is aimed at stabilizing the whisking
frequency in the presence of contact of the vibrissae with objects.
As demonstrated by the data in Figure 3
, the whisking
frequency is stable during each whisking bout. A stable whisking
frequency facilitates phase-sensitive sensory computation and thus
might be actively maintained by a sensory-motor servo loop (Fig.
8a
), consisting
of another set of PLLs, implemented across S1, M1 and POm.
Experiments on the sensory response of neurons in vibrissa M1 cortex
in awake animals (Kleinfeld et al., 2002
) indicate
that M1 neurons compute the fundamental frequency of a complex,
repetitive input. The interpretation of this and related results
could be that vibrissa S1 cortex and M1 cortex, together with
the POm, are part of a PLL that extracts the fundamental frequency
of the input and maintains a stable frequency of whisking.
|
In the real brain, closed-loop optimization is complicated by
processing in parallel channels. According to the results described
above, temporal decoding in the paralemniscal system is accomplished
by sets of many parallel thalamocortical PLLs, each possessing
a different working range. Although the working range of any
single PLL is limited (Ahissar, 1998
), a collection
of PLLs, each having a slightly different working range, can decode
the entire required frequency range. However, such a scheme
poses serious challenges to the system. For example, for a given
input frequency, different PLLs will produce different output
values, depending on their Tc. Thus, for the same
input, some pools of PLLs will produce meaningful outputs while
others, which will be driven out of their working ranges, will
produce nonsense outputs. How can the readout circuit isolate the
‘proper’ PLLs, namely those PLLs whose output is relevant for
sensory computation during the performance of a given task? A
solution to this problem might be ‘built-in’ the sensorimotor
servo loop scheme. By maintaining the whisking frequency centered
on a given frequency, the servo loop in fact selects a range of
PLLs whose optimal set-points, i.e. centers of their working ranges,
are at that frequency. These ‘relevant’ PLLs will present full range
modulations of their output values while other, ‘non-relevant’, PLLs
will exhibit limited modulations due to saturation. Both readout
circuits and motor control circuits should be able to tune to the
PLLs that exhibit the largest modulations. By this tuning, the
sensorimotor servo loop converges to its own set-point, which is thus
determined by the whisking frequency and the profile of activity
modulations across thalamocortical PLLs.
The set-point of the sensorimotor loop depends on the task in hand. For example, object localization, which involves low spatial (and thus also temporal) frequencies, should lead to set-points optimal for low-frequency PLLs. In contrast, fine texture analysis, which usually involves high spatial and temporal frequencies, should lead to set-points optimal for high-frequency PLLs.
In the above two examples, the motor variable used by the servo
loop was the whisking frequency. This is not the only available
variable for servo control. Other variables, such as protraction
velocity or amplitude, can be used as well. For example, when
scanning a textured surface, protraction velocity (V) might
be controlled to optimize the temporal frequency (f) and
compensate for changes in the texture’s spatial frequency (SF),
since f = |V| * SF. It would probably be reasonable to
assume that whisking frequency is usually the variable used to
optimize processing by paralemniscal PLLs, whereas protraction
velocity is used to optimize processing by lemniscal PLLs, if they
exist. This is because paralemniscal PLLs are tuned to whisking
frequencies, which peak near 10 Hz (Fig. 3d
), whereas lemniscal PLLs
are probably tuned to higher frequencies, which are produced
while scanning textures and determined by protraction velocity.
| Predictions for the Servo Loop |
|---|
Another prediction of the sensorimotor servo loop is that if sensory information is removed, by some lesion that ‘opens the sensorimotor loop’, the motor system will not be able to maintain a constant whisking profile against changing conditions, such as changes in air pressure or object profiles. Moreover, under these conditions, the motor system might drive the vibrissae to whisk at one of the extreme states: either with maximal or with minimal possible frequency.
| Concluding Remarks |
|---|
Neuronal processes that are implemented by single neurons, such as
transduction, conduction, filtering and integration, have been
described through the years. Processes implemented by neuronal
circuits have also been described. Among these are feedforward
transformations and recurrent relaxation by neural networks,
oscillations by excitatory–inhibitory loops, and motor control
by closed loops. To this repertoire we add here sensory computation
by closed loops. We suggest that a significant portion of sensory
processing is implemented by closed-loop computations. We have shown
here how thalamocortical phaselocked loops may decode information
that is encoded in time by the rat vibrissae and how such loops could
be nested within a larger-scale sensory-motor servo loop. Similar
phase-locked loops might operate in the visual (Ahissar and Arieli,
2001
) and auditory
(Ahissar et al., 2001b
) systems to
decode temporally encoded information.
Much of our understanding of the operation of neural networks comes from physics. Similarly, understanding closed-loop computation should benefit from engineering. Engineers discovered that closed loops often provide extremely elegant solutions for ‘real-world’ problems, the same kind of problems with which living brains are routinely challenged. Yet, engineered closed loops usually lack one important feature, which is inherent in brains: built-in plasticity. It is possible that closedloop computation and plasticity are two of the most critical features which make brains so efficient. Achieving an understanding of the interplay between closed-loop computations and plasticity is a further challenge.
| Footnotes |
|---|
| References |
|---|
Ahissar E (1998) Temporal-code to rate-code conversion by neuronal phase-locked loops. Neural Comput 10:597–650.[Abstract]
Ahissar E, Arieli A (2001) Figuring space by time. Neuron 32:185–201.[Medline]
Ahissar E, Vaadia E (1990) Oscillatory activity of single units in a somatosensory cortex of an awake monkey and their possible role in texture analysis. Proc Natl Acad Sci USA 87:8935–8939.[Abstract]
Ahissar E, Zacksenhouse M (2001) Temporal and spatial coding in the rat vibrissal system. Prog Brain Res 130:75–88.[Medline]
Ahissar E, Haidarliu S,
Zacksenhouse M (1997) Decoding temporally encoded sensory input by cortical
oscillations and thalamic phase comparators. Proc Natl Acad Sci USA
94:11633–11638.
Ahissar E, Sosnik R, Haidarliu S (2000) Transformation from temporal to rate coding in a somatosensory thalamocortical pathway. Nature 406:302–306.[Medline]
Ahissar E, Sosnik R, Bagdasarian
K, Haidarliu S (2001a) Temporal frequency of whisker movement. II. Laminar
organization of cortical representations. J Neurophysiol 86:354–367.
Ahissar E, Nagarajan S, Ahissar
M, Protopapas A, Mahncke H, Merzenich M (2001b) Speech comprehension is
correlated with temporal response patterns recorded from auditory cortex. Proc
Natl Acad Sci USA 98:13367–13372.
Ahrens KF, Levine H, Suhl H, Kleinfeld D (2002) Spectral mixing of rhythmic neuronal signals in sensory cortex. Proc Natl Acad Sci USA (in press).
Amit D (1989) Modeling brain function. New York: Cambridge University Press.
Bellescize H de (1932) La reception synchrone. Onde Electr 11:230–240.
Ben-Yishai R, Bar-Or RL, Sompolinsky H (1995) Theory of orientation tuning in visual cortex. Proc Natl Acad Sci USA 92:3844–3848.[Abstract]
Berg RW, Kleinfeld D (2002) Rhythmic whisking by rat: retraction as well as protraction of the vibrissae is under active muscular control. J Neurophysiol (in press).
Brecht M, Sakmann B (2001) Whole-cell recordings in rat somatosensory cortex during whisking episodes. Soc Neurosci:130.135.
Buonomano DV, Merzenich MM (1995) Temporal information transformed into a spatial code by a neural network with realistic properties. Science 267:1028–1030.[Medline]
Fee MS, Mitra PP, Kleinfeld D (1997)
Central versus peripheral determinants of patterned spike activity in rat
vibrissa cortex during whisking. J Neurophysiol 78:1144–1149.
Gardner FM (1979) Phaselock techniques. New York: John Wiley.
Georgopoulos AP (1986) On reaching. Annu Rev Neurosci 9:147–170.[Medline]
Gibson JM, Welker WI (1983) Quantitative studies of stimulus coding in first-order vibrissa afferents of rats. 1. Receptive field properties and threshold distributions. Somatosens Res 1:51–67.[Medline]
Gordon J (1991) Spinal mechanisms of motor coordination. In: Principles of neural science, 3rd edn (Kandel ER, Schwartz JH, Jessel TM, eds), pp. 580–595. New York: Elsevier.
Hartings JA, Simons DJ
(1998) Thalamic relay of afferent responses to 1to 12-Hz whisker stimulation in
the rat. J Neurophysiol 80:1016–1019.
Hopfield JJ (1982) Neural networks and physical systems with emergent selective computational abilities. Proc Natl Acad Sci USA 79:2554–2558.[Medline]
Hoppensteadt FC (1986) An introduction to the mathematics of neurons. Cambridge: Cambridge University Press.
Kleinfeld D, Berg RW, O’Connor SM (1999) Anatomical loops and their electrical dynamics in relation to whisking by rat. Somatosens Mot Res 16:69–88.[Medline]
Kleinfeld D, Sachdev RNS, Merchant LM, Jarvis MR, Ebner FF (2002) Adaptive filtering of vibrissa input in motor cortex of rat. Neuron 34:1021–1034.[Medline]
Lichtenstein SH, Carvell GE, Simons DJ (1990) Responses of rat trigeminal ganglion neurons to movements of vibrissae in different directions. Somatosens Mot Res 7:47–65.[Medline]
Nicolelis MAL, Baccala LA, Lin RCS, Chapin JK (1995) Sensorimotor encoding by synchronous neural ensemble activity at multiple levels of the somatosensory system. Science 268:1353–1358.[Medline]
O’Connor SM, Berg RW, Kleinfeld D
(2002) Coherent electrical activity along vibrissa sensorimotor loops during
free whisking in rat. J Neurophysiol 87:2137–2148.
Perkel DH, Bullock TH (1968) Neural coding. Neurosci Res Program Bull 6:221–248.
Perkel DH, Schulman JH, Bullock TH, Moore GP, Segundo JP (1964) Pacemaker neurons: effects of regularly spaced synaptic input. Science 145:61–63.
Rumelhart D, McClelland JL (eds) (1986) Parallel distributed processing, vols I and II. Cambridge, MA: MIT Press.
Schoner G, Kopecz K, Spengler F, Dinse HR (1992) Evoked oscillatory cortical responses are dynamically coupled to peripheral stimuli. Neuroreport 3:579–582.[Medline]
Seung HS (1996) How the brain keeps the
eyes still. Proc Natl Acad Sci USA 93:13339–13344.
Sherman SM, Guillery RW
(1996) Functional organization of thalamocortical relays. J Neurophysiol
76:1367–1395.
Shoykhet M, Doherty D, Simons DJ (2000) Coding of deflection velocity and amplitude by whisker primary afferent neurons: implications for higher level processing. Somatosens Mot Res 17:171–180.[Medline]
Silva LR, Amitai Y, Connors BW (1991) Intrinsic oscillations of neocortex generated by layer 5 pyramidal neurons. Science 251:432–435.[Medline]
Sosnik R, Haidarliu S, Ahissar E
(2001) Temporal frequency of whisker movement. I. Representations in brain stem
and thalamus. J Neurophysiol 86:339–353.
Talbot WH, Darian-Smith I, Kornhuber HH, Mountcastle VB (1968) The sense of flutter-vibration: comparison of the human capacity with response patterns of mechanoreceptive afferents from the monkey hand. J Neurophysiol 31:301–334.[Medline]
Wessberg J, Stambaugh CR, Kralik JD, Beck PD, Laubach M, Chapin JK, Kim J, Biggs SJ, Srinivasan MA, Nicolelis MA (2000) Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 408:361–365.[Medline]
White EL, Keller A (1987) Intrinsic circuitry involving the local axon collaterals of corticothalamic projection cells in mouse SmI cortex. J Comp Neurol 262:13–26.[Medline]
Wiener N (1949) Cybernetics. New York: John Wiley.
Zucker E, Welker WI (1969) Coding of somatic sensory input by vibrissae neurons in the rat’s trigeminal ganglion. Brain Res 12:138–156.[Medline]
|
|
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |