Kenji Doya

2009
59	EE	Kenji Doya, Stephen Grossberg, John G. Taylor: New action editors join the journal! Five exciting special issues in the works! Neural Networks 22(1): 1 (2009)
2008
58		Masumi Ishikawa, Kenji Doya, Hiroyuki Miyamoto, Takeshi Yamakawa: Neural Information Processing, 14th International Conference, ICONIP 2007, Kitakyushu, Japan, November 13-16, 2007, Revised Selected Papers, Part I Springer 2008
57		Masumi Ishikawa, Kenji Doya, Hiroyuki Miyamoto, Takeshi Yamakawa: Neural Information Processing, 14th International Conference, ICONIP 2007, Kitakyushu, Japan, November 13-16, 2007, Revised Selected Papers, Part II Springer 2008
56	EE	Tetsuro Morimura, Eiji Uchibe, Junichiro Yoshimoto, Kenji Doya: A New Natural Policy Gradient by Stationary Distribution Metric. ECML/PKDD (2) 2008: 82-97
55	EE	Makoto Otsuka, Junichiro Yoshimoto, Kenji Doya: Robust Population Coding in Free-Energy-Based Reinforcement Learning. ICANN (1) 2008: 377-386
54	EE	Fredrik Bissmarck, Hiroyuki Nakahara, Kenji Doya, Okihide Hikosaka: Combining Modalities with Different Latencies for Optimal Motor Control. J. Cognitive Neuroscience 20(11): 1966-1979 (2008)
53	EE	Kenji Doya, Stephen Grossberg, John G. Taylor: Neural Networks goes electronic at twenty! Neural Networks 21(1): 1-2 (2008)
52	EE	Masumi Ishikawa, Kenji Doya: Mini-special issue: ICONIP 2007. Neural Networks 21(10): 1419 (2008)
51	EE	Eiji Uchibe, Kenji Doya: Finding intrinsic rewards by embodied evolution and constrained reinforcement learning. Neural Networks 21(10): 1447-1455 (2008)
2007
50	EE	Kenji Doya: Designing the Reward System: Computational and Biological Principles. FOCI 2007: 645
49	EE	Kazuyuki Samejima, Kenji Doya: Estimating Internal Variables of a Decision Maker's Brain: A Model-Based Approach for Neuroscience. ICONIP (1) 2007: 596-603
48	EE	Junichiro Yoshimoto, Kenji Doya: Bayesian System Identification of Molecular Cascades. ICONIP (1) 2007: 614-624
47	EE	Eiji Uchibe, Kenji Doya: Finding Exploratory Rewards by Embodied Evolution and Constrained Reinforcement Learning in the Cyber Rodents. ICONIP (2) 2007: 167-176
46	EE	Stefan Elfwing, Eiji Uchibe, Kenji Doya, Henrik I. Christensen: Evolutionary Development of Hierarchical Learning Structures. IEEE Trans. Evolutionary Computation 11(2): 249-264 (2007)
45	EE	Jun Morimoto, Kenji Doya: Reinforcement Learning State Estimator. Neural Computation 19(3): 730-756 (2007)
44	EE	Saori C. Tanaka, Kazuyuki Samejima, Go Okada, Kazutaka Ueda, Yasumasa Okamoto, Shigeto Yamawaki, Kenji Doya: Erratum to "Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics" [Neural Networks 19 (8) (2006) 1233-1241]. Neural Networks 20(2): 285-286 (2007)
43	EE	Mathieu Bertin, Nicolas Schweighofer, Kenji Doya: Multiple model-based reinforcement learning explains dopamine neuronal activity. Neural Networks 20(6): 668-675 (2007)
42	EE	Takamitsu Matsubara, Jun Morimoto, Jun Nakanishi, Masa-aki Sato, Kenji Doya: Learning a dynamic policy by using policy gradient: application to biped walking. Systems and Computers in Japan 38(4): 25-38 (2007)
2006
41	EE	Krishna P. Miyapuram, Raju S. Bapi, Chandrasekhar V. S. Pammi, Ahmed, Kenji Doya: Hierarchical Chunking during Learning of Visuomotor Sequences. IJCNN 2006: 249-253
40	EE	Genci Capi, Kenji Doya: Application of evolutionary computation for efficient reinforcement learning. Applied Artificial Intelligence 20(1): 35-55 (2006)
39	EE	Saori C. Tanaka, Kazuyuki Samejima, Go Okada, Kazutaka Ueda, Yasumasa Okamoto, Shigeto Yamawaki, Kenji Doya: Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics. Neural Networks 19(8): 1233-1241 (2006)
38	EE	Takashi Bando, Tomohiro Shibata, Kenji Doya, Shin Ishii: Switching particle filters for efficient visual tracking. Robotics and Autonomous Systems 54(10): 873-884 (2006)
37	EE	Takamitsu Matsubara, Jun Morimoto, Jun Nakanishi, Masa-aki Sato, Kenji Doya: Learning CPG-based biped locomotion with a policy gradient method. Robotics and Autonomous Systems 54(11): 911-920 (2006)
2005
36	EE	Stefan Elfwing, Eiji Uchibe, Kenji Doya, Henrik I. Christensen: Biologically inspired embodied evolution of survival. Congress on Evolutionary Computation 2005: 2210-2216
35		Takamitsu Matsubara, Jun Morimoto, Jun Nakanishi, Masa-aki Sato, Kenji Doya: Learning Sensory Feedback to CPG with Policy Gradient for Biped Locomotion. ICRA 2005: 4164-4169
34	EE	Jun Morimoto, Kenji Doya: Robust Reinforcement Learning. Neural Computation 17(2): 335-359 (2005)
33	EE	Genci Capi, Kenji Doya: Evolution of recurrent neural controllers using an extended parallel genetic algorithm. Robotics and Autonomous Systems 52(2-3): 148-159 (2005)
2004
32	EE	Chandrasekhar V. S. Pammi, Krishna P. Miyapuram, Raju S. Bapi, Kenji Doya: Chunking Phenomenon in Complex Sequential Skill Learning in Humans. ICONIP 2004: 294-299
31	EE	Takashi Bando, Tomohiro Shibata, Kenji Doya, Shin Ishii: Switching Particle Filters for Efficient Real-time Visual Tracking. ICPR (2) 2004: 720-723
30	EE	Fredrik Bissmarck, Hiroyuki Nakahara, Kenji Doya, Okihide Hikosaka: Responding to Modalities with Different Latencies. NIPS 2004
29	EE	Hiroyuki Miyamoto, Jun Morimoto, Kenji Doya, Mitsuo Kawato: Reinforcement learning with via-point representation. Neural Networks 17(3): 299-305 (2004)
2003
28	EE	Stefan Elfwing, Eiji Uchibe, Kenji Doya: An Evolutionary Approach to Automatic Construction of the Structure in Hierarchical Reinforcement Learning. GECCO 2003: 507-509
27	EE	Genci Capi, Kenji Doya: Evolving recurrent neural controllers for sequential tasks: a parallel implementation. IEEE Congress on Evolutionary Computation (1) 2003: 514-519
26	EE	Saori C. Tanaka, Kenji Doya, Go Okada, Kazutaka Ueda, Yasumasa Okamoto, Shigeto Yamawaki: Different Cortico-Basal Ganglia Loops Specialize in Reward Prediction at Different Time Scales. NIPS 2003
25	EE	Kazuyuki Samejima, Kenji Doya, Yasumasa Ueda, Minoru Kimura: Estimating Internal Variables and Paramters of a Learning Agent by a Particle Filter. NIPS 2003
24	EE	Nicolas Schweighofer, Kenji Doya: Meta-learning in Reinforcement Learning. Neural Networks 16(1): 5-9 (2003)
23	EE	Kazuyuki Samejima, Kenji Doya, Mitsuo Kawato: Inter-module credit assignment in modular reinforcement learning. Neural Networks 16(7): 985-994 (2003)
2002
22	EE	Kenji Doya, Kazuyuki Samejima, Ken-ichi Katagiri, Mitsuo Kawato: Multiple Model-Based Reinforcement Learning. Neural Computation 14(6): 1347-1369 (2002)
21	EE	Kenji Doya, Peter Dayan, Michael E. Hasselmo: Introduction for 2002 Special Issue: Computational Models of Neuromodulation. Neural Networks 15(4-6): 475-477 (2002)
20	EE	Kenji Doya: Metalearning and neuromodulation. Neural Networks 15(4-6): 495-506 (2002)
2001
19	EE	Raju S. Bapi, Kenji Doya: Multiple Forward Model Architecture for Sequence Processing. Sequence Learning 2001: 308-320
18	EE	Jun Morimoto, Kenji Doya: Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning. Robotics and Autonomous Systems 36(1): 37-51 (2001)
2000
17	EE	Yasuo Nagayuki, Shin Ishii, Kenji Doya: Multi-Agent Reinforcement Learning: An Approach Based on the Other Agent's Internal Model. ICMAS 2000: 215-221
16		Jun Morimoto, Kenji Doya: Acquisition of Stand-up Behavior by a Real Robot using Hierarchical Reinforcement Learning. ICML 2000: 623-630
15		Jun Morimoto, Kenji Doya: Robust Reinforcement Learning. NIPS 2000: 1061-1067
14		Kenji Doya: Reinforcement Learning in Continuous Time and Space. Neural Computation 12(1): 219-245 (2000)
1999
13	EE	Kenji Doya: What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? Neural Networks 12(7-8): 961-974 (1999)
1998
12		Nicolas Schweighofer, Kenji Doya, Mitsuo Kawato: A Model of the Electrophysiological Properties of the Inferior Olive Neurons. ICONIP 1998: 1525-1528
11		Raju S. Bapi, Kenji Doya: A Sequence Learning Architecture Based on Cortico-Basal Ganglionic Loops and Reinforcement Learning. ICONIP 1998: 260-263
10		Jun Morimoto, Kenji Doya: Hierarchical Reinforcement Learning of Low-Dimensional Subgoals and High-Dimensional Trajectories. ICONIP 1998: 850-853
9		Hiroyuki Nakahara, Kenji Doya: Near Saddle-Node Bifurcation Behavior as Dynamics in Working Memory for Goal-Directed Behavior. Neural Computation 10(1): 113-132 (1998)
1996
8	EE	Kenji Doya: Efficient Nonlinear Control with Actor-Tutor Architecture. NIPS 1996: 1012-1018
1995
7	EE	Kenji Doya: Temporal Difference Learning in Continuous Time and Space. NIPS 1995: 1073-1079
6	EE	Hiroyuki Nakahara, Kenji Doya: Dynamics of Attention as Near Saddle-Node Bifurcation Behavior. NIPS 1995: 38-44
1994
5	EE	Kenji Doya, Terrence J. Sejnowski: A Novel Reinforcement Model of Birdsong Vocalization Learning. NIPS 1994: 101-108
1993
4	EE	Kenji Doya, Allen I. Selverston, Peter F. Rowat: A Hodgkin-Huxley Type Neuron Model That Learns Slow Non-Spike Oscillations. NIPS 1993: 566-573
1992
3	EE	Kenji Doya, Mary E. T. Boyle, Allen I. Selverston: Maaping Between Neural and Physical Activities of the Lobster Gastric Mill. NIPS 1992: 913-920
1991
2	EE	Kenji Doya, Shuji Yoshizawa: Adaptive Synchronization of Neural and Physical Oscillators. NIPS 1991: 109-116
1989
1	EE	Kenji Doya, Shuji Yoshizawa: Adaptive neural oscillator using continuous-time back-propagation learning. Neural Networks 2(5): 375-385 (1989)

Coauthor Index

1	Ahmed	[41]
2	Takashi Bando	[31] [38]
3	Raju S. Bapi	[11] [19] [32] [41]
4	Mathieu Bertin	[43]
5	Fredrik Bissmarck	[30] [54]
6	Mary E. T. Boyle	[3]
7	Genci Capi	[27] [33] [40]
8	Henrik I. Christensen	[36] [46]
9	Peter Dayan	[21]
10	Stefan Elfwing	[28] [36] [46]
11	Stephen Grossberg	[53] [59]
12	Michael E. Hasselmo	[21]
13	Okihide Hikosaka	[30] [54]
14	Shin Ishii	[17] [31] [38]
15	Masumi Ishikawa	[52] [57] [58]
16	Ken-ichi Katagiri	[22]
17	Mitsuo Kawato	[12] [22] [23] [29]
18	Minoru Kimura	[25]
19	Takamitsu Matsubara	[35] [37] [42]
20	Hiroyuki Miyamoto	[29] [57] [58]
21	Krishna P. Miyapuram	[32] [41]
22	Jun Morimoto	[10] [15] [16] [18] [29] [34] [35] [37] [42] [45]
23	Tetsuro Morimura	[56]
24	Yasuo Nagayuki	[17]
25	Hiroyuki Nakahara	[6] [9] [30] [54]
26	Jun Nakanishi	[35] [37] [42]
27	Go Okada	[26] [39] [44]
28	Yasumasa Okamoto	[26] [39] [44]
29	Makoto Otsuka	[55]
30	Chandrasekhar V. S. Pammi	[32] [41]
31	Peter F. Rowat	[4]
32	Kazuyuki Samejima	[22] [23] [25] [39] [44] [49]
33	Masa-aki Sato	[35] [37] [42]
34	Nicolas Schweighofer	[12] [24] [43]
35	Terrence J. Sejnowski	[5]
36	Allen I. Selverston	[3] [4]
37	Tomohiro Shibata	[31] [38]
38	Saori C. Tanaka	[26] [39] [44]
39	John G. Taylor	[53] [59]
40	Eiji Uchibe	[28] [36] [46] [47] [51] [56]
41	Kazutaka Ueda	[26] [39] [44]
42	Yasumasa Ueda	[25]
43	Takeshi Yamakawa	[57] [58]
44	Shigeto Yamawaki	[26] [39] [44]
45	Junichiro Yoshimoto	[48] [55] [56]
46	Shuji Yoshizawa	[1] [2]

Colors in the list of coauthors