Satinder Singh
Impact in
- Artificial Intelligence top 0.05%
- Reinforcement Learning in Robotics
- Evolutionary Algorithms and Applications
- Topic Modeling
- Machine Learning and Algorithms
-
- Advanced Bandit Algorithms Research
Papers in
-
- Reinforcement Learning in Robotics 75
- Machine Learning and Algorithms 20
- Evolutionary Algorithms and Applications 16
- Bayesian Modeling and Causal Inference 11
- Speech and dialogue systems 10
-
- Advanced Bandit Algorithms Research 15
- Auction Theory and Applications 11
- Co-authors
- Richard S. Sutton (10 shared papers)Doina Precup (9 shared papers)Yishay Mansour (2 shared papers)David McAllester (3 shared papers)Michael Kearns (14 shared papers)Andrew G. Barto (6 shared papers)Tommi Jaakkola (4 shared papers)Michael I. Jordan (3 shared papers)
- Journals
- Machine Learning (8 papers)Artificial Intelligence (3 papers)Journal of Artificial Intelligence Research (2 papers)Topics in Cognitive Science (2 papers)Chemico-Biological Interactions (1 paper)
- Partner nations
- United StatesIndiaUnited Kingdom
In The Last Decade
Satinder Singh
140 papers receiving 10.4k citations
Satinder Singh's Hit Papers
Peers
Comparison fields: 5 of 189
- Artificial Intelligence 7.6k
- Management Science and Operations Research 1.5k
- Computational Theory and Mathematics 1.4k
- Control and Systems Engineering 1.8k
- Computer Vision and Pattern Recognition 1.4k
Countries citing papers authored by Satinder Singh
This map shows the geographic impact of Satinder Singh's research. It shows the number of citations coming from papers published by authors working in each country. You can also color the map by specialization and compare the number of citations received by Satinder Singh with the expected number of citations based on a country's size and research output (numbers larger than one mean the country cites Satinder Singh more than expected).
Fields of papers citing papers by Satinder Singh
This network shows the impact of papers produced by Satinder Singh. Nodes represent research fields, and links connect fields that are likely to share authors. Colored nodes show fields that tend to cite the papers produced by Satinder Singh. The network helps show where Satinder Singh may publish in the future.
Co-authors
The 25 scholars most cited alongside Satinder Singh, linked wherever they have co-authored with each other. Click a name or a connecting line to browse the papers they share.
All Works
Showing the 20 most-cited of 150 papers — load more, or switch the sort, to bring in the rest.
| # | Work | ||
|---|---|---|---|
| 1 | Policy Gradient Methods for Reinforcement Learning with Function Approximation Hit paper breakdown → | 1999 | 2779 |
| 2 | Between MDPs and semi-MDPs: A framework for temporal abstraction in reinforcement learning Hit paper breakdown → | 1999 | 1685 |
| 3 | Learning to act using real-time dynamic programming Hit paper breakdown → | 1995 | 714 |
| 4 | 1994 | 483 | |
| 5 | 2000 | 408 | |
| 6 | Near-Optimal Reinforcement Learning in Polynomial Time Hit paper breakdown → | 2002 | 393 |
| 7 | 1996 | 362 | |
| 8 | 2002 | 235 | |
| 9 | Reward is enough Hit paper breakdown → | 2021 | 227 |
| 10 | 2010 | 224 | |
| 11 | Reinforcement Learning Algorithm for Partially Observable Markov Decision Problems | 1994 | 216 |
| 12 | Intrinsically Motivated Learning of Hierarchical Collections of Skills | 2004 | 208 |
| 13 | 2017 | 184 | |
| 14 | 1992 | 180 | |
| 15 | Eligibility Traces for Off-Policy Policy Evaluation | 2000 | 174 |
| 16 | Reinforcement Learning with Soft State Aggregation | 1994 | 149 |
| 17 | Deep Learning for Real-Time Atari Game Play Using Offline Monte-Carlo Tree Search Planning | 2014 | 120 |
| 18 | 2014 | 115 | |
| 19 | Finite-Sample Convergence Rates for Q-Learning and Indirect Algorithms | 1998 | 110 |
| 20 | Reinforcement Learning for Spoken Dialogue Systems | 1999 | 106 |
About Satinder Singh
Satinder Singh is a scholar working on Artificial Intelligence, Management Science and Operations Research, Computational Theory and Mathematics, Computer Networks and Communications and Computer Vision and Pattern Recognition, having authored 150 papers that have together received 11.3k indexed citations. Recurring topics across this work include Reinforcement Learning in Robotics (75 papers), Machine Learning and Algorithms (20 papers), Evolutionary Algorithms and Applications (16 papers), Advanced Bandit Algorithms Research (15 papers), Bayesian Modeling and Causal Inference (11 papers), Auction Theory and Applications (11 papers), Speech and dialogue systems (10 papers) and Optimization and Search Problems (7 papers). The work is most often cited by research in Artificial Intelligence (7.6k citations), Management Science and Operations Research (1.5k citations), Computational Theory and Mathematics (1.4k citations), Control and Systems Engineering (1.8k citations) and Computer Vision and Pattern Recognition (1.4k citations). Satinder Singh has collaborated with scholars based in United States, India and United Kingdom. Frequent co-authors include Richard S. Sutton, Doina Precup, Yishay Mansour, David McAllester, Michael Kearns, Andrew G. Barto, Tommi Jaakkola, Michael I. Jordan, Steven J. Bradtke and Richard L. Lewis. Their work appears in journals such as Machine Learning, Artificial Intelligence, Journal of Artificial Intelligence Research, Topics in Cognitive Science and Chemico-Biological Interactions.
Rankless uses publication and citation data sourced from OpenAlex, an open and comprehensive bibliographic database. While OpenAlex provides broad and valuable coverage of the global research landscape, it—like all bibliographic datasets—has inherent limitations. These include incomplete records, variations in author disambiguation, differences in journal indexing, and delays in data updates. As a result, some metrics and network relationships displayed in Rankless may not fully capture the entirety of a scholar's output or impact.