Learning to act in uncertain environments : technical perspective
Bartlett, Peter L. (2010) Learning to act in uncertain environments : technical perspective. Communications of the ACM, 53(5), p. 98.
The problem of decision making in an uncertain environment arises in many diverse contexts: deciding whether to keep a hard drive spinning in a net-book; choosing which advertisement to post to a Web site visitor; choosing how many newspapers to order so as to maximize profits; or choosing a route to recommend to a driver given limited and possibly out-of-date information about traffic conditions. All are sequential decision problems, since earlier decisions affect subsequent performance; all require adaptive approaches, since they involve significant uncertainty. The key issue in effectively solving problems like these is known as the exploration/exploitation trade-off: If I am at a cross-roads, when should I go in the most advantageous direction among those that I have already explored, and when should I strike out in a new direction, in the hopes I will discover something better?
Impact and interest:
Citation counts are sourced monthly from and citation databases.
These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.
Citations counts from theindexing service can be viewed at the linked Google Scholar™ search.
|Item Type:||Journal Article|
|Keywords:||Computing Methodologies; SYMBOLIC AND ALGEBRAIC MANIPULATION; Algorithms, Theory of Computation; COMPUTATION BY ABSTRACT DEVICES; Modes of Computation, Computing Methodologies; ARTIFICIAL INTELLIGENCE; Learning|
|Subjects:||Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > COMPUTATION THEORY AND MATHEMATICS (080200)|
|Divisions:||Past > QUT Faculties & Divisions > Faculty of Science and Technology
Past > Schools > Mathematical Sciences
|Copyright Owner:||Copyright 2010 Association for Computing Machinery, Inc.|
|Deposited On:||17 Aug 2011 23:16|
|Last Modified:||17 Aug 2011 23:16|
Repository Staff Only: item control page