Learning to act in uncertain environments : technical perspective
Bartlett, Peter L. (2010) Learning to act in uncertain environments : technical perspective. Communications of the ACM, 53(5), p. 98.
The problem of decision making in an uncertain environment arises in many diverse contexts: deciding whether to keep a hard drive spinning in a net-book; choosing which advertisement to post to a Web site visitor; choosing how many newspapers to order so as to maximize profits; or choosing a route to recommend to a driver given limited and possibly out-of-date information about traffic conditions. All are sequential decision problems, since earlier decisions affect subsequent performance; all require adaptive approaches, since they involve significant uncertainty. The key issue in effectively solving problems like these is known as the exploration/exploitation trade-off: If I am at a cross-roads, when should I go in the most advantageous direction among those that I have already explored, and when should I strike out in a new direction, in the hopes I will discover something better?
Impact and interest:
Citation counts are sourced monthly from and citation databases.
Citations counts from theindexing service can be viewed at the linked Google Scholar™ search.
|Item Type:||Journal Article|
|Keywords:||Computing Methodologies; SYMBOLIC AND ALGEBRAIC MANIPULATION; Algorithms, Theory of Computation; COMPUTATION BY ABSTRACT DEVICES; Modes of Computation, Computing Methodologies; ARTIFICIAL INTELLIGENCE; Learning|
|Subjects:||Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > COMPUTATION THEORY AND MATHEMATICS (080200)|
|Divisions:||Past > QUT Faculties & Divisions > Faculty of Science and Technology
Past > Schools > Mathematical Sciences
|Copyright Owner:||Copyright 2010 Association for Computing Machinery, Inc.|
|Deposited On:||17 Aug 2011 23:16|
|Last Modified:||17 Aug 2011 23:16|
Repository Staff Only: item control page