Learning to act in uncertain environments : technical perspective

Bartlett, Peter L. (2010) Learning to act in uncertain environments : technical perspective. Communications of the ACM, 53(5), p. 98.

View at publisher


The problem of decision making in an uncertain environment arises in many diverse contexts: deciding whether to keep a hard drive spinning in a net-book; choosing which advertisement to post to a Web site visitor; choosing how many newspapers to order so as to maximize profits; or choosing a route to recommend to a driver given limited and possibly out-of-date information about traffic conditions. All are sequential decision problems, since earlier decisions affect subsequent performance; all require adaptive approaches, since they involve significant uncertainty. The key issue in effectively solving problems like these is known as the exploration/exploitation trade-off: If I am at a cross-roads, when should I go in the most advantageous direction among those that I have already explored, and when should I strike out in a new direction, in the hopes I will discover something better?

Impact and interest:

0 citations in Scopus
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

ID Code: 43985
Item Type: Journal Article
Refereed: Yes
Keywords: Computing Methodologies; SYMBOLIC AND ALGEBRAIC MANIPULATION; Algorithms, Theory of Computation; COMPUTATION BY ABSTRACT DEVICES; Modes of Computation, Computing Methodologies; ARTIFICIAL INTELLIGENCE; Learning
DOI: 10.1145/1735223.1735246
ISSN: 0001-0782
Subjects: Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > COMPUTATION THEORY AND MATHEMATICS (080200)
Divisions: Past > QUT Faculties & Divisions > Faculty of Science and Technology
Past > Schools > Mathematical Sciences
Copyright Owner: Copyright 2010 Association for Computing Machinery, Inc.
Deposited On: 17 Aug 2011 23:16
Last Modified: 17 Aug 2011 23:16

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page