Open problems in the security of learning

Barreno, M., Bartlett, P.L., Chi, F.J., Joseph, A.D., Nelson, B., Rubinstein, B.I.P., Saini, U., & Tygar, J.D. (2008) Open problems in the security of learning. In Proceedings of the 1st ACM workshop on Workshop on AISec - AISec '08, Association for Computing Machinery, Alexandria, VA, pp. 19-26.

View at publisher


Machine learning has become a valuable tool for detecting and preventing malicious activity. However, as more applications employ machine learning techniques in adversarial decision-making situations, increasingly powerful attacks become possible against machine learning systems. In this paper, we present three broad research directions towards the end of developing truly secure learning. First, we suggest that finding bounds on adversarial influence is important to understand the limits of what an attacker can and cannot do to a learning system. Second, we investigate the value of adversarial capabilities-the success of an attack depends largely on what types of information and influence the attacker has. Finally, we propose directions in technologies for secure learning and suggest lines of investigation into secure techniques for learning in adversarial environments. We intend this paper to foster discussion about the security of machine learning, and we believe that the research directions we propose represent the most important directions to pursue in the quest for secure learning.

Impact and interest:

14 citations in Scopus
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

ID Code: 43984
Item Type: Conference Paper
Refereed: Yes
Keywords: Adversarial Learning, Machine Learning, Computer Security, Secure Learning, Security Metrics
DOI: 10.1145/1456377.1456382
ISBN: 9781605582917
Subjects: Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > COMPUTER SOFTWARE (080300)
Divisions: Past > QUT Faculties & Divisions > Faculty of Science and Technology
Past > Schools > Mathematical Sciences
Copyright Owner: Copyright 2008 Association for Computing Machinery
Deposited On: 17 Aug 2011 23:21
Last Modified: 29 Feb 2012 14:34

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page