Delay-Embedding Approach to Multi-Agent System Construction and Calibration

Campbell, Alexander B., Pham, Binh L., & Tian, Yu-Chu (2005) Delay-Embedding Approach to Multi-Agent System Construction and Calibration. In Zerger, A. & Argent, R.M. (Eds.) MODSIM 2005 International Congress on Modelling and Simulation. Modelling and Simulation Society of Australia and New Zealand, 12-15 December 2005, University of Melbourne, Australia.


Agent-based modelling offers a way to break from the crude assumptions of mean-field type models, which ignore space correlations between elements of the system and replace local interactions with uniform long-range ones. Multi-Agent Systems (MAS) explicitly model spatially distributed individuals; however the richness of such a model can also be a liability due to the sensitive dependence of such high-dimensional systems. This has implications for choice of MAS architecture, programming of rules, confidence in predictions, and calibration of model parameters.

Delay-embedding, also known as geometry from a time series, provides a deep theoretical foundation for the analysis of time series generated by nonlinear deterministic dynamical systems. The profound insight of embedding is that an accessible variable can explicitly retrieve unseen internal degrees of freedom.

In the domain of complex systems modelling, however, there typically exist an abundance of observables, in which case reconstructing hidden degrees of freedom may be problematic or even nonsensical. Also, many observables often implies high dimensionality, which generally precludes a dynamical systems approach in the first instance. Un-cautious use of delay-embedding, from which it is easy to get a result regardless of physical justification, has in the past led to a degree of negative press for this idea.

However, the recent extensions of Takens' delay-embedding theorem to deterministically and stochastically forced systems provide a rigorous framework in which to reconstruct using multiple observables. This holds great significance for pattern discovery in complex data series, which we define to be more than one series - spatial, temporal or a mixture - of an underlying complex system. In particular, the concept of a bundle embedding highlights a way to usefully employ the 'surplus' observables in the embedding process. More generally, forced embeddings provide a methodology to breakdown complex system data sets in a modular fashion, while still retaining nonlinear relationships.

Cluster-Weighted Modelling is a sophisticated approach to density estimation that, when applied to the output of a delay-embedding process, is able to obtain a statistical representation of the dynamics. These two concepts - forced embeddings and density estimation - provide a promising theory and a practical probabilistic interpretation respectively to the 'inverse problem' of system identification.

Expert-knowledge based MAS construction and density-estimation of delay-embedded data can therefore be thought of as two complementary approaches to the goal of bottom-up, complex systems modelling. The original contribution of this paper is to present the latter as a highly data-driven approach to MAS construction in its own right, and, perhaps more importantly, as an aid to constructing and calibrating the more expert-knowledge rule-driven approach. The emphasis is on a solid theoretical and conceptual foundation.

To illustrate the feasibility of our approach, preliminary implementation results for an ecological modelling scenario are presented and discussed.

Impact and interest:

1 citations in Scopus
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

Full-text downloads:

227 since deposited on 28 Mar 2006
8 in the past twelve months

Full-text downloads displays the total number of times this work’s files (e.g., a PDF) have been downloaded from QUT ePrints as well as the number of downloads in the previous 365 days. The count includes downloads for all files if a work has more than one.

ID Code: 3784
Item Type: Conference Paper
Refereed: Yes
Additional URLs:
Keywords: Delay, Embedding, Simulation, Calibration, Hypothesis Exploration, Spatially, extended system
ISBN: 0975840029
Subjects: Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > INFORMATION SYSTEMS (080600) > Decision Support and Group Support Systems (080605)
Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > ARTIFICIAL INTELLIGENCE AND IMAGE PROCESSING (080100) > Simulation and Modelling (080110)
Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > ARTIFICIAL INTELLIGENCE AND IMAGE PROCESSING (080100) > Pattern Recognition and Data Mining (080109)
Australian and New Zealand Standard Research Classification > MATHEMATICAL SCIENCES (010000) > PURE MATHEMATICS (010100) > Ordinary Differential Equations Difference Equations and Dynamical Systems (010109)
Divisions: Past > QUT Faculties & Divisions > Faculty of Science and Technology
Copyright Owner: Copyright 2005 (please consult author)
Copyright Statement: The contents of this conference can be freely accessed online via the association's web page (see link).
Deposited On: 28 Mar 2006 00:00
Last Modified: 29 Feb 2012 13:11

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page