# Complex systems

Complex systems present problems both in mathematical modelling and philosophical foundations. The study of complex systems is an approach to science that investigates how relationships between parts give rise to the collective behaviors of a system and how the system interacts and forms relationships with its environment.[1] The subject is also sometimes called complex systems theory, complexity science, study of complex systems, complex networks, network science, and sciences of complexity.

The equations from which models of complex systems are developed generally derive from statistical physics, information theory, and non-linear dynamics and represent organized but unpredictable behaviors of natural systems that are considered fundamentally complex. Often times, the physical manifestations of such systems are difficult to define, and so it is common to identify "the system" with the mathematical model rather than referring to the undefined physical subject the model represents. Such a systems approach is often used in computer science, biology,[2] economics, physics, chemistry,[3] architecture,[4] and many other fields. A variety of abstract theoretical complex systems is studied as a field of mathematics.

The key problems of complex systems are difficulties with their formal modelling and simulation. From such a perspective, in different research contexts complex systems are defined on the basis of their different attributes. Since all complex systems have many interconnected components, the science of networks and network theory are important and useful tools for the study of complex systems. A theory for the resilience of system of systems represented by a network of interdependent networks was developed by Buldyrev et al.[5][6] A consensus regarding a single universal definition of complex system does not yet exist.

For systems that are less usefully represented with equations various other kinds of narratives and methods for identifying, exploring, designing and interacting with complex systems are used.

## Overview

A Braitenberg simulation, programmed in breve, an artificial life simulator

The study of mathematical complex system models is used for many scientific questions poorly suited to the traditional mechanistic conception provided by science.[7] Complex systems is therefore often used as a broad term encompassing a research approach to problems in many diverse disciplines including anthropology, artificial intelligence, artificial life, physics, chemistry, computer science, economics, evolutionary computation, earthquake prediction, meteorology, molecular biology, neuroscience, psychology and sociology.

Traditionally, engineering has striven to solve the non-linear system problem while bearing in mind that for small perturbations, most non-linear systems can be approximated with linear systems, significantly simplifying the analysis. Linear systems represent the main class of systems for which general techniques for stability control and analysis exist. However, many physical systems (for example lasers) are inherently "complex systems" in terms of the definition above, and engineering practice must now include elements of complex systems research.

Information theory applies well to the complex adaptive systems, CAS, through the concepts of object-oriented design, as well as through formalized concepts of organization and disorder that can be associated with any systems evolution process.

## History

A history of complexity science. Update to 2020: http://www.art-sciencefactory.com/complexity-map_feb09.html

Complex systems is an approach to science that studies how relationships between parts give rise to the collective behaviors of a system and how the system interacts and forms relationships with its environment.

The earliest precursor to modern complex systems theory can be found in the classical political economy of the Scottish Enlightenment, later developed by the Austrian school of economics, which says that order in market systems is spontaneous (or emergent) in that it is the result of human action, but not the execution of any human design.[8][9]

Upon this the Austrian school developed from the 19th to the early 20th century the economic calculation problem, along with the concept of dispersed knowledge, which were to fuel debates against the then-dominant Keynesian economics. This debate would notably lead economists, politicians and other parties to explore the question of computational complexity.[citation needed]

A pioneer in the field, and inspired by Karl Popper's and Warren Weaver's works, Nobel prize economist and philosopher Friedrich Hayek dedicated much of his work, from early to the late 20th century, to the study of complex phenomena,[10] not constraining his work to human economies but venturing into other fields such as psychology,[11] biology and cybernetics. Gregory Bateson played a key role in establishing the connection between anthropology and systems theory; he recognized that the interactive parts of cultures function much like ecosystems.

The first research institute focused on complex systems, the Santa Fe Institute, was founded in 1984.[12] Early Santa Fe Institute participants included physics Nobel laureates Murray Gell-Mann and Philip Anderson, economics Nobel laureate Kenneth Arrow, and Manhattan Project scientists George Cowan and Herb Anderson.[13] Today, there are over 50 institutes and research centers focusing on complex systems.

## Typical areas of study

### Complexity in practice

The traditional approach to dealing with complexity is to reduce or constrain it. Typically, this involves compartmentalisation: dividing a large system into separate parts. Organizations, for instance, divide their work into departments that each deal with separate issues. Engineering systems are often designed using modular components. However, modular designs become susceptible to failure when issues arise that bridge the divisions.

### Complexity management

As projects and acquisitions become increasingly complex, companies and governments are challenged to find effective ways to manage mega-acquisitions such as the Army Future Combat Systems. Acquisitions such as the FCS rely on a web of interrelated parts which interact unpredictably. As acquisitions become more network-centric and complex, businesses will be forced to find ways to manage complexity while governments will be challenged to provide effective governance to ensure flexibility and resiliency.[14]

### Complexity economics

Over the last decades, within the emerging field of complexity economics new predictive tools have been developed to explain economic growth. Such is the case with the models built by the Santa Fe Institute in 1989 and the more recent economic complexity index (ECI), introduced by the MIT physicist Cesar A. Hidalgo and the Harvard economist Ricardo Hausmann. Based on the ECI, Hausmann, Hidalgo and their team of The Observatory of Economic Complexity have produced GDP forecasts for the year 2020.[citation needed]

### Complexity and education

Focusing on issues of student persistence with their studies, Forsman, Moll and Linder explore the "viability of using complexity science as a frame to extend methodological applications for physics education research," finding that "framing a social network analysis within a complexity science perspective offers a new and powerful applicability across a broad range of PER topics."[15]

### Complexity and modeling

One of Friedrich Hayek's main contributions to early complexity theory is his distinction between the human capacity to predict the behaviour of simple systems and its capacity to predict the behaviour of complex systems through modeling. He believed that economics and the sciences of complex phenomena in general, which in his view included biology, psychology, and so on, could not be modeled after the sciences that deal with essentially simple phenomena like physics.[16] Hayek would notably explain that complex phenomena, through modeling, can only allow pattern predictions, compared with the precise predictions that can be made out of non-complex phenomena.[17]

This is a schematic representation of three types of mathematical models of complex systems with the level of their mechanistic understanding.

Mathematical models of complex systems are of three types: black-box (phenomenological), white-box (mechanistic, based on the first principles), and grey-box (mixtures of phenomenological and mechanistic models) [18] .[19] In black-box models, the individual-based mechanisms of a complex dynamic system remain hidden. Black-box models are completely nonmechanistic. They are phenomenological and ignore a composition and internal structure of a complex system. We cannot investigate interactions of subsystems of such a non-transparent model. A white-box model of complex dynamic system has ‘transparent walls’ and directly shows underlying mechanisms. All events at micro-, meso- and macro-levels of a dynamic system are directly visible at all stages of its white-box model evolution. In most cases mathematical modelers use the heavy black-box mathematical methods, which cannot produce mechanistic models of complex dynamic systems. Grey-box models are intermediate and combine black-box and white-box approaches. As a rule, this approach is used in ‘overloaded’ form,[clarification needed] which makes it less transparent. It was demonstrated that the logical deterministic cellular automata approach allows the creation of white-box models of ecosystems.[20] Creation of a white-box model of complex system is associated with the problem of the necessity of an a priori basic knowledge of the modeling subject. The deterministic logical cellular automata are necessary but not sufficient condition of a white-box model. The second necessary prerequisite of a white-box model is the presence of the physical ontology of the object under study. The white-box modeling represents an automatic hyper-logical inference from the first principles because it is completely based on the deterministic logic and axiomatic theory of the subject. The purpose of the white-box modeling is to derive from the basic axioms a more detailed, more concrete mechanistic knowledge about the dynamics of the object under study. The necessity to formulate an intrinsic axiomatic system of the subject before creating its white-box model distinguishes the cellular automata models of white-box type from cellular automata models based on arbitrary logical rules. If cellular automata rules have not been formulated from the first principles of the subject, then such a model may have a weak relevance to the real problem.[19]

### Complexity and chaos theory

Complexity theory is rooted in chaos theory, which in turn has its origins more than a century ago in the work of the French mathematician Henri Poincaré. Chaos is sometimes viewed as extremely complicated information, rather than as an absence of order.[21] Chaotic systems remain deterministic, though their long-term behavior can be difficult to predict with any accuracy. With perfect knowledge of the initial conditions and of the relevant equations describing the chaotic system's behavior, one can theoretically make perfectly accurate predictions about the future of the system, though in practice this is impossible to do with arbitrary accuracy. Ilya Prigogine argued[22] that complexity is non-deterministic, and gives no way whatsoever to precisely predict the future.[23]

The emergence of complexity theory shows a domain between deterministic order and randomness which is complex.[24] This is referred as the "edge of chaos".[25]

A plot of the Lorenz attractor.

When one analyzes complex systems, sensitivity to initial conditions, for example, is not an issue as important as it is within chaos theory, in which it prevails. As stated by Colander,[26] the study of complexity is the opposite of the study of chaos. Complexity is about how a huge number of extremely complicated and dynamic sets of relationships can generate some simple behavioral patterns, whereas chaotic behavior, in the sense of deterministic chaos, is the result of a relatively small number of non-linear interactions.[24]

Therefore, the main difference between chaotic systems and complex systems is their history.[27] Chaotic systems do not rely on their history as complex ones do. Chaotic behaviour pushes a system in equilibrium into chaotic order, which means, in other words, out of what we traditionally define as 'order'.[clarification needed] On the other hand, complex systems evolve far from equilibrium at the edge of chaos. They evolve at a critical state built up by a history of irreversible and unexpected events, which physicist Murray Gell-Mann called "an accumulation of frozen accidents."[28] In a sense chaotic systems can be regarded as a subset of complex systems distinguished precisely by this absence of historical dependence. Many real complex systems are, in practice and over long but finite time periods, robust. However, they do possess the potential for radical qualitative change of kind whilst retaining systemic integrity. Metamorphosis serves as perhaps more than a metaphor for such transformations.

### Complexity and network science

A complex system is usually composed of many components and their interactions. Such a system can be represented by a network where nodes represent the components and links represent their interactions.[29] [30][31] for example, the INTERNET can be represented as a network composed of nodes (computers) and links (direct connections between computers). Other examples are social networks, airline networks and biological networks. Networks can also fail and recover spontaneously. For modeling this phenomena see ref.[32]

### General form of complexity computation

The computational law of reachable optimality[33] is established as a general form of computation for ordered system and it reveals complexity computation is a compound computation of optimal choice and optimality driven reaching pattern overtime underlying a specific and any experience path of ordered system within the general limitation of system integrity.

The computational law of reachable optimality has four key components as described below.

1. Reachability of Optimality: Any intended optimality shall be reachable. Unreachable optimality has no meaning for a member in the ordered system and even for the ordered system itself.

2. Prevailing and Consistency: Maximizing reachability to explore best available optimality is the prevailing computation logic for all members in the ordered system and is accommodated by the ordered system.

3. Conditionality: Realizable tradeoff between reachability and optimality depends primarily upon the initial bet capacity and how the bet capacity evolves along with the payoff table update path triggered by bet behavior and empowered by the underlying law of reward and punishment. Precisely, it is a sequence of conditional events where the next event happens upon reached status quo from experience path.

4. Robustness: The more challenge a reachable optimality can accommodate, the more robust it is in term of path integrity.

There are also four computation features in the law of reachable optimality.

1. Optimal Choice: Computation in realizing Optimal Choice can be very simple or very complex. A simple rule in Optimal Choice is to accept whatever is reached, Reward As You Go (RAYG). A Reachable Optimality computation reduces into optimizing reachability when RAYG is adopted. The Optimal Choice computation can be more complex when multiple NE strategies present in a reached game.

2. Initial Status: Computation is assumed to start at an interested beginning even the absolute beginning of an ordered system in nature may not and need not present. An assumed neutral Initial Status facilitates an artificial or a simulating computation and is not expected to change the prevalence of any findings.

3. Territory: An ordered system shall have a territory where the universal computation sponsored by the system will produce an optimal solution still within the territory.

4. Reaching Pattern: The forms of Reaching Pattern in the computation space, or the Optimality Driven Reaching Pattern in the computation space, primarily depend upon the nature and dimensions of measure space underlying a computation space and the law of punishment and reward underlying the realized experience path of reaching. There are five basic forms of experience path we are interested in, persistently positive reinforcement experience path, persistently negative reinforcement experience path, mixed persistent pattern experience path, decaying scale experience path and selection experience path.

The compound computation in selection experience path includes current and lagging interaction, dynamic topological transformation and implies both invariance and variance characteristics in an ordered system's experience path.

In addition, the computation law of reachable optimality gives out the boundary between complexity model, chaotic model and determination model. When RAYG is the Optimal Choice computation, and the reaching pattern is a persistently positive experience path, persistently negative experience path, or mixed persistent pattern experience path, the underlying computation shall be a simple system computation adopting determination rules. If the reaching pattern has no persistent pattern experienced in RAYG regime, the underlying computation hints there is a chaotic system. When the optimal choice computation involves non-RAYG computation, it's a complexity computation driving the compound effect.

## References

1. ^ Bar-Yam, Yaneer (2002). "General Features of Complex Systems" (PDF). Encyclopedia of Life Support Systems. EOLSS UNESCO Publishers, Oxford, UK. Retrieved 16 September 2014.
2. ^ Chapouthier, G, Mosaic structures – a working hypothesis for the complexity of living organisms, E-Logos (Electronic Journal for Philosophy), 2009, 17, http://nb.vse.cz/kfil/elogos/biocosmology/chapouthier09.pdf
3. ^ J. M. Zayed, N. Nouvel, U. Rauwald, O. A. Scherman, Chemical Complexity – supramolecular self-assembly of synthetic and biological building blocks in water, Chemical Society Reviews, 2010, 39, 2806–2816 http://pubs.rsc.org/en/Content/ArticleLanding/2010/CS/b922348g
4. ^ C. Alexander, New Concepts in Complexity Theory: : Arising from studies in the field of architecture, an overview of the four books of The Nature of Order with emphasis on the scientific problems which are raised, http://natureoforder.com/library/scientific-introduction.pdf
5. ^ Buldyrev, Sergey V.; Parshani, Roni; Paul, Gerald; Stanley, H. Eugene; Havlin, Shlomo (2010). "Catastrophic cascade of failures in interdependent networks". Nature. 464 (7291): 1025–1028. Bibcode:2010Natur.464.1025B. doi:10.1038/nature08932. ISSN 0028-0836. PMID 20393559.
6. ^ Parshani, Roni; Buldyrev, Sergey V.; Havlin, Shlomo (2010). "Interdependent Networks: Reducing the Coupling Strength Leads to a Change from a First to Second Order Percolation Transition". Physical Review Letters. 105 (4): 048701. Bibcode:2010PhRvL.105d8701P. doi:10.1103/PhysRevLett.105.048701. ISSN 0031-9007. PMID 20867893.
7. ^ http://www.narberthpa.com/Bale/lsbale_dop/cybernet.htm Bale, L.S. 1995, Gregory Bateson, Cybernetics and the Social/Behavioral Sciences
8. ^ Ferguson, Adam (1767). An Essay on the History of Civil Society. London: T. Cadell. Part the Third, Section II, p. 205.
9. ^ Friedrich Hayek, "The Results of Human Action but Not of Human Design" in New Studies in Philosophy, Politics, Economics, Chicago: University of Chicago Press, 1978, pp. 96–105.
10. ^ Bruce J. Caldwell, Popper and Hayek: Who influenced whom?, Karl Popper 2002 Centenary Congress, 2002.
11. ^ Friedrich von Hayek, The Sensory Order: An Inquiry into the Foundations of Theoretical Psychology, The University of Chicago Press, 1952.
12. ^ Ledford, H (2015). "How to solve the world's biggest problems". Nature. 525 (7569): 308–311. doi:10.1038/525308a.
13. ^ Waldrop, M. M. (1993). Complexity: The emerging science at the edge of order and chaos. Simon and Schuster.
14. ^ CSIS paper: "Organizing for a Complex World: The Way Ahead
15. ^ Forsman, Jonas; Moll, Rachel; Linder, Cedric (2014). "Extending the theoretical framing for physics education research: An illustrative application of complexity science". Physical Review Special Topics - Physics Education Research. 10 (2). doi:10.1103/PhysRevSTPER.10.020122. http://hdl.handle.net/10613/2583.
16. ^ Reason Magazine - The Road from Serfdom
17. ^ Friedrich August von Hayek - Prize Lecture
18. ^ Kalmykov, Lev V.; Kalmykov, Vyacheslav L. (2015), "A Solution to the Biodiversity Paradox by Logical Deterministic Cellular Automata", Acta Biotheoretica: 1–19, doi:10.1007/s10441-015-9257-9
19. ^ a b Kalmykov, Lev V.; Kalmykov, Vyacheslav L. (2015), "A white-box model of S-shaped and double S-shaped single-species population growth", PeerJ, 3: e948, doi:10.7717/peerj.948
20. ^ Kalmykov, Lev V.; Kalmykov, Vyacheslav L. (2013), "Verification and reformulation of the competitive exclusion principle", Chaos, Solitons & Fractals, 56: 124–131, doi:10.1016/j.chaos.2013.07.006
21. ^ Hayles, N. K. (1991). Chaos Bound: Orderly Disorder in Contemporary Literature and Science. Cornell University Press, Ithaca, NY.
22. ^ Prigogine, I. (1997). The End of Certainty, The Free Press, New York.
23. ^ See also D. Carfì (2008). "Superpositions in Prigogine approach to irreversibility". AAPP: Physical, Mathematical, and Natural Sciences. 86 (1): 1–13..
24. ^ a b Cilliers, P. (1998). Complexity and Postmodernism: Understanding Complex Systems, Routledge, London.
25. ^ Per Bak (1996). How Nature Works: The Science of Self-Organized Criticality, Copernicus, New York, U.S.
26. ^ Colander, D. (2000). The Complexity Vision and the Teaching of Economics, E. Elgar, Northampton, Massachusetts.
27. ^ Buchanan, M. (2000). Ubiquity : Why catastrophes happen, three river press, New-York.
28. ^ Gell-Mann, M. (1995). What is Complexity? Complexity 1/1, 16-19
29. ^ Dorogovtsev, S.N.; Mendes, J.F.F. (2003). "Evolution of Networks". doi:10.1093/acprof:oso/9780198515906.001.0001.
30. ^ Fortunato, Santo (2011). "Reuven Cohen and Shlomo Havlin: Complex Networks". Journal of Statistical Physics. 142 (3): 640–641. doi:10.1007/s10955-011-0129-7. ISSN 0022-4715.
31. ^ Newman, Mark (2010). "Networks". doi:10.1093/acprof:oso/9780199206650.001.0001.
32. ^ Majdandzic, Antonio; Podobnik, Boris; Buldyrev, Sergey V.; Kenett, Dror Y.; Havlin, Shlomo; Eugene Stanley, H. (2013). "Spontaneous recovery in dynamical networks". Nature Physics. 10 (1): 34–38. doi:10.1038/nphys2819. ISSN 1745-2473.
33. ^ Wenliang Wang (2015). Pooling Game Theory and Public Pension Plan. ISBN 978-1507658246. Chapter 4.