Santa Fe
Institute
  • Research
    • Themes
    • Projects
    • SFI Press
    • Researchers
    • Publications
    • Library
    • Sponsored Research
    • Fellowships
    • Miller Scholarships
  • News + Events
    • News
    • Newsletters
    • Podcasts
    • SFI in the Media
    • Media Center
    • Events
    • Community
    • Journalism Fellowship
  • Education
    • Programs
    • Projects
    • Alumni
    • Complexity Explorer
    • Education FAQ
    • Postdoctoral Research
    • Education Supporters
  • People
    • Researchers
    • Fractal Faculty
    • Staff
    • Miller Scholars
    • Trustees
    • Governance
    • Resident Artists
    • Research Supporters
  • Applied Complexity
    • Office
    • Applied Projects
    • ACtioN
    • Applied Fellows
    • Studios
    • Applied Events
    • Login
  • Give
    • Give Now
    • Ways to Give
    • Contact
  • About
    • About SFI
    • Engage
    • Complex Systems
    • FAQ
    • Campuses
    • Jobs
    • Contact
    • Library
    • Employee Portal

Science for a Complex World

Events

Here's what's happening

Give

You make SFI possible

Subscribe

Sign up for research news

Connect

Follow us on social media

© 2026 Santa Fe Institute. All rights reserved. This site is supported by the Miller Omega Program.

Home / Events

Judgment Under a Diversity of Timescales

Topical Meeting

All day

September 13, 2018

Agenda

This event is closed to the public.

Location: Des Moines, IA

Co-hosted by Principal Financial Group

Overview

This ACtioN Topical meeting has three goals:

  1. To bring insights from complexity science to bear on the recognition, identification, and evaluation of new ideas, projects, investments, and research programs.
  2. To discuss the subsequent measurement of their adoption and influence.
  3. To consider the complicated trade-offs and strategies which arise when considering both the long and the short term.

General Introduction

Questions of judgment and of impact pervade all elements of activity.

  • How good is this idea?
  • Should I continue along this line of investigation?
  • Does this program have merit?
  • Is this idea original and important?
  • Did this person make the difference or was it their team?
  • Is this portfolio property optimized?
  • How do I design investment strategies that account for different time horizons?
  • Did this data really improve our understanding?

These are all questions that call for significant and ideally verifiable judgments.

At the same time, we are interested in the impact of these judgments: “did the project achieve its objectives?” “what was the measurable impact?” “did the ideas deliver on their promises?” and “did this program open up a new market or new opportunity?”

We are all trained to assess contributions within increasingly narrow and specialized domains while at the same time scientific, technological and economic advances cross and distort these boundaries. And frequently we are at a loss when it comes to judging these endeavors. Furthermore, the age of (big) data has brought about an over-reliance on quantitative and semi-quantitative metrics. These can engender an illusion of objectivity and are by everybody’s admission problematic even when useful. Making these twin challenges that much harder is the fundamental difference between judgment and impact over the short-term and the long term. In the short-term judgment is easier than impact – we use reputation, recommendation, and credentials – whereas in the long-term impact often overtakes judgment – where we use metrics, testimonials and achievements.

Judgment can be thought of in terms of three fundamental dimensions: (1) The weight or value of ideas, (2) The distillation and connection of ideas, and (3) the predictions generated by the ideas. By contrast impact has three complementary dimensions of: (1) the frequency of adoption by a market (e.g. profit or market share), (2) the emergence or generation of correlated and complementary ideas (products or markets that depend on the target product), and (3) the long-term innovations produced by the idea (secondary largely unanticipated technologies and markets). Each of these six dimensions can be addressed through several different complexity tools and frameworks.

Complexity, Judgment, & Impact

Over the last decade, several new approaches and insights from complexity science have been generated that bear directly on the fundamental dimensions of judgment and impact. These come from fields as diverse as network theory, the dynamics of infectious ideas, cultural evolution and phylogenetic inference, the theory of scaling, first-passage processes, and collective computation. 

Topics of relevant prior work include:

  • First mover effects through preferential attachment dynamics in networks (e.g. Newman, 2009)

  • Evolutionary graph theory and Moran processes in structured populations (e.g. Nowak, et. al, 2009)

  • Citation distributions as limiting distributions of simple stochastic processes (e.g. Redner, 1998 )

  • Research strategies and knowledge clusters in large-scale scientific collaboration datasets (e.g. Foster et. al, 2015)

  • Random walk evaluation of knowledge impacts (e.g. Rosvall & Bergstrom, 2007)

  • Phylogenetic analysis of cultural transmission (e.g. Mace & Holden, 2005)

  • The infection-like transmission of ideas through populations (e.g. Mace & Holden 2005)

  • Scaling of measures of productivity in system size (e.g. West, 2017)

  • Merging the dynamics of social networks with the evolution of knowledge systems (e.g. Laubichler and Renn 2015, 2017)

  •  

Each of these methods can be applied over the short and the long term with very different results. It will be an explicit objective of the meeting to weigh the advantages and disadvantages of each in relation to case studies and clearly stated problems.

Registration is open to SFI Applied Complexity Network members and invited guests only. Please contact action@santafe.edu for registration information or to learn how to become a Santa Fe Institute Applied Complexity Network member.

Share
  • Sign Up For SFI News
  • SFI Calendars
  • ACtioN


  • SFI Projects
  • Algorithmic justice
  • Artificial intelligence: Foundations to frontiers
  • A theory of embodied intelligence
Show more

  • SFI Themes
  • Complex Intelligence: Natural, Artificial, and Collective
  • Complexity and History
  • Complex Time - Adaptation, Aging, Arrow of Time
Show more

SFI Login


Create Account

Reset Your Password

More SFI Events

View All Events
October 23, 2026

Agentic Technologies

September 15, 2026

The Agentic Age: Intelligence, Causality, & Risk

June 3, 2026

Epistemic Institutions in the Age of AI

June 1, 2026

AI and Multi-scale Human Intelligence

April 24, 2026

Complexity Futures: New Paradigms 2026

March 17, 2026

ACtioN Briefing: Converging Technologies, Diverging Institutions: Bridging Governance for the Grid and the Grid’s Edge

February 12, 2026

CounterBalance - Institutions and Interpretive Authority: A Showcase of Digital Tools

February 5, 2026

Thriving in a Turbulent World: Harnessing Complexity for New Possibilities

December 2, 2025

AI and Organizational Decision Making

November 6, 2025

The Age of Disruption: Risks and Opportunities

November 5, 2025

ACtioN Academy Epistemic Orientation

October 3, 2025

Rules of the Game

July 22, 2025

ACtioN Briefing: AI’s Impact on Social and Economic Distributions

June 16, 2025

AI’s Impact on Social and Economic Distributions

May 21, 2025

The Caves of Belief - Exploring AI's Impact on Belief Dynamics: A CounterBalance Seminar

April 25, 2025

2025 Complexity Science Symposium

March 25, 2025

ACtioN Briefing: Measuring AI in the World

March 12, 2025

Measuring AI in the World

February 27, 2025

The Science of Structural Transformation Across Complex Systems

January 16, 2025

Deconstructing Meaning: A CounterBalance Seminar

December 13, 2024

Winter Donor Appreciation Event

November 22, 2024

Deconstructing Meaning: A CounterBalance Seminar

November 8, 2024

Complexity in the Wild

October 15, 2024

Political Risk in the Era of Uncertainty

September 12, 2024

Decision-Making Across Timescales: Innovation, Investing, and Sustainability

September 10, 2024

Deconstructing Meaning: A CounterBalance Seminar

August 30, 2024

Sustainable Food Systems

August 14, 2024

Making Sense of Chaos: A Discussion with J. Doyne Farmer

June 25, 2024

ACtioN Briefing: Preparing Your Organization for a World of Algorithms

April 26, 2024

Second Foundation: Perspectives on the Past and Future of Complexity Science

February 19, 2024

Ergodicity Economics

February 6, 2024

Long-term Implications of Short-term Gratifications in Online Environments: A CounterBalance Seminar

November 10, 2023

The Complexity of Civilization

October 12, 2023

The Systems of Regulation

August 23, 2023

Epistemic Uncertainty, the AI Problem Understanding Gap and the Necessity of Structured Societal Context Knowledge for Safe, Robust AI

August 10, 2023

Understanding Rules in Organizations

June 19, 2023

Collective Intelligence: Foundations + Radical Ideas

June 11, 2023

2023 Complex Systems Summer School

May 15, 2023

Platform Governance and Epistemic Valence: A CounterBalance Seminar

April 28, 2023

2023 Science Board & Board of Trustees Symposium on "The Complexity of Knowledge"