The Signal Tracker: Making Narrative & Qualitative Data Strategically Accessible in Real Time

Written by
Jannik Kaiser
on
September 2, 2026
Impact

A few years ago, during a workshop with seasoned evaluators, a colleague dropped a term that has stayed with me ever since: zombie practices.

Zombie practices are the routines in monitoring, evaluation, and learning (MEL) that we carry out almost sleepwalking. We rarely pause to reflect on them; we simply repeat them because "that’s how things are done."

You likely recognize these patterns:

  • Lengthy Final PDF Reports: Spending weeks compiling a massive, 80-page document at the very end of a multi-year project—long after the work has concluded and the context has moved on.
  • Superficial Indicators: Defaulting to easy-to-count KPIs (like attendance numbers or page views) and pretending they reveal true, systemic impact.
  • Hiding behind Compliance: Treating measurement purely as a tool to prove past performance to an external authority, rather than a way to improve our work in the present.

These practices persist because they are reinforced from both sides. Granting institutions often view thick reports as proof of thoroughness, while evaluators—seeking to demonstrate professional rigor and methodological credibility—feel compelled to deliver them even when no one asks for them. We have collectively built a culture where we mistake the size of a deliverable for the quality of our evidence.

The real danger of these zombie practices is that they actively stand in the way of the impact we want to achieve. Yet there’s a way out. 

More resources
Free workshops, events, resources and more, straight to your inbox each month
get our newsletter

Unlocking Qualitative Data: From Anecdotal Quotes to Strategic Intelligence

To break free from these sleepwalking habits, evaluation must become a practice that actually gives more energy than it takes. And to do that, we have to approach one of the field's most critical untapped opportunities: narrative and qualitative data.

Everyone in the social impact sector knows that the true story of change lives in human relationships, mindset shifts, and contextual breakthroughs. Yet qualitative data is frequently treated as a secondary byproduct—relegated to decorative quote boxes in donor reports or buried in appendices because it feels too slow, messy, or subjective to aggregate.

This leaves us with an urgent challenge: How can we make narrative and qualitative data quickly, easily, and strategically accessible—for project teams, leadership, and the wider public—without stripping away context or flattening the story?

How do we move qualitative data away from isolated anecdotes and turn it into a dynamic sensing radar that informs strategic decisions while the work is actively happening?

This is where the Signal Tracker comes in. Over the past few years, we have been testing and evolving a lightweight method that bridges this gap: combining short micro-narratives with participant-led tagging and live visual mapping. It shifts evaluation from a backward-looking audit into a living sensing practice.

This article lays out how the Signal Tracker works—and how you can design one for your own organization or network across four practical steps. 

What’s inside: The 4-Steps to set up a Signal Tracker

To move towards real-time sensing and set up your own Signal Tracker, this blog article guides you through four clear phases:

  1. Clarify Intent & Design the Experience: Defining your core inquiry, embedding capture into existing rhythms, and designing a reciprocal value exchange for participants.
  2. Capture Micro-Narratives & Enable Self-Signification: Combining qualitative stories with participant-led tagging to preserve context without adding evaluator bias.
  3. Build the Visual Sensing Layer: Feeding incoming data into a live visual dashboard (like Kumu) to make qualitative patterns instantly discoverable.
  4. Facilitate Participatory Sense-Making & Action Loops: Using live visual maps to drive collective reflection, strategy adjustments, and feedback loops.

To make this framework tangible, we will draw on two live use cases throughout this guide:

  • The Regenerative Signal Program: A guided capacity-building training where participants' signals generate personal learning, logs while simultaneously building a shared landscape of how regenerative evaluation is applied in real-world contexts.
  • The Regenerative Evaluation Community of Practice: A global network of 250+ practitioners where we use the Signal Tracker to sense emergent shifts, enabling conditions, and real-world experiments, linking these micro-moments directly to the 9 Guiding Principles of Regenerative Evaluation.

Step 1: Clarify Intent & Design the Experience

Before building forms or choosing software, you must answer two fundamental questions: 

  1. What are we actually trying to sense? 
  2. Why would anyone take the time to share a signal?

Many M&E data collection tools fail not because the technology is poor, but because they treat data collection as an administrative imposition rather than a thoughtful human experience. Step 1 is about establishing the strategic intent and structural foundation before a single data point is collected. To do so, there are three key aspects to consider that we are going to explore further: 

  1. Defining your core inquiry 
  2. Embedding capture into existing rhythms
  3. Designing a reciprocal value exchange 

Define Your Core Inquiry

Start by narrowing your lens. A Signal Tracker is not designed to catch every routine task; it is designed to catch significant micro-moments. Are you sensing for:

  • Mindset shifts: Moments where someone re-framed a problem, let go of an outdated assumption, or experienced an "aha!" realization?
  • Relational developments: Shifts in trust, power-sharing, agency, or collaboration within a team or network?
  • Enabling conditions: The specific contextual factors, leadership postures, or environmental setups that allowed a positive shift to happen?
  • Weak signals & tensions: Early, subtle cues that an unexpected dynamic is taking root or friction is surfacing in the field?

Embed Capture into Existing Rhythms

A central feature of the Signal Tracker is that it takes very little time to respond to. This leans towards mapping the natural touchpoints and rhythms that already exist in your context—whether they occur weekly, monthly, or around specific milestones: 

  • During events or cohorts: Add a 5-minute quiet reflection block at the end of a workshop, training module, or peer-coaching circle.
  • In routine operations: Weave a signal prompt into regular monthly check-ins, project retrospectives, or team reflections.
  • Asynchronous capture: Provide a light, mobile-friendly entry form so people can capture a thought the moment an insight emerges.

Keep the entry options flexible. Depending on your participants, offer multiple pathways to share—such as short text prompts, voice notes, or quick facilitated debriefs.

Design a Reciprocal Value Exchange

This is the single most critical element of experience design: Data collection must give back to the person providing it.

If submitting a signal feels like sending data into a black hole for external compliance, participation will quickly drop. In a regenerative approach, the act of reflecting and logging a signal should offer personal or collective value to the storyteller. 

Let’s have a quick look on how we set this up in our two examples: 

  • Personal Learning & Collective Landscapes (The Regenerative Signal Program): Each participant’s entries are compiled over time into a personalized Learning Journal for their certification. At the end of the program, they receive a structured harvest of their own growth, insights, and field applications—turning routine tracking into a meaningful personal asset. At the same time, their entries feed into a collective landscape, showing the entire cohort how these practices are taking root across different organizations.
  • Ecosystem Sensing & Shared Principles (Regenerative Evaluation CoP): In our global community, members know their signals feed into a shared visual commons. Logging an entry allows them to see where peers are experimenting with similar challenges, while helping the broader network track how regenerative evaluation is taking shape across diverse contexts and aligning with the 9 Guiding Principles.

By anchoring Step 1 in clear strategic intent, natural rhythms, and mutual value, data collection ceases to feel like an extractive task and becomes a generative habit.

Step 2: Capture Micro-Narratives & Enable Self-Signification

At the heart of the Signal Tracker is a simple design choice: combining short qualitative micro-narratives with self-signification (participant-led tagging).

Self-signification does not replace established qualitative methods; in fact, it works hand-in-hand with approaches like Grounded Theory, Most Significant Change or Story Harvesting, where evaluators and participants analyze open narratives to surface emergent patterns. What self-signification adds is an immediate layer of participant authorship. By inviting storytellers to tag the meaning of their own reflections, we preserve their authentic voice while creating structured data that is fast to aggregate, cluster, and compare in real time.

What’s a micro-narrative?

A micro-narrative is a brief, open-ended description of a real-world experience, insight, or moment of reflection. Keeping the initial prompt simple—such as "What is a recent insight, shift, or observation from your practice?"—allows emergent dynamics to surface naturally without forcing responses into predefined boxes.

Self-Signification: Fast Aggregation with Full Authorship

Immediately after sharing their narrative, participants answer 2 to 4 lightweight tagging questions. By selecting the categories, enabling conditions, or strategic themes that best fit their experience, participants achieve two key outcomes:

  • Preserving Authorship: The storyteller retains agency over how their experience is categorized and understood.
  • Rapid Pattern-Sensing: Because data arrives pre-indexed, it’s possible to instantly cluster entries by shared themes or conditions, enabling real-time sensing without long processing lags.

How It Looks in Practice

  • The Regenerative Signal Program: Participants share any meaningful reflection or insight arising from their evaluation practice. They self-signify by tagging what made that shift possible—selecting from enabling factors like specific tools, peer support, or dedicated reflection time. This provides immediate visibility into the underlying drivers of capacity and learning.
  • Regenerative Evaluation Community of Practice: Members contribute real-world insights and field experiences, tagging their reflections directly against one or more of the 9 Guiding Principles of Regenerative Evaluation (such as Nurture System Vitality or Honor Place, Story & Lived Experience). This builds a living, collective map showing how core principles are being explored across diverse global contexts.

Step 3: Build the Visual Sensing Layer

Once micro-narratives and self-signified tags are collected, the next priority is making that data immediately visible. The goal of this phase is to establish an automated data flow so that incoming entries instantly feed into a live visualization without requiring manual data transfer or long processing delays.

In our practice, we use a lightweight, accessible setup:

  • Intake: A simple Google Form captures the narrative and self-signification tags.
  • Transformation: Responses automatically populate a linked Google Sheet, where standard formulas reformat and structure the tags for network mapping.
  • Visualization: Kumu connects directly to the Google Sheet, reading updated rows in real time to render incoming signals as interconnected nodes.

While this is our current tech stack, the exact tools can be adapted to your ecosystem. Whether you use Airtable, Notion, Typeform, Power BI, or Kumu, the underlying principle remains the same: automate the connection between capture and visualization so data becomes scannable the moment it is shared.

Step 4: Facilitate Participatory Sense-Making & Adaptive Learning

The true value of the Signal Tracker unfolds when the visual map supports collective sense-making, strategic adaptation, and relational accountability with those sharing their experiences.

The invitation is to bring project teams, community members, leadership, or network partners together into regular sense-making circles—whether during monthly team check-ins, end-of-cohort sessions, or strategic learning spaces.

Together, the group explores the visual landscape to invite deeper inquiry:

  • Pattern Sensing: What clusters or themes are naturally forming? Which enabling conditions are appearing most frequently?
  • Noticing Gaps: Where is there surprisingly little activity? Which strategic intentions or guiding principles might need more space and care?
  • Emergence & Adaptation: What weak signals or early trends are sprouting that we want to actively tend to or explore further?

A core practice of a regenerative approach is maintaining relational accountability with participants. When storytellers see how their micro-narratives directly contribute to strategic reflections, programmatic shifts, or new learning focus areas, data sharing becomes a mutually enriching relationship rather than a one-way extraction.

Ready to Build a Signal Tracker for Your Organization or Network?

Moving towards real-time qualitative sensing doesn't require massive software overhauls or complex, extractive processes.

Whether you are seeking to evolve internal MEL practices, equip a learning cohort, or map emergent trends across a global network, we would love to support your journey. We partner with organizations and networks to:

  • Design custom Signal Trackers: Co-create tailored intake prompts and participant-led categories that honor storytelling while generating structured, decision-ready data.
  • Regenerate your evaluation strategy: Align your frameworks, methods, and reporting with what you actually value, in paced layers rather than a risky overhaull.
  • Capacity building for participatory & systemic MEL: Build internal fluency in regenerative and participatory evaluation, so this work becomes a practice your people own.

Book an exploratory consultation here.

Reach out to our team here.

About the author
Co-Founder & CEO. Lead of Regenerative Measurement & Evaluation, business development & partnerships. Facilitation of peer learning in organisations and impact evaluation processes. Working languages: English & German.
Close Cookie Preference Manager
Cookie Settings
By clicking “Accept All Cookies”, you agree to the storing of cookies on your device to enhance site navigation, analyze site usage and assist in our marketing efforts. More info
Strictly Necessary (Always Active)
Cookies required to enable basic website functionality.
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.