♠ ♥ ♦ ♣People Analytics · 2026

Building CogCards — a talent assessment platform evaluating staff decision-making

A novel, game-based talent assessment I built from scratch and deployed firmwide at a leading global hedge fund to evaluate current staff, guide hiring decisions, and improve investor skill.

Role
Sole owner, concept → deployment
Stakeholders
CIO, Human Capital, Portfolio Managers, Analysts
Tools & Skills
Python · SQL · Airflow · Claude Code · Metric design & validation · Behavioral + survey integration
♥
♠
♦
♣
♠ Key Strengths

Research process highlights

♥ The Problem

Risk-taking was a blind spot

Senior leaders agreed the investment team’s risk-taking was suboptimal — but had no reliable way to measure risk appetite or related decision-making skills in current staff or candidates. Optimal risk-taking is a critical component of investing skill.

Project goal

An assessment of risk appetite and decision-making for current and prospective employees that’s engaging, valid, and deployable at scale.

Research questions

  • Can we identify behavioral patterns that impact investment performance?
  • Which methodology can deliver that quickly and accurately, with limited engineering resources?
♣ Approach

A game measuring actual behavior instead of a personality test

Players try to win as much money as possible in a card-based gambling game. How they bet as wins and losses unfold yields a metric-rich snapshot of decision-making under stress and uncertainty — paired with a short survey to explain it.

♠

Behavioral

In-game choices measure risk appetite and other cognitive dimensions directly, rather than relying on how players describe themselves.

♥

Survey

Closed- and open-ended questions triangulate the behavioral metrics and surface qualitative insight into players’ reasoning.

♦

Deliverables

A polished cloud-deployed game platform, admin panel, and a dashboard surfacing player results for hiring teams.

♥ Key Findings

Identifying opportunities to improve decision-making among employees

My analysis revealed several surprising patterns that we didn't expect to see among our highly-educated and experienced employees.

Behavioral Data

Risk-taking was often suboptimal for maximizing gains in-game.

Self-report Data

An unexpectedly high rate of cognitive biases, including gambler's fallacy.

Combined

Clear evidence of a Dunning–Kruger effect, with overconfidence concentrated among weaker performers.

Qualitative

Open-ended responses (analyzed with Claude) surfaced recurring player archetypes.

Evidence for Gambler's Fallacy

“If I lost several card draws in a row, I would keep hitting that deck because I knew a win would be coming…”
Evidence for the Dunning–Kruger effect
Scatter plot of 50 respondents: low performers overestimate their performance and high performers underestimate it.
Individual respondent Perfect calibration Bottom third: overestimated Top third: underestimated

Each dot is one player's self- vs actual-performance ranking

Y-axis: how each player thought they performed vs other players. X-axis: how they actually performed vs other players, as a percentile.

Those close to the dashed line were unbiased

A player on the dashed line judged their own performance exactly. Above it, they overestimated their ability; below, they underestimated it.

The weakest performers were the most overconfident

Players in the bottom third of actual performance () rated themselves as far better than they actually were.

The strongest performers underestimated their ability

Players in the top third () ranked themselves below their actual standing. It's the classic Dunning–Kruger pattern, and it matters: overconfidence is a widespread and consequential problem in investing.

♦ Recommendations

From insight to action

Some findings have been generalized or omitted, and all visuals are mockups, to preserve confidentiality. They remain faithful to the original results and content.