wellbeing-psychometrics

Design and interpret validated psychometric instruments for measuring wellbeing outcomes. Use when creating measurement frameworks, selecting assessment tools, designing surveys, or analyzing wellbein

SKILL.md

GitHub

Wellbeing Psychometrics & Measurement

Rigorous measurement of wellbeing requires validated instruments with strong psychometric properties. This skill guides selection, implementation, and interpretation of evidence-based measurement tools.

Core Psychometric Principles

Validity Types

  • Construct Validity: Does the instrument measure what it claims to measure?
  • Criterion Validity: Does it predict relevant outcomes?
  • Content Validity: Does it comprehensively cover the domain?
  • Discriminant Validity: Does it distinguish from related but different constructs?

Reliability Indicators

  • Cronbach's Alpha: Internal consistency (0.7-0.9 is acceptable, 0.6+ for exploratory)
  • Test-Retest Reliability: Stability over time (typically ICC > 0.7)
  • Inter-rater Reliability: Agreement between raters (Cohen's kappa, ICC)

Measurement Model Fit

  • CFI/TLI: Comparative fit indices (>0.90 is good)
  • RMSEA: Root Mean Square Error of Approximation (<0.08 is acceptable)
  • SRMR: Standardized Root Mean Square Residual (<0.08 is good)

Validated Wellbeing Instruments

Multidimensional Wellbeing Scales

PERMA-Profiler (Kern et al., 2015)

Structure: 23 items across 6 domains

  • Positive Emotion (hedonic wellbeing)
  • Engagement (flow, absorption)
  • Relationships (social connection)
  • Meaning (life purpose)
  • Accomplishment (achievement, mastery)
  • Negative Emotion (reverse-scored)

Strengths: Brief, validated across cultures, theory-grounded (Seligman's PERMA model) Use for: General wellbeing assessment, product/experience evaluation Psychometrics: α ≈ 0.70-0.85 across domains Administration: 5-10 minutes

Personal Wellbeing Index (PWI-8) (International Wellbeing Group)

Structure: 8 life satisfaction domains

  • Standard of living
  • Health
  • Life achievement
  • Personal relationships
  • Personal safety
  • Community connectedness
  • Future security
  • Life satisfaction (overall)

Strengths: Short, universal, used in major population studies Use for: Population-level monitoring, longitudinal tracking Psychometrics: α ≈ 0.80-0.85 Administration: 3-5 minutes

Hedonic & Eudaimonic Wellbeing

Scale of Positive and Negative Experience (SPANE) (Diener et al., 2010)

Structure: 12 items in 2 factors

  • Positive experiences (positive, negative reversed, good, bad reversed, etc.)
  • Negative experiences (negative, worried, sad, etc.)

Strengths: Brief, captures both dimensions, good cross-cultural validity Use for: Affective wellbeing, emotional state tracking Psychometrics: α ≈ 0.81-0.89 Administration: 2-3 minutes

Meaning in Life Scale (MLQ) (Steger et al., 2006)

Structure: 5 items in 2 dimensions

  • Presence of meaning
  • Search for meaning

Strengths: Concise eudaimonic measure, validated widely Use for: Purpose and meaning assessment Psychometrics: α ≈ 0.73-0.90 Administration: 2 minutes

Flourishing & Flourishing Specific Scales

Psychological Wellbeing Scale (PWB-18) (Ryff, 1989)

Dimensions: 6 core elements (3 items each)

  • Autonomy
  • Competence (mastery)
  • Personal growth
  • Purpose in life
  • Positive relationships
  • Self-acceptance

Strengths: Theoretically grounded in human potential, eudaimonic focus Use for: Comprehensive psychological wellbeing assessment Psychometrics: α ≈ 0.83-0.87 Administration: 10-15 minutes

Flourishing Scale (FS) (Diener et al., 2009)

Structure: 8 items across psychological flourishing

  • Purpose, engagement, relationships, competence, optimism, self-respect

Strengths: Brief, robust factor structure, used widely in research Use for: General flourishing assessment Psychometrics: α ≈ 0.87-0.90 Administration: 3 minutes

Domain-Specific Measures

Satisfaction With Life Scale (SWLS) (Diener et al., 1985)

Structure: 5 items measuring global life satisfaction Strengths: Gold standard for life satisfaction, extensive validation Psychometrics: α ≈ 0.79-0.89 Administration: 2 minutes

UCLA Loneliness Scale (ULS-8) (Hughes et al., 2004)

Structure: 8 items measuring perceived social isolation Strengths: Short form, validated, predictive of health outcomes Psychometrics: α ≈ 0.82 Administration: 2 minutes

Rosenberg Self-Esteem Scale (RSE) (Rosenberg, 1965)

Structure: 10 items measuring global self-worth Strengths: Most widely used self-esteem measure, culturally adapted Psychometrics: α ≈ 0.77-0.88 Administration: 3 minutes

Experience Sampling & Real-time Measures

Experience Sampling Method (ESM) / Ecological Momentary Assessment (EMA)

Structure: Brief surveys delivered via app in real context

  • Current activity and location
  • Social context
  • Emotional state (affect grid or PANAS)
  • Engagement and stress levels

Strengths: Captures real-time experience, reduces recall bias Use for: Product experience evaluation, diary-style wellbeing tracking Consideration: Higher participant burden, data analysis complexity

Measurement Design Best Practices

Scale Selection Criteria

  • Validity: Evidence of measuring intended construct
  • Reliability: Adequate internal consistency and stability
  • Responsiveness: Sensitive to meaningful changes
  • Brevity: Minimizes participant burden
  • Cross-cultural: Available translations and validation
  • Theory-alignment: Matches your wellbeing framework
  • Licensing: Open access or affordable permissions

Administration Considerations

Frequency:

  • Baseline: Before intervention/new design
  • Post-test: Immediately after experience (1-7 days)
  • Follow-up: Long-term effects (weeks to months)

Response Mode:

  • Online/mobile preferred for research-through-design
  • Paper for in-person contexts
  • Experience sampling for real-time tracking

Anchoring Scales:

  • Consistent 1-10 or 1-7 Likert scales
  • Clear labeling ("Strongly Disagree" to "Strongly Agree")
  • Avoid neutral mid-point for forced choice contexts

Data Quality Assurance

  • Attention checks: Reverse-coded or logic questions
  • Completion rates: Monitor for incomplete responses
  • Response time: Identify rushed or suspicious patterns
  • Missing data: Document and handle appropriately

Analysis & Interpretation

Descriptive Statistics

  • Mean, median, standard deviation by subscale
  • Floor/ceiling effects (>15% responses at extremes)
  • Skewness and kurtosis

Inferential Analysis

  • t-tests/ANOVA: Compare groups (e.g., treatment vs. control)
  • Paired tests: Pre-post comparisons
  • Correlation: Relationships between wellbeing dimensions
  • Regression: Predictive relationships

Effect Sizes

  • Cohen's d: 0.2 (small), 0.5 (medium), 0.8 (large)
  • ηp²: 0.01 (small), 0.06 (medium), 0.14 (large)
  • Report alongside p-values for practical significance

Qualitative Integration

  • Triangulate quantitative findings with interview data
  • Use scores to guide depth interviews with high/low scorers
  • Contextualize numerical changes with lived experience

Quick Reference: Instrument Selection Matrix

Goal Best Instrument Time Focus
General wellbeing snapshot PERMA-Profiler 5 min Multidimensional
Population monitoring PWI-8 3 min Life satisfaction
Emotional state SPANE 2 min Affect
Eudaimonic wellbeing PWB or MLQ 5 min Purpose/growth
Life satisfaction SWLS 2 min Overall satisfaction
Psychological flourishing Flourishing Scale 3 min Thriving
Real-time experience ESM/EMA 2 min Momentary state
Loneliness/connection UCLA-8 2 min Social isolation
Self-worth Rosenberg SES 3 min Self-esteem

Common Pitfalls to Avoid

  • Cherry-picking scales: Choose based on theory, not convenience
  • Ignoring psychometrics: Always verify reliability/validity for your population
  • Over-interpretation: Acknowledge measurement error and confidence intervals
  • Single measure: Combine multiple instruments for comprehensive picture
  • Ignoring context: Same score means differently in different populations
  • Neglecting qualitative data: Numbers without stories miss crucial nuance

Resources

  • Open Science Framework (OSF): Repository of validated instruments and protocols
  • PubMed/Google Scholar: Search for validation studies in your population
  • COSMIN: Guidelines for selecting Patient-Reported Outcome Measures
  • International Wellbeing Group: PWI and related resources