Lewis C. Lin’s Newsletter

Deep Dives

M35: Metrics for AI Chatbot

Instagram AI chats surge 50%. Human DMs plummet 25%. Why this signals transformation, not crisis.

Sep 27, 2025
∙ Paid
15
1
Share

Most product teams approach AI adoption by chasing vanity metrics and feature parity, leaving the deeper behavioral transformation underexplored. This analysis demonstrates systems-level strategic thinking through:

  • Framework-Driven Decision Making: Applied VITAL methodology to eliminate bias and rank 5 competing NSMs with objective scoring, revealing why “time spent” beats “user count” for sustainable AI engagement

  • Contradiction Navigation: Transformed alarming usage shifts (AI up 50%, human DMs down 25%) into diagnostic opportunities by generating testable hypotheses about user psychology and interface design

  • Strategic Tradeoff Resolution: Chose depth over breadth (10 power users vs 100 casual users) and speed over accuracy through first-principles reasoning about network effects and engagement psychology

Key Insight: Elite product strategy means building conviction through structured analysis, not intuition—especially when data points in conflicting directions.

Metrics for Meta AI Chatbot

Keep reading with a 7-day free trial

Subscribe to Lewis C. Lin’s Newsletter to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2025 Lewis C. Lin
Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture