Which AI tool you ask changes everything about job impact studies

Using ChatGPT conversation logs to measure job automation risk, economists found that switching between different AI platforms changes employment impact estimates by nearly twofold—because platforms attract different users, not because jobs face different risks. Adjusting for actual workforce composition shrinks estimates by 42-93%. The flaw matters because it systematically understates how much AI will replace workers versus augment them.