Why robots fail at creative problem-solving when conditions change

RoboWits tests whether robots can reason and adapt creatively—not just execute learned skills. Using an automated pipeline, researchers created 208 reasoning-heavy manipulation tasks with graded difficulty. Pre-trained vision-language models achieved decent performance on base tasks but failed dramatically on mutations (geometry, material, or assembly changes), revealing brittleness that standard benchmarks miss. Code and tasks released.