I found the root cause: I specified the source S3 folder rather than the Athena query cache folder for it.
That's what the documentation is saying (and what I ignored):
Amazon S3 Staging Directory: Find this setting in the AWS console for Amazon Athena.
AWS calls this property “Query Result Location”
With the Query Result Location it works fine.