What does "on AWS" mean? There are a lot of ways to host a file "on AWS" - which service are you using?
I agree with Michael completely, but I'm going to take a guess that your CSV file is stored on S3.
If that is the case, this might help : Connect to your S3 data with the Amazon Athena connector in Tableau 10.3 | Tableau Software
I'm a little bit more "old school" so I always prefer a proper database, so I would suggest using Snowflage. You can configure it to auto-ingest CSV files and then you can easily query millions of records.
Thanks Chris for your reply.
Will check the help link that you provided.