feat: integration s3 with arrow filesystem

[MisterRaindrop]

I have implemented Arrow FileSystem to access S3, but I'm still not sure if it meets the requirements.

There are still task or question to complete for the current PR, and it is not ready for merging yet.

Question:
Currently, the object storage options include Azure, AWS, and GCS. I have chosen AWS as the implementation for now is ok?

Task:
I need to deploy MinIO to facilitate testing access to S3, but I'm not sure where it would be best to set it up?

[wgtmac]

Thanks for adding this!

I have chosen AWS as the implementation for now is ok?

Yes, I believe this is worth doing. I supposed to reuse ArrowFileSystemFileIO by passing an arrow::FileSystem of S3 which is supported by Arrow if built with ARROW_S3=ON. But I haven't explored it yet.

I need to deploy MinIO to facilitate testing access to S3

There is a related discussion with regard to minio's recent license change: https://lists.apache.org/thread/vnw9jonmfcsz6bwojhfch1nmywyl50h3. I'm not sure if there is any good alternative to test it.

[MisterRaindrop]

I recommend using MinIO. It is relatively stable and suitable for the current project development phase. Once the community reaches a consensus, the cost of replacing MinIO will not be high.