datasource listing performs full listing despite user pruning partitions

[DoumanAsh]

Describe the bug

Current implementation of caching will result in performing full listing of the table despite user explicit request for pruning partitions
This means that user MUST disable cache if he wants to perform efficient data lookup with partition pruning

This should be documented if it is not intended to be fixed

datafusion/datafusion/datasource/src/url.rs

Line 418 in 54b7dd9

.list(Some(table_base_path))

To Reproduce

No response

Expected behavior

Only cache paths by prefix, not full table

Additional context

No response