Consolidate various configurations options, remove unrelated batch_size
#1565
Labels
api change
Changes the API exposed to users of the crate
datafusion
Changes in the datafusion crate
enhancement
New feature or request
Is your feature request related to a problem or challenge? Please describe what you are trying to do.
We currently have three Configurations:
ExecutionConfig
,PhysicalPlanConfig
andRuntimeConfig
. They all sharebatch_size
, which is only meaningful for query execution.As we get
RuntimeEnv
plumbing through allexecute()
methods, we've gotRuntimeConfig
available to all executing code. Therefore, we'd better consolidate these configs and better separate their responsibilities.Describe the solution you'd like
batch_size
only inRuntimeConfig
, remove all unrelatedbatch_size
passing during query planning.PhysicalPlanConfig
toFileScanConfig
that clarifies its usage scenario.Describe alternatives you've considered
Additional context
#1526 (comment) as well for context.
The text was updated successfully, but these errors were encountered: