We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
EnabledStatistics::None
Describe the bug Take the code as an example,
fn main() { let root_schema = Arc::new(Schema::new(vec![Field::new("a", DataType::Int64, false)])); let props = WriterProperties::builder() .set_statistics_enabled(EnabledStatistics::None) .build(); let file = File::create("test.parquet").unwrap(); let mut writer = ArrowWriter::try_new( file.try_clone().unwrap(), Arc::clone(&root_schema), Some(props), ) .unwrap(); let a = Int64Array::from(vec![1, 2, 3, 4, 5]); let batch = RecordBatch::try_new(Arc::clone(&root_schema), vec![Arc::new(a)]).unwrap(); writer.write(&batch); writer.close(); }
When the default statistics_enabled is set to EnabledStatistics::None, if I read the metadata of test.parquet with code,
statistics_enabled
test.parquet
let f = File::open("test.parquet").unwrap(); let r = ParquetFileArrowReader::try_new(f).unwrap(); let m = r.metadata(); println!("{:#?}", m);
I get:
... statistics: Some( Int64( {min: Some(1), max: Some(5), distinct_count: None, null_count: 0, min_max_deprecated: false}, ), ), ...
Expected behavior
... statistics: None ...
Additional context Tested against arrow 19.0.0.
The text was updated successfully, but these errors were encountered:
Oops, can confirm this was introduced by #2045
Sorry, something went wrong.
Fix disabling parquet statistics (apache#2185)
9329e0c
Fix disabling parquet statistics (#2185) (#2191)
82e0512
Successfully merging a pull request may close this issue.
Describe the bug
Take the code as an example,
When the default
statistics_enabled
is set toEnabledStatistics::None
, if I read the metadata oftest.parquet
with code,I get:
Expected behavior
Additional context
Tested against arrow 19.0.0.
The text was updated successfully, but these errors were encountered: