Add ability to skip or transform page encoding statistics in Parquet metadata

[etseidl]

Which issue does this PR close?

• Closes Reduce allocations in ParquetMetaData for improved performance #8518.

Rationale for this change

This builds on #8763 to add options to either skip decoding of the page encoding statistics array, or transform it to a bitmask. This gets rid of the last of the heavy allocations in the metadata decoder.

What changes are included in this PR?

Adds new options to ParquetMetaDataOptions. Also adds more metadata benchmarks.

Are these changes tested?

Yes

Are there any user-facing changes?

No, just adds new field to ColumnChunkMetaData.

[etseidl]

excerpts from new benchmarks

decode parquet metadata time:   [15.050 µs 15.105 µs 15.164 µs]
decode metadata with schema
                        time:   [7.7038 µs 7.7286 µs 7.7561 µs]
decode metadata with stats mask
                        time:   [14.035 µs 14.100 µs 14.182 µs
decode metadata with skip PES
                        time:   [13.976 µs 14.016 µs 14.060 µs]
decode parquet metadata (wide)
                        time:   [54.013 ms 54.236 ms 54.468 ms]
decode metadata (wide) with schema
                        time:   [48.399 ms 48.562 ms 48.738 ms]
decode metadata (wide) with stats mask
                        time:   [44.912 ms 45.077 ms 45.253 ms]
decode metadata (wide) with skip PES
                        time:   [44.500 ms 44.616 ms 44.739 ms]

Skipping the stats is not any faster than turning them into a mask 😮.

[etseidl]

This is my solution to per-column options. For huge schemas I didn't want a Vec<bool> that's mostly filled with false. Using Arc so cloning should be faster.

skip_encoding_stats	behavior
None	decode all
Some<None>	decode none
Some<Some<Set>>	decode if in set

[etseidl]

This defaults to false so no behavior change. If we want to enable using the mask by default, we can either implement Default, or change this to encoding_stats_as_vec or something to allow enabling the old behavior.

[etseidl]

I wonder if this should be data_page_encoding_stats_mask (or just data_page_encoding_stats) to make it clear it only has the stats for data pages.

[etseidl]

This is for adding the mask to ColumnChunkMetaData. An alternative might be to create an enum with Vec and mask variants if we don't want more bloat.

[etseidl]

Now that I've done the macro, it saves all of 3 lines per instance. I'm fine with doing away with it.

One reason to keep this concise is that once an API is finalized for this setting, I'll add options for chunk statistics, size statistics, and geo statistics, and potentially an option to skip decoding the page index length/offsets as well (oh, and bloom filters too). That's a lot of repetition with high chances of cut-and-paste errors that I'd like to avoid, especially with the addition of per-column setters (i.e. the poorly named set_keep_X). I'd really like the whole suite of accessors/setters to be generated with a macro, but then documentation becomes problematic. Suggestions welcome 😄

[etseidl]

I'm open to a better name for this. set_decode_encoding_stats_for_columns is a bit long winded.