Fine grained storage for the DUNE experiment
DUNE’s fine-grained Phlex/FORM I/O model stores data products across many independent RNTuple containers, which can increase read-side overhead during full event reassembly. The project addresses this by creating a reproducible benchmark baseline, running systematic studies across container count, data size, and cache conditions, and quantifying dominant bottlenecks such as metadata cost, file-open overhead, cache pressure, and cluster traversal. Deliverables include a reproducible benchmark suite, analysis plots and reports, before/after results for optimization prototypes (container caching, prefetching, and read-side consolidation), and a final recommendation report for production-oriented FORM storage decisions.
Project details
Technologies
Not listed in the archive