DAMNIT
DAMNIT (Data And Metadata iNspection Interactive Thing) is a tool developed by the Data Analysis group at the European XFEL to provide users with a way to automatically create an overview of their experiment, hopefully replacing the manually-created spreadsheets that are often used.
Cite this software
Description
The tool in a nutshell
The DAMNIT GUI provides a tabular, aggregated view on data and metadata
as soon as new content from experiment data acquisition is available.
Benefits of using DAMNIT
DAMNIT has been designed with the following purposes in mind:
- Replace spreadsheets for the purpose of logging sequences of measurements
- Standardise the metadata content to be tracked and evaluated
- Automate the creation of entries as soon data are collected
- Be close to online monitoring for reasonably fast decisions
- Have rich data visualisation with various graphs for free
- Embed complex data analysis to the workflows where needed
European XFEL data are collected in runs. The automatically built
DAMNIT tables help to compare data runs which is crucial to detect:
- trends of data quality
- opportunities for data selection
- opportunities for data aggregation
- correlations with the experimental setup
(e.g. beam, sample, detector configuration)
The DAMNIT feedback is as fast as file-based workflows allow:
- Live monitoring is complemented on a minutes timescale
- This "close-to-online" principle allows for efficient high-level decisions
like change of sample
Participating organisations
Contributors
Related projects
DAPHNE4NFDI
Software developed or co-developed in the scope of the DAPHNE4NFDI consortium