DAMNIT

DAMNIT (Data And Metadata iNspection Interactive Thing) is a tool developed by the Data Analysis group at the European XFEL to provide users with a way to automatically create an overview of their experiment, hopefully replacing the manually-created spreadsheets that are often used.

6
contributors

Cite this software

What DAMNIT can do for you

The tool in a nutshell

The DAMNIT GUI provides a tabular, aggregated view on data and metadata
as soon as new content from experiment data acquisition is available.

Benefits of using DAMNIT

DAMNIT has been designed with the following purposes in mind:

  • Replace spreadsheets for the purpose of logging sequences of measurements
  • Standardise the metadata content to be tracked and evaluated
  • Automate the creation of entries as soon data are collected
  • Be close to online monitoring for reasonably fast decisions
  • Have rich data visualisation with various graphs for free
  • Embed complex data analysis to the workflows where needed

European XFEL data are collected in runs. The automatically built
DAMNIT tables help to compare data runs which is crucial to detect:

  • trends of data quality
  • opportunities for data selection
  • opportunities for data aggregation
  • correlations with the experimental setup
    (e.g. beam, sample, detector configuration)

The DAMNIT feedback is as fast as file-based workflows allow:

  • Live monitoring is complemented on a minutes timescale
  • This "close-to-online" principle allows for efficient high-level decisions
    like change of sample
Logo of DAMNIT
Keywords
Programming languages
  • Python 99%
  • Dockerfile 1%
License
</>Source code

Participating organisations

European X-Ray Free-Electron Laser

Contributors

MdCT
Matheus do Carmo Teodoro
JW
James Wrigley
TK
Thomas Kluyver
TM
Thomas Michelat
CC
Cammille Carinan
Developer
European XFEL GmbH
RR
Robert Rosca

Related projects

DAPHNE4NFDI

Software developed or co-developed in the scope of the DAPHNE4NFDI consortium

Updated 2 months ago