Changes between Version 53 and Version 54 of ProjectDocumentation
- Timestamp:
- Jun 16, 2018, 6:37:47 PM (6 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
ProjectDocumentation
v53 v54 108 108 == EXP02 == 109 109 == EXP03 == 110 = 8 - Data format = 111 = 9- Data management = #Datamanagement110 111 = 8 - Data management = #Datamanagement 112 112 We can distinguish three steps: 113 114 113 * Raw data: as given by the different instruments. They are generally stored in local disks, instrument units (volts, pixels for images...). The available formats are often limited and proprietary to the company selling the instrument. For long data sets, avoid text formats which are longer to read and occupy more disk space than binary formats. 115 * Processed data: th ey are stored in storage bays with backup system, as local instrument disks are quickly full and less safe. Physical units and standard formats are needed for communication to researchers who did not participate in the project.114 * Processed data: those are the physical quantities of interest, obtained after calibration of the raw data and processing linked to the instruments, leading for instance to velocity fields form the images by Particle Imaging Velocimetry. They should be understandable by researchers who did not participate in the project, so that physical units and standard formats are needed. They are stored in storage bays with backup system, as local instrument disks are quickly full and less safe. 116 115 * Published data: they contain a selection of the most "interesting" data, and involve various analysis of the processed data, like statistics, plots, which are very dependent on the project. We consider two levels of published data. 117 116 * Publication on the OpenDAP server of LEGI: this allows for flexible modification and online consultation, see [https://servforge.legi.grenoble-inp.fr/projects/soft-trokata/wiki/SoftWare/ProjectMeta] for details. 118 117 * Publication as a Zenodo archive: its advantage is the perennity of the storage and its support by European authorities. However, the data of a project are limited in size (50 Go), and can be only downloaded as a .zip archive, without online consultation. It is appropriate as a final step after the OpenDAP. [[BR]] 118 119 = 9 - Data format =