| 3 | | Project-Meta is a software to help you to manage your open data, using the protocol OpenDAP. The initiative is supported by the European Commission as part of the project Hydralab+ of the Horizon 2020 programme. This programme requests that research data are open access, that is providing online access free of charge to the end-user and reusable. Furthermore access must allow the right to copy, distribute, search, link, crawl and mine the data. In addition to these general requests, we aim at achieving the following goals: |
| | 4 | |
| | 5 | Project-Meta is a software to help you to manage your open data, using the protocol OpenDAP. |
| | 6 | The initiative is supported by the European Commission as part of the project Hydralab+ of the Horizon 2020 programme. |
| | 7 | This programme requests that research data are open access, that is providing online access free of charge to the end-user and reusable. |
| | 8 | Furthermore access must allow the right to copy, distribute, search, link, crawl and mine the data. |
| | 9 | In addition to these general requests, we aim at achieving the following goals: |
| 13 | | The protocol is based on http, so that data can be scanned with an ordinary web browser. However added functionality of data visualization is provided by graphics programs (like Matlab, GrADS, Ferret or ncBrowse). Compared to ordinary file transfer protocols (e.g. FTP) a major advantage using OPeNDAP is the ability to retrieve subsets of files, so it is possible to work remotely without downloading whole data files. Although any file format can be use, data are often in HDF or NetCDF formats. The older NetCDF format is limited to arrays of numbers, while HDF provides wider possibilities of data structures (and it contains NetCDF as a particular case). We choose the NetCDF format which is sufficient for most experimental data and can be more easily read with a variety of software. |
| | 19 | The protocol OPeNDAP (Open-source Project for a Network Data Access Protocol). |
| | 20 | This includes standards for encapsulating structured data, annotating the data with attributes and adding semantics that describe the data. |
| | 21 | OPeNDAP is widely used by governmental agencies such as NASA and NOAA to serve satellite, weather and other observed earth science data. |
| | 22 | |
| | 23 | The protocol is based on http, so that data can be scanned with an ordinary web browser. |
| | 24 | However added functionality of data visualization is provided by graphics programs (like Matlab, GrADS, Ferret or ncBrowse). |
| | 25 | Compared to ordinary file transfer protocols (e.g. FTP) a major advantage using OPeNDAP is the ability to retrieve subsets of files, so it is possible to work remotely without downloading whole data files. |
| | 26 | Although any file format can be use, data are often in HDF or NetCDF formats. |
| | 27 | The older NetCDF format is limited to arrays of numbers, while HDF provides wider possibilities of data structures (and it contains NetCDF as a particular case). |
| | 28 | We choose the NetCDF format which is sufficient for most experimental data and can be more easily read with a variety of software. |
| | 29 | |
| | 37 | The first step is to make a list of the data folders to display. |
| | 38 | This list needs to be introduced in a text file, |
| | 39 | complemented by some information about the authors of the work and about related publications. |
| | 40 | This text file must be put in your current folder with the name {{{PROJECT-META.yml}}}. |
| | 41 | The text structure must follow some simple rules consisting in the YAML format. |
| | 42 | An example could be found in the Project-Meta repository or online |
| | 43 | [http://servforge.legi.grenoble-inp.fr/pub/soft-trokata/project-meta/PROJECT-META.sample.yml PROJECT-META.sample.yml]. |
| | 49 | |
| | 50 | == {{{PROJECT-META.yml}}} meta file == |
| | 51 | |
| | 52 | This file is at the core of the procedure. |
| | 53 | A first task is to list the data folder to publish. |
| | 54 | For that purpose a good practice is to organise the data and the procedures of analysis |
| | 55 | such that the final data to publish are contained in folders named with specific extensions. |
| | 56 | Then search tools can be used to list all the selected folders. |
| | 57 | For instance the following unix command lists all the folders with extension {{{*.mproj*}}} |
| | 58 | and append it to the file {{{PROJECT-META.yml}}} (and creates the file if it does not exist yet): |
| 45 | | All code is under '''free license'''. Scripts in `bash` are under GPL version 3 or later (http://www.gnu.org/licenses/gpl.html), `C++` sources are under GPL version 2 or newer, the `perl` scripts are under the same license as `perl` itself ie the double license GPL and Artistic License (http://dev.perl.org/licenses/artistic.html). |
| | 83 | |
| | 84 | All code is under '''free license'''. |
| | 85 | Scripts in `bash` are under GPL version 3 or later (http://www.gnu.org/licenses/gpl.html), |
| | 86 | `C++` sources are under GPL version 2 or newer, |
| | 87 | the `perl` scripts are under the same license as `perl` itself ie the double license GPL and Artistic License (http://dev.perl.org/licenses/artistic.html). |
| 60 | | It is possible to have access to writing at the forge on reasoned request to [mailto:Gabriel.Moreau(A)legi.grenoble-inp.fr Gabriel Moreau]. For issues of administration time and security, the forge is not writable without permission. For the issues of decentralization of the web, autonomy and non-allegiance to the ambient (and North American) centralism, we use our own forge... |
| | 103 | It is possible to have access to writing at the forge on reasoned request to [mailto:Gabriel.Moreau(A)legi.grenoble-inp.fr Gabriel Moreau]. |
| | 104 | For issues of administration time and security, the forge is not writable without permission. |
| | 105 | For the issues of decentralization of the web, autonomy and non-allegiance to the ambient (and North American) centralism, we use our own forge... |
