Commit Graph

19 Commits

Author SHA1 Message Date
Simone Gotti 4c30a5af1c runservice: handle jsonnet and json config files
Handle config files with name `config.jsonnet`, `config.json` and
`config.yml` and take the first from the repository in this order

For a jsonnet file execute it and use the generated output as the config
2019-04-16 15:00:37 +02:00
Simone Gotti 03451535c8 runservice: rework config format
The current config format was thought for future extensions for reusing runtimes
and job definitions adding some parameters.

After a lot of thoughts this looks like a complex approach: the final result
will be a sort of templating without a lot of powers.

Other approach like external templating should be an alternative but I really
don't think templating yaml is the way to go.

A much better approach will to just use jsonnet when we need to create matrix
runs and a lot of other use cases.

So just make the config a simple yaml/json. User can generate their config using
any preferred tool and in future we'll leverage jsonnet automated parsing and
provide a lot of jsonnet based examples for most use cases.

Main changes:

* Runs are now an array and not a map. The run name is in the Name field
* Tasks are now an array and not a map. The task name is in the Name field
* Use https://github.com/ghodss/yaml so we'll use json struct tags and unmarshall functions
2019-04-16 11:01:02 +02:00
Simone Gotti 4c12b03544 toolbox: expand archive/unarchive starting tilde
Expand archive sourceDir(s) and unarchive DestDir
2019-04-13 14:56:35 +02:00
Simone Gotti c300a37d09 runservice: add some initial scheduler tests 2019-04-11 17:23:59 +02:00
Simone Gotti 8b92b6f55c initial project group impl
and related api updated
2019-03-14 14:36:18 +01:00
Simone Gotti 4cacae198f go.mod: update gorilla mux version 2019-03-18 15:05:43 +01:00
Simone Gotti 021a0465ce gateway: initial implementation 2019-02-21 17:58:25 +01:00
Simone Gotti 57c756a5a4 configstore: initial implementation 2019-02-21 16:08:30 +01:00
Simone Gotti bd21f1f9b5 scheduler: initial basic implementation 2019-02-21 16:04:33 +01:00
Simone Gotti cbe26c5797 Add makefile 2019-02-21 15:59:16 +01:00
Simone Gotti 36fc79dfc6 runservice: initial commit 2019-02-21 15:54:50 +01:00
Simone Gotti 4cd382425c toolbox: initial commit 2019-02-21 15:57:11 +01:00
Simone Gotti 86e8479de9 Add initial objectstorage wal manager 2019-02-22 08:45:59 +01:00
Simone Gotti 2eea5ab8c6 Add dump util 2019-02-21 16:30:34 +01:00
Simone Gotti 5bdfb4c084 Add common services configuration 2019-02-21 16:05:06 +01:00
Simone Gotti 968104c469 Add database helper 2019-02-21 16:05:54 +01:00
Simone Gotti 7aae1d3e1b Add initial objectstorage implementation 2019-02-21 16:00:48 +01:00
Simone Gotti e38ba8ea31 Add etcd store 2019-02-21 16:00:12 +01:00
Simone Gotti 86d5a85409 Add common logging helper 2019-02-21 16:05:35 +01:00