39 Commits

Author SHA1 Message Date
PatchOfScotland
933d568fb2 added time to all events. this is a unix timestamp so will need to be converted to something nicer if dispalyed, but hey, its easy to store 2023-04-27 15:13:47 +02:00
PatchOfScotland
d3eb2dbf9f added standardised job creation 2023-04-22 21:48:33 +02:00
PatchOfScotland
f306d8b6f2 updated runner structure so that handlers and conductors actually pull from queues in the runner. changes to logic in both are extensive, but most individual functinos are unaffected. I've also moved several functions that were part of individual monitor, handler and conductors to the base classes. 2023-04-20 17:08:06 +02:00
PatchOfScotland
547d5fefce refactored correctness dir away from core sub dir into either functionality or core as appropriate 2023-03-31 15:55:16 +02:00
PatchOfScotland
5952b02be4 added support for directory event matching 2023-03-31 13:51:14 +02:00
PatchOfScotland
18d579da22 added tests for new bash jobs, and removed extra hash definition in job dict 2023-03-30 14:20:29 +02:00
PatchOfScotland
311c98f7f2 rewored rules to only invoke base rule, and added bash jobs 2023-03-30 11:33:15 +02:00
PatchOfScotland
747f2c316c added type hinting for new functions 2023-03-16 15:30:37 +01:00
PatchOfScotland
f1f16ca3b8 added naming to monitors, handlers and conductors so runners can identify them, in prep for in-workflow modification of patterns and recipes' 2023-03-16 13:53:01 +01:00
PatchOfScotland
ede29f3158 reformated imports for pep8 compatability 2023-03-14 15:12:22 +01:00
PatchOfScotland
af489d2bb9 added test for get_recipe_from_notebook 2023-03-14 13:39:01 +01:00
PatchOfScotland
40ed98000b reformatted imports to work better on other machines, plus added benchmarking to project 2023-03-13 11:32:45 +01:00
PatchOfScotland
4d29ced83d added test for reqs structuring 2023-02-13 19:34:32 +01:00
PatchOfScotland
9b744e9afe resolved circular dependencies in validation by splitting meow off too 2023-02-10 18:40:15 +01:00
PatchOfScotland
6fab2f7a10 also refactored core.meow into seperate files in hope that it'll help solve circular imports 2023-02-10 16:23:24 +01:00
PatchOfScotland
7f8b4f3e32 split functionality file across new module as was getting too long on its own. All functions remian the same, but imports will need to be updated. 2023-02-10 14:46:46 +01:00
PatchOfScotland
c0411c43a4 added tests for handlers and conductors validating events and jobs 2023-02-09 17:29:21 +01:00
PatchOfScotland
a2df62c693 reformted jobs being passed to conductors so they only get a job directory and have to read the definitions from the appropriate files 2023-02-09 15:22:26 +01:00
PatchOfScotland
a1451881ae updated code so should work on windows, with exception of waiting on multiple connections 2023-02-08 14:46:03 +01:00
PatchOfScotland
9435d500db added a few more tests, most notably of python execution 2023-02-03 16:07:09 +01:00
PatchOfScotland
47f9fe73fa differentiated papermill and python jobs more clearly 2023-02-03 14:47:16 +01:00
PatchOfScotland
1b638ec496 moved sweep definitions to base pattern 2023-02-03 10:47:51 +01:00
PatchOfScotland
64aaf46196 standardised event construction and validation a bit more 2023-02-02 17:41:18 +01:00
PatchOfScotland
636d70f4e8 added python handler, and reworked handler and conductor event/job discovery to be more modular 2023-02-01 17:43:16 +01:00
PatchOfScotland
5acb8c230e tidied up job creation a bit more 2023-02-01 15:04:06 +01:00
PatchOfScotland
deb24f33ff updated conductor so it updates job meta files with statues 2023-02-01 11:25:03 +01:00
PatchOfScotland
a2abf91e7e updated job creation to be written to files, which are then read and executed 2023-01-31 18:03:11 +01:00
PatchOfScotland
64452e3f03 added support for multiple sweeps 2023-01-31 17:17:44 +01:00
PatchOfScotland
69cf90554d moved notebook declarations to tests/shared.py 2023-01-31 16:09:16 +01:00
PatchOfScotland
f4c31b13df added cvery brief descriptions to tests 2023-01-31 15:49:29 +01:00
PatchOfScotland
adfce30508 created shared file for some test fucntions 2023-01-31 14:52:03 +01:00
PatchOfScotland
31d06af5bf added rudimentary conductor for job execution 2023-01-26 13:47:17 +01:00
PatchOfScotland
226bf7a7f9 updated event dict to always include path, should be more future proof 2023-01-16 14:41:06 +01:00
PatchOfScotland
2cd92c04fa some cleanup of unneeded imports and other small cleanups 2023-01-13 18:15:15 +01:00
PatchOfScotland
d9004394c1 refactored monitor handler interaction to better allow differing event types in same system 2023-01-13 18:04:50 +01:00
PatchOfScotland
5dded8fc96 added test for complete execution 2023-01-10 13:34:41 +01:00
PatchOfScotland
ea9a689b26 added support for multi-type waiting plus some cleanup 2022-12-15 11:31:51 +01:00
PatchOfScotland
380f7066e1 added watchdog file monitoring 2022-12-13 14:59:43 +01:00
PatchOfScotland
ccaca5e60e added mig_meow rule creation 2022-12-02 14:05:49 +01:00