PatchOfScotland
|
d3eb2dbf9f
|
added standardised job creation
|
2023-04-22 21:48:33 +02:00 |
|
PatchOfScotland
|
f306d8b6f2
|
updated runner structure so that handlers and conductors actually pull from queues in the runner. changes to logic in both are extensive, but most individual functinos are unaffected. I've also moved several functions that were part of individual monitor, handler and conductors to the base classes.
|
2023-04-20 17:08:06 +02:00 |
|
PatchOfScotland
|
b87fd43cfd
|
setup for rework of monitor/handler/conductor interactions
|
2023-04-18 16:24:08 +02:00 |
|
PatchOfScotland
|
ddca1f6aa4
|
integrated threadsafe status updates
|
2023-04-18 13:50:20 +02:00 |
|
PatchOfScotland
|
3f28b11be9
|
added a proper version of job update protection
|
2023-04-14 16:15:36 +02:00 |
|
PatchOfScotland
|
9aa8217957
|
undid last commit as it would prevent anything ever being removed
|
2023-04-14 15:44:31 +02:00 |
|
PatchOfScotland
|
2bba56fdf8
|
updated status updating to merge in a more accomodating manner
|
2023-04-14 15:40:42 +02:00 |
|
PatchOfScotland
|
c57198919b
|
added functions to update job status files in a threadsafe manner
|
2023-04-14 15:28:27 +02:00 |
|
PatchOfScotland
|
547d5fefce
|
refactored correctness dir away from core sub dir into either functionality or core as appropriate
|
2023-03-31 15:55:16 +02:00 |
|
PatchOfScotland
|
5952b02be4
|
added support for directory event matching
|
2023-03-31 13:51:14 +02:00 |
|
PatchOfScotland
|
14dec78756
|
condensed hint messages a bit
|
2023-03-31 12:55:29 +02:00 |
|
PatchOfScotland
|
6b532e8a70
|
added more hinting to pattern validation messages
|
2023-03-31 12:51:12 +02:00 |
|
PatchOfScotland
|
cea7b9f010
|
removed rogue recipe script
|
2023-03-31 11:42:12 +02:00 |
|
PatchOfScotland
|
0c6977ecd3
|
standardised naming of test recipe scripts
|
2023-03-31 11:41:38 +02:00 |
|
PatchOfScotland
|
18d579da22
|
added tests for new bash jobs, and removed extra hash definition in job dict
|
2023-03-30 14:20:29 +02:00 |
|
PatchOfScotland
|
311c98f7f2
|
rewored rules to only invoke base rule, and added bash jobs
|
2023-03-30 11:33:15 +02:00 |
|
PatchOfScotland
|
747f2c316c
|
added type hinting for new functions
|
2023-03-16 15:30:37 +01:00 |
|
PatchOfScotland
|
9bf62af31a
|
added functions from runner to get monitor, handler and conductors
|
2023-03-16 14:50:04 +01:00 |
|
PatchOfScotland
|
f1f16ca3b8
|
added naming to monitors, handlers and conductors so runners can identify them, in prep for in-workflow modification of patterns and recipes'
|
2023-03-16 13:53:01 +01:00 |
|
PatchOfScotland
|
9547df7612
|
added -s option to test to skip time consuming tests. also updated readme accordingly
|
2023-03-16 13:25:44 +01:00 |
|
PatchOfScotland
|
a7f910ecff
|
updated regex used in wildcard matching in file monitor to work on windows because why would things work on all systems
|
2023-03-15 15:16:38 +01:00 |
|
PatchOfScotland
|
23e9243b69
|
updated benchmarks ref in readme
|
2023-03-15 11:40:07 +01:00 |
|
PatchOfScotland
|
1f858e1a46
|
added note to readme about seperate benchmarking package
|
2023-03-15 11:21:32 +01:00 |
|
PatchOfScotland
|
a7224430e9
|
moved benchmarking to its own meow_benchmarks package
|
2023-03-15 11:16:14 +01:00 |
|
PatchOfScotland
|
ede29f3158
|
reformated imports for pep8 compatability
|
2023-03-14 15:12:22 +01:00 |
|
PatchOfScotland
|
af489d2bb9
|
added test for get_recipe_from_notebook
|
2023-03-14 13:39:01 +01:00 |
|
PatchOfScotland
|
40ed98000b
|
reformatted imports to work better on other machines, plus added benchmarking to project
|
2023-03-13 11:32:45 +01:00 |
|
PatchOfScotland
|
c01df1b190
|
added test to check that adding pattern and recipe to monitor behaves correctly
|
2023-03-07 16:34:49 +01:00 |
|
PatchOfScotland
|
486c92f6da
|
cleared up test_runner
|
2023-02-24 10:38:02 +01:00 |
|
PatchOfScotland
|
b9063e1743
|
added requirements file
|
2023-02-20 14:18:22 +01:00 |
|
PatchOfScotland
|
8e34a50891
|
added implemenation and test for module versioning
|
2023-02-15 00:41:39 +01:00 |
|
PatchOfScotland
|
fcd897f2ff
|
added requirement tests
|
2023-02-14 18:58:37 +01:00 |
|
PatchOfScotland
|
4d29ced83d
|
added test for reqs structuring
|
2023-02-13 19:34:32 +01:00 |
|
PatchOfScotland
|
6d92ce9fdb
|
added comment to parameter sweep function
|
2023-02-11 23:51:23 +01:00 |
|
PatchOfScotland
|
7dd654bb8c
|
added a parameter sweep execution test
|
2023-02-11 23:27:03 +01:00 |
|
PatchOfScotland
|
59c352904b
|
added helper function to create parameter sweep, plus appropriate test
|
2023-02-11 23:12:18 +01:00 |
|
PatchOfScotland
|
9b744e9afe
|
resolved circular dependencies in validation by splitting meow off too
|
2023-02-10 18:40:15 +01:00 |
|
PatchOfScotland
|
89a0700e1d
|
split up meow tests
|
2023-02-10 16:28:55 +01:00 |
|
PatchOfScotland
|
6fab2f7a10
|
also refactored core.meow into seperate files in hope that it'll help solve circular imports
|
2023-02-10 16:23:24 +01:00 |
|
PatchOfScotland
|
b8885146fa
|
added missing return call in new id generation funcs
|
2023-02-10 15:33:01 +01:00 |
|
PatchOfScotland
|
7059a7340d
|
seperated out rule and job id generation
|
2023-02-10 15:09:51 +01:00 |
|
PatchOfScotland
|
908ecf9950
|
split up functionality tests into different classes per file
|
2023-02-10 15:00:04 +01:00 |
|
PatchOfScotland
|
7f8b4f3e32
|
split functionality file across new module as was getting too long on its own. All functions remian the same, but imports will need to be updated.
|
2023-02-10 14:46:46 +01:00 |
|
PatchOfScotland
|
dfd83e28dc
|
removed some rogue print statements
|
2023-02-10 11:05:44 +01:00 |
|
PatchOfScotland
|
c0411c43a4
|
added tests for handlers and conductors validating events and jobs
|
2023-02-09 17:29:21 +01:00 |
|
PatchOfScotland
|
abffeed9db
|
added some more tests for job execution and ensured an error file is always produced but failed jobs
|
2023-02-09 16:10:10 +01:00 |
|
PatchOfScotland
|
a2df62c693
|
reformted jobs being passed to conductors so they only get a job directory and have to read the definitions from the appropriate files
|
2023-02-09 15:22:26 +01:00 |
|
PatchOfScotland
|
1eb022f79e
|
added comments to local python constructor
|
2023-02-09 09:36:22 +01:00 |
|
PatchOfScotland
|
d0a824c80f
|
cleaned up a few loose imports no longer needed and commented out code
|
2023-02-09 09:28:42 +01:00 |
|
PatchOfScotland
|
d918a1bdc1
|
accomdated windows differing connection types in wait function
|
2023-02-08 15:44:26 +01:00 |
|
PatchOfScotland
|
d9df9c3cb2
|
resolved merge conflicts
|
2023-02-08 15:37:12 +01:00 |
|
Patch
|
a5191e351b
|
Merge pull request #2 from toppggg/Windows1
Windows
|
2023-02-08 15:32:15 +01:00 |
|
PatchOfScotland
|
a1451881ae
|
updated code so should work on windows, with exception of waiting on multiple connections
|
2023-02-08 14:46:03 +01:00 |
|
PatchOfScotland
|
d787e37adc
|
added a few more comments
|
2023-02-03 16:29:49 +01:00 |
|
PatchOfScotland
|
d823b50fc9
|
added a very small readme
|
2023-02-03 16:24:54 +01:00 |
|
PatchOfScotland
|
9435d500db
|
added a few more tests, most notably of python execution
|
2023-02-03 16:07:09 +01:00 |
|
PatchOfScotland
|
bc7a043225
|
removed fake watchdog events as they were uncessary, and added a few more tests for good measure
|
2023-02-03 15:14:43 +01:00 |
|
PatchOfScotland
|
47f9fe73fa
|
differentiated papermill and python jobs more clearly
|
2023-02-03 14:47:16 +01:00 |
|
PatchOfScotland
|
72d6b263b7
|
removed surplus imports
|
2023-02-03 10:50:18 +01:00 |
|
PatchOfScotland
|
1b638ec496
|
moved sweep definitions to base pattern
|
2023-02-03 10:47:51 +01:00 |
|
PatchOfScotland
|
64aaf46196
|
standardised event construction and validation a bit more
|
2023-02-02 17:41:18 +01:00 |
|
PatchOfScotland
|
636d70f4e8
|
added python handler, and reworked handler and conductor event/job discovery to be more modular
|
2023-02-01 17:43:16 +01:00 |
|
PatchOfScotland
|
5acb8c230e
|
tidied up job creation a bit more
|
2023-02-01 15:04:06 +01:00 |
|
PatchOfScotland
|
deb24f33ff
|
updated conductor so it updates job meta files with statues
|
2023-02-01 11:25:03 +01:00 |
|
PatchOfScotland
|
d08b8ce8c4
|
tidied up python job_func a bit
|
2023-01-31 18:06:36 +01:00 |
|
PatchOfScotland
|
a2abf91e7e
|
updated job creation to be written to files, which are then read and executed
|
2023-01-31 18:03:11 +01:00 |
|
PatchOfScotland
|
bb7c4af1e5
|
added files missed from last commit
|
2023-01-31 17:18:03 +01:00 |
|
PatchOfScotland
|
64452e3f03
|
added support for multiple sweeps
|
2023-01-31 17:17:44 +01:00 |
|
PatchOfScotland
|
69cf90554d
|
moved notebook declarations to tests/shared.py
|
2023-01-31 16:09:16 +01:00 |
|
PatchOfScotland
|
c2330f23d3
|
added test directories to gitignore
|
2023-01-31 15:54:19 +01:00 |
|
PatchOfScotland
|
f4c31b13df
|
added cvery brief descriptions to tests
|
2023-01-31 15:49:29 +01:00 |
|
PatchOfScotland
|
adfce30508
|
created shared file for some test fucntions
|
2023-01-31 14:52:03 +01:00 |
|
PatchOfScotland
|
b95042c5ca
|
added comments throughout
|
2023-01-31 14:36:38 +01:00 |
|
PatchOfScotland
|
31d06af5bf
|
added rudimentary conductor for job execution
|
2023-01-26 13:47:17 +01:00 |
|
PatchOfScotland
|
75de8147be
|
updated event dict to always include path, should be more future proof
|
2023-01-20 11:03:16 +01:00 |
|
PatchOfScotland
|
226bf7a7f9
|
updated event dict to always include path, should be more future proof
|
2023-01-16 14:41:06 +01:00 |
|
PatchOfScotland
|
be2a9beff3
|
added interaction for monitor state updating
|
2023-01-15 13:44:53 +01:00 |
|
PatchOfScotland
|
6ab9c84745
|
added support for retroactive event recognition
|
2023-01-15 10:57:44 +01:00 |
|
PatchOfScotland
|
eabedb4747
|
moved runner to own file as will be heavily expanded
|
2023-01-15 10:10:29 +01:00 |
|
PatchOfScotland
|
ee81b2561e
|
added support for multiple monitors and handlers
|
2023-01-13 18:53:02 +01:00 |
|
PatchOfScotland
|
2cd92c04fa
|
some cleanup of unneeded imports and other small cleanups
|
2023-01-13 18:15:15 +01:00 |
|
PatchOfScotland
|
d9004394c1
|
refactored monitor handler interaction to better allow differing event types in same system
|
2023-01-13 18:04:50 +01:00 |
|
PatchOfScotland
|
e9519d718f
|
added parameter sweeps back in
|
2023-01-10 16:44:33 +01:00 |
|
PatchOfScotland
|
5dded8fc96
|
added test for complete execution
|
2023-01-10 13:34:41 +01:00 |
|
PatchOfScotland
|
ea9a689b26
|
added support for multi-type waiting plus some cleanup
|
2022-12-15 11:31:51 +01:00 |
|
PatchOfScotland
|
380f7066e1
|
added watchdog file monitoring
|
2022-12-13 14:59:43 +01:00 |
|
PatchOfScotland
|
4041b86343
|
added generic rule generation
|
2022-12-12 11:01:26 +01:00 |
|
PatchOfScotland
|
ccaca5e60e
|
added mig_meow rule creation
|
2022-12-02 14:05:49 +01:00 |
|
PatchOfScotland
|
00b5449089
|
added files missed by last commit
|
2022-12-02 13:15:17 +01:00 |
|
PatchOfScotland
|
07ceca0061
|
added bones of mig_meow pattern and recipe implementations
|
2022-12-02 13:14:33 +01:00 |
|
PatchOfScotland
|
9dd2d0c209
|
initial commit with barebones project structure
|
2022-11-29 17:15:14 +01:00 |
|
Patch
|
f940354be4
|
Initial commit
|
2022-11-29 13:46:29 +01:00 |
|