Hey. My too cents here. I am building DSCI - self hosted git with ci embedded . Suitable for small teams with limited VPS hosting, features:

• general programming languages for ci ( not YAML )

• super simple install and maintaining- everything is a single binary ( golang ) , ci jobs run on localhost/podman/docker

• no need extra runners / k8s / devops teams - everything is in dev hands through regular programming code - super simple

• ci SDK is available for bash/python/perl/raku/php/powershell/golang

It’s still in early development stage , but users can already play with it - here is demo stand - http://dsci.sparrowhub.io/

Documentation is available here - http://deadsimpleci.sparrowhub.io/ or GitHub - https://github.com/melezhik/DSCI

See installation page on podman specific setup … Pretty much the same as docker

But now when you have a YAML program as the first level abstraction how do you handle results between those multi language calls ? In DSCI this is achieved via states and normal functions , and everting is just a function on general purpose programming language, in YAML you need all these magic ( awkward ) YAML syntax to mimic all those things ( pass parameters , handle global variables , process user input , handle returned parameters , etc )

The issues you had just proves that YAML based CI approach always leads to troubles with time. And yeah, I have been there, code generators for YAML. Hundreds of lines for YAML pipelines, etc ))

It allows the CI engine to determine which jobs to start, what their steps are etc.

Yep, like a said , I don’t mind to have such a configuration inside YAML, but this should NOT be pipeline code itself )

… put those in separate scripts and call them from the YAML.

This is exactly what I try to avoid, cause:

1. many people (in my experience ) even don’t bother refactoring YAML spaghetti code to separate scripts and we end up unmaintainable codebase

2. and even if one has to do such a refactoring what is the point of using YAML at all ?

All I need just a collection of tasks/jobs written on languages of choice and I don’t need YAML “programming” language at all )

PS And btw I don’t mind having a minimal amount of YAML as configuration layer and this is what is presented in DSCI, but only minimal ))

it’s just because I think in real world we have a lot of tasks where state is required or extremely beneficial, some examples on top of my head:

• creation of virtual machines with dynamic IP addresses
• creation of bug tracking system tickets with unique ticket IDs
• looking up in databases where fetched records have unique IDs

etc

Ok, try to do it on GH actions, share states between tasks/jobs for example:

tasks/task_one/task.py

#!/usr/python3
update_state({
  'out1' : 'out1 value',
  'out2' : 'out2 value'
})

tasks/task_two/task.py

#!/usr/python3
dict = get_state()
print(dict["out1"])
print(dict["out2"])

Or share states between jobs:

jobs/job1/task.py

#!/usr/python3

update_state({
  'out1' : 'out1 value',
  'out2' : 'out2 value'
})

jobs/job2/task.py

dict = config()

print(dict["_dsci_"]["job1"]["out1"])
print(dict["_dsci_"]["job1"]["out2"])

I can’t imagine how much boilerplate code (if this ever possible ) one needs to write to achieve that on YAML based pipelines (GH Actions/ etc)

And don’t tell me about jobs artifacts ))

Only as high level glue , main logic is just normal programming languages - see here https://github.com/melezhik/DSCI/tree/main/examples

Here is SDK for those languages:

Raku Perl Bash Python Ruby Powershell Php Golang

UPDATE: so it’s not just hitting up a language from a pipeline , it’s full reach SDK, one writes a pipeline on a language, if I get your comment correctly

GH project link - https://github.com/melezhik/DSCI

GH project link - https://github.com/melezhik/doubletap for ones who are curious

This seems, at best, some general security checks but not mapped to any framework in particular.

So. Yes. Ssh access should be passwords only, etc. Some common sense. We don’t need standard to that

Thanks. This is going to be addressed here - https://github.com/melezhik/Sparrow6/issues/13

I probably need to add report example here …

Update - done in readme

I guess cause not every AI stuff is a bad and annoying thing .

Something started to happen to programming.dev see some posts with many downvotes but without any comments , so people don’t even bother to say what /why they don’t like , even in Reddit people usually comment even when they don’t like your posts and explain their point …

Update : or maybe this is just a c/programming tendency …