remote execution

[korovkin]

i am thinking about using goreman as a controller for job executions.

for example this one would run two jobs locally -

j1: curl "www.google.com" | process
j2: curl "www.yahoo.com" | process

and this one would run the job on a remote machine:

j1: curl "www.google.com" | process
j2: ssh w1 'curl "www.yahoo.com" | process'

what's the best way to achieve that?
also, is it possible to add handler for "on proc done" ?
(so i can use that event in order to clean up / copy out the result of the proc)

[gedw99]

Use a command and control system like NATS.

then write a nats client that can control Goreman. Deploy the nats client on your servers.

you can even embed the Goreman binary I side the nats client so that it spits out Goreman at startup time to disk .

Then you can start up 100’s of servers and via another nats client on your desktop of in GitHub action control how many instance of Goreman in what .

ypu can even send the process file across using Nat object storage !

[mattn]

Do you mean sequencial processes with j1 to j2 ?

[korovkin]

it has been 5 years :)

i wrote this -
https://github.com/korovkin/parallel

[gedw99]

the only reason I suggested nats is because it can run anything on remote servers.

you don’t event need to compile anything because the nats cli and a bash scriot can run Goreman prof file on other servers.