IRC channel logs


back to list of logs

<rekado>yesterday I wanted to add some progress monitoring to PiGx and looked into what snakemake has to offer there.
<rekado>I’m not too happy with what I found, and I wonder how GWL could improve on it.
<rekado>snakemake can send its output in structured form to an API endpoint, but it will hang (and crash the workflow) when the API endpoint disappears
<rekado>it also pushes *everything* to that endpoint; all output, debug level as well as progress info.
<rekado>it doesn’t provide enough information to the API to allow the service to identify the workflow that reports on progress.
<rekado>I was thinking that the lo-fi approach might be better suited to this problem: let the workflow itself produce a status JSON blob that describes the full workflow and the current status of each step
<rekado>a monitoring server can then ask the workflow about the current status
<PurpleSym>Urgh, another RStudio quirks: If you want to run it behind a reverse proxy, it will only respect the Forwarded header, if you run it somewhere else than /. And the official documentation straight out raises the white flag and recommends using proxy_rewrite.
<PurpleSym>But it is always be respected when deciding to set cookies to HTTPS-only.
<rekado>I feel this very strong urge to … write a different Rstudio, using R like ESS does.
<rekado>and without the Java–>JavaScript translation
<rekado>but I know my limits
<efraim>wheeee julia package dump!
<PurpleSym>RStudio is a dumpster fire. But I heard Visual Studio code is getting increaset R support, so… ;)
<rekado>I really want to like RStudio; it clearly satisfies an itch that a lot of R users feel. But whenever I look at the implementation I can’t help but feel overwhelmed. I keep asking myself if all this complexity was a conscious choice, or if it was merely a consequence of the selected starting conditions.
<PurpleSym>Bad choices (dlopen+exec R), old codebase (GWT), overwhelmed by own success (1k open issues), at the same time trying to satisfy commercial customers, lots of R ecosystem side-projects… :/
<PurpleSym>They also effectively maintain two versions of RStudio, Open Source and “Pro”.
<PurpleSym>“There are 8 full time equivalent (FTE) employees developing the RStudio IDE desktop and server products as of December 2020.” (
<civodul>woow, quite a lot of people
<roelj>rekado: For the GWL stuff: How would the JSON blob be updated to reflect the latest status of the workflow?
<rekado>roelj: by the runner
<rekado>we have a loop over the processes to be executed, so the “guix workflow” process knows what’s running and what isn’t .
<rekado>so it can do whatever is necessary to update the status
<roelj>rekado: But, how does a client read it? Just read a file that is periodically overwritten, or more like an HTTP endpoint?
<drakonis>no julia 1.6 yet?
<drakonis>and how come installing gwl with guix install does not enable it on the cli?
<drakonis>should i install it by adding it to a config file?