Open Source Heartbeat

vsoch pushed to singularityhub/shpc-registry

Merge pull request #294 from singularityhub/update/containers-2025-01-20

[bot] update/containers-2025-01-20

vsoch commented on issue oras-project/oras-py#181.

Since these are docs, I think a good strategy would be to leave the original example, but add the second line with a comment explaining the use case….

vsoch pushed to rseng/software

Merge pull request #406 from rseng/update/software-2025-01-19

Update from update/software-2025-01-19

vsoch commented on kubeflow/website

vsoch pushed to hpc-social/good-first-issues

unpin ruby/setup-ruby action version

Merge pull request #8 from converged-computing/add-other-types

feat: support for other types

ci: add tests for fluxqueue (#6)

ci: add tests for fluxqueue
refactor build to be in parallel

Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch commented on issue oras-project/oras-py#180.

If you found a way that works, why would you be doing something wrong?…

vsoch commented on issue apptainer/apptainer#2706.

> I don’t know how to get the container you reference to get a python tensorflow installation….

vsoch commented on issue vsoch/citelang#54.

That sounds like a bug! Do you want to take a shot at a PR to fix it?…

vsoch pushed to flux-framework/fluxion-go

feat and ci: grow support with updated branch

This currently uses a custom branch, and will need to be updated when merged into flux-sched. This last change updates the CI to use the latest noble image, and adds back the shrink support and test.

Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch commented on issue flux-framework/flux-sched#1316.

This is tested (and the basics are working in fluxion-go)! :partying_face: …

vsoch commented on issue expfactory/expfactory#179.

Thanks! You will need to make sure tests pass, and please ping me if you need me to look at something….

vsoch pushed to singularityhub/singularity-hpc

Revert “Introducing version_naming property that makes modulefile as version

vsoch commented on issue oras-project/oras-py#180.

Feel free to contribute to the project to flx documentation or the defaults. Thanks!…

vsoch commented on issue oras-project/oras-py#180.

My suggestion is to make an auth backend that explicitly matches what the registry needs. That was the reason for the redesign of auth generally - getting all these different flows to work with just one implementation is near impossible….

vsoch commented on kubeflow/website

vsoch pushed to converged-computing/flux-service

eks: amazonlinux2023 testing done

The EFA works on the node and in the container, at the same time! The performance seems to be trivially impacted.

Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch pushed to conda-forge/urlchecker-feedstock

Rebuild for CFEP-25 noarch: python syntax (#20)

update to CFEP-25 noarch: python syntax
MNT: Re-rendered with conda-build 24.11.2, conda-smithy 3.45.2, and conda-forge-pinning 2025.01.11.16.15.44

vsoch pushed to conda-forge/gridtest-feedstock

Merge pull request #5 from regro-cf-autotick-bot/noarch_python_min-migration-1_h0ebd88

Rebuild for CFEP-25 noarch: python syntax

Merge pull request #1 from converged-computing/test-google-builds

wip: testing packer for google cloud

vsoch created a new branch, main at converged-computing/flux-service

View Repository

vsoch pushed to rseng/software

Merge pull request #405 from rseng/update/software-2025-01-12

Update from update/software-2025-01-12

docs: fix typos and function headers

Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch released 0.1.31.

## What’s Changed

Introducing version_naming property that makes modulefile as version

vsoch commented on issue singularityhub/singularity-hpc#679.

@Amjadhpc you’ll need to go up to 0.1.31 now - we had another PR merge in this morning….

vsoch opened a pull request to converged-computing/fluxqueue

vsoch pushed to conda-forge/qme-feedstock

Merge pull request #3 from regro-cf-autotick-bot/noarch_python_min-migration-1_h654fa6

Rebuild for CFEP-25 noarch: python syntax

vsoch commented on issue rootless-containers/usernetes#362.

@AkihiroSuda I’m not sure this helps, but when using the public address, the internal DNS still does not appear to be working. This is ubuntu 24.04 on Azure, and something I noticed is that there is a systemd service for resolv.conf. E.g., here is what is running: …

vsoch pushed to researchapps/nextflow

flux-executor: add simple test case for jobid with f

Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch pushed to flux-framework/spack

toybox: depend on virtual zlib (#48486)

vsoch commented on issue flux-framework/fluxion-go#14.

> Sure that my knowledge of programming such things was different, so I might just have made mistakes on my own …

scheduler and queue: start of work (#3)

scheduler and queue: start of work

We need a very simple custom scheduler plugin to receive and deploy (bind) node assignments, and we will do that with the fluxqueue-scheduler I am adding here. The queue will live alongside the controller and interact with the fluxion service, and I have added the skeleton for that (which needs a lot of work, but it is building so this is a great start!

wip: addition of queue logic

This is a WIP to save state of primarily the main.go/sum because it is currently building, of course still needs a lot of work on the code!

queue: job pod is added to queue

Fluxion is also added and serving the cluster.

fluxion submit is working!

We next need to unsuspend/ungate the pod to send to the fluxion custom scheduler, and also implement logic to react to different kubernetes events.

feat: the full cycle to schedule a pod is working

Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch pushed to converged-computing/flux-usernetes

update state of usernetes on azure

Signed-off-by: vsoch vsoch@users.noreply.github.com

test: ubuntu 24.04 build (#7)

Signed-off-by: vsoch vsoch@users.noreply.github.com Co-authored-by: vsoch vsoch@users.noreply.github.com

vsoch closed issue vsoch/opensource-art#46.

Better License ...

also here… Why not letting the big guys pay for your art? think the OCTL license would fit better to it. …View Comment

vsoch closed issue vsoch/cdb#8.

Better License

Hey just found your project. I think the OCTL license would fit better to it. …View Comment

vsoch commented on singularityhub/singularity-hpc

vsoch commented on issue rootless-containers/usernetes#361.

Thank you for the speedy review!…

vsoch created a new branch, update-flux-job-regex at researchapps/nextflow

View Repository

vsoch commented on nextflow-io/nextflow

vsoch pushed to converged-computing/flux-usernetes

feat: add custom build of infiniband with ubuntu 24.04

Because Microsoft is only providing an image from 2022… :/

Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch open issue converged-computing/flux-tutorials#6.

Add ubuntu 24.04 VM image

Microsoft wouldn’t do it, so I made one. And it works, and everything installed is transparent and without the extra software (and proprietary software) bloat. I’ll add it later this week….View Comment

vsoch commented on issue vsoch/citelang#54.

It’s likely related to the parsing of dependencies in a specific order, and then taking into account the weights. I would look into that first….

vsoch opened a pull request to spack/spack

vsoch commented on issue singularityhub/singularity-hpc#679.

I agree it’s not good to duplicate functionality, but in that views adds complexity (and this change makes it possible to generate the default with versions) I’m wondering if this isn’t a good addition regardless….

vsoch pushed to singularityhub/shpc-registry

Delete quay.io/pawsey/cuda-hpc-python directory

Signed-off-by: Vanessasaurus <814322+vsoch@users.noreply.github.com>

vsoch open issue rootless-containers/usernetes#362.

Question: debugging private net in containers

Hi @AkihiroSuda - we have a setup on Azure where the private network addresses stopped working from inside the container. For basic FYI, I can ping or curl the 6443 server from the outside, but then when I make shell the same requests hang. I can’t have any of the workers connect to the control plane, of course. …View Comment

vsoch pushed to researchapps/usernetes

cni-plugins: update to v1.6.2

problem: release 1.6.1 no longer has the targz for most platforms solution: update to release 1.6.2, released on 1/6/2024 Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch commented on issue opencontainers/specs.opencontainers.org#9.

@ssst0n3 looks like ruby might need a version bump too….

vsoch pushed to flux-framework/spack

Update from update-package/flux-core-2025-01-08 (#286)

Automated deployment to update package flux-core 2025-01-08
Add back 0.67.0 and py-ply
Update package.py

Co-authored-by: github-actions github-actions@users.noreply.github.com Co-authored-by: Vanessasaurus <814322+vsoch@users.noreply.github.com>

vsoch pushed to flux-framework/flux-framework.github.io

Merge pull request #135 from flux-framework/release-docs-2025-01-08

Update from release-docs-2025-01-08

fluxion submit is working!

We next need to unsuspend/ungate the pod to send to the fluxion custom scheduler, and also implement logic to react to different kubernetes events.

Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch pushed to converged-computing/aks-infiniband-install

feat: add usernetes install

Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch commented on issue prefix-dev/pixi#2838.

Gotcha - I assumed it was related to the solver not solving. I wound up doing a new build and not using pixi, so we can close this issue….

vsoch commented on issue expfactory/expfactory#179.

This library is fairy old, and the dependency versions could use an update! If you want to open a PR with the changes and then share the trace for the later crash, likely it is also fixable. Debugging is just a logical process of working through these bugs carefully. …

queue: job pod is added to queue

Fluxion is also added and serving the cluster.

Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch commented on singularityhub/singularity-hpc

vsoch open issue prefix-dev/pixi#2838.

Install gromacs with cuda

I’m trying to install gromacs with cuda, specifically:…View Comment

vsoch commented on issue prefix-dev/pixi#2838.

I’m trying this in the pixi.toml:…

vsoch commented on issue expfactory/expfactory#179.

There are a lot of ideas if you Google search for those errors - please debug them and report back….

vsoch pushed to conda-forge/watchme-feedstock

Rebuild for CFEP-25 noarch: python syntax (#4)

update to CFEP-25 noarch: python syntax
MNT: Re-rendered with conda-build 24.11.2, conda-smithy 3.45.1, and conda-forge-pinning 2025.01.06.12.46.45

vsoch commented on singularityhub/singularity-hpc

vsoch pushed to rseng/software

Merge pull request #404 from rseng/update/software-2025-01-05

Update from update/software-2025-01-05

vsoch open issue flux-framework/fluxion-go#14.

Feature: (and question) error messages associated with specific request

Apologies in advance if I’m overthinking this! I think there are two issues to work on: …View Comment

wip: addition of queue logic

This is a WIP to save state of primarily the main.go/sum because it is currently building, of course still needs a lot of work on the code!

Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch pushed to converged-computing/fluxion

Merge pull request #4 from converged-computing/cleanup-match

match: remove unused variable count

vsoch pushed to conda-forge/rse-feedstock

Rebuild for CFEP-25 noarch: python syntax (#16)

update to CFEP-25 noarch: python syntax
MNT: Re-rendered with conda-build 24.11.2, conda-smithy 3.45.1, and conda-forge-pinning 2025.01.03.14.12.46

vsoch pushed to conda-forge/deid-feedstock

Merge pull request #46 from regro-cf-autotick-bot/noarch_python_min-migration-1_h28972a

Rebuild for CFEP-25 noarch: python syntax

vsoch opened a pull request to converged-computing/fluxqueue

vsoch commented on kubernetes-sigs/jobset

Merge pull request #2 from converged-computing/add-fluxion

fluxion: add service to provide scheduler

vsoch pushed to conda-forge/singularity-hpc-feedstock

Rebuild for CFEP-25 noarch: python syntax (#47)

update to CFEP-25 noarch: python syntax
MNT: Re-rendered with conda-build 24.11.2, conda-smithy 3.45.1, and conda-forge-pinning 2025.01.02.20.43.49

vsoch commented on issue spack/spack#48341.

> Unfortunately that also means that files that were added in the middle of 2024 with a copyright header year of 2023 were not flagged until today… …

vsoch commented on issue singularityhub/singularity-hpc#679.

@Amjadhpc could you please add a test that enables the new setting and ensures it produces the right output? And @muffato I’m interested in your feedback here since you are correct views could be an alternative solution….

vsoch pushed to flux-framework/spack

Automated deployment to update package flux-sched 2025-01-02

vsoch merged a pull request to flux-framework/spack

vsoch pushed to Amjadhpc/singularity-hpc

Ran black to format the indenting

vsoch commented on issue rseng/zenodo-release#17.

> Thanks for the explanation about the branch. I was not aware of this technicality. Should I reopen this PR as a branch directly? …

vsoch commented on issue flux-framework/spack#245.

I think I fixed it, see #274 …

vsoch opened a pull request to flux-framework/spack

vsoch commented on issue flux-framework/flux-core#6535.

Thank you! I should be able to test this out again toward the end of the week (it was for the Azure setup)….

vsoch open issue flux-framework/flux-core#6535.

flux hostlist: return only those available

I have a cluster with a lot of faux “down” nodes, and I want to get the set that is up. I thought I could use avail|available as one of SOURCES so I tried both …View Comment

vsoch opened a pull request to converged-computing/flux-usernetes

azure: add usernetes scripts

Signed-off-by: vsoch vsoch@users.noreply.github.com

azure: ensure we source hpcx environment before install

Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch pushed to rseng/software

Merge pull request #403 from rseng/update/software-2024-12-29

Update from update/software-2024-12-29

vsoch pushed to converged-computing/flux-distribute

aws: add 30 node experiment

Signed-off-by: vsoch vsoch@users.noreply.github.com

bug: vmset is not reliable with hostnames (#3)

bug: vmset is not reliable with hostnames

We cannot be guaranteed that the lead broker is flux00000 so we need to provide automation to update/fix the issue. I am also adding a script for OSU to install the benchmarks

Signed-off-by: vsoch vsoch@users.noreply.github.com

vsoch pushed to flux-framework/spack

freeglut: add v3.6.0 (#48292)

freeglut: add v3.6.0
Change the version range for the patch

Co-authored-by: jmcarcell jmcarcell@users.noreply.github.com

vsoch commented on issue singularityhub/singularity-hpc#678.

@Amjadhpc that is a very reasonable feature request! Are you able to develop in Python or would you need help? You’d want to add a setting to settings.yaml that is something akin to version_naming and then a boolean that defaults to false (to preserve current behavior) and if true, you’d want to tweak the install path to instead of creating a directory with the version, to have it write a file with the module extension to that path instead. Let me know if you would like to give that a try and open a PR. Happy Holidays!…

vsoch merged a pull request to singularityhub/shpc-registry

vsoch merged a pull request to flux-framework/spack

vsoch commented on issue flux-framework/flux-core#5326.

Worked! …

vsoch commented on issue converged-computing/flux-tutorials#1.

@wkharold this is fully working to build and deploy, and (if/when you have bandwidth) the cleanup (without my custom delete.sh script) doesn’t fully work - there looks like something circular going on with foundation vs. the instances subnetwork….

vsoch closed a pull request to flux-framework/spack