The following are a subset of projects, primarily recent, that I remember to add here. You can also see archived work that I don’t intend to work on anytime soon. If you want to see recent work or a better representation of my open source contributions, please see my profile on GitHub.
Recent Projects
- Metrics Operator: Kubernetes operator for deploying HPC apps and metrics in K8s
- Flux Operator: Kubernetes operator for Flux
- kubescaler: Tool for autoscaling studies in Kubernetes
- The Action Updater: for GitHub action syntax and versions
- Spack Updater: Helper to maintain and update Spack packages
- tunel: apps and launchers for HPC
- pipelib: easily parse, sort, fitler Docker tags or software releases
- oras-py: ORAS Python client
- Research Software Engineering Operations: Community, resources, and knowledge
- CiteLang: nested credit for software
Containers
- singularity-hpc (shpc): Singularity containers as modules for hpc, including a community library of community containers.
- singularity-compose: orchestration for Singularity containers.
- Singularity Registry: serve your own registry of Singularity containers [software][paper]
- spython: Singularity Python Client
- docker2singularity: convert Docker containers to Singularity using Docker
- singularity-docker: Singularity in Docker, served from quay.io
- ContainerTree: data structures and visualizations for understanding containers
- ContainerTools: suite of tools for containers
- Containershare: containershare for Sherlock
- Singularity Registry Global Client: local client to manage Singularity containers.
- Singularity Hub: cloud builders for Singularity containers [software]
- Singularity (2016-2018): developing tools and applications for container based analyses [software]
Developer Community
- Developer Stories: (rebranded RSE Stories)
- RSE Stories: (renamed) Research Software Engineer Stories (article on bssw)
- The Stanford Software Survey: to assess software and community needs for research software engineering.
- Research Software Encyclopedia: taxonomy, criteria, and software showcase.
- Research Software Encylclopedia: database.
- Open Source Heartbeat action: to showcase your contributions.
- RSE-roles: a small collection of research software engineer job descriptions
- RSE phenotype generator: Create a graphic that shows the communities and skills that represent you as a research software engineer.
- Remote Bingo: to have fun with your virtual co-workers.
- Starter Pack: to creating a local RSE chapter or community.
- RSE Map: Where can we find us-rse community members?
- RSE Blog: A community syndicated blog.
Presentations
- Compatibility for HPC: A Story of Rainbows and Schedulers. HPCNow Knowledge Meeting 2024
- Application Building in Kubernetes: Kubecon Chicago 2023 and CNCF Announcement and the talk
- Open Source Introspection: 2023 UC Open Source Symposium Keynote
- Cloud and HPC Convergence: Flux for Job Management on Kubernetes, HPC Knowledge Meeting 2023
- The hpc.social project: at the annual EasyBuild user's meeting.
- Talk on the Flux Operator: (recorded video|conference video) Kubecon in Amsterdam, 2023.
- The Software Complexity Puzzle: talk at CU Boulder, 2022.
- The Research Software Engineer Movement: talk at the 2022 EasyBuild users meeting.
- SeptembRSE Keynote: The Stories We Tell Ourselves
- Research Software Engineers: A New Career: January 6, 2020 at the UIT Unconference
- Singularity Registry HPC (shpc): and at the US-RSE Virtual Conference May, 2021
- Adding an Executor to Airflow, a Contributor Overflow Exception: July 24, 2020
- Containers Story: November 2020
- Twas the Night Before SC Lightning Talk: November 2020 (and Science Slam)
- Singularity Container on Google Cloud Platform Tutorial
- Stanford Campus IT Plan Research Summit 2020: February 18, 2020
- SORSE: Research Software Directories, What, Why, and How: September 17, 2020
- Extensions to Schema.org for structured, semantic, and executable research documents: September 24, 2020
- Developer Productivity at the 2020 Collegeville Workshop July 18, 2020
- GitHub Lightning Talk, urlchecker: May 6, 2020
- Data Containers, Talk at DataVerse 2020 Encapsulation section: August 5, 2020
Projects
- The Candy Generator: for open source Halloween fun!
- spack-monitor: A Spack monitoring service, including a database and interface for collecting metadata about builds.
- spack-search: A static and dockerized search application for specific strings in spack search code.
- deid: best effort anonymization for dicom
- uptodate: for automated GitHub container builds
- spliced: Run experiments to make predictions for ABI
- gosmeagle: ABI corpora extraction in Python
- gosmeagle: ABI corpora extraction in Go
- The Chonker Awards: Automatically updating interface to show the largest files across my GitHub repositories.
- caliper: a tool for measuring and assessing change in packages
- JuliArt for generative art
- Url Checker: A command line client and GitHub action to check URLs in static files
- Snakeface: A prototype interface for running Snakemake
- Tributors: pay tribute to your contributors!
- QueueMe: reproducible job submission dashboard
- gridtest: grid parameterization for testing and general use
- helpme: command line program for helping you out
- askci: version controlled, programmatic, collaborative documentation server
- freegenes: lab management portal
- WatchMe: reproducible monitoring
- The Scientific Filesystem (scif): a filesystem organization for scientific software and metadata [client] [RRID]
- Snakemake Google Life Sciences Executor
- Stanford Research Computing Lessons: Lessons and tutorials for HPC
- Dinosaur Datasets: Open Source Datasets
- OpenBases: templates that use Github+CircleCI for easy, reproducible research
- OpenSchemas: Tools to interact with and develop specifications for schema.org
- The Experiment Factory: reproducible experiment containers [library] [RRID]
- The Robots I just needed over 15K of them. Don't judge.
- Pokemon Ascii: avatar generator [Github]
- Service Worker Resource Saved [demo]
- Banner: Custom banner creation (created for a virtual machine for a publication)
- Wordfish: tools for finding relationships in corpus from terminologies [details]
Also see archived work.