Presenter: Christian Presley, EIT, FNL

This presentation will demonstrate how to run open-weight language models on an HPC cluster using Ollama from the command line and through Open OnDemand (OOD), as well as how to connect with VS Code Remote SSH and pass through to a Slurm compute session. While Slurm is not designed as a dedicated or production-scale inference platform, these workflows can be useful for model exploration, coding, testing, and small-scale experimentation.

This will be a hybrid event. Please register at this link.

This session will be recorded, and materials will be shared with attendees a few days after the event.

For additional details and questions, please contact Natasha Pacheco (natasha.pacheco@nih.gov), Advanced Biomedical Computational Science group, Frederick National Laboratory for Cancer Research.