Talk to Us

To explore more about us, check out our about page.

Subscribe now

News

• NSF announces investment to shape the nation’s future data backbone

  CHTC’s Brian Bockelman will lead the development of FabAID, a five-year, $24.5 million National Science Foundation project designed to strengthen the nation’s data infrastructure for AI-driven science. Building on decades of CHTC expertise in distributed computing and data sharing, FabAID will connect researchers nationwide with the data, computing resources, and services they need. Read more about CHTC’s role in shaping the future of national cyberinfrastructure.

  

• OSG School Students Build HTC Skills to Advance Their Research

  This July, 61 researchers from 30 institutions gathered in Madison for the 10th OSG School, running 165,804 jobs (9.5 CPU years!) across the OSPool in just five days.

  

Story Highlights

• Found in translation at HTC26: Throughput computing addresses new needs in AI, astrophysics by Callie Kositzke

  For the fourth year in a row, High Throughput Computing Week (HTC) 2026 brought together researchers from around the world at UW-Madison to explore how throughput computing is enabling data-intensive science, from multi-messenger astrophysics to AI-driven biology.

  

• Three Scientists from the Vera C. Rubin Observatory Astronomy Community Present at HTC Week 2026 by Sophie Dorros

  The Vera C. Rubin Observatory, a facility jointly funded by the National Science Foundation and the U.S. Department of Energy’s Office of Science, is equipped with the largest digital camera ever built to produce high-resolution imagery of our solar system. Last June, the first images were revealed, data HTCondor helped process.

  This June at HTC26, three scientists from the Rubin Observatory community presented on how HTC and HTCondor helps them process data from the observatory to eventually produce images of our solar system.

  

• David Swanson Awardee Saloni Bhogale Presents at HTC Week 2026 by Sophie Dorros

  At HTC26, 2026 David Swanson Memorial Award recipient Saloni Bhogale shared how high throughput computing transformed her research on the effectiveness of legal institutions in the developing world.

  Bhogale leveraged HTC tools like HTCondor to run simulation studies to test new statistical methods at the intersection of causal inference and machine learning, enabling new insights into access to justice in India.

  

• A Day of Learning and Collaboration at CHTC for Summer Undergraduate Researchers by Sophie Dorros

  For the second consecutive year, CHTC welcomed undergraduate researchers from the UW–Eau Claire Blugold Center for High Performance Computing for a day of hands-on learning, networking, and collaboration.

  Through demonstrations, lightning talks, and discussions with CHTC staff, students explored how high throughput computing can accelerate research across a wide range of scientific disciplines

  

• Transforming Economic Research with High Throughput Computing by Sophie Dorros
  At HTC26, economist Ken Judd demonstrated how HTCondor enables researchers to tackle complex climate and economic models by breaking massive computational problems into smaller, parallel tasks. His work shows how high throughput computing can help economists better account for uncertainty in climate policy and unlock new approaches to large-scale modeling

  

  To explore previous news features, check out our news stories page here.

Upcoming Events

• Save the date for High Throughput Computing Week 2027 (HTC27)

  

  • Join us for HTC27, taking place June 8-11 in Madison, Wisconsin. Now in its fifth year, HTC27 will once again bring together the throughput computing community to discuss emerging challenges, highlight recent advances, and explore new opportunities for collaboration.

  • HTC27 offers users, developers, contributors, and collaborators from OSPool, OSDF, HTCondor, and Pelican an opportunity to connect, exchange ideas, discover the latest services and research, and participate in live demonstrations. HTC27 welcomes researchers, administrators, resource providers, and anyone interested in advancing throughput computing.

• HTCondor European Workshop 2026

  • The 2026 European HTCondor Workshop will be held from Tuesday, September 29th, through Friday October 2nd, sponsored by IN2P3’s Computing Centre (CC-IN2P3) in Lyon, France.

  • The workshop will bring together HTCondor developers and users to discuss recent developments, share experiences, and foster collaboration through direct exchanges and feedback. This years topics include the HTCondor Compute Entrypoint (CE), token-based authentication as well as practical aspects of HTCondor usage and administration. Register here

Tip of the Month

How do you transfer a list of files that changes with each job?
Using the queue <variable> from <list> syntax, you can!
For example, create parameters.txt with your list of files as the last few parameters.

1995, 2000, illinois.data
1995, 2000, illinois.data, nebraska.data
1995, 2000, illinois.data, wisconsin.data
1995, 2000, illinois.data, nebraska.data, wisconsin.data

Modify your submit file:

transfer_input_files = $(files)

queue start, end, files from parameters.txt

Now, $(files) will take on the values of the third item to the end of the line, and we use transfer_input_files to transfer all the .data files to our job!

A Sign Off

Thanks for engaging with our July edition of HTC News. If you’re a researcher, collaborator, or Institution working with or contributing to HTC and want to be featured in future newsletters, please reach out to us at chtc@cs.wisc.edu or share some of your work in the comments below.

Until next time,

The CHTC Communications Team

Share

Office Hours and Training Resources

Talk to Us

To explore more about us, check out our about page.

Subscribe now

Story Highlights

• “Advancing Science Internationally Through Collaboration” by Sophie Dorros

  • The WLCG is a global network of data centers that use HTCondor to share computing power and storage to process and analyze the massive amounts of data produced by CERN’s Large Hadron Collider.

  • This collaboration is pushing HTCondor to new limits, handling millions of jobs and billions of CPU hours while continuously improving scalability, flexibility, and performance.

    

• “A Conversation with CHTC Web Developer, Cannon Lock” by Sophie Dorros

  • CHTC web developer Cannon Lock discusses his challenges with the college-to-office transition, mentoring interns, and the rewards of working for a non-profit.

    

• “Bioinformatics Café: Building Community and Bridging Computing and Biology” by Sophie Dorros

  • The Bioinformatics Café is a monthly, hands-on meetup hosted by the Center for High Throughput Computing (CHTC), which is supported by both the UW-Madison and the Morgridge Institute for Research. At the Café life-science researchers come together to learn, co-work, and troubleshoot with support from expert facilitators.

  • CHTC Research Computing Facilitator Danny Morales discusses how the Café to create community and push research work forward in the UW-Madison Bioinformatics Community

    

  To explore previous news features, check out our news stories page here.

Upcoming Events

• Throughput Computing Week 2026

  • From June 9-12 in Madison, Wisconsin, throughput Computing Week 2026 (HTC26) will bring together the Throughput Computing community to share challenges, exchange recent advances, and explore opportunities. Registration options can be found here.

  • Consider signing up to give a talk. Presentations at HTC26 are short, typically 20 minutes in length. Applying requires a brief abstract submission: Sign up to Speak. Topics for this year include: The Challenges of AI, The Challenges of Multi Messenger Astrophysics Computing, HTC Admin Jumpstart and Masterclasses, The Challenges of Data, and Campus Track sessions.

• OSPool User Training - Pytorch on the OSPool

  • Tuesday, April 21 from 2:30-4:00pm EST, this workshop outlines best practices for running Pytorch-based workflows on the OSPool, including requesting certain GPUs, optimizing resource requests, and strategies for higher throughput. Click here to register

• OSPool User Training - DAGMan: HTCondor’s Workflow Manager

  • Tuesday, May 19 from 2:30-4:00pm EST, presented by an HTCondor DAGMan developer, this workshop is designed for researchers that would like to automate sequential, multi-job workflows with DAGMan, HTCondor’s built-in workflow manager. Register here

Tip of the Month

Request variable memory with retry_request_memory

Have your jobs ever gone on hold because of spikes in memory usage? You could over-request memory, but this decreases your job throughput and also wastes memory resources that could be used for other jobs.

Instead of submitting a batch of jobs that over-request memory, use retry_request_memory!

For example, if you add this to your submit file:

request_memory = 1GB
retry_request_memory = 4GB

Every job will request 1 GB of memory. If the job is evicted because it exceeds 1 GB of memory, the job will be restarted with 4 GB of memory.

For more complex options, expressions, and examples, check out the HTCondor manual!

News

• Wuerthwein Stepping Down as OSG Executive Director on April 1.

  

  • Frank Wuerthwein’s statement to the OSG community: “I am stepping down as OSG Executive Director. My responsibilities as Director of SDSC is increasingly pushing me in areas that are less and less overlapping. OSG deserves somebody who is a more focused advocate for our vision.”

  • Liz Sexton-Kennedy , OSG Council Chair, remarks that “Frank has provided outstanding vision and commitment to the OSG over the past decade. It has grown in the services it provides, and the scientific community it servers under his direction. I am truly grateful to him for all he has done. It’s been a pleasure working with him. Thank you Frank!”

  • Miron Livny, OSG Technical Director, thanks Wuethwein for his devotion to the OSG Consortium from cutting the ribbon in 2005 until today and for his commitment to distributed high throughput computing.

    

• Peter Couvares Elected as OSG Executive Director

  At the OSG Council meeting on January 22nd, the Council unanimously elected Peter Couvares as the next OSG Executive Director.

• Memory Leak in the Linux Kernel- Detecting Memory Leaks Tips and Tricks

  

  • HTCondor developers recently received an email saying “I think I’m seeing a memory leak in the Linux kernel, need help!” Knowing the right places to look made debugging easy.

  • The lesson here is writing a robust job scheduler like HTCondor is complicated, and changing the default values on some of the more obscure configuration knobs should not be taken lightly. If you are the administrator of an HTCondor installation, consider periodically running the command condor_config_val -summary to get a report of all the configuration knobs that have been changed from their default value. If the default value of a knob has been changed and you do not know why, consider removing that change to restore the default value.

A Sign Off

Thanks for engaging with our April edition of HTC News. If you’re a researcher, collaborator, or Institution working with or contributing to HTC and want to be featured in future newsletters, please reach out to us at chtc@cs.wisc.edu or share some of your work in the comments below.

Until next time,

The CHTC Communications Team

Share

Office Hours and Training Resources

To explore more about us, check out our about page.

Subscribe now

Story Highlights

• “One Researcher’s Leap into Throughput Computing: Bringing Machine Learning to Dairy Farm Management” by Sophie Dorros

  • Ariana Negreiro, Ph.D, discusses her research, utilizing HTCondor, DAGman workflows, and Pelican, to develop tools for dairy cattle management.

  • Negreiro’s research points to promising results: machine learning can be used to eliminate manually weighing and measuring dairy cattle, avoiding extra stress for cows and helping farmers save on labor costs.

  

• “2025 HTCondor European Workshop Showcases Advances in High Throughput Computing” by Sophie Dorros

  • Showcasing both technical advances and real-world applications of HTCondor, the 2025 HTCondor European Workshop was held at the Institute of Physics of the Czech Academy of Sciences (FZU) in Prague.

    

• “Researcher Receives David Swanson Award for Work Powered by High Throughput Computing” by Jacob Isaacson

  • Brandi Pessman, a postdoctoral researcher at the University of Nebraska–Lincoln, received the OSG David Swanson Award in June 2025. This award, established in honor of David Swanson and his contributions to the OSG and the high throughput computing community, is presented to a former student of the OSG School who has subsequently achieved significant results empowered by distributed high throughput computing.

  • Pessman’s research focuses on the effects of noise on the way spiders construct their webs and presented her work at Throughput Computing Week 2025, an annual event focused on throughput computing and the science it enables.

  

  To explore previous news features, check out our news stories page here.

Upcoming Events

• Save the Date - Throughput Computing Week 2026

  

  • Throughput Computing Week 2026 (HTC26) will be held in Madison, WI, from June 9-12th. HTC26 will bring together researchers, campuses, science collaborations, facilitators, administrators, government representatives, and professionals interested in high-throughput computing to:

    • Engage with the throughput computing community, including the OSG Consortium, PATh and Pelican teams and many others contributing to HTC

    • Be inspired by presentations and conversations with community leaders and contributors sharing common interests

    • Learn about HTC and new developments to advance your science, your collaboration, or your campus

  • HTC25 featured over 130 in person attendees and more that 80 presentations.

  • Watch Dr. Erik Wright’s Keynote Presentation at HTC25 “Biological Diversity at an Unfathomable Scale.”

  • Click here to view registration details and updates for HTC26. Registration will open at the end of January 2026.

• OSPool User Training - Choosing the Right Hardware on the OSG OSPool: ARM64, x86_64 microarchs, and GPUs

  • On December 16th from 2:00 pm - 4:00 pm EST, new and prospective OSPool users who want to learn about using Jupyter Hub to access OSPool resources can join this OSPool User Training session. This short training covers the key differences between ARM64, x86_64, and x86 microarchitectures, how to build and run portable software across them, and considerations for GPU-enabled resources.

  • Attendees will learn how to request specific hardware, optimize for performance and compatibility, and fully leverage hardware heterogeneity in the OSPool. To register, see here.

    Explore our event page to learn more about previous and upcoming events.

Tip of the Month

There’s a new feature for submitting jobs with HTCondor! 
Now you can use shell = <your script> instead of using executable and arguments!

Before:
executable = hello-world.sh
arguments = $(Process)

After: 
shell = ./hello-world.sh $(Process)

Notable differences

1. You will have to add your executable (i.e., hello-world.sh to your list of files in transfer_input_files), since HTCondor can’t automatically detect your executable.

2. Your executable must have executable permissions. You can achieve this by running the chmod +x command, i.e., chmod +x hello-world.sh. This will prevent a “Permission denied” error.

3. An alternate solution to (2): Use shell = bash hello-world.sh$(Process).

Read more and try it!

• Read about the new shell option in our guides: Practice: Submit HTC Jobs using HTCondor

• Try using shell and let us know how it goes for you! Happy computing!

News

• HTCondor Withstands CERN’S Massive Stress Test

  • In 2030, the Large Hadron Collider, the world’s largest and most powerful particle accelerator, will become the High-Luminosity LHC (HL-LHC), creating more particle collisions per second and increasing the amount of data able to be collected.

  • HTCondor performed very well under CERN’s recent series of tests to prepare data infrastructure for the massive increase in data coming its way from the HL-LHC.

    

• HTCondor by the Numbers: Over 1 Billion Jobs Ran over the Past Year from just 3 Pools!

  • The OSPool, the CMS and IGWN pools alone accounted for over 1 billion HTCondor jobs that ran over the past year. (425M jobs from the OSPool, 600M from the CMS Pool, and 60 million from the IGWN Pool).

A Sign Off

Thanks for engaging with our December edition of HTC News. If you’re a researcher, collaborator, or Institution working with or contributing to HTC and want to be featured in future newsletters, please reach out to us at chtc@cs.wisc.edu or share some of your work in the comments below.

Until next time,

The CHTC Communications Team

Share

Office Hours and Training Resources

Talk to Us

Today’s newsletter features Oral Roberts University’s integration into the OSPool, the Thyme Lab’s use of high throughput computing to unlock new frontiers in drug discovery, and the upcoming events: Throughput Computing Week 2025, the 40 Years of The Condor Project: A Celebration, and the OSG School.

To explore more about us, check out our about page and last month’s newsletter.

Subscribe now

Story Highlights

• “Oral Roberts University Advances Cyberinfrastructure with OSPool Integration” by Kallen Wank

  • Oral Roberts University (ORU) in Tulsa, Oklahoma, recently joined the Open Science Pool (OSPool) after receiving an NSF CC* award to boost campus cyberinfrastructure. Led by Dr. Stephen Wheat, ORU completed integration in just 45 minutes—one of the fastest to date.

  • Through OSPool, ORU is expanding access to research computing while offering students hands-on experience in big data and high-performance computing. Read more about ORU’s rapid integration and commitment to shared research infrastructure here.

• “Unlocking New Frontiers in Drug Discovery: High Throughput Computing in the Thyme Lab” by Kallen Wank

  • The Thyme Lab, now based at UMass Chan Medical School, is leveraging the OSPool’s high throughput computing power to accelerate discoveries in neurodevelopmental drug research. The lab uses zebrafish and protein modeling software to identify potential treatments for disorders like insomnia and narcolepsy. Through support from the OSG Office Hours and a tenfold increase in computing capacity, the Thyme Lab has run over 4.7 million jobs in the last 12 months —pushing the boundaries of computational drug discovery. Read more, here.

To explore previous news features, check out our news stories page here.

LIGO’s 200th Gravitational Wave Detection

• LIGO-Virgo-KAGRA announced their 200th Gravitational Wave Detection of O4. Dr. Stuart Anderson, who serves as the LIGO Scientific Computing Lead, reported that “most, but not quite all, of the O4 detections (and rapid followup analysis, i.e., skymaps and other parameter estimation) were made using HTCondor.”

Tip of the Month - Using Containers

Containers make your projects easier and more efficient. They’re portable, consistent, and customizable, ensuring your app runs the same way everywhere. With containers, you don’t need to worry about host machines or version conflicts. You can even build your own container with everything you need. When you provide a container to CHTC, they can run your jobs without extra setup, saving time and hassle.

Get Started: Check the CHTC website or the UW Data Science Hub for guides and help.

Read more here

Upcoming Events

• Throughput Computing Week (HTC25)
  HTC25 will be held from June 2-6, 2025, in Madison, Wisconsin, bringing together researchers, campuses, and professionals interested in high-throughput computing. The event will feature presentations, a retrospective on the history of HTC, and the opportunity to engage with experts in the field. Registration for in-person and virtual participation is now open here.

• Celebrating 40 Years of The Condor Project

  Celebrate 40 years of The Condor Project at HTC25! Join us for retrospective talks, reflections and a reception to mark these milestones. Read more and RSVP here.

• OSG School 2025
  OSG School 2025, taking place from June 23-27, 2025, will provide participants with hands-on training in high-throughput computing systems, ideal for researchers, students, and instructors looking to incorporate HTC into their work.

  

  Explore our event page to learn more about previous and upcoming events.

A Sign Off

Thanks for engaging with our April edition of HTC News. If you’re a researcher, collaborator, or Institution working with or contributing to HTC and want to be featured in future newsletters, please reach out to us at chtc@cs.wisc.edu or share some of your work in the comments below.

Until next time,

The CHTC Communications Team

Share

Office Hours and Training Resources

Event Details:

• HTC25 gives OSPool or HTCondor users, contributors, and collaborators the chance to exchange ideas and experiences, to learn about the latest services and research, and to experience live demos. Current or potential consumers or providers of distributed high throughput computing, HTCondor or Pelican users or administrators are welcome to attend.

• Keynote Speaker Monday Morning: Biological Discovery at an Unfathomable scale with Dr. Erik Wright. “Recent technological advances have revealed an enormous diversity of lifeforms by sequencing their genomes. There are now millions of available genomes, each comprised of thousands of genes. The universe of newly discovered genes is expanding far faster than our ability to study them in the laboratory. Here, I will present how high-throughput computing is unlocking the function of novel genes at an unfathomable scale.”

• Following last year's successful launch of this programming, CC* (current or future) campuses and administrators can attend dedicated break out sessions on Wednesday of the event, in addition to the plenary sessions on Tuesday morning.

• HTC25 will include presentations from researchers and administrators who use OSG services, HTCondor or Pelican. Leadership will discuss the current state and future plans for these services. Tutorials across the services will be offered.

• Read our news feature covering HTC24 here

  

Registration and More Details

Celebrating The Condor Project:

Forty years ago, the first Condor job ran at UW-Madison. Since then, it has given rise to the idea of "High Throughput Computing," and has been used to power scientific discovery. Twenty years ago, the OSG ran its first job, extending into "Distributed High Throughput Computing."

To commemorate these milestones, you are invited join this celebration and cocktail reception, taking place during HTC25. Please RSVP by May 22.

RSVP Here

More Details Here

We hope to see you this Summer.

If you’re a researcher, collaboration or Institution working with or contributing to HTC and want to be featured in future newsletters, please reach out to us at chtc@cs.wisc.edu or share some of your work in the comments below.

Until next time,

The CHTC Communications Team

Subscribe now

Talk to Us

Introduction

Welcome back to HTC News, a newsletter produced by the Center for High Throughput Computing (CHTC).

To explore more about us, check out our about page and last month’s newsletter.

Subscribe now

Story Highlights

• “IceCube Neutrino Observatory: Making Discoveries in Astrophysics Through the Use of High Throughput Computing and the OSPool” by Ria Dhingra and Kallen Wank

  • Located in the depths of the South Pole almost a mile under the earth’s surface, the IceCube Neutrino Observatory captures 233 million cosmic rays every day, opening the door to groundbreaking discoveries in high-energy physics.

  • On a daily basis, IceCube generates an alert line of low throughput data that provides real-time monitoring of neutrino events. This continuous stream of data feeds directly into the CHTC systems, computing the thousands of daily tasks. In the past year alone, IceCube utilized over 50 million core hours and ran over 36 million jobs using HTCondor. Read more about the project and its utilization of HTC resources here.

• “Ecologists Utilizing HTC to Examine the Effects of Megafires on Wildlife” by Bryna Goeking

  • As the western United States sees an unprecedented increase in wildfires, ecologists are investigating the impacts of these events on over 600 different species of wildlife through help from CHTC. Read more, here.

To explore previous news features, check out our news stories page here.

Featured News:

PATh Becomes NAIRR Pilot Service Provider for AI Workloads.

PATh provides allocatable services to support the entire life cycle of AI workloads–training data generation, training data cleaning, model training, and inference (prediction) using AI models. As of February 20th, the Partnership to Advance Throughput Computing (PATh) project is a service provider for the National Artificial Intelligence Research Resource (NAIRR) Pilot project.

Read our news feature here: “PATh Becomes NAIRR Pilot Service Provider for AI Workloads” by Ria Dhingra

For information on acquiring access to NAIRR allocated resources on PATh, see here and more on NAIRR’s website here.

Apply Now: OSG School

OSG School, June 23-27 • Applications Close March 7th

Could you transform your research with extra computing capacity beyond your laptop or lab computers? Do you need help managing your research computing workloads with automation? If you work with research workloads that can be made into lists of independent computing tasks, we can help! We are seeking applicants for the OSG School 2025, to be held June 23-27 at the beautiful University of Wisconsin-Madison.

Apply by March 7th!

The OSG School teaches you how to use HTC effectively and get a research workload up and running. We use lectures, demos, hands- on exercises, and personal consulting with OSG experts. Past participants have come from physics, chemistry, engineering, math, biological and life sciences, earth sciences, agricultural and animal sciences, social sciences, economics, medicine, and more.

See here for more details and to apply. Contact us with questions.

Read our feature story on the OSG School’s mission here

Tip of the Month

A tip for OSPool users from Research Computing Facilitator, Amber Lim:

• “Condor_watch_q is a helpful real time tool that shows the status of your job whether it's idle (waiting to be run), running, on hold, removed, or done!”

  

What’s Been Going on in our Community:

• Registration for HTC25 opened in mid-February. Mark your calendars because CHTC is hosting its third annual Throughput Computing Week (HTC25) from June 2nd to June 6th, 2025 in Madison, Wisconsin. HTC25 will feature speakers sharing insights into the latest developments in HTC, including campuses contributing to the OSPool, researchers using HTC for AI and ML, advancements and opportunities in data sharing and storage, and HTCondor tutorials and new features. To see day-by-day agenda, thematic breakdown, and to register—see here.

• Kubernetes Hackathons. On Tuesday, February 18th, CHTC hosted its recurring Hackathon on the open-source system for managing, scaling, and deploying containerized applications. This month’s Hackathon included a GitOps tutorial.

• New CHTC team member. New team member Danny Morales joined the CHTC Facilitation team this month.

• Outreach and Job Postings. CHTC is hiring students! Positions are open for the Systems Admin Internship, Systems Integrator Internship, and Student Science Writer. We tabled at the Madison Area Technical College and the UW-Madison School of Computer, Data & Information Sciences job fairs this month. To stay tuned on CHTC job postings, see here.

  

• CHTC and OSPool Container Training. Containers help researchers run their software on almost any machine. On February 18th, Dr. Andrew Owen led a workshop for OSPool users, covering the advantages, basics, concepts, and hands-on tutorial for using containers in large-scale computing.

• PATh staff participated in the NAIRR Pilot Program Conference. Team members Miron Livny, Brian Bockelman, and Ian Ross traveled to DC to attend the Inaugural NAIRR meeting. Read more on PATh x NAIRR here.

• Tutorials Presented at the CC* Conference. The NSF CC* Workshop in Tempe, Arizona, brought together campuses and CC* PI’s from across the United States to share ideas for advancing campus cyberinfrastructure. Team members Brian Bockelman, Christina Koch, and Miron Livny attended on behalf of CHTC and PATh and led hands-on tutorials on the OSPool and the Open Science Data Federation (OSDF).

• First CHTC Researcher Forum. On February 26th, CHTC hosted its inaugural Researcher Forum to empower users and connect community members at UW-Madison. Attendees heard upcoming news, engaged with CHTC staff, and learned about how other users leveraged CHTC resources.

  

• UW-Madison RISE initiative and impact of CHTC. The UW-Madison RISE initiative is a multifaceted effort focused on faculty hiring, research infrastructure, interdisciplinary collaboration and student opportunity. The RISE-AI model aims to advance deep learning and foundation models, natural language processing, signal processing, learning theory, optimization, and related areas. This initiative has resulted in CHTC collaboration with faculty hires to support their computing needs.

• Fellowship Applications. The CHTC Fellows Program supports students in the development and use of cyberinfrastructure, providing them the opportunity to work with mentors on delivering a project that will make an impact on the nation’s science. We just completed interviews for the first round of applications. To be considered for the second round—Appy Now. (Applications Close March 15th)

  ---

OSPool: Record Number of Contributors

This month, the OSPool hit a record number of institutions contributing capacity. Check out our feature story, highlighting ten of these institutions contributing to the OSPool in support of scientific research across the nation.

Read About the OSPool and contributing institutions in our latest feature story:

• “Reaching Record Numbers of Contributing Institutions to the OSPool” by Ria Dhingra and Kallen Wank

News Shorts

Short news updates from the Center For High Throughput Computing; ranging from PATh tutorials at the CC* (Campus Cyberinfrastructure) PI Workshop to the study of Neuroscience and Addiction utilizing HTC.

• February News Shorts by Kallen Wank

A Sign Off

Thanks for engaging with our February edition of HTC News. If you’re a researcher, collaborator, or Institution working with or contributing to HTC and want to be featured in future newsletters, please reach out to us at chtc@cs.wisc.edu or share some of your work in the comments below.

Until next time,

The CHTC Communications Team

Talk to Us

Introduction

Welcome to the first issue of HTC News, a newsletter produced by the Center for High Throughput Computing (CHTC), including activities from the PATh project, HTCSS, OSG Consortium and more. Today’s newsletter features coverage of a biologist’s work using HTC to unravel antibiotic resistance, highlights of the first CHTC Fellows Program, updates on the upcoming HTC25 Week, and the opening of applications for the OSG School!

To explore more about us and this newsletter, check out our about page.

Subscribe now

Story Highlights

• “Erik Wright: A Biologist Using High Throughput Computing to Unravel Antibiotic Resistance” by Ria Dhingra

  • Want to know how OSG Consortium resources and HTCondor software can contribute to research projects? Read about Erik Wright’s utilization of high throughput computing systems like the OSPool to research antibiotic resistance here.

• “Student Fellows Advanced Research Computing Infrastructure at CHTC” by Kallen Wank

  • The CHTC Fellows Program supports students in the development and use of cyberinfrastructure, providing them the opportunity to work with mentors on delivering a project that will make an impact on the nation’s science. Read here to learn more about the fellowship, our fantastic first batch of projects, and the eight student fellows.

  • APPLY NOW: CHTC Fellows Program, 2025

    • Applications will close March 15, 2025.

• “Fostering Community Amongst Developers and Researchers: A Reflection on the HTCondor Autumn 2024 Workshop” by Ria Dhingra

  • Five CHTC team members attended the 2024 European Autumn HTCondor Workshop, hosted by Nikhef, the Dutch National Institute for Subatomic Physics. Read more about the 2024 EU Workshop and takeaways here.

• “Collaborations Between Two National Laboratories and the OSG Consortium Propel Nuclear and High-Energy Physics Forward” by Cristina Encarnacion

  • The Electron-Proton/Ion Collider (ePIC) Collaboration was formed to design, build, and operate the first experiment at the Electron-Ion Collider (EIC). Read here to learn about this collaboration and its use of HTC to gather data and simulate jobs.

To explore previous news features, check out our news stories page, here.

Save the Date: Throughput Computing Week 2025

HTC25, June 2 - 6

Mark your calendars because CHTC is hosting its third annual Throughput Computing Week (HTC25) from June 2nd to June 6th, 2025 in Madison, Wisconsin. HTC25 will feature speakers sharing insights into the latest developments in HTC, including campuses contributing to the OSPool, researchers using HTC for AI and ML, advancements and opportunities in data sharing and storage, and HTCondor tutorials and new features. This year, on Tuesday afternoon June 3, will also feature special presentations from leaders in the field celebrating the 40th anniversary and milestones of HTC, the 20th anniversary of the OSG Consortium, and the 75th birthday of Miron Livny.

What’s Been Going on in our Community:

• Weekly Campus Meet-ups. Hosted by OSG Campus Coordinator, Tim Cartwright, and Lead Research Computing Facilitator, Christina Koch, the Weekly Campus Meet-ups are a series of zoom meetings focused on the dual purposes of empowering universities to set up computing systems while contributing computing resources. Campuses considering contributing to the OSPool are encouraged to join the discussion and hear directly from other participating campuses and from OSG staff. Contact support@osg-htc.org for a Zoom invitation. To learn more about the process to begin contributing to the OSPool, see this onboarding story here.

• OSG School Applications Opening Soon. The OSG School will take place June 23–27 at the University of Wisconsin–Madison. Applications for the School will open by the end of January and will close at the end of the day on March 7. During the School, students will learn to use HTC systems, at your own campus or using the national-scale Open Science Pool (OSPool), to run large-scale computing applications that are at the heart of today’s cutting-edge science. For more information, see here.

• Utilizing HTC for ML. The National Science Foundation (NSF) approved a PATh supplement that will provide the PATh project with resources to demonstrate the application of distributed high throughput computing (dHTC) techniques to machine learning (ML). The effort brings new collaborators (the Gitter Lab) into PATh, whose ML experts will measure the impact of using distributed, heterogeneous capacity for ML training workloads. The goal will be to show that ML is inherently a high throughput activity and dHTC techniques provide value to the ML community for a large range of workloads.

• Feature on CHTC HTCondor Developer. Cole Bollig, an HTCondor Core Developer and one of the youngest members of our team approaches his third year at CHTC, completes his first semester of graduate school, and returns from the Autumn HTCondor European Workshop. Read our spotlight on Cole, here:

  • “A Spotlight on Cole Bollig: Finding CHTC, Community, and Learning HTCondor” by Ria Dhingra

    

• NDC-C Pathfinder Hackathon. CHTC hosted the first Pathfinder Hackathon from November 12th to the 15th in Madison, WI. The event focused on learning how to use Pelican to utilize and share large scientific datasets across National Oceanic and Atmospheric Administration focused projects. Learn more about Pathfinders at the NDC-C Pathfinder website. If you or your team have large data sets you want to share or access contact pi-team@pelicanplatform.org.

  

• Expanding HTC at Two Indian Organizations. Two Indian institutions, IUCAA (Inter-University Centre for Astronomy and Astrophysics) and TIFR (Tata Institute of Fundamental Research), invited members of CHTC to lead information sessions and establish collaboration for research efforts. Welcoming the invitations, CHTC members Miron Livny, Greg Thain and Rachel Lombardi traveled in September to Mumbai and Pune, India to support the institutions’ research initiatives.

• Partnership with Jackson State University. With the goal of enabling high throughput computing on the campus, CHTC team member Aaron Moate traveled to JSU to assist with the installation and configuration of Access Point (AP) and Execution Point (EP) hosts while also preparing HTCondor administration training materials for local JSU system administrations. JSU is now on track to be an institution contributing computing resources to the OSPool while also opening up additional computing resources to its own campus researchers.

• Fermilab joins CHTC for Talks and Tutorials. On December 11th, 7 members from the Fermilab joined CHTC in Madison for a series of tutorials, informational sessions, and discussions on the use of HTCondor. Currently, HTCondor is an important backpoint of Fermi’s cyberinfrastructure, utilizing over 81,000 cores in the past year alone.

• New CHTC team members. Howard Zhong, Sarthak Agarwal, and Ria Dhingra have joined the CHTC team! (As a research software engineer, software engineer, and science writer—respectively). See our full CHTC team here.

  ---

OSPool Stats: 2024

The OSPool is a source of computing capacity accessible to any researcher affiliated with a US academic institution. Capacity is allocated following a Fair-Share policy. To harness the OSPool capacity, you will need to obtain an account via the OSG Portal.

News Shorts

News shorts features HTC users at the National Autonomous University of Mexico (UNAM), the University of Hawaii-Moana, and Doshisha University, Japan. Additionally, it shares our experience at SC24 Atlanta.

• News Shorts by Ria Dhingra and Kallen Wank

• Bonus News Short—Pelican: “Decoding Sun’s Secrets With the Help of Pelican” by Kallen Wank

A Sign Off

Thanks for engaging with our first edition of HTC News. If you’re a researcher, collaboration or Institution working with or contributing to HTC and want to be featured in future newsletters, please reach out to us at chtc@cs.wisc.edu or share some of your work in the comments below.

Until next time,

The CHTC Communications Team

Welcome to HTC News, a Center for High Throughput Computing (CHTC) newsletter on all things high throughput computing (HTC). This newsletter provides an opportunity for audiences ranging from researchers, campuses, facilitators, administrators, government representatives, users, and professionals interested in high throughput computing to learn about the throughput computing community and it work—including CHTC, the OSG Consortium, HTCondor, PATh, and Pelican teams. We aim to share exciting updates of our work and our team (who develop and distribute the software suite HTCondor) and, significantly, the scientific contributions of HTC users and campuses providing resources and computing capacity.

To share more about your experience with HTC, individual research projects, or to get in touch with us, we can be reached at chtc@cs.wisc.edu.

Subscribe now

Thanks for engaging with HTC News. Please contact us if you or your institution has ideas on how we might be able to aid your research endeavors or collaborate.

Best,

The Center for High Throughput Computing

Learn more about CHTC, our projects, and the HTC community—including the OSG Consortium, PATh, Pelican, and fellow researchers and collaborations on our about page.

---