Workflows Community Initiative | The Python Exchange May 2023
About the Python Exchange for the Department of Energy: https://meetup.doepy.org/
Sign up here to be notified when the next Python Exchange is scheduled: https://bit.ly/py-exchange
Title: “Workflows Community Initiative & PSI/J Python Reference Implementation”
Abstract: Scientific workflows are critical tools in modern scientific computing, enabling the orchestration of large and complex experiments that span multiple facilities and computational resources. The Workflows Community Initiative (https://workflows.community) is a collaborative effort aimed at advancing the state-of-the-art in workflow systems and related technologies.
The initiative brings together researchers, developers, and practitioners to foster communication and collaboration on important issues related to workflow management, including workflow design, execution, monitoring, optimization, and interoperability. As part of the DOE ECP’s ExaWorks project, we have defined PSI/J (Portable Submission Interface for Jobs), a simple and portable interface for submitting jobs to distributed computing resources, regardless of their underlying architecture or middleware. Our Python-based reference PSI/J implementation supports a range of job submission types, including batch jobs, parallel jobs, and interactive jobs.
Bio: Rafael Ferreira da Silva is a Senior Research Scientist in the National Center for Computational Sciences (NCCS) at the Oak Ridge National Laboratory (ORNL), where he also serves as the Executive Director of the Workflows Community Initiative. With a strong research focus on the efficient and resilient execution of large-scale scientific workflow applications on heterogeneous distributed systems, as well as the modeling and simulation of parallel and distributed computing systems, Dr. Ferreira da Silva has led and contributed to numerous large-scale projects related to distributed computing platforms, cyberinfrastructure systems, and applications. Dr. Ferreira da Silva's expertise also extends to community engagement and workshop organization. He has served as the principal investigator on several U.S. DOE- and NSF-funded projects, and his scholarly work includes over 100 peer-reviewed journal articles, conference proceedings articles, book chapters, editorials, and conference abstracts. Dr. Ferreira da Silva is a member of the Association for Computing Machinery (ACM), and a Senior Member of the Institute of Electrical and Electronics Engineers (IEEE). For more information about his work and accomplishments, please visit https://rafaelsilva.com.
At Don't Use This Code, want to create a unique opportunity to see Python succeed and thrive within the DOE. In collaboration with an organizing committee of Python users and advocates from various DOE sites, we host regular conversations on the topic of Python in order to create a new resource for scientists, researchers, and technical staff. Our goal is to share best practices and build a strong, lasting community for Python users within the Department of Energy National Lab system.
If you, or someone you know, might make a great panelist, we'd love to get in touch! Just send us an email at [email protected] if you would like to participate or have any questions.