{"id":62361,"date":"2025-05-22T08:43:24","date_gmt":"2025-05-22T08:43:24","guid":{"rendered":"https:\/\/nag.com\/?post_type=insights&#038;p=62361"},"modified":"2025-05-22T10:02:26","modified_gmt":"2025-05-22T10:02:26","slug":"hpc-software-engineer-interview","status":"publish","type":"insights","link":"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/","title":{"rendered":"Powering the SKA Telescopes: High-Performance Computing for the Next Generation of Radio Astronomy"},"content":{"rendered":"<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p><a href=\"https:\/\/www.skao.int\/en\" target=\"_blank\" rel=\"noopener\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-62355 size-medium aligncenter\" src=\"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/skao_logo_2021_colour_rgb_2500x1058px-300x127.jpg\" alt=\"\" width=\"300\" height=\"127\" \/><\/a><\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <h3>SKAO and <span class=\"nag-n-override\" style=\"margin-left: 0 !important;\"><i>n<\/i><\/span>AG\u00a0<\/h3>\n<p>The SKA Observatory is an international endeavour to build the world\u2019s largest radio telescopes, a \u20ac2 billion project aimed at transforming humanity\u2019s understanding of the universe. Behind this monumental effort lies an equally groundbreaking challenge: processing petabytes of raw data every day into high-resolution astronomical images.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p><span class=\"nag-n-override\" style=\"margin-left: 0 !important;\"><i>n<\/i><\/span>AG\u2019s High-Performance Computing (HPC) engineers play a pivotal role in making this possible. Their work ensures the seamless transformation of vast volumes of data into science-ready data products, supporting the SKAO&#8217;s mission to accelerate discovery in radio astronomy and gravitational wave science.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n\n<div class=\"content-image-split pv-4  ph-1 \" style=\"background-color: ;\" >\n    <div class=\"container\">\n        <div class=\"row ph-1\">\n            <div class=\"col-12  card-rounded\" >\n\n                <div class=\"row fdir-cr fdir-r-lg \">\n                    <div class=\"content-side df pv-3 ph-1 ph-lg-5 ph-xl-8 c-primary--white col-12 col-lg-6\" style=\"\n                    background-color: #082d48ff;\n                    color: ;\n                    align-items: center; \">\n\n                        <div>\n                                                            <h3 class=\"mb-1\">Q&#038;A with Sean Stansill, <span class=\"nag-n-override\" style=\"margin-left: 0 !important;\"><i>n<\/i><\/span>AG HPC Software Engineer<\/h3>\n                                                        <h4>Hi Sean, can you describe your role in the SKA project and what you and your team is responsible for?<\/h4>\n<p>My team and I are responsible for a range of tools that are needed to process petabytes (yes, with a P!) of raw data into detailed pictures of the sky. Among our contributions, we\u2019ve optimised key software components \u2014 most notably the imaging and \u201ccleaning\u201d pipeline that converts calibrated data into high-fidelity astronomical images, as well as the tools that detect and catalogue the radio emission from black holes captured in these images.<\/p>\n<p>Personally, I\u2019ve focused heavily on data engineering, specifically helping to design and define the next-generation data format for radio astronomy: Measurement Set version 4 (MSv4). This new format is poised to become a global standard for radio telescopes worldwide. I\u2019ve also been instrumental in developing tools to ensure its smooth adoption by the broader radio astronomy community.<\/p>\n<p>In December 2024, I represented the SKA project as the lead expert on I\/O performance and scalability at an international review spanning 24 institutions, including input from Oak Ridge National Laboratory \u2014 the epicentre of HPC in the United States. During this review, I advised the panel on the hardware strategies and software architectures that will unlock the full potential of MSv4, pushing the limits of what\u2019s possible in large-scale data processing for radio astronomy.<\/p>\n<p>Image Copyright: SKAO\u00a0Image Author: SKAO<\/p>\n                                                    <\/div>\n\n                    <\/div>\n                    <div class=\"img-side small-image-holder col-12 col-lg-6 ph-0 df\" style=\"align-items: center; background-color: #082d48ff;  color: ; \">\n                        <img loading=\"lazy\" decoding=\"async\" width=\"700\" height=\"700\" src=\"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/SKA-Mid-close-up-artist-impression-web.jpg\" class=\"bg-media \" alt=\"\" style=\"object-position: % %;\" \/>\n                        <div class=\"wrap \">\n                                                    <\/div>\n\n                    <\/div>\n                <\/div>\n\n\n            <\/div>\n\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <h4>What part of the SKA telescopes are you focused on <em>(e.g. data, processing, storage, networking, other)<\/em>?<\/h4>\n<p>My focus is on science data processing \u2014 the stage of the pipeline where we run large-scale batch processing on HPC systems to transform raw telescope data into science-ready images and catalogues. This is where the heavy lifting happens, as we apply sophisticated algorithms to transform petabytes of data into images varying from 1 megapixel to over 17,000 megapixels in size.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>While my primary role is within this area, I collaborate closely with colleagues across other critical parts of the SKAO software ecosystem. For example, the real-time processing team, who use FPGA arrays to hunt for pulsars in real-time before any data even touches a disk, and the SRCNet team \u2014 architects of a global network of data centres designed to receive, distribute, and further process the outputs from the Science Data Processor (SDP). Together, our efforts ensure that data flows smoothly from telescope to scientist, no matter where in the world the science happens.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-3 pt-lg-3 pt-xl-3\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <h4>Why is HPC critical to the operation of the SKA telescopes?<\/h4>\n<p>The concept for the SKA telescopes dates all the way back to the late 1980s But for decades, it remained an ambitious idea, waiting for computer hardware to catch up. Astronomers always knew that to unlock the SKA\u2019s potential, we\u2019d need computing systems fast enough \u2014 and affordable enough \u2014 to process the staggering volumes of data produced by its two massive telescopes.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>That\u2019s why the SKA telescopes are often described as \u201csoftware telescopes\u201d. Rather than relying on a single, gigantic dish, the SKA combines data from hundreds of dishes and thousands of antennas through software, creating images far superior to anything achievable with even the largest single-dish telescope.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p><strong>Without HPC systems, the SKA telescopes simply wouldn\u2019t be possible. HPC is the beating heart of the project, enabling us to turn torrents of raw signals into precise, high-resolution snapshots of the universe.<\/strong><\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <h5><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-62377 size-full alignleft\" src=\"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/SIMULATION_comparison_collage.jpg\" alt=\"\" width=\"1000\" height=\"1000\" \/><\/h5>\n<p class=\"para-sm\">\u00a0<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p class=\"para-sm\">Image Copyright: SKAO \u00b7 Collage of simulated images of future SKA-Low observations, showing what the telescope is expected to be able to produce as it grows in size. The images depict the same area of sky as that observed in the first image from a working version of the telescope, released in March 2025. Top left: By 2026\/2027, SKA-Low will have more than 17,000 antennas and will become the most sensitive radio telescope of its kind in the world. It will be able to detect over 4,500 galaxies in this same patch of sky. Top right: By 2028\/2029, SKA-Low will count over 78,000 antennas and be able to detect more than 23,000 galaxies in this field. Bottom: The full SKA-Low telescope will count more than 130,000 antennas spread over 74 km. Similar observations of this area will be able to detect some 43,000 galaxies, while deep surveys performed of this area of the sky from 2030 will be able to reveal up to 600,000 galaxies.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-3 pt-lg-3 pt-xl-3\" ><\/div>\n\n\n<p><\/p>\n\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <h4>Describe your day-to-day involvement with the project?<\/h4>\n<p>Right now (May 2025), I\u2019m focused on integrating MSv4 support into a key software tool called DP3 (pronounced \u201cDP cubed\u201d). DP3 plays a crucial role in the SKA data pipeline: it calibrates the raw signals we receive from the telescopes and flags corrupted data, ensuring the data is scientifically accurate. By adding MSv4 support, we\u2019re enabling distributed calibration \u2014 allowing us to spread the workload across multiple computing nodes, with recent benchmarks showing 20x throughput compared to the most widely used MSv2 format.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>Day to day, my work is hands-on software development. I spend much of my time writing and optimising code, but in a project of this scale and complexity, collaboration is just as critical as coding. With such a diverse software ecosystem, we work closely as a team to stay aligned and ensure we\u2019re all moving towards our shared goals.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>Beyond being part of the SDP software team, I\u2019m also part of a collaborative working group that includes key contributors from the US National Radio Astronomy Observatory (NRAO) and the South African Radio Astronomy Observatory (SARAO). We meet weekly to align our software solutions, share technical insights, and ensure tight integration across our international efforts. This close collaboration is vital to ensure our tools work seamlessly across observatories and deliver the best possible outcomes for the global radio astronomy community.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>And it\u2019s not just about coding \u2014 I also work alongside teams contributing to the SDP roadmap and long-term vision. Together, we\u2019re constantly refining our priorities and strategies to realise the ambition of building the SKA telescopes.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-3 pt-lg-3 pt-xl-3\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <h4>What are and have been the biggest technical challenges you\u2019ve faced?<\/h4>\n<p>I\u2019m a physicist by training \u2014 my PhD focused on writing software to simulate magnetic systems at the tiniest length scales. Interestingly, I was never particularly drawn to astronomy during my studies. But once I joined the SKA project, I quickly discovered that radio astronomy comes with its own rich history of specialised data processing techniques, as well as some truly unique challenges. One of the first hurdles I faced was the sheer breadth of new terminology and concepts specific to the field, especially those arising from the difficulties of observing the universe amidst a world saturated with wireless signals.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>Once I found my footing in the landscape of radio astronomy, the real technical challenge emerged: squeezing every last ounce of performance from the hardware we have. This is because, despite being a \u20ac2 billion flagship project, the SKAO operates with a relatively modest budget for HPC infrastructure. My colleagues and I are deeply immersed in the fine details of both the data and the hardware, constantly engineering robust and scalable solutions to push the limits of what\u2019s possible. It\u2019s a challenge that demands not just technical skill, but creativity \u2014 one of the things that makes working on the SKA project so rewarding.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-62196 size-full\" src=\"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/SKA-HQ-external-web.jpg\" alt=\"\" width=\"1000\" height=\"428\" \/><\/p>\n<p class=\"para-sm\">Image Credit and Copyright: SKAO\/Cassandra Cavallaro \u00b7\u00a0Author: Cassandra Cavallaro<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p class=\"para-sm\">The historic Lovell Telescope reflected in the window of SKAO Global HQ, UK.\u00a0<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-3 pt-lg-3 pt-xl-3\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <h4>Were there any specific scale or performance issues that pushed the limits of what\u2019s currently possible in HPC?<\/h4>\n<p>As part of the SDP development \u00a0we continually test our software and hardware against progressively larger volumes of data, all with the goal of hitting the required performance and scalability targets by the time the telescope comes online towards the end of the decade. Among all the challenges, the most demanding HPC bottleneck is unquestionably I\/O performance. To realise the full SKA vision, our Science Processing Centres in Cape Town and Perth will need to sustain average read and write speeds of around 8 terabytes per second, 24 hours a day \u2014 a staggering figure.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>While that might sound achievable in comparison to high-end data centres, the SKA project\u2019s challenge lies in the complexity of our data access patterns. Unlike workloads that are \u201cembarrassingly parallel\u201d, where tasks can be distributed independently across compute nodes, our workflows require tightly coordinated data movement which is governed by the physics of radio astronomy. This means we have to choreograph data access across many nodes with precision. Achieving this level of orchestration is an ongoing frontier in HPC, and it\u2019s pushing us right up against the limits of today\u2019s hardware and software architectures.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-3 pt-lg-3 pt-xl-3\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <h4>Does the project require any novel approaches, tools, or technologies?<\/h4>\n<p>Wherever possible, we aim to use battle-tested, off-the-shelf solutions. This allows our developers to focus their efforts on the truly unique challenges of radio astronomy, rather than reinventing the wheel. Importantly, the software we build for the SKA telescopes isn\u2019t just for internal use \u2014 it\u2019s made available to the global radio astronomy community. That means there\u2019s a strong emphasis on modernising and optimising existing tools to make them more robust, sustainable, and accessible for a wide range of users.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>That said, we\u2019re always keeping a close eye on advances in software, hardware, and infrastructure, and we actively adopt the latest technologies in data storage and numerical computing where they offer real benefits. Some of our most complex challenges centre around managing data dependencies efficiently. We work hard to minimise inter-process communication (IPC) and avoid data access contention, both of which are critical for scaling our software effectively across an entire HPC cluster. Solving these problems often requires creative, novel approaches to data orchestration \u2014 it\u2019s at this intersection of proven technologies and innovative problem-solving where much of the SDP software progress happens.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-3 pt-lg-3 pt-xl-3\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <h4>Have you been doing anything that hasn\u2019t been done before in this space?<\/h4>\n<p>I\u2019ve been a strong advocate for integrating object storage technologies \u2014 widely adopted in cloud computing \u2014 into the SKAO\u2019s Science Data Processor (SDP). This approach is still quite unconventional in HPC environments, but I believe it represents the start of a paradigm shift. As HPC increasingly converges with data science and \u201cbig data\u201d workloads, the required performance characteristics of these systems are evolving. Our choice of underlying technologies needs to evolve too.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>Object storage offers flexibility and scalability that align well with the data-intensive nature of the SKA telescopes. However, introducing new technologies into an established domain like HPC is never straightforward. From experience, I know it can be challenging to build consensus and overcome natural resistance to change. But, by demonstrating the tangible benefits of these approaches, I hope to help pave the way for a new generation of HPC systems that are better suited to the data challenges of modern scientific research.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-3 pt-lg-3 pt-xl-3\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <h4>Do you need to optimise code or hardware performance in a unique way?<\/h4>\n<p>Not all of my work is about writing code to make software faster \u2014 a significant part of my role involves running hardware optimisation experiments to guide critical infrastructure decisions. When you\u2019re dealing with data at the scale of the SKA project, the amount of system memory (RAM) in each machine can have an outsized impact on performance.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>In one case, my team and I observed a 4\u00d7 performance boost by doubling the amount of RAM available. With the larger memory footprint, the operating system was able to cache all of data accessed by other processes in memory, dramatically reducing the number of read operations from high-latency storage like our Lustre partitions. Crucially, this also increases the bandwidth available for ingesting data from the telescope. What makes this particularly exciting is that it\u2019s a performance improvement that doesn\u2019t require huge investment. By carefully matching memory configurations to our projected data volumes, we can achieve significant gains cost-effectively.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-3 pt-lg-3 pt-xl-3\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <h4>How does your work contribute to the bigger mission of SKA \u2014 understanding the universe, detecting cosmic signals, etc.?<\/h4>\n<p>A huge part of a radio astronomer\u2019s work today involves painstaking data processing \u2014 something the SKAO must fully automate because the vast data volumes are too large to transmit over the internet. By taking this burden off researchers, the SKAO will accelerate the pace of discovery, freeing scientists to focus on new ideas and groundbreaking research rather than manual data wrangling. It\u2019s a transformation that will be a tremendous benefit to the global radio astronomy community.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>The work I do directly enables the SKA telescopes to image structures in the universe with far greater sensitivity than ever before. By combining extreme sensitivity with unprecedented resolution, we\u2019re opening a window into the faintest structures in the cosmos, allowing us to probe the physics of the distant past. With the SKA telescopes, we\u2019ll be able to study the evolution of dark matter, investigate processes happening at the atomic scale in black hole jets, and even detect the very first light emitted in the universe.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>One particularly exciting frontier is pulsar research. Pulsars \u2014 ancient, collapsed stars with the strongest magnetic fields known in the universe \u2014 are a relatively new focus in astrophysics. The SKA telescopes will vastly expand our ability to discover, characterise, and track pulsars \u2014 providing unparalleled opportunities to test the limits of Einstein\u2019s theory of General Relativity.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-62408 size-full\" src=\"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/iStock-2153952121-web.jpg\" alt=\"\" width=\"582\" height=\"582\" \/><\/p>\n<p class=\"para-sm\">Image: Pulsar neutron star. Source of radio emission in space.<\/p>\n<p>\u00a0<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>Perhaps most thrilling of all, the SKA telescopes\u2019 extraordinary sensitivity will play a crucial role in advancing gravitational wave astronomy. Experiments like LIGO, the most sensitive science instrument ever built, can detect ripples in space-time but struggle to differentiate between genuine gravitational waves and local interference \u2014 even something as mundane as a microwave being switched on in a local town. The SKA telescopes will act as a verification tool, confirming the astrophysical origins of LIGO\u2019s signals. Once a gravitational wave is confirmed, the SKAO would be alerted. Then, its telescopes could be put into an emergency observation mode and rapidly point at the source. I\u2019m convinced that when we witness the first direct observation of two black holes merging, it will be thanks to the SKAO.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-3 pt-lg-3 pt-xl-3\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <h4>What excites you most about working on the SKA project?<\/h4>\n<p>What excites me most about working on the SKA project is the chance to learn from, and collaborate with, some of the brightest minds in radio astronomy. I get a unique, behind-the-scenes view of how groundbreaking science is done, and I have the privilege of helping to develop new techniques that will directly contribute to published research and future discoveries.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n<div class=\"container content-area-default \">\n    <div class=\"row justify-content--center\">\n        <div class=\"col-12 col-md-10 col-lg-8 col-xl-6\">\n            <p>There\u2019s something incredibly rewarding about knowing that the tools and systems I\u2019m helping to build could play a role in answering some of the biggest questions about our universe. And one day, when a Nobel Prize in Physics is awarded for discoveries made with SKA data, I\u2019ll be able to say: I helped make that possible.<\/p>\n        <\/div>\n    <\/div>\n<\/div>\n\n<!-- Spacer -->\n<div class=\"pt-1 pt-lg-1 pt-xl-1\" ><\/div>\n\n\n<p><\/p>\n\n\n\n<div class=\"content-image-split pv-4  ph-1 \" style=\"background-color: ;\" >\n    <div class=\"container\">\n        <div class=\"row ph-1\">\n            <div class=\"col-12  card-rounded\" >\n\n                <div class=\"row fdir-cr fdir-r-lg \">\n                    <div class=\"content-side df pv-3 ph-1 ph-lg-5 ph-xl-8 c-primary--white col-12 col-lg-6\" style=\"\n                    background-color: #082d48ff;\n                    color: ;\n                    align-items: center; \">\n\n                        <div>\n                                                        <h4>What\u2019s one thing you think people should know about the work behind the SKA project that often gets overlooked?<\/h4>\n<p>In building automated, near-real-time data pipelines for the SKA telescopes, there\u2019s simply no room for error. Unlike traditional data processing workflows, we can\u2019t afford to stop and restart if something goes wrong \u2014 the data is flowing continuously, and the telescopes need to be operational almost 100% of the time. That means the software I\u2019m developing has to work flawlessly, first time, every time. It\u2019s a level of precision and reliability that pushes us to write the most robust and dependable code of our careers.<\/p>\n<h4>If you had to sum up your contribution in one sentence what would it be?<\/h4>\n<p>I&#8217;m helping pave the way for scalable, high-performance storage systems that will power radio telescopes for decades to come.<\/p>\n<p>Image Copyright: SKAO<\/p>\n                                                    <\/div>\n\n                    <\/div>\n                    <div class=\"img-side small-image-holder col-12 col-lg-6 ph-0 df\" style=\"align-items: center; background-color: #082d48ff;  color: ; \">\n                        <img loading=\"lazy\" decoding=\"async\" width=\"1000\" height=\"566\" src=\"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/SKAO-at-night-3sites-web.png\" class=\"bg-media \" alt=\"\" style=\"object-position: % %;\" \/>\n                        <div class=\"wrap \">\n                                                    <\/div>\n\n                    <\/div>\n                <\/div>\n\n\n            <\/div>\n\n        <\/div>\n    <\/div>\n<\/div>\n\n\n<div class=\"gbc-title-banner tac tac-lg tac-xl\" style='border-radius: 0px; '>\n    <div class=\"container\" style='border-radius: 0px; '>\n        <div class=\"row justify-content--center\" >\n            <div class=\"col-12\"  >\n                <div class=\"wrap pv-1 \" style=\"0pxbackground-color: \">\n                                <div class=\"col-12 col-md-10 col-lg-8 col-xl-6  banner-content\"  >\n    \n                    \n                    <div class=\"mt-1 mb-1 content\"><\/div>\n\n                    \n                    <a href='https:\/\/nag.com\/insights\/' style='background-color: #ff7d21ff; border-radius: 30px; font-weight: 600; ' class='btn mr-1  ' >More Insights <i class='fas fa-angle-right'><\/i><\/a><a href='https:\/\/nag.com\/hpc-services\/' style='border: 2px solid ; border-radius: 30px; font-weight: 600; ' class='btn mr-1 outline ' ><span class=\"nag-n-override\" style=\"margin-left: 0 !important;\"><i>n<\/i><\/span>AG HPC Services <i class='fas fa-angle-right'><\/i><\/a><a href='https:\/\/nag.com\/contact-us\/' style='font-weight: 600; padding: 0px!important; ' class='btn mr-1  ' >Talk to Us <i class='fas fa-angle-right'><\/i><\/a>                <\/div>\n                <\/div>\n            <\/div>\n        <\/div>\n    <\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Welcome to our featured Q&#038;A session, where we dive into questions posed to <span class=\"nag-n-override\" style=\"margin-left: 0 !important;\"><i>n<\/i><\/span>AG HPC Software Engineer Sean Stansill about his time working on the SKA telescopes.<\/p>\n","protected":false},"author":8,"featured_media":62343,"parent":0,"menu_order":0,"template":"","meta":{"content-type":"","footnotes":""},"post-tag":[59,106,43],"class_list":["post-62361","insights","type-insights","status-publish","has-post-thumbnail","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v25.8 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Powering the SKA Telescopes: High-Performance Computing for the Next Generation of Radio Astronomy - nAG<\/title>\n<meta name=\"description\" content=\"See how HPC powers the SKA telescopes. nAG engineer Sean Stansill shares insights on data processing, MSv4, and scaling science with software.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Powering the SKA Telescopes: High-Performance Computing for the Next Generation of Radio Astronomy - nAG\" \/>\n<meta property=\"og:description\" content=\"See how HPC powers the SKA telescopes. nAG engineer Sean Stansill shares insights on data processing, MSv4, and scaling science with software.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/\" \/>\n<meta property=\"og:site_name\" content=\"nAG\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-22T10:02:26+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/SKAO-at-night-3sites-1024x429.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"429\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:site\" content=\"@NAGTalk\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"14 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/\",\"url\":\"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/\",\"name\":\"Powering the SKA Telescopes: High-Performance Computing for the Next Generation of Radio Astronomy - nAG\",\"isPartOf\":{\"@id\":\"https:\/\/nag.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/SKAO-at-night-3sites.png\",\"datePublished\":\"2025-05-22T08:43:24+00:00\",\"dateModified\":\"2025-05-22T10:02:26+00:00\",\"description\":\"See how HPC powers the SKA telescopes. nAG engineer Sean Stansill shares insights on data processing, MSv4, and scaling science with software.\",\"breadcrumb\":{\"@id\":\"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/#primaryimage\",\"url\":\"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/SKAO-at-night-3sites.png\",\"contentUrl\":\"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/SKAO-at-night-3sites.png\",\"width\":13334,\"height\":5580,\"caption\":\"Composite image of the three SKAO sites (the HQ in the UK, SKA-Mid telescope in South Africa and SKA-Low telescope in Australia) combining real images with artist's impressions. Credit: SKAO\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/nag.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Insights\",\"item\":\"https:\/\/nag.com\/insights\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Powering the SKA Telescopes: High-Performance Computing for the Next Generation of Radio Astronomy\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/nag.com\/#website\",\"url\":\"https:\/\/nag.com\/\",\"name\":\"NAG\",\"description\":\"Robust, trusted numerical software and computational expertise.\",\"publisher\":{\"@id\":\"https:\/\/nag.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/nag.com\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/nag.com\/#organization\",\"name\":\"Numerical Algorithms Group\",\"alternateName\":\"NAG\",\"url\":\"https:\/\/nag.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/nag.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/nag.com\/wp-content\/uploads\/2023\/11\/NAG-Logo.png\",\"contentUrl\":\"https:\/\/nag.com\/wp-content\/uploads\/2023\/11\/NAG-Logo.png\",\"width\":1244,\"height\":397,\"caption\":\"Numerical Algorithms Group\"},\"image\":{\"@id\":\"https:\/\/nag.com\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/x.com\/NAGTalk\",\"https:\/\/www.linkedin.com\/company\/nag\/\",\"https:\/\/www.youtube.com\/user\/NumericalAlgorithms\",\"https:\/\/github.com\/numericalalgorithmsgroup\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Powering the SKA Telescopes: High-Performance Computing for the Next Generation of Radio Astronomy - nAG","description":"See how HPC powers the SKA telescopes. nAG engineer Sean Stansill shares insights on data processing, MSv4, and scaling science with software.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/","og_locale":"en_US","og_type":"article","og_title":"Powering the SKA Telescopes: High-Performance Computing for the Next Generation of Radio Astronomy - nAG","og_description":"See how HPC powers the SKA telescopes. nAG engineer Sean Stansill shares insights on data processing, MSv4, and scaling science with software.","og_url":"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/","og_site_name":"nAG","article_modified_time":"2025-05-22T10:02:26+00:00","og_image":[{"width":1024,"height":429,"url":"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/SKAO-at-night-3sites-1024x429.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_site":"@NAGTalk","twitter_misc":{"Est. reading time":"14 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/","url":"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/","name":"Powering the SKA Telescopes: High-Performance Computing for the Next Generation of Radio Astronomy - nAG","isPartOf":{"@id":"https:\/\/nag.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/#primaryimage"},"image":{"@id":"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/#primaryimage"},"thumbnailUrl":"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/SKAO-at-night-3sites.png","datePublished":"2025-05-22T08:43:24+00:00","dateModified":"2025-05-22T10:02:26+00:00","description":"See how HPC powers the SKA telescopes. nAG engineer Sean Stansill shares insights on data processing, MSv4, and scaling science with software.","breadcrumb":{"@id":"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/#primaryimage","url":"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/SKAO-at-night-3sites.png","contentUrl":"https:\/\/nag.com\/wp-content\/uploads\/2025\/05\/SKAO-at-night-3sites.png","width":13334,"height":5580,"caption":"Composite image of the three SKAO sites (the HQ in the UK, SKA-Mid telescope in South Africa and SKA-Low telescope in Australia) combining real images with artist's impressions. Credit: SKAO"},{"@type":"BreadcrumbList","@id":"https:\/\/nag.com\/insights\/hpc-software-engineer-interview\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/nag.com\/"},{"@type":"ListItem","position":2,"name":"Insights","item":"https:\/\/nag.com\/insights\/"},{"@type":"ListItem","position":3,"name":"Powering the SKA Telescopes: High-Performance Computing for the Next Generation of Radio Astronomy"}]},{"@type":"WebSite","@id":"https:\/\/nag.com\/#website","url":"https:\/\/nag.com\/","name":"NAG","description":"Robust, trusted numerical software and computational expertise.","publisher":{"@id":"https:\/\/nag.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/nag.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/nag.com\/#organization","name":"Numerical Algorithms Group","alternateName":"NAG","url":"https:\/\/nag.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/nag.com\/#\/schema\/logo\/image\/","url":"https:\/\/nag.com\/wp-content\/uploads\/2023\/11\/NAG-Logo.png","contentUrl":"https:\/\/nag.com\/wp-content\/uploads\/2023\/11\/NAG-Logo.png","width":1244,"height":397,"caption":"Numerical Algorithms Group"},"image":{"@id":"https:\/\/nag.com\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/x.com\/NAGTalk","https:\/\/www.linkedin.com\/company\/nag\/","https:\/\/www.youtube.com\/user\/NumericalAlgorithms","https:\/\/github.com\/numericalalgorithmsgroup"]}]}},"_links":{"self":[{"href":"https:\/\/nag.com\/wp-json\/wp\/v2\/insights\/62361","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nag.com\/wp-json\/wp\/v2\/insights"}],"about":[{"href":"https:\/\/nag.com\/wp-json\/wp\/v2\/types\/insights"}],"author":[{"embeddable":true,"href":"https:\/\/nag.com\/wp-json\/wp\/v2\/users\/8"}],"version-history":[{"count":61,"href":"https:\/\/nag.com\/wp-json\/wp\/v2\/insights\/62361\/revisions"}],"predecessor-version":[{"id":63111,"href":"https:\/\/nag.com\/wp-json\/wp\/v2\/insights\/62361\/revisions\/63111"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/nag.com\/wp-json\/wp\/v2\/media\/62343"}],"wp:attachment":[{"href":"https:\/\/nag.com\/wp-json\/wp\/v2\/media?parent=62361"}],"wp:term":[{"taxonomy":"post-tag","embeddable":true,"href":"https:\/\/nag.com\/wp-json\/wp\/v2\/post-tag?post=62361"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}