hls4ml: A flexible, open-source platform for deep learning acceleration on reconfigurable hardware

Abstract

We present hls4ml , a free and open-source platform that translates machine learning (ML) models from modern deep learning frameworks into high-level synthesis (HLS) code that can be integrated into full designs for field-programmable gate arrays (FPGAs) or application-specific integrated circuits (ASICs). With its flexible and modular design, hls4ml supports a large number of deep learning frameworks and can target HLS compilers from several vendors, including Vitis HLS, Intel oneAPI and Catapult HLS. Together with a wider eco-system for software-hardware co-design, hls4ml has enabled the acceleration of ML inference in a wide range of commercial and scientific applications where low latency, resource usage, and power consumption are critical. In this paper, we describe the structure and functionality of the hls4ml platform. The overarching design considerations for the generated HLS code are discussed, together with selected performance results.

View publication

BibTeX

@article{schulte2025hls4ml,
    author = "Schulte, Jan-Frederik and Ramhorst, Benjamin and Sun, Chang and Mitrevski, Jovan and Ghielmetti, Nicol{\`o} and Lupi, Enrico and Danopoulos, Dimitrios and Loncar, Vladimir and Duarte, Javier and Burnette, David and others",
    title = "hls4ml: A flexible, open-source platform for deep learning acceleration on reconfigurable hardware",
    journal = "ACM Transactions on Reconfigurable Technology and Systems",
    year = "2025",
    publisher = "ACM New York, NY"
}

Recommended citation: Jan-Frederik Schulte, Benjamin Ramhorst, Chang Sun, Jovan Mitrevski, Nicolò Ghielmetti, Enrico Lupi, Dimitrios Danopoulos, Vladimir Loncar, Javier Duarte, David Burnette, others (2025). "hls4ml: A flexible, open-source platform for deep learning acceleration on reconfigurable hardware." ACM Transactions on Reconfigurable Technology and Systems.
Download Paper