ANDANTE held its first benchmarking workshop online on the 2nd of July, 2021. The workshop was held online, and it was dedicated to discussing current benchmarking methods and how ANDANTE should approach benchmarking work comparative analysis throughout the project. Benchmarking is as necessary as challenging for ANDANTE, given the diversity of neural network accelerators and the fact that adapting the algorithm to the hardware is critical to performance.
Workshop Program
Welcome and Start
- Introduction : Andrea Dunbar/CSEM
- Standard benchmarking for machine learning : Siavash Bigdeli/CSEM
- Useful benchmarking for commercial neuromorphic : HW Dilan Munir/SynSense
Track 1: Tools 1 Methodologies
- Simulation framework for energy and latency in multi-core neuromorphic architectures : Stefano Traferro/imec-NL
Track 2: Benchmarking Categories
- Consideration on the real word in use-case-based Benchmarking : Kay Bierzynnski/Infineon
- Challenges of using medial datasets : Diana Cojocaru/Philipps
Track 3: Metrics
- Impact of HW optimization on KPIs : Petar Jokic/CSEM
- Easy power extraction with Cadence tools : Erfan Azarkhis/CSEM
- KPI-aware optimization and design : Maen Mallah/Fraunhofer IIS, Ferdinand Pschidl /Fraunhofer
Track 1: Outlook
Future of Benchmarking : Simon Narduzzi/CSEM
Discussion
- What are the main challenges?
- What are the current tools? What work is being done?
- Which direction should ANDANTE project take with respect to these challenges?
- Use case base benchmarking.
- Standardisation of Benchmarking.
Slides
- Agenda_workshop_ANDANTE_210702.pdf
- Commercially-relevant_benchmarks_for_Neuromorphic_computing_DylanMuir-2.pdf
- Outlook_Future_Of_Benchmarking_SimonNarduzzi.pdf
- Standard_benchmarking_for_machine_learning_SiavashBigdeli.pdf
- Summary_ANDANTE_Benchmarking_Workshop_AndreaDunbar.pdf
- Track1_Simulation_framework_for_energy_and_latency_in_multi-core_neuromorphic_architectures_StefanoTraferro.pdf
- Track2_Challenges_of_using_medical_datasets_DennisMoolenaar.pdf
- Track2_Consideration_of_the_Real_World_in_Use-Case-Based_Benchmarking_KayBierzynski.pdf
- Track3_Early_Power_Extraction_with_Cadence_Tools_ErfanAzarkhish.pdf
- Track3_Impact_of_HW_optimizations_on_KPIs_PetarJokic.pdf
- Track3_KPI-Aware_Optimization_and_design_MMallah_FPscheidl.pdf