Gennady Pekhimenko

On Leave

Faculty Member, Vector Institute

Associate Professor, Department of Computer Science, University of Toronto

Canada CIFAR Artificial Intelligence Chair

Gennady Pekhimenko is an Assistant Professor at the University of Toronto, CS department and (by courtesy) ECE department, where he is leading the EcoSystem (Efficient Computing Systems) group. Gennady is also a Faculty Member at Vector Institute and a CIFAR AI chair. Before joining Univ. of Toronto, he spent a year in 2017 at Microsoft Research in Redmond in the Systems Research group. He got his PhD from the Computer Science Department at Carnegie Mellon University in 2016. Gennady is a recipient of Amazon Machine Learning Research Award, Facebook Faculty Research Award, Connaught New Researcher Award, NVIDIA Graduate, Microsoft Research, Qualcomm Innovation, and NSERC CGS-D Fellowships. He was also recently inducted into the ISCA Hall of Fame and was a recipient of the MICRO Top Picks Award in 2021. His research interests are in the areas of systems, computer architecture, compilers, and applied machine learning.

Research Interests

  • Systems for Machine Learning
  • Machine Learning for Systems
  • Computer Architecture
  • Stream Processing


  • ISCA Hall of Fame
  • MICRO Top Picks Award in 2021
  • Amazon Machine Learning Research Award
  • Facebook Faculty Research Award
  • Connaught New Researcher Award


Distributed deep learning in open collaborations

Michael Diskin and Alexey Bukhtiyarov and Max Ryabinin and Lucile Saulnier and Anton Sinitsin and Dmitry Popov and Dmitry V Pyrkin and Maxim Kashirin and Alexander Borzunov and Albert Villanova del Moral and Denis Mazur and Ilia Kobelev and Yacine Jernite and Thomas Wolf and Gennady Pekhimenko


Moshpit SGD: Communication-efficient decentralized training on heterogeneous unreliable devices

Max Ryabinin and Eduard Gorbunov and Vsevolod Plokhotnyuk and Gennady Pekhimenko


FPRaker: A Processing Element For Accelerating Neural Network Training

Omar Mohamed Awad and Mostafa Mahmoud and Isak Edo and Ali Hadi Zadeh and Ciaran Bannon and Anand Jayarajan and Gennady Pekhimenko and Andreas Moshovos


LifeStream: a high-performance stream processing engine for periodic streams

Anand Jayarajan and Kimberly Hau and Andrew Goodwin and Gennady Pekhimenko


NVOverlay: enabling efficient and scalable high-frequency snapshotting to NVM

Ziqi Wang and Chul-Hwan Choo and Michael A Kozuch and Todd C Mowry and Gennady Pekhimenko and Vivek Seshadri and Dimitrios Skarlatos