Quentin Anthony
Quentin Anthony
Verified email at - Homepage
Cited by
Cited by
Gpt-neox-20b: An open-source autoregressive language model
S Black, S Biderman, E Hallahan, Q Anthony, L Gao, L Golding, H He, ...
Proceedings of the ACL Workshop on Challenges & Perspectives in Creating …, 2022
Pythia: A suite for analyzing large language models across training and scaling
S Biderman, H Schoelkopf, Q Anthony, H Bradley, K O'Brien, E Hallahan, ...
International conference on machine learning (ICML), 2023
RWKV: Reinventing RNNs for the Transformer Era
B Peng, E Alcaide, Q Anthony, A Albalak, S Arcadinho, H Cao, X Cheng, ...
arXiv preprint arXiv:2305.13048, 2023
Gems: Gpu-enabled memory-aware model-parallelism system for distributed dnn training
A Jain, AA Awan, AM Aljuhani, JM Hashmi, QG Anthony, H Subramoni, ...
SC20: International Conference for High Performance Computing, Networking …, 2020
Performance characterization of dnn training using tensorflow and pytorch on modern clusters
A Jain, AA Awan, Q Anthony, H Subramoni, DKDK Panda
2019 IEEE International Conference on Cluster Computing (CLUSTER), 1-11, 2019
Emergent and Predictable Memorization in Large Language Models
S Biderman, US Prashanth, L Sutawika, H Schoelkopf, Q Anthony, ..., 2023
GPT-NeoX: Large scale autoregressive language modeling in pytorch
A Andonian, Q Anthony, S Biderman, S Black, P Gali, L Gao, E Hallahan, ...
Continual Pre-Training of Large Language Models: How to (re) warm your model?
K Gupta, B Thérien, A Ibrahim, ML Richter, Q Anthony, E Belilovsky, I Rish, ...
Hypar-flow: Exploiting mpi and keras for scalable hybrid-parallel dnn training using tensorflow
AA Awan, A Jain, Q Anthony, H Subramoni, DK Panda
arXiv preprint arXiv:1911.05146, 2019
Adaptive and hierarchical large message all-to-all communication algorithms for large-scale dense gpu systems
KS Khorassani, CH Chu, QG Anthony, H Subramoni, DK Panda
2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet …, 2021
Accelerating MPI all-to-all communication with online compression on modern GPU clusters
Q Zhou, P Kousha, Q Anthony, K Shafie Khorassani, A Shafi, ...
International Conference on High Performance Computing, 3-25, 2022
Efficient training of semantic image segmentation on summit using horovod and mvapich2-gdr
Q Anthony, AA Awan, A Jain, H Subramoni, DKDK Panda
2020 IEEE International Parallel and Distributed Processing Symposium …, 2020
Accelerating GPU-based Machine Learning in Python using MPI Library: A Case Study with MVAPICH2-GDR
SM Ghazimirsaeed, Q Anthony, A Shafi, H Subramoni, DKDK Panda
2020 IEEE/ACM Workshop on Machine Learning in High Performance Computing …, 2020
Hy-Fi: Hybrid Five-Dimensional Parallel DNN Training on High-Performance GPU Clusters
A Jain, A Shafi, Q Anthony, P Kousha, H Subramoni, DK Panda
International Conference on High Performance Computing, 109-130, 2022
Scaling single-image super-resolution training on modern hpc clusters: Early experiences
Q Anthony, L Xu, H Subramoni, DKDK Panda
2021 IEEE International Parallel and Distributed Processing Symposium …, 2021
MCR-DL: Mix-and-Match Communication Runtime for Deep Learning
Q Anthony, AA Awan, J Rasley, Y He, A Shafi, M Abduljabbar, ...
arXiv preprint arXiv:2303.08374, 2023
Highly efficient alltoall and alltoallv communication algorithms for gpu systems
CC Chen, KS Khorassani, QG Anthony, A Shafi, H Subramoni, DK Panda
2022 IEEE International Parallel and Distributed Processing Symposium …, 2022
trlX: A framework for large scale reinforcement learning from human feedback
A Havrilla, M Zhuravinskyi, D Phung, A Tiwari, J Tow, S Biderman, ...
Proceedings of the 2023 Conference on Empirical Methods in Natural Language …, 2023
Accelerating distributed deep learning training with compression assisted allgather and reduce-scatter communication
Q Zhou, Q Anthony, L Xu, A Shafi, M Abduljabbar, H Subramoni, ...
2023 IEEE International Parallel and Distributed Processing Symposium (IPDPS …, 2023
Cross-layer Visualization and Profiling of Network and I/O Communication for HPC Clusters
P Kousha, Q Anthony, H Subramoni, DK Panda
arXiv preprint arXiv:2109.08329, 2021
The system can't perform the operation now. Try again later.
Articles 1–20