| Foundational Challenges in Assuring Alignment and Safety of Large Language Models U Anwar, A Saparov*, J Rando*, ES Lubana*, D Paleka*, M Turpin*, ... Transactions of Machine Learning Research (TMLR), 2024 | 120* | 2024 |
| Orchestra: Unsupervised Federated Learning via Globally Consistent Clustering ES Lubana, CI Tang, F Kawsar, RP Dick, A Mathur International Conference on Machine Learning (ICML) (spotlight), 2022 | 69 | 2022 |
| A Gradient Flow Framework For Analyzing Network Pruning ES Lubana, RP Dick International Conference on Learning Representations (ICLR) (spotlight), 2021 | 61 | 2021 |
| Augmentations in graph contrastive learning: Current methodological flaws & towards better practices P Trivedi, ES Lubana, Y Yan, Y Yang, D Koutra Proceedings of the ACM Web Conference 2022, 1538-1549, 2022 | 55 | 2022 |
| Mechanistic Mode Connectivity ES Lubana, EJ Bigelow, RP Dick, D Krueger, H Tanaka International Conference on Machine Learning (ICML), 2023 | 53* | 2023 |
| Beyond BatchNorm: towards a unified understanding of normalization in deep learning ES Lubana, R Dick, H Tanaka Advances in Neural Information Processing Systems (NeurIPS), 2021 | 53 | 2021 |
| Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks S Jain*, R Kirk*, ES Lubana*, RP Dick, H Tanaka, E Grefenstette, ... International Conference on Learning Representations (ICLR), 2024 | 45 | 2024 |
| Minimalistic image signal processing for deep learning applications ES Lubana, RP Dick, V Aggarwal, PM Pradhan 2019 IEEE International Conference on Image Processing (ICIP), 4165-4169, 2019 | 38* | 2019 |
| Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task M Okawa*, ES Lubana*, RP Dick, H Tanaka* Advances in Neural Information Processing Systems (NeurIPS), 2023 | 36 | 2023 |
| What shapes the loss landscape of self-supervised learning? L Ziyin, ES Lubana, M Ueda, H Tanaka International Conference on Learning Representations (ICLR), 2023 | 28 | 2023 |
| Analyzing data-centric properties for graph contrastive learning P Trivedi, ES Lubana, M Heimann, D Koutra, J Thiagarajan Advances in Neural Information Processing Systems (NeurIPS), 2022 | 18* | 2022 |
| How capable can a transformer become? a study on synthetic, interpretable tasks R Ramesh, M Khona, RP Dick, H Tanaka, ES Lubana International Conference on Machine Learning (ICML), 2023 | 17* | 2023 |
| How do quadratic regularizers prevent catastrophic forgetting: The role of interpolation ES Lubana, P Trivedi, D Koutra, R Dick Conference on Lifelong Learning Agents (CoLLAs), 2021 | 15* | 2021 |
| What Makes and Breaks Safety Fine-tuning? A Mechanistic Study S Jain, ES Lubana, K Oksuz, T Joy, P Torr, A Sanyal, PK Dokania Advances in Neural Information Processing Systems (NeurIPS), 2024 | 8 | 2024 |
| A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language ES Lubana*, K Kawaguchi*, RP Dick, H Tanaka arXiv preprint arXiv:2408.12578, 2024 | 4 | 2024 |
| Emergence of Hidden Capabilities: Exploring Learning Dynamics in Concept Space CF Park*, M Okawa*, A Lee, H Tanaka, ES Lubana Advances in Neural Information Processing Systems (NeurIPS) (spotlight), 2024 | 3 | 2024 |
| In-Context Learning Dynamics with Random Binary Sequences EJ Bigelow, ES Lubana, RP Dick, H Tanaka, TD Ullman International Conference on Learning Representations (ICLR), 2024 | 3 | 2024 |
| FoMo rewards: Can we cast foundation models as reward functions? ES Lubana, J Brehmer, P De Haan, T Cohen NeurIPS workshop on Foundation Models for Decision Making, 2023 | 3 | 2023 |
| Abrupt Learning in Transformers: A Case Study on Matrix Completion P Gopalani, ES Lubana, W Hu Advances in Neural Information Processing Systems (NeurIPS), 2024 | 2* | 2024 |
| Competition Dynamics Shape Algorithmic Phases of In-Context Learning CF Park*, ES Lubana*, I Pres, H Tanaka arXiv preprint arXiv:2412.01003, 2024 | 1 | 2024 |
Robert DickUniversity of Michigan, StrydVerified email at rpdmail.dyndns.org
