Zeyuan Allen-Zhu （朱澤園）

Cited by

	All	Since 2018
Citations	11174	9854
h-index	44	40
i10-index	56	55

3000

1500

750

2250

201120122013201420152016201720182019202020212022202337 61 87 137 155 285 492 730 1110 1457 1672 1948 2920

Public access

View all

19 articles

0 articles

available

not available

Based on funding mandates

Co-authors

Yuanzhi LiAssistant Professor at CMUVerified email at andrew.cmu.edu
Lorenzo OrecchiaUniversity of Chicago, Computer ScienceVerified email at bu.edu
Weizhu ChenMicrosoftVerified email at microsoft.com
Elad HazanProfessor at Princeton University and Director Google AI PrincetonVerified email at princeton.edu
Edward HuPhD candidate at MilaVerified email at mila.quebec
Philip J. WallisVictorian Catchment Management Council; Monash UniversityVerified email at monash.edu
Yang YuanMassachusetts Institute of TechnologyVerified email at cs.cornell.edu
Zhao SongAdobe ResearchVerified email at ias.edu
Alessandro ChiesaEPFLVerified email at epfl.ch
zheng chenMicrosoftVerified email at microsoft.com
Sebastien BubeckSr Principal Research Manager, ML Foundations group, Microsoft ResearchVerified email at microsoft.com
Chenguang ZhuLead AI Research Scientist at ZoomVerified email at microsoft.com
Yelong ShenMicrosoftVerified email at microsoft.com
Naman AgarwalSenior Research Scientist, Google AI PrincetonVerified email at google.com
Tengyu MAStanford UniversityVerified email at stanford.edu
Brian BullinsAssistant Professor, Purdue UniversityVerified email at purdue.edu
Dan AlistarhIST AustriaVerified email at ist.ac.at
Zhenyu LiaoApplied Scientist in Amazon Inc.Verified email at amazon.com
Pinyan LuITCS, Shanghai University of Finance and EconomicsVerified email at mail.shufe.edu.cn
Xiaorui SunUniversity of Illinois at ChicagoVerified email at uic.edu

Zeyuan Allen-Zhu （朱澤園）

Other namesZeyuan Allen Zhu

Meta AI / FAIR Labs

Verified email at csail.mit.edu - Homepage

Deep Learning Machine Learning Optimization Algorithms Theory


Title Sort by citations Sort by year Sort by title	Cited by Cited by	Year
LoRA: Low-rank adaptation of large language models EJ Hu, Y Shen, P Wallis, Z Allen-Zhu, Y Li, S Wang, L Wang, W Chen ICLR 2022: International Conference on Learning Representations, 2022	1611*	2022
A convergence theory for deep learning via over-parameterization Z Allen-Zhu, Y Li, Z Song ICML 2019: International Conference on Machine Learning, 2019	1360	2019
Is Q-learning Provably Efficient? C Jin, Z Allen-Zhu, S Bubeck, MI Jordan NIPS 2018: Neural Information Processing Systems, 2018	823	2018
Learning and generalization in overparameterized neural networks, going beyond two layers Z Allen-Zhu, Y Li, Y Liang NeurIPS 2019: Neural Information Processing Systems, 2019	755	2019
Katyusha: the first direct acceleration of stochastic gradient methods Z Allen-Zhu STOC 2017: Symposium on Theory of Computing, 19-23, 2017	644	2017
Variance reduction for faster non-convex optimization Z Allen-Zhu, E Hazan ICML 2016: International Conference on Machine Learning, 699-707, 2016	409	2016
Linear coupling: An ultimate unification of gradient and mirror descent Z Allen-Zhu, L Orecchia ITCS 2017: Innovations in Theoretical Computer Science, 2017	366*	2017
Finding approximate local minima faster than gradient descent N Agarwal, Z Allen-Zhu, B Bullins, E Hazan, T Ma STOC 2017: Symposium on Theory of Computing, 1195-1199, 2017	331*	2017
A simple, combinatorial algorithm for solving SDD systems in nearly-linear time JA Kelner, L Orecchia, A Sidford, ZA Zhu STOC 2013: Symposium on Theory of Computing, 911-920, 2013	281	2013
Byzantine Stochastic Gradient Descent D Alistarh, Z Allen-Zhu, J Li NIPS 2018: Neural Information Processing Systems, 2018	270	2018
Towards understanding ensemble, knowledge distillation and self-distillation in deep learning Z Allen-Zhu, Y Li ICLR 2023: International Conference on Learning Representations, 2023	265	2023
Natasha 2: Faster Non-Convex Optimization Than SGD Z Allen-Zhu NIPS 2018: Neural Information Processing Systems, 2018	252	2018
Improved SVRG for non-strongly-convex or sum-of-non-convex objectives Z Allen-Zhu, Y Yuan ICML 2016: International Conference on Machine Learning, 1080-1089, 2016	220	2016
Even faster accelerated coordinate descent using non-uniform sampling Z Allen-Zhu, Z Qu, P Richtárik, Y Yuan ICML 2016: International Conference on Machine Learning, 1110-1119, 2016	205	2016
What Can ResNet Learn Efficiently, Going Beyond Kernels? Z Allen-Zhu, Y Li NeurIPS 2019: Neural Information Processing Systems, 2019	188	2019
On the convergence rate of training recurrent neural networks Z Allen-Zhu, Y Li, Z Song NeurIPS 2019: Neural Information Processing Systems, 2019	181	2019
Asymptotically optimal strategy-proof mechanisms for two-facility games P Lu, X Sun, Y Wang, ZA Zhu ACM-EC 2010: Conference on Economics and Computation, 315-324, 2010	178	2010
Neon2: Finding Local Minima via First-Order Oracles Z Allen-Zhu, Y Li NIPS 2018: Neural Information Processing Systems, 2018	144	2018
LazySVD: Even faster SVD decomposition yet without agonizing pain Z Allen-Zhu, Y Li NIPS 2016: Neural Information Processing Systems, 974-982, 2016	128	2016
A novel click model and its applications to online advertising ZA Zhu, W Chen, T Minka, C Zhu, Z Chen WSDM 2010: International Conference on Web Search and Data Mining, 321-330, 2010	128	2010

The system can't perform the operation now. Try again later.

Articles 1–20

Citations per year

Duplicate citations

Merged citations

Add co-authorsCo-authors

Follow

Cited by

Co-authors