Salman A. Avestimehr Explained

Salman Avestimehr
Birth Name:	Amir Salman Avestimehr
Nationality:	Iranian
Fields:	Machine learning Information theory Coding theory Distributed computing
Workplaces:	University of Southern California California Institute of Technology Cornell University
Alma Mater:	Sharif University of Technology UC Berkeley
Doctoral Advisor:	David Tse
Thesis Title:	Wireless network information flow: a deterministic approach
Thesis Url:	https://www2.eecs.berkeley.edu/Pubs/TechRpts/2008/EECS-2008-128.html
Thesis Year:	2008
Known For:	“An Approximation Approach to Network Information Theory,”

Salman A. Avestimehr is a Dean's professor at the Electrical & Computer Engineering and Computer Science Departments of University of Southern California, where he is the inaugural director of the USC-Amazon Center for Secure and Trusted Machine Learning^[1] (Trusted AI) and the director of the Information Theory and Machine Learning (vITAL) research lab.^{[2] [3]} He is also the CEO and Co-Founder of FedML.^[4] Avestimehr's contributions in research and publications are in the areas of information theory, machine learning, large-scale distributed computing, and secure/private computing and learning. In particular, he is best known for deterministic approximation approaches to network information theory and coded computing.^{[5] [6]} He was a general co-chair of the 2020 International Symposium on Information Theory (ISIT), and is a Fellow of IEEE.^{[7] [8]} He is also co-authors of four books titled “An Approximation Approach to Network Information Theory”, “Multihop Wireless Networks: A Unified Approach to Relaying and Interference Management”, “Coded Computing”, and “Problem Solving Strategies for Elementary-School Math.”

Education

Avestimehr completed his bachelor's degree in electrical engineering from Sharif University of Technology in 2003. He received his M.S. degree in 2005 in electrical engineering and computer science from University of California, Berkeley in 2005. Continuing his studies at UC Berkeley, he finished his Ph.D. in computer science in 2008; his doctoral adviser was David Tse.^{[9] [10] [11]}

Career and research

Avestimehr was a postdoctoral scholar at the Center for the Mathematics of Information (CMI) at Caltech in 2008. He served as an assistant professor at the school of electrical and computer engineering of Cornell University from 2009 to 2013. Avestimehr was promoted to a Dean's professorship in electrical and computer engineering at the University of Southern California, where he has taught since 2013. He is also the inaugural director of the USC-Amazon Center for Secure and Trusted Machine Learning. He has been a general co-chair of the 2020 International Symposium on Information Theory (ISIT). He has also been an associate editor for IEEE Transactions on Information Theory. Current research areas of Prof. Avestimehr include information theory, distributed computing, machine learning, and secure and private learning/computing.^{[12] [6]}

Awards and honors

• 2020. IEEE Fellow^[8]
• 2019. IEEE Information Theory Society James L. Massey Research & Teaching Award^[13]
• 2015. The Okawa Foundation Award^[14]
• 2013. IEEE Communications Society and Information Theory Society Joint Paper Award^[15]
• 2011. Presidential Early Career Award for Scientists and Engineers (PECASE, 2011)^{[16] [17]}
• 2010. National Science Foundation CAREER Award^{[18] [19]}

Bibliography

• “An Approximation Approach to Network Information Theory,” by A. S. Avestimehr, S. Diggavi, C. Tian and D. Tse, Foundations and Trends in Communications and Information Theory, 2015.^[20]
• “Multihop Wireless Networks: A Unified Approach to Relaying and Interference Management,” by I. Shomorony and A. S. Avestimehr, Foundations and Trends in Networking, 20114.^[21]
• “Coded Computing,” by S. Li and A. S. Avestimehr, Foundations and Trends in Communications and Information Theory, 2020.^[22]
• “Problem Solving Strategies for Elementary-School Math,” by K. Avestimehr and A. S. Avestimehr, Now Publishers, 2020.^[23]

Selected publications

• C. He, M. Annavaram, and A. S. Avestimehr, “Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge,” in NeurIPS, 2020.^[24]
• C. He, et al, A. S. Avestimehr, “FedML: A research library and benchmark for federated machine learning”.^[25]
• Q. Yu, S. Li, N. Raviv, M. Mousavi Kalan, M. Soltanolkotabim and A. S. Avestimehr, “Lagrange Coded Computing: Optimal Design for Resiliency, Security and Privacy,” in Proc. AISTATS 2019.^[26]
• M. Yu, Z. Lin, K. Narra, S. Li, Y. Li, N. S. Kim, A. Schwing, M. Annavaram, and A. S. Avestimehr, “GradiVeQ: Vector Quantization for Bandwidth-Efficient Gradient Aggregation in Distributed CNN Training,” in NeurIPS,

2018.^[27]

• S. Li, M. A. Maddah-Ali, Q. Yu and A. S. Avestimehr, “A Fundamental Tradeoff Between Computation and Communication in Distributed Computing,” in IEEE Transactions on Information Theory, vol. 64, no. 1, pp. 109–128, Jan. 2018.^[28]
• S. Li, M. A. Maddah-Ali and A. S. Avestimehr, “A Scalable Framework for Wireless Distributed Computing,” in ACM/IEEE Transactions on Networking, vol. 25, no. 5, pp. 2643–2654, Oct. 2017.^[29]
• N. Naderializadeh, M. Maddah-Ali, and A. S. Avestimehr, “Fundamental Limits of Cache-Aided Interference Management,” in IEEE Transactions on Information Theory, vol. 63, no. 5, pp. 3092–3107, May 2017.^[30]
• S. Li, M. A. Maddah-Ali and A. S. Avestimehr, “Coding for Distributed Fog Computing,” IEEE Communications Magazine, vol. 55, no. 4, pp. 34–40, April 2017.^[31]
• Q. Yu, M. A. Maddah-Ali and A. S. Avestimehr, “Polynomial Codes: an Optimal Design for High-Dimensional Coded Matrix Multiplication,” in NIPS, 2017.
• C. Geng, N. Naderializadeh, A. S. Avestimehr, and S. Jafar, “On the Optimality of Treating Interference as Noise,” IEEE Transactions on Information Theory, Vol 61, No 7, 2015.
• N. Naderializadeh and A.S. Avestimehr, “ITLinQ: A New Approach for Spectrum Sharing in Device-to-Device Communication Systems,” IEEE Journal on Selected Areas in Communications Special Issue on 5G Wireless Communication Systems, Vol 32, No 6, 2014.
• I. Shomorony and A. S. Avestimehr, “Worst-Case Additive Noise in Wireless Networks,” IEEE Transactions on Information Theory, Vol 59, No 6, June 2013
• I. Shomorony and A. S. Avestimehr, “Two-Unicast Wireless Networks: Characterizing the Degrees-of-Freedom,” IEEE Transactions on Information Theory, Vol 59, No 1, January, 2013.
• V. Aggarwal, A. S. Avestimehr, and A. Sabharwal, “On Achieving Local View Capacity Via Maximal Independent Graph Scheduling,” IEEE Transactions on Information Theory, Special Issue on Interference Networks, Vol 57, No 5, May 2011.
• A. S. Avestimehr, S. N. Diggavi, and D. N. C. Tse, “Wireless Network Information Flow: A Deterministic Approach,” IEEE Transactions on Information Theory, Vol. 57, No. 4, pp. 1872–1905, April 2011.

External links

• Personal homepage
• Google Scholar Page

Notes and References

1. https://trustedai.usc.edu “USC-Amazon Center for Secure and Trusted Machine Learning”
2. https://viterbi.usc.edu/directory/faculty/Avestimehr/Salman “USC Viterbi Faculty Directory”
3. https://dot.la/usc-machine-learning-research-center-2650162192/ “USC-Amazon Center on Secure and Trusted Machine Learning”
4. https://fedml.ai “FedML, Inc.”
5. https://scholar.google.com/citations?user=Qhe5ua0AAAAJ&hl=en “Professor Avestimehr publications and research”
6. https://lids.mit.edu/news-and-events/events/coded-computing-transformative-framework-resilient-secure-and-private Laboratory for Information and Decision Systems: Coded Computing: A Transformative Framework for Resilient, Secure, and Private Distributed Learning
7. https://www.itsoc.org/profiles/avestime “Institute of Electrical and Electronics Engineers ”
8. https://www.ieee.org/content/dam/ieee-org/ieee/web/org/about/fellows/2020-ieee-fellow-class.pdf 2020 Newly Elevated Fellows
9. https://www2.eecs.berkeley.edu/Pubs/TechRpts/2008/EECS-2008-128.html “Berkeley EECS:"Wireless network information flow: a deterministic approach”
10. https://lids.mit.edu/news-and-events/events/coded-computing-transformative-framework-resilient-secure-and-private “MIT LABORATORY FOR INFORMATION & DECISION SYSTEMS”
11. https://www.linkedin.com/in/salman-avestimehr-46aa662/ “Avestimehr Linkedin Profile”
12. https://ece.umn.edu/event/ece-colloquium-series-professor-salman-avestimehr/ “University of Minnesota: "Department of Electrical and Computer Engineering”
13. https://www.itsoc.org/honors/massey-award “James L. Massey Research & Teaching Award for Young Scholars”
14. http://www.okawa-foundation.or.jp/en/activities/research_grant/list_2015.html “The Okawa Foundation for Information and Telecommunications”
15. https://www.itsoc.org/honors/comsoc-information-theory-joint-paper-award “Communications Society & Information Theory Society Joint Paper Award”
16. https://obamawhitehouse.archives.gov/the-press-office/2011/09/26/president-obama-honors-outstanding-early-career-scientists “President Obama Honors Outstanding Early-Career Scientists”
17. https://mobile.facebook.com/story.php?story_fbid=646376432166763&substory_index=0&id=148321261972285 “Iranian Who's who”
18. http://news.cornell.edu/stories/2010/02/salman-avestimehr-receives-nsf-career-award “Cornell Chronicle"Salman Avestimehr receives NSF early career award”
19. https://www.nsf.gov/awardsearch/showAward?AWD_ID=0953117 “NSF:"Award Abstract #0953117”
20. Book: A. Avestimehr Salman . Suhas N. Diggavi . Chao Tian. David N. C. Tse . An Approximation Approach to Network Information Theory . Now Publishers. 2015 . 198 . 978-1-68083-026-2 .
21. Book: I. Shomorony . A. Avestimehr Salman . Multihop Wireless Networks: A Unified Approach to Relaying and Interference Management . Now Publishers. 2014 . 131 . 978-1-60198-904-8 .
22. Book: Songze Li . A. Avestimehr Salman . Coded Computing . Now Publishers. 2020 . 148 . 978-1-68083-704-9 .
23. Book: Kiana Avestimehr . A. Avestimehr Salman . amp . Problem Solving Strategies for Elementary-School Math . Now Publishers. 2020 . 124 . 978-1-68083-984-5.
24. https://arxiv.org/abs/2007.13518 “Group Knowledge Transfer: Federated Learning of Large CNNs at the Edge”
25. https://arxiv.org/abs/2007.13518 “FedML: A research library and benchmark for federated machine learning”
26. https://arxiv.org/abs/1806.00939 “Lagrange Coded Computing: Optimal Design for Resiliency, Security and Privacy”
27. https://experts.illinois.edu/en/publications/gradiveq-vector-quantization-for-bandwidth-efficient-gradient-agg “Illinois experts:" Vector quantization for bandwidth-efficient gradient aggregation in distributed CNN training”
28. https://www.researchgate.net/publication/301648426_A_Fundamental_Tradeoff_between_Computation_and_Communication_in_Distributed_Computing “ResearchGate:"A Fundamental Tradeoff between Computation and Communication in Distributed Computing”
29. https://dl.acm.org/citation.cfm?id=3179923 “IEEE/ACM Transactions on Networking Journal ”
30. https://ieeexplore.ieee.org/document/7857805 “IEEE Digital Library”
31. https://www.semanticscholar.org/paper/Coding-for-Distributed-Fog-Computing-Li-Maddah-Ali/ad265f389a2d67cf64442c1953c0dba53431a1b3 “Semantic Scholar:"Coding for Distributed Fog Computing”