Imagination is one of the key properties of human intelligence that enables us not only to generate creative products like art and music, but also to understand the visual world.
Research Overview
Education Profile
- Ph.D., Computer Science, Rutgers University, United States, 2016
- M.Sc., Computer Science, Rutgers University, United States, 2014
- M.Sc., Computer Systems, Ain Shams University (ASU), Egypt, 2010
- B.Sc., Computer Systems, Ain Shams University (ASU), Egypt, 2006
Location
Research Interests
Imagination Inspired AI, Computer Vision, Machine Learning, Intersection between Natural Language Processing, and Computer Vision and their applications on both understanding and generation, Sequence-to-Sequence Learning.
Patents
- Adobe Research: Mohamed Elhoseiny, Scott Cohen, Wbalter Chang, Brian Price, Ahmed Elgammal, “Structured knowledge modeling, extraction and localization from images”, US Patent, 2019
- SRI International: Hui Cheng, Jingen Liu, Harpreet Sawhney, Mohamed Elhoseiny, “Zero-shot event detection using semantic embedding”, US, Patent, 2021
Mohamed Elhoseiny is an Assistant Professor in Computer Science (CS) Program at the Visual Computing Center (VCC) in King Abdullah University of Science and Technology (KAUST).
Education and early career
Dr. Elhoseiny received his Ph.D. degree from Rutgers University, New Brunswick, in October 2016 under Prof. Ahmed Elgammal. His work has been widely recognized. In 2018, he received the best paper award for his work on creative fashion generation at ECCV workshop from Tamara Berg of UNC chapel hill and sponsored by IBM Research and JD AI Research. The work got also featured at the New Scientist Magazine and he co-presented it the Facebook F8 annual conference with Camille Couprie. His earlier work on creative art generation was featured by the New Scientist magazine and MIT technology review in 2017, HBO Silicon Valley TV Series ( season 5 episode 3) in 2018. His Creative AI artwork was featured/presented at the best of AI meeting 2017 at Disney (6000+ audience), Facebook's booth at NeurIPS 2017, and the official FAIR video in June 2018. His work on life-long learning was covered at the MIT technology review in 2018. In Nov 2018 and based on his 5-year work on zero-shot learning, Dr. Elhoseiny made significant participation in the United Nations Biodiversity conference (~10,000 audience from >192 countries and tens of important organization) on how AI may benefit biodiversity which reflects in both disease management and climate change.
Areas of expertise and current scientific interests
Dr. Elhoseiny has collaborated with several researchers at Facebook AI Research including Marcus Rohrbach, Yann LeCun, Devi Parikh, Dhruv Batra, Manohar Paluri, Marc'Aurelio Ranzato, and Camille Couprie. He has also fruitfully teamed up with academic institutions including KULeuven (with Rahaf Aljundi and Tinne Tuytelaars), UC Berkeley (with Sayna Ebrahimi and Trevor Darrell), the University of Oxford (with Arslan Chaudry and Philip Torr), and the Technical University of Munich (with Shadi AlBarqouni and Nassir Navab). His primary research interests are in computer vision, the intersection between natural language and vision and computational creativity.
Honors & Awards
- IEEE Senior Member, Area Chair at CVPR21/ICCV21/IJCAI22/ECCV22/ICLR23, Session Chair at WACV22
- The organizer of the first workshop on “Closing the Loop Between Vision and Language (CLVL)” in ICCV 2015 at Chile (Santiago), ICCV 2017 at Italy (Venice), ICCV 2019 at South Korea (Seoul), ICCV 2021(virtual), featured in ICCV21 daily magazine.
- Program Chair and Co-founder of the SAAI Initiative (Art& AI Symposium and multi-stage Hackathon); https://saai.devpost.com/ in partnership with several international organizations and several hubs at Berlin, Bangalore, KAUST, San Francisco, Zurich.
- I have authored/co-authored more than 50 publications at the premier Computer Vision and Machine Learning conferences and journals.
- Media Attention of five different projects in MIT technology review, New Scientist, and others in 2017-2018
- Best paper award for his work on creative fashion generation at ECCV workshop from Tamara Berg of UNC chapel hill and sponsored by IBM Research and JD AI Research in 2018.
- Dr. Elhoseiny received the Doctoral Consortium award at CVPR 2016 and an NSF Fellowship for his Write-a-Classifier project in 2014.
- Best Paper Award for “DesIGN: Design Inspiration from Generative Networks”at ECCV workshop on Art and Fashion, Sept, 2018
- Nominated to represent Facebook at the United Nations Biodiversity conference by Manohar Paluri , Director of Facebook AI and Jerome Presenti, VP of AI at Facebook.
- My Creative AI Artist demo got featured in the official Facebook AI Research (FAIR) video, June, 2018-present, see at time 1:29 here https://research.fb.com/category/facebook-ai-research/
- Nominated to represent Facebook AI Research (FAIR) at the “Best of AI meeting” that was held at “Disney Innovation Group” to demonstrate Creative Adversarial Networks (CAN), September 2017
- Invited for oral presentation at the main Facebook F8 conference, May, 2018, https://developers.facebook.com/videos/f8-2018/design-design-inspiration-from-generative-networks/
- International Conference on Computer Vision and Pattern Recognition (CVPR) 2016 - Doctorial Consortium award
- Best Research-Intern Award (silver), Vision and Learning Group, Center of Vision Technologies, SRI International, Summer 2014
- NSF Fellowship 2014