Rogerio Schmidt Feris
Principal Scientist and Manager
MIT-IBM Watson AI Lab
I am a principal scientist and manager at the MIT-IBM Watson AI lab. I am broadly interested in teaching machines to see, listen, and read, with little or no supervision, like humans do. In particular, my research work has been centered on data efficiency (learning more from less), model efficiency, and multimodal perception methods that combine vision, sound/speech, and language.
I am passionate about doing fundamental research as well as developing systems that make a real-world impact. My work has not only been published in top AI conferences, but has also been integrated into multiple products, and covered by media outlets such as the New York Times, ABC News, and CBS 60 minutes. See my bio for more information about me.
Our work on AI/ML for auto-curation of sports highlights has been selected for a Technology and Engineering Emmy award! Our system has been used to automatically produce the official highlights of the USOpen, Wimbledon, and Masters tournaments.
We received the award in Las Vegas, as part of the National Association of Broadcasters (NAB) ceremony -- April 16, 2023
We received a best paper award honorable mention at WACV 2023
Area Chair: NeurIPS 2023, ICCV 2023, ICLR 2023, CVPR 2023, NeurIPS 2022, ICLR 2022, NeurIPS 2021, CVPR 2021, ICML 2021, ICLR 2021, NeurIPS 2020, ECCV 2020, CVPR 2020, NeurIPS 2019, NeurIPS 2018, ACM MM 2017, CVPR 2017, CVPR 2016, CVPR 2015, ISVC 2015, ICCV 2015
Associate Editor: IEEE Transactions on Pattern Analysis and Machine Intelligence (2018-2023)
See more Professional Activities
- DARPA Learning with Less Labels (2019-2023)
- IARPA Deep Intermodal Video Analytics (2017-2021)
Peihao Wang, Rameswar Panda, Lucas Torroba Hennigen, Philip Greengard, Leonid Karlinsky, Rogerio Feris, David Cox, Zhangyang Wang, Yoon Kim
ICLR 2023 (notable-top-25%)
[Paper] [Project Page] [Code]
Aadarsh Sahoo, Rameswar Panda, Rogerio Feris, Kate Saenko, Abir Das
WACV 2023 (Best Paper Award Honorable Mention)
Manel Baradad, Chun-Fu Chen, Jonas Wulff, Tongzhou Wang, Rogerio Feris, Antonio Torralba, Phillip Isola
Yo-whan Kim, Samarth Mishra, SouYoung Jin, Rameswar Panda, Hilde Kuehne, Leonid Karlinsky, Venkatesh Saligrama, Kate Saenko, Aude Oliva, Rogerio Feris
Amit Alfassy, Assaf Arbelle, Oshri Halimi, Sivan Harary, Roei Herzig, Eli Schwartz, Rameswar Panda, Michele Dolfi, Christoph Auer, Peter W. J. Staar, Kate Saenko, Rogerio Feris, Leonid Karlinsky
Samarth Mishra, Rameswar Panda, Cheng Perng Phoo, Chun-Fu Chen, Leonid Karlinsky, Kate Saenko, Venkatesh Saligrama, Rogerio Feris
Sivan Harary, Eli Schwartz, Assaf Arbelle, Peter Staar, Shady Abu-Hussein, Elad Amrani, Roei Herzig, Amit Alfassy, Raja Giryes, Hilde Kuehne, Dina Katabi, Kate Saenko, Rogerio Feris, Leonid Karlinsky
CVPR 2022, Oral
N. Shvetsova, B. Chen, A. Rouditchenko, S.Thomas, B. Kingsbury, R. Feris, D. Harwath, J. Glass, and H. Kuehne
Bowen Pan, Rameswar Panda, Yifan Jiang, Zhangyang Wang, Rogerio Feris, Aude Oliva
Ashraful Islam, Chun-Fu Chen, Rameswar Panda, Leonid Karlinsky, Rogerio Feris, Richard J. Radke
Rameswar Panda, Chun-Fu Chen, Quanfu Fan, Ximeng Sun, Kate Saenko, Aude Oliva, Rogerio Feris
Ashraful Islam, Chun-Fu Chen, Rameswar Panda, Leonid Karlinsky, Richard Radke, Rogerio Feris
Assaf Arbelle, Sivan Doveh, Amit Alfassy, Joseph Shtok, Guy Lev, Eli Schwartz, Hilde Kuehne, Hila Barak Levi, Prasanna Sattigeri, Rameswar Panda, Chun-Fu Chen, Alex Bronstein, Kate Saenko, Shimon Ullman, Raja Giryes, Rogerio Feris, Leonid Karlinsky
ICCV 2021, Oral
Brian Chen, Andrew Rouditchenko, Kevin Duarte, Hilde Kuehne, Samuel Thomas, Angie Boggust, Rameswar Panda, Brian Kingsbury, Rogerio Feris, David Harwath, James Glass, Michael Picheny, Shih-Fu Chang
Andrew Rouditchenko, Angie Boggust, David Harwath, Brian Chen, Dhiraj Joshi, Samuel Thomas, Kartik Audhkhasi, Hilde Kuehne, Rameswar Panda, Rogerio Feris, Brian Kingsbury, Michael Picheny, Antonio Torralba, James Glass
Andrew Rouditchenko, Angie Boggust, David Harwath, Samuel Thomas, Hilde Kuehne, Brian Chen, Rameswar Panda, Rogerio Feris, Brian Kingsbury, Michael Picheny, James Glass
Hui Wu, Yupeng Gao, Xiaoxiao Guo, Ziad Al-Halah, Steven Rennie, Kristen Grauman, Rogerio Feris
Mathew Monfort, SouYoung Jin, Alexander Liu, David Harwath, Rogerio Feris, James Glass, Aude Oliva
Chun-Fu Chen, Rameswar Panda, Kandan Ramakrishnan, Rogerio Feris, John Cohn, Aude Oliva, Quanfu Fan
Yue Meng, Rameswar Panda, Chung-Ching Lin, Prasanna Sattigeri, Leonid Karlinsky, Kate Saenko, Aude Oliva, Rogerio Feris
Leonid Karlinsky, Joseph Shtok, Amit Alfassy, Moshe Lichtenstein, Sivan Harary, Eli Schwartz, Sivan Doveh, Prasanna Sattigeri, Rogerio Feris, Alexander Bronstein, Raja Giryes
Rameswar Panda, Michele Merler, Mayoore Jaiswal, Hui Wu, Kandan Ramakrishnan, Ulrich Finkler, Chun-Fu Chen, Minsik Cho, David Kung, Rogerio Feris, Bishwaranjan Bhattacharjee
Yue Meng, Chung-Ching Lin, Rameswar Panda, Prasanna Sattigeri, Leonid Karlinsky, Aude Oliva, Kate Saenko, Rogerio Feris
Camilo Fosco, Mathew Monfort, Allen Lee, Rogerio Feris, Carl Vondrick, Aude Oliva
Zhonghao Wang, Mo Yu, Yunchao Wei, Rogerio Feris, Jinjun Xiong, Wen-mei Hwu, Thomas S. Huang, Humphrey Shi
Khoi-Nguyen C. Mac, Dhiraj Joshi, Raymond A. Yeh, Jinjun Xiong, Rogerio S. Feris, Minh N. Do
ICCV 2019, Oral
Amit Alfassy, Leonid Karlinsky, Amit Aides, Joseph Shtok, Sivan Harary, Rogerio Feris, Raja Giryes, Alex M. Bronstein
CVPR 2019, Oral
Yunhui Guo, Honghui Shi, Abhishek Kumar, Kristen Grauman, Tajana Rosing, Rogerio Feris
Top results on the Visual Decathlon challenge (2019)
Leonid Karlinsky, Joseph Shtok, Sivan Harary, Eli Schwartz, Amit Aides, Rogerio Feris, Raja Giryes, Alex M. Bronstein
Michele Merler, Khoi Nguyen C. Mac, Dhiraj Joshi, Quoc Bao Nguyen, Stephen Hammer, John Kent, Jinjun Xiong, Minh N. Do, John R. Smith, Rogerio Feris
IEEE Transactions on MultiMedia (TMM) 2019
Our system was used to produce the official highlights of the USOpen, Wimbledon, and Masters tournaments (and watched by millions of fans worldwide)
Michele Merler, D. Joshi, Khoi-Nguyen C. Mac, Q. Nguyen, Stephen Hammer, John Kent, Jinjun Xiong, Minh Do, John Smith, Rogerio Feris
CVPR Workshop on Sight and Sound, 2018
Eli Schwartz, Leonid Karlinsky, Joseph Shtok, Sivan Harary, Mattias Marder, Rogerio Feris, Abhishek Kumar, Raja Giryes, Alex M. Bronstein
NeurIPS 2018, Spotlight
Abhishek Kumar, Prasanna Sattigeri, Kahini Wadhawan, Leonid Karlinsky, Rogerio Feris, William T. Freeman, Gregory Wornell
Bowen Cheng, Yunchao Wei, Honghui Shi, Rogerio Feris, Jinjun Xiong, Thomas Huang
DCR achieved state-of-the-art results on Pascal VOC and MS-COCO
Zuxuan Wu, Tushar Nagarajan, Abhishek Kumar, Steven Rennie, Larry S. Davis, Kristen Grauman, Rogerio Feris
CVPR 2018, Spotlight
Xi Peng, Zhiqiang Tang, Fei Yang, Rogerio Feris, Dimitris Metaxas
Yongxi Lu, Abhishek Kumar, Shuangfei Zhai, Yu Cheng, Tara Javidi, Rogerio Feris
CVPR 2017, Spotlight
Rogerio Feris, Behjat Siddiquie, James Petterson, Yun Zhai, Ankur Datta, Lisa Brown, Sharath Pankanti
IEEE Transactions on Multimedia, 2012
See also: Feris et al, Attribute-based Vehicle Search in Crowded Surveillance Videos, ICMR 2011
Ramesh Raskar, Karhan Tan, Rogerio Feris, Jingyi Yu, Matthew Turk
Rogerio Feris, James Gemmell, Kentaro Toyama, Volker Krueger
Face and Gesture Recognition 2002
Developed as part of the GazeMaster project for videoconferencing. I did this work during my internship at Microsoft Research in 2001.
Recent Invited/Keynote Talks
"Representation Learning based on Synthetic Data"[pdf]
- Google Research India, 2022
- Flatiron Institute, 2022
- Binghamton University, 2022
- University of British Columbia, 2021
"Dynamic Neural Networks for Efficient Multimodal Video Understanding" [Video]
- Boston University AIR Distinguished Speaker Series, 2021
- CVPR 2021 L2ID Workshop
- CVPR 2021 MULA Workshop.
- CVPR 2021 LatinX Workshop
AI We Can Scale, "Learning to Learn" [Video]
- What's Next in AI event, 2020
- ICML 2020 LatinX in AI Workshop
- CVPR 2020 DIRA Workshop
- NeurIPS 2019 EMC^2 Workshop
"Is it All Relative? Interactive Fashion Search based on Relative Natural Language Feedback” [pdf]
- CVPR 2019 FFSS-USAD Workshop
“Speeding Up Deep Neural Networks with Adaptive Computation and Efficient Multi-Scale Architectures”[pdf]
- CVPR 2019 EMC^2 Workshop
"Learning More from Less: Weak Supervision and Beyond" [pdf]
- CVPR 2019 Workshop on Learning from Imperfect Data
A simpler path to better computer vision. MIT News, 2022
A safer, lower-cost alternative to real data for pretraining computer vision models. IBM Research blog, 2022.
Hallucinating to Better Text Translation. Communications of the ACM / MIT News, 2022.
IBM’s StarNet brings explainable AI to image classification. VentureBeat, 2020.
Shrinking deep learning’s carbon footprint. MIT News, 2020.
IBM’s AI creates new labeled image sets using semantic content. VentureBeat, 2019.
Coffee delivery drone patented by IBM. BBC News, 2018.
Enjoy Those U.S. Open Highlights. A Computer Picked Them for You. New York Times, 2017.
How an IBM Computer Picks U.S. Open Highlights. Fortune, 2017.
IBM’s Watson Serves Up This Year’s U.S. Open Highlights. NBC News, 2017.
IBM's Watson is creating US Open tennis highlight videos. Engadget, 2017.
IBM uses AI to serve up Wimbledon highlights. CNet, 2017.
IBM To Provide Wimbledon Highlights Using Artificial Intelligence. SportTechie, 2017.
IBM Watson is creating highlight reels at the Masters. ZDNet, 2017.
Fighting terrorism in New York City. CBS 60 Minutes, 2011. (starting at minute 7:20)
ABC7 puts video analytics to the test. ABC News, 2010.
Cameras help confirm Scott suicide ruling. ABC News, 2009.
Intelligent Iris. ABC News, 2008.
The Nonphotorealistic camera. SlashDot, 2004.
The postings on this site are my own and don't necessarily represent IBM's positions.