In the Developmental Intelligence Laboratory, we are interested in understanding fundamental cognitive mechanisms of human intelligence, human learning, and human interaction and communication in everyday activities. To do so, we collect and analyze micro-level multimodal behavioral data using state-of-the-art sensing and computational techniques. One of our primary research aims is to understand human learning and early development. How do young children acquire fundamental knowledge of the world? How do they select and process the information around them and learn from scratch? How do they learn to move their bodies and to communicate and interact with others? Learning this kind of knowledge and skills is the core of human intelligence. To understand how human learners achieve the learning goal, the primary approach in our research is to attach GoPro-like cameras on the head of young children to record egocentric video from their point of view. Using this innovative approach, we've been collecting video data of children’s everyday activities, such as playing with their parents and their peers, reading books with parents and caregivers, and playing outside. We've been using state-of-the-art machine learning and data mining approaches to analyze high-density behavioral data. This research line will ultimately solve the mystery on why human children are such efficient learners. Moreover, the findings from our research will be used to help improve learning of children with developmental deficits. A complimentary research line is to explore how human learning can teach us about how machines can learn. Can we model and simulate how a human child learns and develops? To this end, our research aims at bridging and connecting developmental science in psychology and machine learning and computer vision in computer science.
Being highly enthusiastic about research in deep learning I was always searching for unexplored areas in the field (Though it is tough to find one). I had previously worked on Maths word problem…
This study examined the question, ‘What is the impact of a digital math intervention on secondary ELL
students’ mathematical capabilities and perceptions of their future possibilities?’ The hypothesis was
that through its direct effect on increasing students’ math ability and its indirect effect on increasing
students’ perceived math self-efficacy, the digital intervention affects students’ perceptions of their
functionings and future possibilities. A path analysis, with qualitative data nested into the design, was
used to analyze the conceptualized relationships. The study was conducted with 50 ninth-and-10thgrade
Hispanic students in a Colorado high school, over 6 months. The primary finding was that
through its direct effect on increasing students’ math ability and its indirect effect on increasing students’
perceived math self-efficacy, the digital intervention improved students’ perceptions of their functionings
and future possibilities. What this study specifically underscores is the importance of taking
a coherent and purposeful approach toward the design of digital student-directed educational technology,
especially for ELL students who may have specific learning needs.
Abridged transcription of his talk about the different affordances of various media, especially books and screens. For the former, written text is foregrounded, whereas images are foregrounded for the latter.
J. Choi, A. Khlif, and E. Epure. Proceedings of the 1st Workshop on NLP for Music and Audio (NLP4MusA), page 23--27. Online, Association for Computational Linguistics, (2020)
J. Choi, A. Khlif, and E. Epure. Proceedings of the 1st Workshop on NLP for Music and Audio (NLP4MusA), page 23--27. Online, Association for Computational Linguistics, (2020)
G. Cheema, S. Hakimov, A. Sittar, E. Müller-Budack, C. Otto, and R. Ewerth. Findings of the Association for Computational Linguistics: NAACL 2022, Seattle, WA, United States, July 10-15, 2022, page 962--979. Association for Computational Linguistics, (2022)
S. Hakimov, G. Cheema, and R. Ewerth. Proceedings of the 16th International Workshop on Semantic Evaluation, SemEval@NAACL 2022, Seattle, Washington, United States, July 14-15, 2022, page 756--760. Association for Computational Linguistics, (2022)
L. Lucignano, F. Cutugno, S. Rossi, and A. Finzi. Proceedings of the 15th ACM on International Conference on Multimodal Interaction, page 197–204. New York, NY, USA, Association for Computing Machinery, (2013)
J. Shi, C. Otto, A. Hoppe, P. Holtz, and R. Ewerth. Proceedings of the 1st International Workshop on Search as Learning with Multimedia Information (SALMM), page 11–19. New York, NY, USA, Association for Computing Machinery, (2019)
A. Vovk, D. Gasques, F. Wild, and N. Weibel. Proceedings of the 2019 CHI Conference Extended Abstracts on Human Factors in Computing Systems, New York, NY, USA, ACM, (2019)Workshop.
S. Scherer, N. Weibel, L. Morency, and S. Oviatt. Proceedings of the 1st International Workshop on Multimodal Learning Analytics, page 1:1--1:8. New York, NY, USA, ACM, (2012)Workshop Paper.
S. Oviatt, A. Cohen, and N. Weibel. Proceedings of the 15th ACM on International Conference on Multimodal Interaction, page 563--568. New York, NY, USA, ACM, (2013)Workshop.
X. Ochoa, M. Worsley, N. Weibel, and S. Oviatt. Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, page 498--499. New York, NY, USA, ACM, (2016)Workshop.
A. Piper, N. Weibel, and J. Hollan. Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility, page 203--210. New York, NY, USA, ACM, (2010)
L. Morency, S. Oviatt, S. Scherer, N. Weibel, and M. Worsley. Proceedings of the 15th ACM on International Conference on Multimodal Interaction, page 373--378. New York, NY, USA, ACM, (2013)Workshop.
A. Fouse, N. Weibel, E. Hutchins, and J. Hollan. CHI '11 Extended Abstracts on Human Factors in Computing Systems, page 299--304. New York, NY, USA, ACM, (2011)Demo.
A. Piper, N. Weibel, and J. Hollan. Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work Companion, page 269--270. New York, NY, USA, ACM, (2012)Demo.
P. Gebhard, T. Schneeberger, T. Baur, and E. André. Proceedings of the Seventeenth International Conference on Autonomous Agents and Multiagent Systems (AAMAS '18), Stockholm, Sweden, page ?--?. New York, ACM, (2018)to appear.
M. Moniri, D. Sonntag, and A. Luxenburger. Adjunct Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16), Heidelberg, Germany, page 333--336. New York, ACM, (2016)
Y. Körber, V. Hahn, M. Moniri, T. Schwartz, and M. Feld. Proceedings of the 13th IEEE International Conference on Intelligent Environments (IE '17), Seoul, South Korea, page 184--187. Los Alamitos, CA, IEEE Computer Society, (2017)
M. Barz, M. Moniri, M. Weber, and D. Sonntag. Adjunct Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp '16), Heidelberg, Germany, page 17--20. New York, ACM, (2016)
M. Moniri, A. Luxenburger, W. Schuffert, and D. Sonntag. Proceedings of the International Conference on Artificial Reality and Telexistence and Eurographics Symposium on Virtual Environments (ICAT-EGVE '16), Little Rock, AR, USA, page 37--44. Geneve, Switzerland, Eurographics Association, (2016)
M. Moniri, and C. Müller. Adjunct Proceedings of the 6th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '14), Seattle, WA, USA, page 256--261. New York, ACM, (2014)
A. Prange, D. Schmidt, and D. Sonntag. 30th IEEE International Symposium on Computer-Based Medical Systems, CBMS 2017, Thessaloniki, Greece, June 22--24, 2017, page 773--774. Los Alamitos, CA, IEEE Computer Society, (2017)
P. Gebhard. Proceedings of the Fourth International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS '05), Utrecht, The Netherlands, page 29--36. New York, ACM, (2005)
R. Neßelrath, T. Becker, M. Reiplinger, and T. Schwartz. Intelligente Vernetzung in der Fabrik: Industrie 4.0 Umsetzungsbeispiele für die Praxis, Fraunhofer Verlag, Stuttgart, (2015)
N. Pfleger, T. Becker, D. Neisens, and T. Schwartz. Intelligente Vernetzung in der Fabrik: Industrie 4.0 Umsetzungsbeispiele für die Praxis, Fraunhofer Verlag, Stuttgart, (2015)
R. Neßelrath, and M. Feld. Proceedings of the 10th International Conference on Intelligent Environments (IE-14), Shanghai, China, page 162--169. Los Alamitos, CA, IEEE Computer Society, (2014)