Publications

Pre-registration/Preprint/Submitted/Under review/Revision

Pearson, L., Thomas Nuttall, Pouw, W. (preprint). Landscapes of coarticulation: The co-structuring of gesture-vocal dynamics in Karnatak vocal performance.
Preprint doi: 10.31234/osf.io/npm96
Multimodal data dashboard

Bögels, S., Li, T., Rasenberg, M., Eijk, L., Toni, I., Pouw, W. (preprint). There is a power law of joint communicative effort and it reflects communicative work.
Preprint doi: 10.31234/osf.io/k8se5

Pouw, W., Werner, R., Burchardt, L. S., Selen, L. (under major revision). The human voice aligns with whole-body kinetics.
Preprint doi: 10.1101/2023.11.28.568991
RMarkdown

Leonetti, S., Ravignani, A., Pouw, W. (under major revision). Movement underpins sound production on multiple levels across species.

Pouw, W., Kehy, M., Gamba, M., Ravignani, A. (under major revision). Cross-modal Constraints in Multimodal Vocalizations in Siamang (Symphalangus syndactylus).
Preprint doi: 10.32942/X2C595

Bosker**, H., Hoetjes**, M., Pouw**, W., van Maastricht**, L. (under review). Foreign language learners show a kinematic accent in their gestures.
** Shared first authorship

2024/in press/ accepted

Ghaleb, E., Khaertdinov, B., Pouw, W., Rasenberg, M., Holler, J., Özyürek, A. & Fernández, R. (Accepted). Learning co-Speech gesture Rrpresentations in dialogue through contrastive learning: An intrinsic evaluation. In Proceedings of the 26th ACM International Conference on Multimodal Interaction, 2024. doi: 10.1145/3678957.3685707

Owoyele, B. A., Schilling, M., Sawahn, Rohan, Kaemer, N., Zherebenkov, P., Verma, B., Pouw, W., de Melo, G. (conditionally accepted). MaskAnyone Toolkit: Offering Strategies for Minimizing Privacy Risks and Maximizing Utility in Audio-Visual Data Archiving. In Proceedings of the 2024 International Conference on Information Systems (ICIS2024).

Eigsti, I., Pouw, W. (Accepted). Deliberate synchronization of speech and gesture: Effects of neurodiversity and development. Language and Cognition.

Burchardt, L. B., van de Sande, Y., Kehy, M., Gamba, M., Ravignani, A., Pouw, W. (2024). A toolkit for the dynamic study of air sacs in siamang and other elastic circular structures. PLOS Computational Biology.
doi (open access): 10.1371/journal.pcbi.1012222

Weston, H., Pouw, W., Fuchs. S. (2024). On the relation between leg-motion rate and speech tempo during submaximal cycling exercise. Journal of Speech, Language, and Hearing Research.
doi (open Access): 10.1044/2023_JSLHR-23-00178

Werner, R., Selen, L., Pouw, W. (2024). Arm movements increase acoustic markers of expiratory flow. Proceedings of the International Conference of Speech Prosody (Speech Prosody 2024).
Preprint doi: 10.1101/2024.01.08.574611

Pouw, W., Burchardt, L. S., Werner, R., Selen, L. (2024). Movement-related muscle activity and kinetics affect vocalization amplitude. In Proceedings of the International Conference on the Evolution of Language (Evolang2024).
doi: 10.17617/2.3587960
PDF Proceedings

Fuchs, S., Kadavá, Š., Pouw, W., , Walker, B., Fay, N., Winter, B., A. Cwiek (2024). Exploring the sound structure of novel vocalizations. In Proceedings of the International Conference on the Evolution of Language (Evolang2024).

Kadavá, Š., Cwiek, A., Fuchs, S., Pouw, W. (2024). What do we mean when we say gestures are more expressive than vocalizations? An experimental and simulation study. In Proceedings of the annual meeting of the Cognitive Science Society 2024.
PDF (author copy)

Ghaleb, E., Rasenberg, M., Pouw, W., Holler, J., Toni, I., Özyürek, A., Fernández, R. (2024). Analysing cross-speaker convergence through the lens of automatically detected shared linguistic constructions. In Proceedings of the annual meeting of the Cognitive Science Society 2024.
PDF (author copy)

Van de Sande, Y., Pouw*, W., Southern*, L. (2024). Automated recognition of grooming behavior in wild chimpanzees. Proceedings of the annual meeting of the Cognitive Science Society 2024.
PDF (online)
*shared supervision/senior authorship

2023

Jenkins, T., Pouw**, W. (2023). A kinematic-acoustic analysis of gesture-speech coupling in aphasia. Journal of Experimental Psychology: General.
doi: 10.1037/xge0001346
** Shared first authorship
PDF (author copy)

Kadavá, Š., Cwiek, A., Fuchs, S., Pouw, W. (2023). Is gesture-speech physics at work in rhythmic pointing? Evidence from Polish counting-out rhymes. Proceedings of the 20th International Congress of Phonetic Sciences (ICPhS), Prague, 7-8 August 2023.

Gregori, A., Amici F., Brilmayer, I., Cwiek, O., Fritzsche L., Fuchs, S, Henlein, A., Herbort O., Kügler F., Lemanski, J., Liebal, K., Lücking A., Mehler, A., Nguyen K. T., Pouw. W., Prieto, P., Rohrer P., Sanchez-Ramon P.G., Schulte-Rüther, M., Schumacher, P., Schweinberger S., Struckmeier V., Trettenbrein P., von Eiff, C. (2023). A roadmap for technological innovation in multimodal communication research. In: Duffy, V.G. (eds) Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. HCII 2023. Lecture Notes in Computer Science, vol 14029. pp. 402-438. Springer, Cham.
doi: 978-3-031-35748-0_30
PDF (author copy)

Ghaleb, E., Burenko, I., Rasenberg, M., Pouw, W., Uhrig, P., Holler, J., Toni, I., Ozyurek, O., Fernández, R. (accepted). Co-Speech gesture detection through multi-phase sequence labeling. In IEEE/CVF Winter Conference on Applications of Computer Vision (WACV).
Preprint doi: 10.48550/arXiv.2308.10680

2022

Owoyele, B., Trujillo, J., De Melo, G., Pouw, W. (2022). Masked-Piper: Masking personal identities in visual recordings while preserving multimodal information. SoftwareX.
doi (open Access): 10.1016/j.softx.2022.101236

Pouw, W., Fuchs, S. (2022). Origins of vocal-entangled gesture. Neuroscience and Biobehavioral Reviews.
doi (open Access): 10.1016/j.neubiorev.2022.104836

Eijk, L., Rasenberg, M, Arnese, F., Blokpoel, M., Dingemanse, M., Doeller, C., Ernestus, M., Holler, J., Milivojevic, B., Ozyurek, A., Pouw, W., van Rooij, I., Schriefers, H., Toni, I., Trujillo, J., Bogels, S. (Accepted). The CABB dataset: A multimodal corpus of communicative interactions for behavioural and neural analyses. NeuroImage.
doi (open access): 10.1016/j.neuroimage.2022.119734

Pouw, W., Harrison, S. J., Dixon, J. A. (2022). The importance of visual control and biomechanics in the regulation of gesture-speech synchrony for an individual deprived of proprioceptive feedback of body position. Scientific Reports.
doi (open access): 10.1038/s41598-022-18300-x
OPEN DATA OSF

Pouw, W., Dixon, J. A. (2022). What you hear and see specifies the perception of a limb-respiratory-vocal act (commentary) Proceedings of the Royal Society B, 289(1979), 1-2.
doi (open access): rspb.2022.1026

Pearson**, L. , Pouw**, W.(2022). Gesture-vocal Coupling in Karnatak Music Performance: A Neuro-bodily Distributed Aesthetic Entanglement. Annals of the New York Academy of the Sciences.
doi (open access): 10.1111/nyas.14806
** Shared first authorship
OPEN DATA OSF

Pouw, W., Holler, J. (2022). Timing in conversation is dynamically adjusted turn by turn in dyadic telephone conversations. Cognition.
doi (open access): 10.1016/j.cognition.2022.105015
OPEN DATA OSF

Rasenberg, M. Pouw, W., Ozyurek, A., Dingemanse, M. (2022). The multimodal nature of communicative efficiency in social interaction. Scientific Reports.
doi (open access): 10.1038/s41598-022-22883-w
OPEN DATA Donders Repository

2021

Pouw, W., Dingemanse, M., Motamedi, Y., Özyürek, A. (2021). A systematic investigation of gesture kinematics in evolving manual languages in the lab. Cognitive Science.
doi (open access): 10.1111/cogs.13014
OPEN DATA & RMarkdown

Pouw, W., Proksch, S., Drijvers, L., Gamba, M., Holler, J., Kello, C., Scheafer, R., Wiggins, G. (2021). Multilevel rhythms in multimodal communication. Philosophical Transactions of the Royal Society B: Biological Sciences.
doi: 10.1098/rstb.2020.0334
PDF (author copy)

Pouw, W., de Wit, J., Bögels, S., Rasenberg, M., Milivojevic, B., Ozyurek, A. (2021). Semantically related gestures move alike: Towards a distributional semantics of gesture kinematics. In: Duffy V.G. (eds) Digital Human Modeling and Applications in Health, Safety, Ergonomics and Risk Management. Human Body, Motion and Behavior. HCII 2021. Lecture Notes in Computer Science, vol 12777. Springer, Cham. https://doi.org/10.1007/978-3-030-77817-0_20
OPEN DATA OSF
PDF (author copy)

Brown, A., Pouw, W., Brentari, D., Goldin-Meadow, S. (2021). When hands are used to communicate they are less susceptible to illusion than when they are used to estimate. Psychological Science. doi: 10.1177/0956797621991552
OPEN DATA OSF
PDF (author copy)

Pouw, W., de Jonge-Hoekstra, L., Harrison, S., J., Paxton, A., & Dixon, J. A. (2021). Gesture-speech physics in fluent speech and rhythmic upper limb movements. Annals of the New York Academy of the Sciences.
doi (open access): 10.1111/nyas.14532
OPEN DATA & RMarkdown

2020

Pouw, W., Paxton, A., Harrison, S. J., & Dixon, J. A. (2020). Reply to Ravignani and Kotz: Physical impulses from upper-limb movements impact the respiratory-vocal system. Proceedings of the National Academy of Sciences. doi: 10.1073/pnas.2015452117
PDF (author copy)

Pouw, W. Harrison, S. J., Esteve-Gibert, N., Dixon, J.A. (2020). Energy flows in gesture-speech physics: The respiratory-vocal system and its coupling with hand gestures. The Journal of the Acoustical Society of America, 148, 1231-1247. doi: 10.1121/10.0001730
OPEN DATA and PREREGISTRATION OSF
PDF (author copy)

Hostetter, A., Pouw, W., Wakefield, E. (2020). Learning from gesture and action: An investigation of memory for where objects went and how they got there. Cognitive Science. doi: 10.1111/cogs.12889
OPEN DATA and PREREGISTRATION OSF
PDF (author copy)

Pouw, W., Jaramillo, J., Dixon, J.A., Ozyurek, A. (Accepted). Quasi-rhythmic features of hand gestures show unique modulations within languages: Evidence from bilingual speakers. Proceedings of the 7th meeting of Gesture and Speech in Interaction - GESPIN2020
PDF (author copy)

Dowell, C., Hajnal, A., Pouw, W. , Wagman, J. (2020). Visual and haptic perception of affordances of feelies. Perception, 49(9), 905-925.
doi: 10.1177/0301006620946532
PDF (author copy)

Pouw, W., Paxton, A., Harrison, S. J., & Dixon, J. A. (2020). Acoustic information about upper limb movement in voicing. Proceedings of the National Academy of Sciences , 117(21), 11364-11367.
doi (open access): 10.1073/pnas.2004163117
OPEN DATA and PREREGISTRATION OSF

Pouw**, W., Trujillo**, J.P., Dixon, J.A. (2020). The quantification of gesture-speech synchrony: An overview and validation of video-based motion tracking. Behavior Research Methods, 52, 723-740.
doi (open access): 10.3758/s1342
OPEN DATA OSF
**Shared first Authorship

Pouw, W., & Dixon, J. A. (2020). Gesture networks: Introducing dynamic time warping and network analysis for the kinematic study of gesture ensembles. Discourse Processes, 57(4), 301-319. doi: 10.1080/0163853X.2019.1678967
OPEN DATA OSF
PDF (author copy)

2019

Pouw, W., Harrison, S. J. & Dixon, J. A. (2019). Gesture–speech physics: The biomechanical basis for the emergence of gesture-speech synchrony. Journal of Experimental Psychology: General, 149(2), 391-404. doi: 10.1037/xge0000646>
OPEN DATA and PREREGISTRATION OSF
PDF (author copy)

Pouw, W., Dixon, J. A. (2019). Entrainment and modulation of gesture-speech synchrony under delayed auditory feedback. Cognitive Science, 43(3). doi: 10.1111/cogs.12721
Open Access doi: 10.1111/cogs.12721
OPEN DATA and PREREGISTRATION OSF

Pouw**, W., Rop**, G., de Koning, B., Paas, F (2019). The cognitive basis for the split-attention effect. Journal of Experimental Psychology: General. doi: 10.1037/xge0000578
Preprint PDF PsyArxiv:
**Shared first authorship
OPEN DATA and PREREGISTRATION (exp2) OSF

Kamermans, K. L.**, Pouw**, W., Fassi, L., Aslanidou, A., Paas, F, A., Hostetter, (2019). Reinterpretation in multimodal imagery and the role of manual enactment. Acta Psychologica, 197 , 131-124. doi: 10.1037/10.1016/j.actpsy.2019.05.004
**Shared first Authorship
Preprint PDF PsyArxiv: https://psyarxiv.com/esk6v/

Pouw, W., Paxton, A., Harrison, S.J., & Dixon, J. A. (2019). Acoustic specification of upper limb movement in voicing. In: Grimminger, A. (Ed.): Proceedings of the 6th meeting of Gesture and Speech in Interaction - GESPIN 6 (pp. 68-74). Paderborn: Universitaetsbibliothek Paderborn.
Open Access doi: 10.17619/UNIPB/1-812
OPEN DATA OSF

Pouw, W. & Dixon, J. A. (2019). Quantifying gesture-speech synchrony. In: Grimminger, A. (Ed.): Proceedings of the 6th meeting of Gesture and Speech in Interaction - GESPIN 6 (pp. 75-80). Paderborn: Universitaetsbibliothek Paderborn.
Open Access doi: 10.17619/UNIPB/1-815
OPEN DATA OSF
CORRIGENDUM

Kamermans**, K., Pouw**, W. T. J. L., Mast, F. W., Paas, F (2019). Reinterpretation in Visual Imagery Is Possible without Visual Cues: A Validation of Previous Research. Psychological Research , 38 (6), 1237-1250.doi: 10.1007/s00426-017-0956-5
OPEN DATA OSF
**Shared first Authorship

2018

Pouw, W.**, Wassenburg, S.**, de Koning, B., Hostetter, A., Paas, F (2018). Does gesture strengthen sensorimotor knowledge of objects? The case of the size-weight illusion. Psychological Research. doi: 10.1007%2Fs00426-018-1128-y **Shared first Authorship
Preprint PDF PsyArxiv doi: 10.17605/OSF.IO/SVHMR
OPEN DATA and PREREGISTRATION OSF

Eielts**, C., Pouw**, W., Ouwehand, K., Van Gog, T., Zwaan, R. A., Paas, F (2018). Co-thought Gesturing Supports More Complex Problem Solving in Subjects with Lower Visual Working-memory Capacity. Psychological Research. doi: 10.1007/s00426-018-1065-9
**Shared first Authorship
OPEN DATA OSF

Pouw, W. T. J. L., Gog, T., Zwaan, R. A., Agostinho, S., Paas, F (2018). The role of co-thought gestures, visual working memory, and task complexity in problem-solving: A replication study with children (8-12 yrs). Applied Cognitive Psychology, 32, 66-88. doi: 10.1002/acp.3380
PDF OPEN DATA + PRE-REGISTRATION OSF

2017

Kamermans, K. L.**, Pouw, W.**,, Fred W. Mast, Fred Paas (2017). Reinterpretation in visual imagery is possible without visual cues: a validation of previous research. Psychological Research. doi: 10.1007/s00426-017-0956-5
PDF OPEN DATA OSF

Pouw, W., Aslanidou, A., Kamermans, K., Paas, F (2017). Is ambiguity detection in haptic imagery possible? Evidence for enactive imaginings. In G. Gunzelmann, A. Howes, T. Tenbrink, & E. J. Davelaar (Eds.), Proceedings of the 39th Annual Conference of the Cognitive Science Society (pp. 2925-2930). Austin, TX: Cognitive Science Society.
PDF OPEN DATA OSF

Pouw, W. T. J. L., Van Gog, T., Zwaan, R. A., Paas, F (2017). Are gesture and speech mismatches produced by an integrated gesture-speech system? A more dynamically embodied perspective is needed for understanding gesture-related learning. Behavioral and Brain Sciences, 40. doi: 10.1017/S0140525X15003039.
PDF

2016

Van Wermeskerken, M., Fijan, N., Eielts, E. C., Pouw, W. T. J. L. (2016). Observation of depictive- versus tracing gestures selectively aids verbal versus visual-spatial learning in primary school children. Applied Cognitive Psychology, 30, 806-814. doi: 10.1002/acp.3256
PDF

Pouw, W. T. J. L., van Gog, T., Zwaan, R. A., Paas, F. (2016). Augmenting Instructional Animations with Sensori-motor Information to Help Children Learn about Physical Systems. Frontiers in Psychology. doi: 10.3389/fpsyg.2016.00860
PDF

Pouw, W. T. J. L. Hostetter, A. (2016). Gesture as predictive action. Invited contribution for Special issue of Reti, Saperi, Linguaggi: Italian Journal of Cognitive Sciences, 3, 57-80. doi:10.12832/83918
PDF

Pouw, W. T. J. L., Eielts, E. C., van Gog, T., Zwaan, R. A., Paas, F. (2016). Does (non-)meaningful sensori-motor engagement promote learning with animated physical Systems? Mind, Brain & Education, 10(2), 91-104. doi: 10.1111/mbe.12105
PDF

Pouw, W. T. J. L., Mavilidi, M., Van Gog, T., Paas, F. (2016). Gesturing during mental problem solving reduces eye movements, especially for individuals with lower visual working memory capacity. Cognitive Processing, 17(3), 269-277. doi: 10.1007/s10339-016-0757-6
PDF

2015

Pouw, W. T. J. L., de Jong, H (2015). Rethinking situated and embodied social psychology. Theory and Psychology. doi:10.1177/0959354315585661 
PDF

2014

Pouw, W. T. J. L., De Nooijer, J. A., Van Gog, T., Zwaan, R. A., Paas, F. (2014a). Toward a more embedded/extended perspective on the cognitive function of gestures. Frontiers in Psychology, 5, 359. doi: 10.3389/fpsyg.2014.00359
PDF

Pouw, W. T. J. L., Van Gog, T., & Paas, F. (2014b). An embedded and embodied cognition review of instructional manipulatives. Educational Psychology Review, 26, 51-72. doi: 10.1007/s10648-014-9255-5

2013

Van Stekelenburg, J., Petrovic, I., Pouw, W. T. J. L., Limburg, N., Nederlof, N. (2013). From correlation to causation: The cruciality of a collectivity in the context of collective action. Journal of Social and Political Psychology, 1, 161–187 doi: 10.5964/jspp.v1i1.38
PDF

2012

IJzerman, H., Gallucci, M., Pouw, W. J. T. L., Weiβgerber, S. C., Van Doesum, N. J., & Williams, K. D. (2012). Cold-blooded loneliness: Social exclusion leads to lower finger temperatures. Acta Psychologica, 140, 283-288. http://dx.doi.org/10.1016/j.actpsy.2012.05.002 (link replication package)doi: 10.3389/fpsyg.2014.00359
PDF

Unpublished pre-registration and exploratory data reports

Pouw, W. Harrison, S., Dixon, J. A. (2018). The physical basis for gesture-speech synchrony: Exploratory study and pre-registration.doi: 10.31234/osf.io/9fzsv
OPEN DATA AND PREREGISTRATION REPORT OSF

Pouw, W., Dixon, J. (2018). Effects of delayed auditory feedback on gesture-speech synchrony: Pre-registration and exploratory study. doi: 10.17605/OSF.IO/3UHPV
OPEN DATA AND PREREGISTRATION REPORT OSF