Publications and outreach
Table of contents
Publications
We are happy to provide you with publications in International Sign, plain language or in a version suitable for screed readers on request. Link to contact information
- Battisti, A.; Ebling, S. (2024). Automatic Annotation Elaboration as Feedback to Sign Language Learners. In The 18th Linguistic Annotation Workshop (LAW-XVIII), St. Julian’s, Malta, 22 March 2024.
Paper: Automatic Annotation Elaboration ... (PDF)Abstract, screen reader ready: Automatic Annotation Elaboration ... (PDF, 32 KB) - Battisti, A.; van den Bold, E.; Göhring, A.; Holzknecht, F.; Ebling, S. (2024). Person Identification from Pose Estimates in Sign Language. In Proc. 11th Workshop on the Representation and Processing of Sign Languages. LREC-Coling 2024.
Paper: Person Identification from Pose Estimates ... (PDF)
Abstract, screen reader ready: Person Identification from Pose Estimates (PDF, 37 KB)
Bericht (in German): Anonymisierung der Posen (PDF, 159 KB)
DSGS-Video: Anonymisierung der Posen - Carrer, L., Säuberli, A., Kappus, A. and Sarah Ebling. (2024). Towards Holistic Human Evaluation of Automatic Text Simplification. In Proceedings of the Fourth Workshop on Human Evaluation of NLP Systems (HumEval) @ LREC-COLING 2024, pages 71–80, Torino, Italia. ELRA and ICCL.
Paper: Towards Holistic Human Evaluation of Automatic Text Simplification (PDF)
Abstract, screen reader ready: Towards Holistic Human Evaluation ... (PDF, 33 KB)
Studie zur Prüfung von automatisch vereinfachten Texten (Zusammenfassung in leicht verständlichem Deutsch) (PDF, 55 KB) - Cory, O., Sincan, O.M., Vowels, M., Battisti, A., Holzknecht, F., Tissi, K., Sidler-Miserez, S., Haug, T., Ebling, S. and Bowden, R. (2024). Modelling the Distribution of Human Motion for Sign Language Assessment. 12th Workshop on Assistive Computer Vision and Robotics at ECCV.
Paper: Modelling the Distribution of Human Motion for Sign Language Assessment (PDF)
Abstract, screen reader ready: Modelling the Distribution of Human Motion ... (PDF, 72 KB) - El Hajal, K., Hermann, E., Kulkarni, A. and Magimai-Doss, M., (2025). Unsupervised Rhythm and Voice Conversion of Dysarthric to Healthy Speech for ASR. In Proceedings of Workshop on Speech Pathology Analysis and DEtection (SPADE), Hyderabad, India, IEEE, 2025.
Paper: Unsupervised Rhythm and Voice Conversion ... (PDF)
Abstract, screen reader ready: Unsupervised Thythm and Voice Conversion ... (PDF, 33 KB) - El Hajal, K., Hermann, E., Kulkarni, A. and Magimai-Doss, M., (2025). kNN Retrieval for Simple and Effective Zero-Shot Multi-speaker Text-to-Speech. Accepted at NAACL 2025.
Paper: kNN Retrieval for Simple and Effective Zero-Shot Multi-speaker Text-to-Speech (PDF)
Abstract, screen reader ready: kNN Retrieval for ... Multi-speaker Text-to-Speech (PDF, 22 KB) - Fischer, L., Gao, Y., Lintner, A., Rios, A., Ebling, S. (2025): SwissADT: An Audio Description Translation System for Swiss Languages. Accepted at NAACL 2025.
Paper: SwissADT: An Audio Description Translation System for Swiss Languages (PDF)
Abstract, screen reader ready: SwissADT ... (PDF, 35 KB) - Gao, Y., Fischer, L., Lintner, A., Ebling, S. (2024). Audio Description Generation in the Era of LLMs and VLMs: A Review of Transferable Generative AI Technologies. ArXiv.org 2410.08860, University of Zurich.
Paper: Audio Description Generation in the Era of LLMs and VLMs (PDF)
Abstract, screen reader ready: Audio Description Generation ... (PDF, 33 KB) - Hermann, E., Magimai.-Doss, M. (2023). Few-shot Dysarthric Speech Recognition with Text-to-Speech Data Augmentation. In Proceedings INTERSPEECH 2023, p. 156-160.
Paper: Few-shot Dysarthric Speech Recognition with Text-to-Speech Data Augmentation (PDF)
Abstract, screen reader ready: Few-shot Dysarthric Speech Recognition ... (PDF, 36 KB) - Ivashechkin, M.; Mendez, O.; Bowden, R. (2023). Denoising Diffusion for 3D Hand Pose Estimation from Images. In Proc. 11th Workshop on Assistive Computer Vision and Robotics. Int. Conf. on Computer Vision 2023.
- Paper: Denoising Diffusion for 3D Hand Pose Estimation from Images (PDF)
Abstract, screen reader ready: Denoising Diffusion for 3D Hand Pose Estimation ... (PDF, 31 KB)Abstract in International Sign: Denoising Diffusion for 3D Hand Pose Estimation ... (MP4, 23 MB) - Jiang, Z., Göhring, A., Moryossef, A., Sennrich, R., and Ebling, S. (2024). SwissSLi: the Multi-parallel Sign Language Corpus for Switzerland. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 15448–15456, Torino, Italia. ELRA and ICCL.
Full paper: SwissSLi: the Multi-parallel Sign Language Corpus for Switzerland (PDF)
Abstract, screen reader ready: SwissSLi ... (PDF, 35 KB) - Jiang, Z.; Moryossef, A.; Müller, M.; Ebling, S. (2023). Machine Translation between Spoken Languages and Signed Languages Represented in SignWriting. In Findings of the Association for Computational Linguistics: EACL 2023, p. 1706-1724.
Paper: Machine Translation between Spoken Languages and Signed Languages Represented in SignWriting (PDF)
Abstract, screen reader ready: Machine Translation between Spoken Languages and Signed Languages ... (PDF, 52 KB)Abstract in International Sign: Machine Translation between Spoken Languages and Signed Languages ... (MP4, 28 MB) - Kulkarni, A., Tran, H.M., Kulkarni, A., Dowerah, S., Lolive, D., Doss, M.M. (2024.) Exploring generalization to unseen audio data for spoofing: insights from SSL models. In Proc. The Automatic Speaker Verification Spoofing Countermeasures Workshop (ASVspoof 2024), 86-93.
Paper: Exploring Generalization To Unseen Audio Data For Spoofing (PDF) - Abstract: Exploring generalization to unseen audio data for spoofing (HTML)
- Lakhal, M.I ; Bowden, R. (2024). Diversity-Aware Sign Language Production through a Pose Encoding Variational Autoencoder. IEEE 18th International Conference on Automatic Face and Gesture Recognition (FG).
Paper: Diversity-Aware Sign Language Production through a Pose Encoding Variational Autoencoder (PDF)
Abstract, screen reader ready: Diversity-Aware Sign Language Production ... (PDF, 68 KB) - Mascarell, L., Chalumattu, R., and Rios, A. (2024). German Also Hallucinates! Inconsistency Detection in News Summaries with the Absinth Dataset. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 7696–7706, Torino, Italia. ELRA and ICCL.
- Paper (PDF): German Also Hallucinates! Inconsistency Detection in News Summaries with the Absinth Dataset
Paper (HTML): German also Hallucinates! ... - Moryossef, A., Müller, M., Göhring, A., Jiang, Z., Goldberg, Y., and Ebling, S. (2023). An Open-Source Gloss-Based Baseline for Spoken to Signed Language Translation. ArXiv.org 2305.17714, University of Zurich.
Paper: An Open-Source Gloss-Based Baseline for Spoken to Signed Language Translation (PDF)
Abstract, screen reader ready: An Open-Source Gloss-Based Baseline ... (PDF, 50 KB) - Moryossef, A.; Jiang, Z.; Müller, M.; Ebling, S.; and Goldberg, Y. (2023). Linguistically Motivated Sign Language Segmentation. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 12703–12724, Singapore.
Paper: Linguistically Motivated Sign Language Segmentation (PDF).Abstract, screen reader ready: Linguistically Motivated Sign Language Segmentation. (PDF, 59 KB) - Müller, M.; Alikhani, M.; Avramidis, E.; Bowden, R.; Braffort, A.; Camgöz, N. C.; Ebling, S.; España-Bonet, C.; Göhring, A.; Grundkiewicz, R.; Inan, M.; Jiang, Z.; Koller, O.; Moryossef, A.; Rios, A.; Shterionov, D.; Sidler-Miserez, S.; Tissi, K.; and Van Landuyt, D. (2023). Findings of the WMT 2023 Shared Task on Sign Language Translation. In Proceedings of the Eighth Conference on Machine Translation.
Paper: Findings of the WMT 2023 Shared Task on Sign Language Translation (PDF)
Abstract, screen reader ready: Findings of the WMT 2023 Shared Task ... (PDF, 53 KB) - Müller, M.; Ebling, S.; Avramidis, E.; Battisti, A.; Berger, M.; Bowden, R.; Braffort, A.; Camgöz, N. C.; España-Bonet, C.; Grundkiewicz, R.; Jiang, Z.; Koller, O.; Moryossef, A.; Perrollaz, R.; Reinhard, S.; Rios, A.; Shterionov, D.; Sidler-Miserez, S.; Tissi, K.; and Van Landuyt, D. (2022). Findings of the WMT 2022 Shared Task on Sign Language Translation. In Proceedings of the Seventh Conference on Machine Translation, p. 744–772.
Paper: Findings of the WMT 2022 Shared Task on Sign Language Translation (PDF).
Abstract, screen reader ready: Findings of the WMT 2022 Shared Task ... (PDF, 45 KB) - Müller, M.; Jiang, Z.; Moryossef, A.; Rios, A.; and Ebling, S. (2023). Considerations for meaningful sign language machine translation based on glosses. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL). Outstanding Paper Award.
Paper: Considerations for meaningful sign language machine translation based on glosses (PDF)Abstract, screen reader ready: Considerations for meaningful sign language machine translation ... (PDF, 36 KB) - Naderi, M., Hermann, E., Nanchen, A., Hovsepyan, S., Magimai.-Doss, M. (2024). Towards interfacing large language models with ASR systems using confidence measures and prompting. In Proc. Interspeech 2024, 2980-2984.
Paper: Towards interfacing large language models with ASR systems (PDF)
Abstract: Towards interfacing large language models with ASR systems (HTML) - Parra-Gallego, L.F., Purohit, T., Vlasenko, B., Orozco-Arroyave, J.R., Magimai.-Doss, M. (2024) Cross-transfer Knowledge between Speech and Text Encoders to Evaluate Customer Satisfaction. In Proc. Interspeech 2024, 477-481.
Paper: Cross-transfer Knowledge between Speech and Text Encoders (PDF)
Abstract: Cross-transfer Knowledge between Speech and Text Encoders (HTML) - Pelykh, A., Sincan, O.M. and Bowden, R., (2024). Giving a Hand to Diffusion Models: a Two-Stage Approach to Improving Conditional Human Image Generation. IEEE 18th International Conference on Automatic Face and Gesture Recognition (FG).
Paper: Giving a Hand to Diffusion Models: a Two-Stage Approach to Improving Conditional Human Image Generation (PDF)
Abstract, screen reader ready: Giving a Hand to Diffusion Models ... (PDF, 30 KB) - Piton, T., Hermann, E., Pasqualotto, A., Cohen, M., Magimai.-Doss, M., Bavelier, D. (2023). Using Commercial ASR Solutions to Assess Reading Skills in Children: A Case Report. In Proc. Interspeech 2023, 4573-4577.
Paper: Using Commercial ASR Solutions to Assess Reading Skills in Children (PDF)
Abstract: Using Commercial ASR Solutions to Assess Reading Skills in Children (HTML) - Säuberli, A.; Hansen-Schirra, S.; Holzknecht, F.; Gutermuth, S.; Deilen, S.; Schiffl, L.; and Ebling, S. (2023). Enabling text comprehensibility assessment for people with intellectual disabilities using a mobile application. In Frontiers in Communication, 8.
- Webpage: Enabling text comprehensibility assessment for people with intellectual disabilities using a mobile application
Abstract, screen reader ready: Enabling text comprehensibility assessment ... (PDF, 44 KB)
Studie über Verständnis-Tests mit einer App (Zusammenfassung in leicht verständlichem Deutsch) (PDF, 73 KB) - Säuberli, A.; Holzknecht, F.; Haller, P.; Deilen, S.; Schiffl, L.; Hansen-Schirra, S.; Ebling, S.(2024). Digital Comprehensibility Assessment of Simplified Texts among Persons with Intellectual Disabilities.In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI'24).
Webpage: Digital Comprehensibility Assessment of Simplified Texts among Persons with Intellectual Disabilities
Abstract, screen reader ready: Digital Comprehensibility Assessment of Simplified Texts ... (PDF, 33 KB)Studie zur Verständlichkeit von vereinfachten Texten (Zusammenfassung in leicht verständlichem Deutsch) (PDF, 144 KB) - Säuberli A. and Clematide, S. 2024. Automatic Generation and Evaluation of Reading Comprehension Test Items with Large Language Models. In Proceedings of the 3rd Workshop on Tools and Resources for People with REAding DIfficulties (READI) @ LREC-COLING 2024, pages 22–37, Torino, Italia. ELRA and ICCL.
Paper: Automatic Generation and Evaluation of Reading Comprehension. Test Items with Large Language Models (PDF)Abstract, screen reader ready: Automatic Generation and Evaluation of Reading Comprehension (PDF, 42 KB)
Studie zur Qualität von automatisch erstellten Leseverständnis-Fragen (Zusammenfassung in leicht verständlichem Deutsch) (PDF, 32 KB) - Sincan, O.M.; Camgoz, N.C.; Bowden, R. (2023). Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discourse. In Proc. 11th Workshop on Assistive Computer Vision and Robotics. Int. Conf. on Computer Vision 2023.
Paper: Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discourse (PDF)
Abstract, screen reader ready: Is context all you need? ... (PDF, 38 KB) - Sincan, O.M., Camgoz, N.C. and Bowden, R., (2024). Using an LLM to Turn Sign Spottings into Spoken Language Sentences. arXiv preprint arXiv:2403.10434.
Paper: Using an LLM to Turn Sign Spottings into Spoken Language Sentences (PDF)
Abstract, screen reader ready: Using an LLM to Turn Sign Spottings ... (PDF, 67 KB) - Vlasenko, B.; Vyas, S.; Magimai.-Doss, M. (2024). Comparing data-driven and handcrafted features for dimensional emotion recognition. ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Seoul, Korea, Republic of, 2024, pp. 11841-11845.
Paper: Comparing data-driven and handcrafted features for dimensional emotion recognition (PDF)
Abstract, screen reader ready: Comparing data-driven and handcrafted features ... (PDF, 37 KB) - Walsh, H., Saunders, Ben,. Bowden, R. (2024). Select and Reorder: A Novel Approach for Neural Sign Language Production. LREC-COLING 2024.
Paper: Select and Reorder: A Novel Approach for Neural Sign Language Production (PDF)Abstract, screen reader ready: Select and Reorder ... (PDF, 72 KB) - Walsh, H., Ravanshad, A., Rahmani, M., and Bowden, R. (2024) A Data-Driven Representation for Sign Language Production. In Proceedings of the 18th International Conference on Automatic Face and Gesture Recognition (FG 2024).
Paper: A Data-Driven Representation for Sign Language Production (PDF)
Abstract, screen reader ready: A Data-Driven Representation ... (PDF, 75 KB) - Walsh, H., Saunders, B., Bowden, R. (2024). Sign Stitching: A Novel Approach to Sign Language Production. British Machine Vision Conference (BMVC).
Paper: Sign Stitching: A Novel Approach to Sign Language Production (PDF)
Abstract, screen reader ready: Sign Stitching (PDF, 69 KB) - Wong, R.; Camgoz, N.C.; Bowden, R. (2023). Learnt Contrastive Concept Embeddings for Sign Recognition. In Proc. 11th Workshop on Assistive Computer Vision and Robotics. Int. Conf. on Computer Vision 2023.
Paper: Learnt Contrastive Concept Embeddings for Sign Recognition (PDF)
Abstract, screen reader ready: Learnt Contrastive Concept Embeddings ... (PDF, 34 KB)
Keynote talks
Developing assistive technologies through co-creation
Talk of our principal investigator Dr. Sarah Ebling at TEDxZurich 2023
Recording of the talk
Developing Sign Language Technologies for the Users: Insights from a NLP Perspective
Talk of our principal investigator Dr. Sarah Ebling at SLRTP 2022
Recordings of this presentation and of other keynote speakers
Further reading
Mag. Dr. Christopher Ebner for flagship partner capito
Leicht verständliche Sprache genderfair! Studie zur Verwendung genderfairer Sprache in Leicht verständlicher Sprache
Download study abstract in English (PDF, 91 KB)
Kurzfassung in Deutsch herunterladen (PDF, 93 KB)
Zusammenfassung in leicht verständlichem Deutsch herunterladen (PDF, 191 KB)
Studie herunterladen (Hauptdokument, in Deutsch) (PDF, 659 KB)