Contact Information

2021

"Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond." Amir Feder (*), Katherine A. Keith, Emaad Manzoor, Reid Pryzant, Dhanya Sridhar, Zach Wood-Doughty, Jacob Eisenstein, Justin Grimmer, Roi Reichart, Margaret E. Roberts, Brandon M. Stewart, Victor Veitch and Diyi Yang. (*) - All authors equally contributed to the paper (names appear in alphabetic order of students and post-docs and then of faculty). [Paper: pdf]

"Customized Pre-training for Domain Adaptation with Category Shift, with an Application to Aspect Extraction." Entony Lekhtman, Yftah Ziser and Roi Reichart. EMNLP 2021. [Paper: pdf]
"The Hitchhiker's Guide to Computational Linguistics in Suicide Prevention." Yaakov Ophir, , Refael Tikochinski, Anat Brubstein Klumek, and Roi Reichart. Clinical Psychological Science. [Paper: pdf]
"Are VQA Systems RAD ? Measuring Robustness to Augmented Data with Focused Interventions." Daniel Yakoby, Itai Gat, Amir Feder and Roi Reichart. ACL 2021 (Short Paper). [Paper: pdf]
"A Closer Look at Few-Shot Crosslingual Transfer: The Choice of Shots Matter." Mengjie Zhao, Yi Zhu, Ehsan Shareghi, Ivan Vulic, Roi Reichart, Anna Korhonen and Hinrich Schutze. ACL 2021.
"Designing an Automatic Agent for Repeated Language-based Persuasion Games." Maya Raifer, Guy Rotman, Reut Apel, Moshe Tennenholtz and Roi Reichart. [arxiv version]
"CausaLM: Causal Model Explanation Through Counterfactual Language Models." Amir Feder, Nadav Oved, Uri Shalit and Roi Reichart. Computational Linguisics (Long Paper). [arxiv version] [Code and data: github]
"PADA: A Promt-based Autoregressive Approach for Adaptation to Unseen Domains." Eyal Ben-David (*), Nadav Oved (*), and Roi Reichart. (*) - Both authors equally contributed to the paper. [arxiv version] [Code: github]
"Model Compression for Domain Adaptation through Causal Effect Estimation." Guy Rotman (*), Amir Feder (*) and Roi Reichart. (*) - Both authors equally contributed to the paper. Transactions of the Association for Computational Linguistics (TACL). [arxiv version]
"Combining Deep Generative Models and Multi-lingual Pretraining for Semi-supervised Document Classification." Yi Zhu, Ehsan Shareghi, Yingzhen Li, Roi Reichart and Anna Korhonen. EACL 2021 (Short Paper). [arxiv version]
"Predicting Decisions in Language Based Persuasion Games." Reut Apel, Ido Erev, Roi Reichart and Moshe Tenenholtz. [arxiv version] [Code and data: github] 2020 "Deep Neural Networks Detect Suicide Risk from Textual Facebook Posts." Yaakov Ophir, Refael Tikochinski, Christa Asterhan, Itay Sisso and Roi Reichart. Scientific Reports (10):16685(2020) - Nature. [ paper]
"The Secret is in the Spectra: Predicting Cross-lingual Task Performance with Spectral Similarity Measures." Haim Dubossarsky, Ivan Vulic, Roi Reichart and Anna Korhonen. EMNLP 2020 (Long Paper). [Paper: pdf]
"Semantically-driven Sentence Fusion: Modeling and Evaluation." Eyal Ben David, Orgad Keller, Eric Malmi, Idan Szpektor and Roi Reichart. Findings of EMNLP 2020 (Long Paper). [Paper: pdf]
"Parameter Space Factorization for Zero-Shot Learning across Tasks and Languages." Edoardo Maria Ponti, Ivan Vulic, Ryan Cotterell, Marinela Parovic, Roi Reichart and Anna Korhonen. Transactions of the Association for Computational Linguistics (TACL). [arxiv version]
"Geosocial Location Classification: Associating Type to Places Based on Geotagged Social-Media Posts." Elad Kravi, Yaron Kanza, Benny Kimelfeld and Roi Reichart. SIGSPATIAL 2020. [Paper: pdf] [Long version]
"Predicting In-game Actions from Interviews of NBA Players." Nadav Oved (*), Amir Feder (*) and Roi Reichart. (*) - Both authors equally contributed to the paper. Computational Linguistics. [(final CL version)] [Code and data: github]
"PERL: Pivot-based Domain Adaptation for Pre-trained Deep Contextualized Embedding Models." Eyal Ben-David, Carmel Rabinovitz and Roi Reichart. Transactions of the Association for Computational Linguistics (TACL). [arxiv version] [Code: github]
"Statistical Significance Testing for Natural Language Processing." Rotem Dror, Lotem Peled-Cohen, Segev Shlomov and, Roi Reichart. Book published in the Human Language Technology series of Morgan&Claypool. [publisher page]
"Predicting Strategic Behavior from Free Text." Omer Ben-Port, Sharon Hirsch, Lital Kuchy, Guy Elad, Roi Reichart and Moshe Tennenholtz. Accepted to the Journal of Artificial Intelleigence Research (JAIR). [arxiv version] [Five-page extended abstract (IJCAI 2020 journal track)]
"Multidirectional Associative Optimization of Function-Specific Word Representations." Daniela Gerz, Ivan Vulic, Marek Rei, Roi Reichart and Anna Korhonen . ACL 2020 (Long Paper). [arxiv (ACL) version] [Pre-trained vectors]
"Multi-SimLex: A Large-Scale Evaluation of Multilingual and Cross-Lingual Lexical Semantic Similarity." Ivan Vulic, Simon Beker, Edoardo Maria Ponti, Ulla Petti, Ira Leviant, Kelly Wing, Olga Majewska, Eden Bar, Matt Malone, Thierry Poibeau, Roi Reichart and Anna Korhonen . Computational Linguistics (Long Paper). [arxiv version] [Project Page and Dataset]
2019 "Deep Contextualized Self-training for Low Resource Dependency Parsing." Guy Rotman and Roi Reichart. Transactions of the Association for Computational Linguistics (TACL). [Paper (authors final version): pdf]
"On the Importance of Subword Information for Morphological Tasks in Truly Low-resource Languages." Yi Zhu, Benjamin Heinzerling, Ivan Vulic, Michael Strube, Roi Reichart and Anna Korhonen . CoNLL 2019 (Long Paper). [Paper: pdf]
"Towards Zero-shot Language Modeling." Edoardo Maria Ponti, Ivan Vulic,Ryan Cotterell, Roi Reichart and Anna Korhonen . EMNLP 2019 (Long Paper). [Paper: pdf]
"Do We Really Need Fully Unsupervised Cross-lingual Embeddings ?" Ivan Vulic, Goran Glavas, Roi Reichart and Anna Korhonen . EMNLP 2019 (Long Paper). [Paper: pdf]
"Cross-lingual Semantic Specialization via Lexical Relation Extraction." Edoardo Maria Ponti, Ivan Vulic, Goran Glavas, Roi Reichart and Anna Korhonen . EMNLP 2019 (Long Paper). [Paper: pdf]
"Perturbation Based Learning for Structured NLP tasks with Application to Dependency Parsing." Amichay Doitch (*), Ram Yasdi (*), Tamir Hazan, Roi Reichart. Transactions of the Association for Computational Linguistics (TACL). (*) - Both authors equally contributed to the paper. [Paper (authors final version): pdf]
"Modeling Language Variation and Universals: A Survey on Typological Linguistics for Natural Language Processing." Edoardo Maria Ponti, Helen OHoran, Yevgeni Berzak, Ivan Vulic, Roi Reichart, Thierry Poibeau, Ekaterina Shutova and Anna Korhonen . Computational Linguistics (Long Paper).
"GECKO - A Tool for Effective Annotation of Human Conversations." Golan Levy, Raquel Sitman, Ido Amir, Eduard Goldshtein, Ran Mochary, Eilon Reshef, Roi Reichart and Omri Allouche. Interspeech 2019 (Show and Tell). [Paper: pdf] [Code: github]
"The Turker Blues: Hidden Factors behind Increased Depression Rates in Amazon's Mechanical Turk." Yaakov Ophir, Itay Sisso, Christa Asterhan, Refael Tikochinski and Roi Reichart. Clinical Psychological Science. [Paper: pdf] [Journal page: here]
"Deep Dominance - How to Properly Compare Deep Neural Models." Rotem Dror, Segev Shlomov and Roi Reichart. ACL 2019 (long paper). [Paper: pdf]
"Task Refinement Learning for Improved Accuracy and Stability of Unsupervised Domain Adaptation." Yftah Ziser and Roi Reichart. ACL 2019 (long paper). [Paper: pdf]
"Zero-shot Semantic Parsing for Instructions." Ofer Givoli and Roi Reichart. ACL 2019 (long paper). [Paper: pdf]
"Bayesian Learning for Neural Dependency Parsing." Ehsan Shareghi, Yingzhen Li, Yi Zhu, Roi Reichart and Anna Korhonen. NAACL 2019 (long paper). [Paper: pdf]
2018 "Deep Pivot-Based Modeling for Cross-language Cross-domain Transfer with Minimal Guidance." Yftah Ziser and Roi Reichart. EMNLP 2018 (long paper). [Paper: pdf] [Code: github]
"Neural Transition Based Parsing of Web Queries: An Entity Based Approach." Rivka Malca and Roi Reichart. EMNLP 2018 (long paper). [Paper: pdf] [Code: bitbucket]
"On the Relation Between Linguistic Typology and (Limitations of) Multilingual Language Modeling." Daniela Gerz, Ivan Vulic, Edoardo Maria Ponti, Roi Reichart and Anna Korhonen. EMNLP 2018 (long paper). [Paper: pdf]
"Language Modeling for Morphologically Rich Languages: Character-Aware Modeling for Word-Level Prediction." Daniela Gerz, Edoardo Maria Ponti, Jason Naradowski, Ivan Vulic, Roi Reichart and Anna Korhonen. Transactions of the Association for Computational Linguistics (TACL(6):451-465). [Paper: pdf] [Data: LM training data in 50 morphologically diverse languages]
"Bridging Languages Through Images with Deep Partial Canonical Correlation Analysis." Guy Rotman, Ivan Vulic and Roi Reichart. ACL 2018 (long paper). [Paper: pdf] [Code and Data: github]
"The Hichhiker's Guide to Testing Statistical Significance in Natural Language Processing." Rotem Dror, Gili Baumer, Segev Shlomov and Roi Reichart. ACL 2018 (long paper). [Paper: pdf] [Note on how to choose a statistical significance test: arxiv] [Code: github]
"Isomorphic Transfer of Syntactic Structures in Cross-Lingual NLP." Edoardo Maria Ponti, Roi Reichart, Anna Korhonen and Ivan Vulic. ACL 2018 (long paper). [Paper: pdf]
"Pivot Based Language Modeling for Improved Neural Domain Adaptation." Yftah Ziser and Roi Reichart. NAACL 2018 (long paper). [Paper: pdf] [Code: github] 2017 "Replicability Analysis for Natural Language Processing: Testing Significance with Multiple Datasets." Rotem Dror, Gili Baumer, Marina Bogomolov and Roi Reichart. Accepted to the Transactions of the Association for Computational Linguistics (TACL). [arXiv: pdf] [Code: github]
"Automatic Selection of Context Configuraitons for Improvred (and Fast) Class-specific Word Representations." Ivan Vulic, Roy Schwartz, Ari Rappoport, Roi Reichart and Anna Korhonen. CoNLL 2017 (long paper). [arXiv (older version): pdf]
"Neural Structural Correspondence Learning for Domain Adaptation." Yftah Ziser and Roi Reichart. CoNLL 2017 (long paper). [Paper: pdf] [Code: github]
"Semantic Specialization of Distributional Word Vector Spaces using Monolingual and Cross-lingual Constraints." Nikola Mrksic, Ivan Vulic, Diarmuid O Seaghdha, Ira Leviant, Roi Reichart, Milica Gasic, Anna Korhonen and Steve Young. Transactions of the Association for Computational Linguistics (TACL). [Paper: pdf] [Code: github]
"Sarcasm SIGN: Interpreting Sarcasm with Monolingual Machine Translation." Lotem Peled and Roi Reichart. ACL 2017 (long paper). [Paper: pdf] [Data set: Project Page]
"Morph-fitting: Fine-Tunning Word Vector Spaces with Simple Language Specific Rules." Ivan Vulic, Nikola Mrksic, Roi Reichart, Diarmuid O Seaghdha, Steve Young and Anna Korhonen. ACL 2017 (long paper). [Paper: pdf]
2016 "Survey on the Use of Typological Information in Natural Language Procecessing." Helen O'Horan, Yevgeni Berzak, Ivan Vulic, Roi Reichart and Anna Korhonen. COLING 2016 (long paper). [Paper: pdf]
"The Structured Weighted Violations Perceptron Algorithm." Rotem Dror and Roi Reichart. EMNLP 2016 (long paper). [arXiv preprint (arxiv:1602.03040): pdf] [Paper: pdf]
"Effective Greedy Inference for Graph-based Non-Projective Dependency Parsing." Ilan Tchernowitz, Liron Yedidsion and Roi Reichart. EMNLP 2016 (long paper). [Paper: pdf]
"SimVerb-3500: A Large-Scale Evaluation Set of Verb Similarity." Daniela Gerz, Iva Vulic, Felix Hill, Roi Reichart and Anna Korhonen. EMNLP 2016 (long paper). [arXiv preprint (arxiv:1602.03040): pdf] [Paper: pdf]
"Edge-Linear First-Order Dependency Parsing with Undirected Minimum Spanning Tree Inference." Effi Levi, Roi Reichart and Ari Rappoport. ACL 2016 (long paper). [Paper: pdf]
"Syntactic Parsing of Web Queries with Question Intent." Yuval Pinter, Roi Reichart and Idan Szpektor. NAACL 2016 (long paper). [Paper: pdf] [CQA Query Treebank (Go to "Language Data" and then "L28")] [Parsing Guidelines]
"Symmetric Patterns and Coordinations: Fast and Enhanced Reresentations of Verbs and Adjectives." Roy Schwartz, Roi Reichart and Ari Rappoport. NAACL 2016 (short paper). [Paper: pdf]
"Finger Flexion Imagery: EEG Classification Through Physiologically-Inspired Feature Extraction and Hierarchical Voting" Daniel Furman, Roi Reichart and Hillel Pratt. Brain-Computer Interface (BCI) 2016. (long paper). [Paper: pdf] (This is a non-NLP paper)
2015 "Separated by an Un-common Language: Towards Judgment Language Informed Vector Space Modeling" Ira Leviant and Roi Reichart. 2015. Preprint pubslished on arXiv. arxiv:1508.00106[Paper: pdf] [Dataset: Multilingual-WS353-SimLex999] "SimLex-999: Evaluating Semantic Models with (Genuine) Similarity Estimation" Felix Hill, Roi Reichart and Anna Korhonen. Accepted to Computational Linguistics (CL Journal). [Paper (arxiv:1408:3456): pdf] [Paper (CL): pdf] [Dataset: SimLex-999] "Symmetric Pattern Based Word Embeddings for Improved Word Similarity Prediction" Roy Schwartz, Roi Reichart and Ari Rappoport. CoNLL 2015 (long paper). [Paper: pdf] [Dataset: sp-embeddings] "Contrastive Analysis with Predictive Power: Typology Driven Estimation of Grammatical Error Distribution in ESL" Yevgeni Berzak, Roi Reichart and Boris Katz. CoNLL 2015 (long paper). [Paper: pdf] "Unsupervised Declarative Knowledge Induction for Constraint-Based Learning of Information Structure in Scientific Documents" Yufan Guo, Roi Reichart and Anna Korhonen. Transactions of the Association for Computational Linguistics (TACL(3):131-143), (Presented in NAACL 2015). [Paper: pdf] 2014 "An Unsupervised Model for Instance Level Subcategorization Acquisition" Simon Baker, Roi Reichart and Anna Korhonen. EMNLP 2014 (long paper).[Paper: pdf] [Verb Similarity Dataset: download] "Multi-Modal Models for Concrete and Abstract Concept Meaning" Felix Hill, Roi Reichart and Anna Korhonen. Transactions of the Association for Computational Linguistics (TACL(2):285-296), (Presented in EMNLP 2014). [Paper: pdf] "Minimally Supervised Classification to Semantic Categories Using Symmetric Patterns" Roy Schwartz, Roi Reichart and Ari Rappoport. COLING 2014 (long paper). [Paper: pdf] "Reconstructing Native Language Typology from Foreign Language Usage" Yevgeni Berzak, Roi Reichart and Boris Katz. CoNLL 2014 (long paper). [Paper: pdf] 2013 "Improved Lexical Acquisition through DPP-based Verb Clustering" Roi Reichart and Anna Korhonen. ACL 2013 (long paper). [Paper: pdf] [Source Code: download] "Improved Information Structure Analysis of Scientific Documents Through Discourse and Lexical Constraints." Yufan Guo, Roi Reichart and Anna Korhonen. NAACL 2013 (long paper). [Paper: pdf] 2012 "Document and Corpus Level Inference For Unsupervised Learning of Information Structure of Scientific Documents." Roi Reichart and Anna Korhonen. COLING 2012 (short paper). [Paper: pdf] "A Diverse Dirichlet Process Ensemble for Unsupervised Induction of Syntactic Categories." Roi Reichart, Gal Elidan and Ari Rappoport. COLING 2012 (long paper). [Paper: pdf] "CRAB Reader: A Tool for Analysis and Visualization of Argumentative Zones of Scientific Literature." Yufan Guo, Ilona Solinis, Roi Reichart and Anna Korhonen. COLING 2012 (demo paper). [Paper: pdf] "Improved Parsing and POS tagging Using Inter-Sentence Consistency Constraints." Alexander M. Rush (*) , Roi Reichart (*), Michael Collins and Amir Globerson , EMNLP 2012 (long paper). (*) - Both authors equally contributed to the paper. [Paper: pdf] "Learning to MAP into a Universal POS Tagset." Yuan Zhang, Roi Reichart, Regina Barzilay and Amir Globerson , EMNLP 2012 (long paper). [Paper: pdf] "Multi Event Extraction Guided by Global Constraints." Roi Reichart and Regina Barzilay , NAACL 2012 (long paper). [Paper: pdf] "You Too?! Mixed-initiative LDA story matching to help teens in distress." , Karthik Dinakar, Birago Jones , Henri Lieberman, Rosalind W. Picard , Carolyn Rose , Matthew Thoman and Roi Reichart, International Conference on Weblog and Social Media (ICWSM) 2012. 2011 "Neutralizing Linguistically Problematic Annotations in Unsupervised Dependency Parsing Evaluation." Roy Schwartz, Omri Abend, Roi Reichart and Ari Rappoport, ACL 2011 (long paper). [Paper: pdf] [Source Code: download] "Confidence Driven Unsupervised Semantic Parsing." Dan Goldwasser, Roi Reichart, James Clarke and Dan Roth, ACL 2011 (long paper). [Paper: pdf] Modeling the Detection of Textual Cyberbullying , Karthik Dinakar, Roi Reichart and Henri Lieberman, International Conference on Weblog and Social Media (ICWSM) - Social Mobile Web Workshop 2011. [Paper: pdf] 2010 "Improved Fully Unsupervised Parsing with Zoomed Learning." Roi Reichart and Ari Rappoport , EMNLP 2010 (long paper). [Paper: pdf] "Tense Sense Disambiguation: a New Task and a Supervised Algorithm." Roi Reichart and Ari Rappoport , EMNLP 2010 (long paper). [Paper: pdf] "A Multi-Domain Web-Based Algorithm for POS Tagging of Unknown Words." Shulamit Umansky-Pesin , Roi Reichart and Ari Rappoport , COLING 2010 (long paper). [Paper: pdf] "Improved Unsupervised POS Induction through Prototype Discovery." Omri Abend , Roi Reichart and Ari Rappoport , ACL 2010 (long paper). [Paper: pdf] "Improved Unsupervised POS Induction Using Intrinsic Clustering Quality and a Zipfian Constraint." Roi Reichart, Raanan Fattal , and Ari Rappoport , CoNLL 2010 (long paper). [Paper: pdf] "Type Level Clustering Evaluation: New Measures and a POS Induction Case Study." Roi Reichart (*), Omri Abend (*) , and Ari Rappoport , CoNLL 2010 (long paper). (*) - Both authors equally contributed to the paper. [Paper: pdf] 2009 "Sample Selection for Statistical Parsers: Cognitively Driven Algorithms and Evaluation Measures." Roi Reichart and Ari Rappoport , CoNLL 2009 (long paper). Received the best paper award. [Paper: pdf] "The NVI Clustering Evaluation Measure." Roi Reichart and Ari Rappoport , CoNLL 2009 (long paper). [Paper: pdf] "Automatic Selection of High Quality Parses Created By a Fully Unsupervised Parser." Roi Reichart and Ari Rappoport , CoNLL 2009 (long paper). [Paper: pdf] "Superior and Efficient Fully Unsupervised Pattern-based Concept Acquisition Using an Unsupervised Parser." Dmitry Davidov , Roi Reichart and Ari Rappoport , CoNLL 2009 (long paper). [Paper: pdf] "Unsupervised Argument Identification for Semantic Role Labeling." Omri Abend , Roi Reichart and Ari Rappoport , ACL 2009 (long paper). [Paper: pdf] 2008 "Unsupervised Induction of Labeled Parse Trees by Clustering with Syntactic Features." Roi Reichart and Ari Rappoport , COLING 2008 (long paper, oral presentation). [Paper: pdf ] "A Supervised Algorithm for Verb Disambiguation into VerbNet Classes." Omri Abend , Roi Reichart and Ari Rappoport , COLING 2008 (long paper, oral presentation). [Paper: pdf ] "Multi-Task Active Learning for Linguistic Annotations." Roi Reichart(*), Katrin Tomanek(*), Udo Hahn and Ari Rappoport , ACL 2008 (long paper, oral presentation). (*) - Both authors equally contributed to the paper. [Paper: pdf ] "Extraction of Entailed Semantic Relations Through Syntax-based Comma Resolution." Vivek Srikumar, Roi Reichart, Mark Sammons, Ari Rappoport and Dan Roth , ACL 2008 (long paper, oral presentation). [Paper: pdf ] 2007 "Self-Training for Enhancement and Domain Adaptation of Statistical Parsers Trained on Small Datasets." Roi Reichart and Ari Rappoport, ACL 2007 (long paper, oral presentation). [Paper: pdf ] "An Ensemble Method for Selection of High Quality Parses." Roi Reichart and Ari Rappoport , ACL 2007 (long paper, oral presentation). [Paper: pdf ] Students Post-Docs Yaakov Ophir (2018 - current) PhD Students Reut Apel Eyal Ben David Amir Feder Nadav Oved Yael Shor (together with Inbal Arnon) Guy Rotman Refael Tokochinski (together with Uri Hasson) MSc Students Chen Badler Yael Badian Boaz Ben Dov Zorik Gekhman Almog Gueta Shir Lissak Daniel Yakoby Alumni Rotem Dror (PhD) Daniela Gerz (PhD, at Cambridge, together with Anna Korhonen)) Ira Leviant (PhD) Yftah Ziser (PhD) Reut Apel (MSc) Eyal Ben David (MSc) Amichay Doitch (MSc) Lilach Edelstein (MSc) Ofer Givoli (MSc) Tony Lekhtman (MSc) Hagar Leoub (MSc) Rivka Malka (MSc) Nadav Oved (MSc) Lotem Peled (MSc) Iftah Peretz (MSc) Maya Raifer (MSc) Guy Rotman (MSc) Meiran Rubinstein (MSc) Ilan Tchernovitz (MSc) Ram Yasdi (MSc) Dor Zohar (MSc) Data Multilingual data for language modeling : LM training data in 50 morphologically diverse languages (see Gerz et al., TACL 2018 paper). WIW (word, translation and image) : English words, their translation to several languages and an image that describes the word (see Rotman et al., ACL 2018 paper). Sarcasm Sign: 3000 sarcastic tweets, each with five honest (non-sarcastic) interpretations. See (Peled and Reichart, ACL 2017) for details. sp-embeddings: Word embeddings based on word co-occurrence in symmetric patterns that were acquired from text in an unsupervised manner. These vectors achieve state-of-the-art results on the SimLex999 word similarity dataset, and are particularly useful for verb similarity prediction. SimLex-999: SimLex-999 provides similarity scores for 999 word pairs - comprised of nouns, verbs and adjectives. It was annotated through the Amazon Mechanical Turk with annotation guidelines that emphasize the similarity, rather than association, between the words in the pair. This is in contrast to existing datasets that where annotation was done with guidelines that were strongly biased towards association. The data set was created in a collaboration with Felix Hill and Anna Korhonen from the University of Cambridge. MultilingualWS353&MultilingualSimLex999: Translated versions of the WordSim353 and SimLex999 datasets to German, Italian and Russian. The translated datasets were scored according to translated versions of the scoring guidlines of the original datasets. The new scores were produced by crowd workers, all fluent speakers of the target language. simVerb-3500: A gold standarad evlauation resource for verb pair similarity, providing 3500 verb pairs with human similarity ratings on the scale of 1-10. The resource covers all normed verb type from the USF free-association database, and provides at least three examples for each verbNet class. Verb Similarity Dataset (Baker, Reichart and Korhonen, EMNLP 2014): 143 pairs of verbs annotated by 10 annotators following the WS-353 guidelines. The data was used for evaluation in the paper and collected together with my co-authors. Please cite the paper when using it.

Code


Clustering Evaluation Code: MATLAB code for Information-theoretic and mapping-based measures for clustering evaluation (Reichart and Rappoport, CoNLL 2009). The IT-based measures are: V,VI and NVI. The mapping-based measures are two variants of greedy mapping: many-to-one and one-to-one (based on the Kuhn-Munkres algorithm).

Clustering with DPPs: MATLAB code for DPP-based hierarchical clustering (Reichart and Korhonen, ACL 2013). The algorithm achieves state-of-the-art verb clustering performance and is particularly suited for joint modeling.