Get our free extension to see links to code for papers anywhere online!

Chrome logo Add to Chrome

Firefox logo Add to Firefox

Picture for James Pustejovsky

Designing Multimodal Datasets for NLP Challenges


May 12, 2021
James Pustejovsky, Eben Holderness, Jingxuan Tu, Parker Glenn, Kyeongmin Rim, Kelley Lynch, Richard Brutti


  Access Paper or Ask Questions

Neurosymbolic AI for Situated Language Understanding


Dec 05, 2020
Nikhil Krishnaswamy, James Pustejovsky

* 18 pages + refs, 16 figures, presented at the 8th Annual Conference on Advances in Cognitive Systems (ACS), 2020 

  Access Paper or Ask Questions

Situated Multimodal Control of a Mobile Robot: Navigation through a Virtual Environment


Jul 13, 2020
Katherine Krajovic, Nikhil Krishnaswamy, Nathaniel J. Dimick, R. Pito Salas, James Pustejovsky

* 4 pages, 1 table, 4 figures, proceedings of RoboDIAL special session a SigDIAL 2020 

  Access Paper or Ask Questions

COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation


Jul 06, 2020
Qingyun Wang, Manling Li, Xuan Wang, Nikolaus Parulian, Guangxing Han, Jiawei Ma, Jingxuan Tu, Ying Lin, Haoran Zhang, Weili Liu, Aabhas Chauhan, Yingjun Guan, Bangzheng Li, Ruisong Li, Xiangchen Song, Heng Ji, Jiawei Han, Shih-Fu Chang, James Pustejovsky, Jasmine Rah, David Liem, Ahmed Elsayed, Martha Palmer, Clare Voss, Cynthia Schneider, Boyan Onyshkevych

* 11 pages, submitted to ACL 2020 Workshop on Natural Language Processing for COVID-19 (NLP-COVID), for resources see http://blender.cs.illinois.edu/covid19/ 

  Access Paper or Ask Questions

Exploration and Discovery of the COVID-19 Literature through Semantic Visualization


Jul 03, 2020
Jingxuan Tu, Marc Verhagen, Brent Cochran, James Pustejovsky


  Access Paper or Ask Questions

A Formal Analysis of Multimodal Referring Strategies Under Common Ground


Mar 16, 2020
Nikhil Krishnaswamy, James Pustejovsky

* 9 pages (incl refs), 7 figures, 3 tables, proceedings of LREC 2020 (postponed due to COVID-19) 

  Access Paper or Ask Questions

Assessing the Efficacy of Clinical Sentiment Analysis and Topic Extraction in Psychiatric Readmission Risk Prediction


Oct 09, 2019
Elena Alvarez-Mellado, Eben Holderness, Nicholas Miller, Fyonn Dhang, Philip Cawkwell, Kirsten Bolton, James Pustejovsky, Mei-Hua Hall

* LOUHI @ EMNLP 2019 

  Access Paper or Ask Questions

Multimodal Continuation-style Architectures for Human-Robot Interaction


Sep 18, 2019
Nikhil Krishnaswamy, James Pustejovsky

* Advances in Cognitive Systems Cognitive Vision Workshop (2019), 8 pages, 5 figures 

  Access Paper or Ask Questions

Distinguishing Clinical Sentiment: The Importance of Domain Adaptation in Psychiatric Patient Health Records


Apr 05, 2019
Eben Holderness, Philip Cawkwell, Kirsten Bolton, James Pustejovsky, Mei-Hua Hall

* Accepted at Clinical NLP @ NAACL 2019 

  Access Paper or Ask Questions

Situational Grounding within Multimodal Simulations


Feb 05, 2019
James Pustejovsky, Nikhil Krishnaswamy

* AAAI-19 Workshop on Games and Simulations for Artificial Intelligence 

  Access Paper or Ask Questions

Combining Deep Learning and Qualitative Spatial Reasoning to Learn Complex Structures from Sparse Examples with Noise


Nov 27, 2018
Nikhil Krishnaswamy, Scott Friedman, James Pustejovsky


  Access Paper or Ask Questions

Multimodal Interactive Learning of Primitive Actions


Oct 01, 2018
Tuan Do, Nikhil Krishnaswamy, Kyeongmin Rim, James Pustejovsky

* Presented at AI-HRI AAAI-FSS, 2018 (arXiv:1809.06606) 

  Access Paper or Ask Questions

Analysis of Risk Factor Domains in Psychosis Patient Health Records


Sep 15, 2018
Eben Holderness, Nicholas Miller, Philip Cawkwell, Kirsten Bolton, James Pustejovsky, Marie Meteer, Mei-Hua Hall

* Accepted at EMNLP-LOUHI 2018 

  Access Paper or Ask Questions

Learning event representation: As sparse as possible, but not sparser


Oct 02, 2017
Tuan Do, James Pustejovsky

* Qualitative reasoning Workshop 2017 

  Access Paper or Ask Questions

Fine-grained Event Learning of Human-Object Interaction with LSTM-CRF


Sep 30, 2017
Tuan Do, James Pustejovsky

* European Symposium on Artificial Neural Networks, Computational Intelligence and Machine Learning (ESANN 2017) 

  Access Paper or Ask Questions

Generating Simulations of Motion Events from Verbal Descriptions


Oct 06, 2016
James Pustejovsky, Nikhil Krishnaswamy

* 11 pages, 5 figures, *SEM workshop, COLING 2014 

  Access Paper or Ask Questions

VoxML: A Visualization Modeling Language


Oct 05, 2016
James Pustejovsky, Nikhil Krishnaswamy

* 8 pages, 9 figures, proceedings of LREC 2016 

  Access Paper or Ask Questions

ECAT: Event Capture Annotation Tool


Oct 05, 2016
Tuan Do, Nikhil Krishnaswamy, James Pustejovsky

* 4 pages, 4 figures, ISA workshop 2015 

  Access Paper or Ask Questions

Multimodal Semantic Simulations of Linguistically Underspecified Motion Events


Oct 03, 2016
Nikhil Krishnaswamy, James Pustejovsky


  Access Paper or Ask Questions

Annotation Methodologies for Vision and Language Dataset Creation


Jul 10, 2016
Gitit Kehat, James Pustejovsky

* in Scene Understanding Workshop (SUNw) in CVPR 2016 

  Access Paper or Ask Questions

TempEval-3: Evaluating Events, Time Expressions, and Temporal Relations


May 25, 2014
Naushad UzZaman, Hector Llorens, James Allen, Leon Derczynski, Marc Verhagen, James Pustejovsky


  Access Paper or Ask Questions

Clinical TempEval


Mar 19, 2014
Steven Bethard, Leon Derczynski, James Pustejovsky, Marc Verhagen


  Access Paper or Ask Questions