Get our free extension to see links to code for papers anywhere online!

 Add to Chrome

 Add to Firefox

CatalyzeX Code Finder - Browser extension linking code for ML papers across the web! | Product Hunt Embed

Augmenting Compositional Models for Knowledge Base Completion Using Gradient Representations

Nov 02, 2018
Matthias Lalisse, Paul Smolensky



Neural models of Knowledge Base data have typically employed compositional representations of graph objects: entity and relation embeddings are systematically combined to evaluate the truth of a candidate Knowedge Base entry. Using a model inspired by Harmonic Grammar, we propose to tokenize triplet embeddings by subjecting them to a process of optimization with respect to learned well-formedness conditions on Knowledge Base triplets. The resulting model, known as Gradient Graphs, leads to sizable improvements when implemented as a companion to compositional models. Also, we show that the "supracompositional" triplet token embeddings it produces have interpretable properties that prove helpful in performing inference on the resulting triplet representations.

* 10 pages, 2 figures, To appear in proceedings of the Society for Computation in Linguistics (SCIL 2019) 


Share this with someone who'll enjoy it:

   Access Paper Source



Share this with someone who'll enjoy it: