What's Wrong with Gradient-based Complex Query Answering?
Ouns El Harzli
NeSy 2023
2023
Abstract
Multi-hop query answering on knowledge graphs is known to be a challenging computational task. Neurosymbolic approaches using neural link predictors have shown promising results but are still outperformed by combinatorial optimization methods on several benchmarks, including the FB15k dataset. We analyze the task on the FB15k dataset and propose two new gradient-based methods, one learning simultaneously the representations of several candidate answers and the other learning a skolem function projecting to candidate answers instead of learning direct candidate representations. We implement both using Logic Tensor Networks. As part of this investigation we identified two important factors that limit the ability of differentiable methods to learn correct answers. The first factor is the (un)reliability of the pre-trained neural link predictors which biases the guesses of the query solver. To account for this, we suggest new evaluation metrics using satisfiability scores, that better reflect the true performance of neurosymbolic approaches on multi-hop query answering. The second factor is the regularization technique proposed in previous works, which limits the exploration of the gradient-based solver. Our results provide the foundation for future work mitigating these bottlenecks.
Related Publications
Science is advancing at an increasingly quick pace, as evidenced, for instance, by the exponential growth in the number of published research articles per year [1]. On the one hand, this poses anincreasingly pressing challenge: Effectively navigating this ever-growing body o…
Knowledge graphs are powerful tools for modelling complex, multi-relational data and supporting hypothesis generation, particularly in applications like drug repurposing. However, for predictive methods to gain acceptance as credible scientific tools, they must ensure not on…
Over the last few years Literature-based Discovery (LBD) has regained popularity as a means to enhance the scientific research process. The resurgent interest has spurred the development of supervised and semi-supervised machine learning models aimed at making previously imp…
JOIN US
Shape the Future of AI with Sony AI
We want to hear from those of you who have a strong desire
to shape the future of AI.