SyntNN at SemEval-2018 Task 2: is Syntax Useful for Emoji Prediction? Embedding Syntactic Trees in Multi Layer Perceptrons

Abstract

In this paper, we present SyntNN as a way to include traditional syntactic models in multilayer neural networks used in the task of Semeval Task 2 of emoji prediction. The model builds on the distributed tree embedder also known as distributed tree kernel. Initial results are extremely encouraging but additional analysis is needed to overcome the problem of overfitting.

Publication
Proceedings of The 12th International Workshop on Semantic Evaluation
Andrea Santilli
Andrea Santilli
PhD Student in Computer Science

PhD Student passionate about natural language processing, representation learning and machine intelligence.