Programvaruportalen LUCAS

Lunds Tekniska Högskola

Denna sida på svenska This page in English This page in English

2011-12-14 Named entity recognition for short text messages

When: 2011-12-14 09.00

Where: LTH, E-huset, E:1426

Registration: Please register no later than 2011-12-13 at 12.00 in the form below

Speakers: Tobias Ek, Håkan Jonsson@Sony Ericsson, Pierre

The presentations summarizes a paper by Tobias Ek, Camilla Kirkegaard, Håkan Jonsson, and Pierre Nugues: Named entity recognition for short text messages. In Proceedings of the 12th PACLING Conference, Kuala Lumpur, July 19-21, 2011.

The paper describes a named entity recognition (NER) system for short text messages (SMS) running on a mobile platform. Most NER systems deal with text that is structured, formal, well written, with a good grammatical structure, and few spelling errors. SMS text messages lack these qualities and have instead a short-handed and mixed language studded with emoticons, which makes NER a challenge on this kind of material.

We implemented a system that recognizes named entities from SMSes written in Swedish and that runs on an Android cellular telephone. The entities extracted are locations, names, dates, times, and telephone numbers with the idea that extraction of these entities could be utilized by other applications running on the telephone. We started from a regular expression implementation that we complemented with classifiers using logistic regression. We optimized the recognition so that the incoming text messages could be processed on the telephone with a fast response time. We reached an F-score of 86 for strict matches and 89 for partial matches.