Center for the Evaluation of Language and Communication Technologies explained

The Center for the Evaluation of Language and Communication Technologies (CELCT) was an organisation devoted to the evaluation of language technologies, located in Povo, Trento (Italy).

CELCT was established in 2003 by FBK (Fondazione Bruno Kessler) and DFKI (Deutsches Forschungszentrum für Künstliche Intelligenz), and was funded by the Autonomous Province of Trento. The goals of CELCT were "to set up infrastructures and develop skills in order to operate successfully in the field of the evaluation of language and communication technologies, becoming a reference point in the field at the national and European levels."^[1] CELCT interpreted its mission by carrying out several activities in the field of HLT evaluation, mainly focusing on the organization of national and international evaluation campaigns and on the creation of speech and text corpora in different languages and at different linguistic annotation levels.

CELCT's activities were closed on December 31, 2013. The staff working at CELCT at the time of its closure is continuing their research activities within FBK.^[2]

European projects

• TOSCA-MP:^{[3] [4] [5]} Task-oriented search and content annotation for media production
• EXCITEMENT:^[6] EXploring Customer Interactions through Textual EntailMENT
• PROMISE:^{[7] [8]} Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation
• TrebleCLEF: Evaluation, Best Practice & Collaboration for Multilingual Information Access
• EuroMatrix:^[9] Statistical and Hybrid Machine Translation Between All European Languages

Other projects

• • LiveMemories:^[10] Active Digital Memories of Collective Life - Project funded by the Autonomous Province of Trento OntoText:^[11] From Text to Knowledge for the Semantic Web - Project funded by the Autonomous Province of Trento
• Law Making Environment^[12] - Project in collaboration with Consiglio Nazionale delle Ricerche

Evaluation campaigns

CELCT was involved in the following initiatives devoted to the evaluation of Natural Language Processing tools, collaborating with various organizations and networks of excellence both at the national and international level:

• Document Understanding Conference: DUC 2005^[13]
• Multilingual Question Answering Track at CLEF^[14] (from 2005 to 2013)
• Recognizing Textual Entailment (RTE) Challenges^[15] (from 2005 to 2013)
• International Workshop on Spoken Language Translation: IWSLT 2006,^{[16] [17]} IWSLT 2007,^{[18] [19]} IWSLT 2011,^{[20] [21]} and IWSLT 2012^{[22] [23]}
• Evalita:^[24] Evaluation of NLP and Speech Tools for Italian (2007, 2009, 2011)
• Cross-Lingual Textual Entailment task at Semeval (2012^[25] and 2013^[26])

Publications

CELCT produced a number of scientific publications in all its activity fields.^{[27] [28] [29]}

Notes and References

1. Web site: CELCT web site. 10 January 2014. https://web.archive.org/web/20140218215340/http://www.celct.it/about-us.php. 18 February 2014. dead.
2. Web site: Fondazione Bruno Kessler website. 10 January 2014.
3. Web site: TOSCA-MP European project website. 18 January 2014.
4. Web site: Deliverable D2.1 of TOSCA-MP project. 10 January 2014.
5. Web site: Deliverable D2.2 of TOSCA-MP project. 10 January 2014.
6. Web site: EXCITEMENT European project website. 18 January 2014.
7. Web site: PROMISE website. 18 January 2014.
8. Web site: Partners of PROMISE. 13 January 2014.
9. Web site: Euromatrix European project website. 2014-01-17. https://web.archive.org/web/20160905140224/http://www.euromatrix.net/. 2016-09-05. dead.
10. Web site: LiveMemories website. 26 February 2014.
11. Web site: Ontotext project website. 18 January 2014.
12. Web site: Law Making Environment project website. 18 January 2014. https://web.archive.org/web/20160304001432/http://nir.ittig.cnr.it/lme/index.php?option=com_content&view=article&id=46&Itemid=53. 4 March 2016. dead.
13. Web site: DUC 2005 website.
14. Web site: CLEF web site. https://web.archive.org/web/20120131211642/http://www.clef-initiative.eu/. dead. 31 January 2012. 10 January 2014.
15. Web site: RTE challenges website. 18 January 2014.
16. Web site: IWSLT2006 website. 18 January 2014. https://web.archive.org/web/20130202221943/http://www2.nict.go.jp/univ-com/multi_trans/WS/IWSLT2006/index.html. 2013-02-02. dead.
17. Web site: Organizers of IWSLT 2006. 10 January 2014. https://web.archive.org/web/20130204071310/http://www2.nict.go.jp/univ-com/multi_trans/WS/IWSLT2006/archives/2005/11/organizers.html. 2013-02-04. dead.
18. Web site: IWSLT2007 website. 18 January 2014.
19. Web site: Organizers of IWSLT 2007. 10 January 2014.
20. Web site: IWSLT2011 website. 18 January 2014.
21. Web site: Organizers of IWSLT 2011 evaluation campaign. 10 January 2014. dead. https://web.archive.org/web/20140130045300/http://iwslt2011.org/doku.php?id=06_evaluation. 30 January 2014.
22. Web site: IWSLT2012 website. 18 January 2014.
23. Web site: MT Track organizers of IWSLT 2012. 10 January 2014.
24. Web site: Evalita website. 18 January 2014.
25. Web site: CLTE@Semeval-2012 website. 18 January 2014.
26. Web site: CLTE@Semeval-2013 website. 22 January 2014.
27. Web site: Complete list of CELCT publications. 18 January 2014. https://web.archive.org/web/20140627023931/http://www.celct.it/publication.php. 27 June 2014. dead.
28. Web site: List of CELCT publications in the ACL Anthology Network. 18 January 2014. https://web.archive.org/web/20160304091937/http://clair.eecs.umich.edu/aan/organization.php?org_id=118#ui-tabs-2. 4 March 2016. dead.
29. Web site: List of CELCT publications in the ACL Anthology Searchbench. 18 January 2014.