The sixth campaign of the Cross Language Evaluation Forum (CLEF) for European languages was held from January to September 2005. CLEF is by now an established international evaluation initiative and 74 groups from all over the world submitted results for one or more of the different evaluation tracks in 2005, compared with 54 groups in 2004. There were eight distinct evaluation tracks, designed to test the performance of a wide range of systems for multilingual information access. Full details regarding the design of the tracks, the methodologies used for evaluation, and the results obtained by the participants can be found in the different sections of these proceedings. As always the results of the campaign were reported and discussed at the annual workshop held in Vienna, Austria, September 21-23, immediately following the ninth European Conference on Digital Libraries. The workshop was attended by approximately 110 academic and industrial researchers and system developers. In addition to presentations by participants in the campaign, Noriko Kando from the National Institute of Informatics, Tokyo, gave an invited talk on the activities of the NTCIR evaluation initiative for Asian languages. Breakout sessions gave participants a chance to discuss ideas and results in detail. The final session was dedicated to proposals for activities for CLEF 2006. The presentations given at the workshop can be found on the CLEF Web site at: www. clef-campaign. org. We should like to thank the other members of the CLEF Steering Committee for their assistance in the coordination of this event.
Author(s): Carol Peters (auth.), Carol Peters, Fredric C. Gey, Julio Gonzalo, Henning Müller, Gareth J. F. Jones, Michael Kluck, Bernardo Magnini, Maarten de Rijke (eds.)
Series: Lecture Notes in Computer Science 4022 : Information Systems and Applications, incl. Internet/Web, and HCI
Edition: 1
Publisher: Springer-Verlag Berlin Heidelberg
Year: 2006
Language: English
Pages: 1013
Tags: Information Storage and Retrieval; Artificial Intelligence (incl. Robotics); Information Systems Applications (incl.Internet); Language Translation and Linguistics
Front Matter....Pages -
What Happened in CLEF 2005....Pages 1-10
CLEF 2005: Ad Hoc Track Overview....Pages 11-36
Ad-Hoc Mono- and Bilingual Retrieval Experiments at the University of Hildesheim....Pages 37-43
MIRACLE at Ad-Hoc CLEF 2005: Merging and Combining Without Using a Single Approach....Pages 44-53
The XLDB Group at the CLEF 2005 Ad-Hoc Task....Pages 54-60
Thomson Legal and Regulatory Experiments at CLEF-2005....Pages 61-68
Using the X-IOTA System in Mono- and Bilingual Experiments at CLEF 2005....Pages 69-78
Bilingual and Multilingual Experiments with the IR-n System....Pages 79-82
Dictionary-Based Amharic-French Information Retrieval....Pages 83-92
A Hybrid Approach to Query and Document Translation Using a Pivot Language for Cross-Language Information Retrieval....Pages 93-101
Conceptual Indexing for Multilingual Information Retrieval....Pages 102-112
SINAI at CLEF 2005: Multi-8 Two-Years-on and Multi-8 Merging-Only Tasks....Pages 113-120
CLEF 2005: Multilingual Retrieval by Combining Multiple Multilingual Ranked Lists....Pages 121-130
Monolingual, Bilingual, and GIRT Information Retrieval at CLEF-2005....Pages 131-140
Socio-Political Thesaurus in Concept-Based Information Retrieval....Pages 141-150
The Performance of a Machine Translation-Based English-Indonesian CLIR System....Pages 151-154
Exploring New Languages with HAIRCUT at CLEF 2005....Pages 155-164
Dublin City University at CLEF 2005: Multi-8 Two-Years-On Merging Experiments....Pages 165-169
Applying Light Natural Language Processing to Ad-Hoc Cross Language Information Retrieval....Pages 170-178
Four Stemmers and a Funeral: Stemming in Hungarian at CLEF 2005....Pages 179-186
ENSM-SE at CLEF 2005: Using a Fuzzy Proximity Matching Function....Pages 187-193
Bulgarian and Hungarian Experiments with Hummingbird SearchServer TM at CLEF 2005....Pages 194-203
Combining Passages in the Monolingual Task with the IR-n System....Pages 204-207
Weighting Query Terms Based on Distributional Statistics....Pages 208-211
Domain-Specific Track CLEF 2005: Overview of Results and Approaches, Remarks on the Assessment Analysis....Pages 212-221
A Baseline for NLP in Domain-Specific IR....Pages 222-225
Domain-Specific CLIR of English, German and Russian Using Fusion and Subject Metadata for Query Expansion....Pages 226-237
Evaluating a Conceptual Indexing Method by Utilizing WordNet....Pages 238-246
Domain Specific Mono- and Bilingual English to German Retrieval Experiments with a Social Science Document Corpus....Pages 247-250
Overview of the CLEF 2005 Interactive Track....Pages 251-262
Use of Free On-Line Machine Translation for Interactive Cross-Language Question Answering....Pages 263-272
“How Much Context Do You Need?”: An Experiment About the Context Size in Interactive Cross-Language Question Answering....Pages 273-282
UNED at iCLEF 2005: Automatic Highlighting of Potential Answers....Pages 283-292
Effect of Connective Functions in Interactive Image Retrieval....Pages 293-296
Using Concept Hierarchies in Text-Based Image Retrieval: A User Evaluation....Pages 297-306
Overview of the CLEF 2005 Multilingual Question Answering Track....Pages 307-331
A Fast Forward Approach to Cross-Lingual Question Answering for English and German....Pages 332-336
The ŒDipe System at CLEF-QA 2005....Pages 337-346
An XML-Based System for Spanish Question Answering....Pages 347-350
A Logic Programming Based Approach to QA@CLEF05 Track....Pages 351-360
Extending Knowledge and Deepening Linguistic Processing for the Question Answering System InSicht....Pages 361-369
Question Answering for Dutch Using Dependency Relations....Pages 370-379
Term Translation Validation by Retrieving Bi-terms....Pages 380-389
Exploiting Linguistic Indices and Syntactic Structures for Multilingual Question Answering: ITC-irst at CLEF 2005....Pages 390-399
The TALP-QA System for Spanish at CLEF 2005....Pages 400-409
Priberam’s Question Answering System for Portuguese....Pages 410-419
A Full Data-Driven System for Multiple Language Question Answering....Pages 420-428
Experiments on Cross–Linguality and Question–Type Driven Strategy Selection for Open–Domain QA....Pages 429-438
QUASAR: The Question Answering System of the Universidad Politécnica de Valencia....Pages 439-448
Towards an Offline XML-Based Strategy for Answering Questions....Pages 449-456
AliQAn, Spanish QA System at CLEF-2005....Pages 457-466
20th Century Esfinge (Sphinx) Solving the Riddles at CLEF 2005....Pages 467-476
Question Answering Experiments for Finnish and French....Pages 477-487
MIRACLE’s Cross-Lingual Question Answering Experiments with Spanish as a Target Language....Pages 488-491
The Role of Lexical Features in Question Answering for Spanish....Pages 492-501
Cross-Language French-English Question Answering Using the DLT System at CLEF 2005....Pages 502-509
Finding Answers to Indonesian Questions from English Documents....Pages 510-516
BulQA: Bulgarian–Bulgarian Question Answering at CLEF 2005....Pages 517-526
The Query Answering System PRODICOS....Pages 527-534
The CLEF 2005 Cross–Language Image Retrieval Track....Pages 535-557
Linguistic Estimation of Topic Difficulty in Cross-Language Image Retrieval....Pages 558-566
Dublin City University at CLEF 2005: Experiments with the ImageCLEF St Andrew’s Collection....Pages 567-573
A Probabilistic, Text and Knowledge-Based Image Retrieval System....Pages 574-577
UNED at ImageCLEF 2005: Automatically Structured Queries with Named Entities over Metadata....Pages 578-581
Easing Erroneous Translations in Cross-Language Image Retrieval Using Word Associations....Pages 582-591
A Corpus-Based Relevance Feedback Approach to Cross-Language Image Retrieval....Pages 592-601
CUHK at ImageCLEF 2005: Cross-Language and Cross-Media Image Retrieval....Pages 602-611
The University of Jaén at ImageCLEF 2005: Adhoc and Medical Tasks....Pages 612-621
Data Fusion of Retrieval Results from Different Media: Experiments at ImageCLEF 2005....Pages 622-631
Combining Visual Features for Medical Image Retrieval and Annotation....Pages 632-641
A Structured Visual Learning Approach Mixed with Ontology Dimensions for Medical Queries....Pages 642-651
FIRE in ImageCLEF 2005: Combining Content-Based Image Retrieval with Textual Information Retrieval....Pages 652-661
A Clustered Retrieval Approach for Categorizing and Annotating Images....Pages 662-672
Manual Query Modification and Data Fusion for Medical Image Retrieval....Pages 673-679
Combining Textual and Visual Features for Image Retrieval....Pages 680-691
Supervised Machine Learning Based Medical Image Annotation and Retrieval in ImageCLEFmed 2005....Pages 692-701
Content-Based Retrieval of Medical Images by Combining Global Features....Pages 702-711
Combining Textual and Visual Features for Cross-Language Medical Image Retrieval....Pages 712-723
The Use of MedGIFT and EasyIR for ImageCLEF 2005....Pages 724-732
Retrieving Images Using Cross-Language Text and Image Features....Pages 733-736
UB at CLEF 2005: Bilingual CLIR and Medical Image Retrieval Tasks....Pages 737-743
Overview of the CLEF-2005 Cross-Language Speech Retrieval Track....Pages 744-759
Using Various Indexing Schemes and Multiple Translations in the CL-SR Task at CLEF 2005....Pages 760-768
The University of Alicante at CL-SR Track....Pages 769-772
Pitt at CLEF05: Data Fusion for Spoken Document Retrieval....Pages 773-782
UNED@CL-SR CLEF 2005: Mixing Different Strategies to Retrieve Automatic Speech Transcriptions....Pages 783-791
Dublin City University at CLEF 2005: Cross-Language Speech Retrieval (CL-SR) Experiments....Pages 792-799
CLEF-2005 CL-SR at Maryland: Document and Query Expansion Using Side Collections and Thesauri....Pages 800-809
Overview of WebCLEF 2005....Pages 810-824
EuroGOV: Engineering a Multilingual Web Corpus....Pages 825-836
Web Retrieval Experiments with the EuroGOV Corpus at the University of Hildesheim....Pages 837-845
Danish and Greek Web Search Experiments with Hummingbird SearchServer TM at CLEF 2005....Pages 846-855
Combination Methods for Crosslingual Web Retrieval....Pages 856-864
University of Alicante at the CLEF 2005 WebCLEF Track....Pages 865-868
MIRACLE at WebCLEF 2005: Combining Web Specific and Linguistic Information....Pages 869-872
BUAP-UPV TPIRS: A System for Document Indexing Reduction at WebCLEF....Pages 873-879
Web Page Retrieval by Combining Evidence....Pages 880-887
UNED at WebCLEF 2005....Pages 888-891
Using the Web Information Structure for Retrieving Web Pages....Pages 892-897
University of Glasgow at WebCLEF 2005: Experiments in Per-Field Normalisation and Language Specific Stemming....Pages 898-907
GeoCLEF: The CLEF 2005 Cross-Language Geographic Information Retrieval Track Overview....Pages 908-919
MIRACLE at GeoCLEF 2005: First Experiments in Geographical IR....Pages 920-923
University of Alicante at GeoCLEF 2005....Pages 924-927
Evaluating Geographic Information Retrieval....Pages 928-938
Using the WordNet Ontology in the GeoCLEF Geographical Information Retrieval Task....Pages 939-946
The GeoTALP-IR System at GeoCLEF 2005: Experiments Using a QA-Based IR System, Linguistic Analysis, and a Geographical Thesaurus....Pages 947-955
CSUSM Experiments in GeoCLEF2005: Monolingual and Bilingual Tasks....Pages 956-962
Berkeley at GeoCLEF: Logistic Regression and Fusion for Geographic Information Retrieval....Pages 963-976
Using Semantic Networks for Geographic Information Retrieval....Pages 977-986
Experiments with Geo-Filtering Predicates for IR....Pages 987-996
The XLDB Group at GeoCLEF 2005....Pages 997-1006
Portuguese at CLEF 2005....Pages 1007-1010
Back Matter....Pages -
