Call for Paper - August 2020 Edition
IJCA solicits original research papers for the August 2020 Edition. Last date of manuscript submission is July 20, 2020. Read More

Review of Methods in TREC from 1992 to 2014

Print
PDF
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Year of Publication: 2016
Authors:
Kalpana Khandale, Maheshkumar B. Landge, C. Namrata Mahender
10.5120/ijca2016907938

Kalpana Khandale, Maheshkumar B Landge and Namrata C Mahender. Article: Review of Methods in TREC from 1992 to 2014. International Journal of Computer Applications 134(5):6-13, January 2016. Published by Foundation of Computer Science (FCS), NY, USA. BibTeX

@article{key:article,
	author = {Kalpana Khandale and Maheshkumar B. Landge and C. Namrata Mahender},
	title = {Article: Review of Methods in TREC from 1992 to 2014},
	journal = {International Journal of Computer Applications},
	year = {2016},
	volume = {134},
	number = {5},
	pages = {6-13},
	month = {January},
	note = {Published by Foundation of Computer Science (FCS), NY, USA}
}

Abstract

The Text REtrieval Conferences (TRECs) are a series of workshops that encourage research in information retrieval from realistic applications by providing large test collections, uniform scoring procedures, and a forum for organizations interested in comparing results. This paper describes the overview of Text Retrieval conferences (TRECs) from 1992 (TREC-1) to 2014 (TREC-23). The goals the judging procedure of TREC are mentioned for understanding the importance & compounds involved in text retrieval in real time applications. A brief comparative report about the methods, number of tracks and the outcomes are presented in this paper so that researchers working or want to work under this domain get an up to date view regarding Text retrieval process and applications.

References

  1. Harman D., The Text REtrieval Conference (TREC) National Institute of Standards and Technology, Gaithersburg, Md. 20899 USA
  2. Harman D. (Ed.). (1993). The First Text REtrieval Conference (TREC-1). National Institute of Standards and Technology Special Publication 500-207, Gaithersburg, Md. 20899. Harman, D. (Ed.). (1994a).
  3. The Second Text Retrieval Conference (TREC-2). National Institute of Standards and Technology Special Publication 500-215, Gaithersburg, Md. 20899.Also a special issue of Information Processing and Management, 31(3) in press.
  4. Overview of the Third Text Retrieval Conference (TREC-3). National Institute of Standards and Technology Special Publication 500-215, Gaithersburg, Md. 20899.
  5. D. K. Harman, editor. Proceedings of the Fourth Text REtrieval Conference (TREC- 4), October 1996. NIST Special Publication 500-236.
  6. Ellen M. Voorhees and Donna Harman. Overview of the fifth Text REtrieval Conference (TREC-5). In E.M. Voorhees and D.K. Harman, editors, Proceedings of the Fifth Text REtrieval Conference (TREC-5), pages 1{28, November 1997. NIST Special Publication 500-238.
  7. Ellen M. Voorhees and Donna Harman. Overview of the sixth Text REtrieval Conference (TREC-6).In Voorhees and Harman [12], pages 1{24.NIST Special Publication 500-240.
  8. Ellen M. Voorhees and Donna Harman. Overview of the seventh Text Retrieval Conference (TREC-7).National Institute of Standards and Technology Gaithersburg, Md. 20899.
  9. Ellen M. Voorhees and Donna Harman. Overview of the eighth Text REtrieval Conference (TREC-8). In E.M. Voorhees and D.K. Harman, editors, Proceedings of the Eighth Text REtrieval Conference (TREC-8), pages 1–24, 2000. NIST Special Publication 500-246.Electronic version available at http://trec.nist.gov/pubs.html.
  10. Ellen M. Voorhees and Donna Harman. Overview of the Ninth Text REtrieval Conference (TREC-9).National Institute of Standards and Technology Gaithersburg, Md. 20899.
  11. Ellen M. Voorhees and Donna Harman.Overview of TREC-2001.National Institute of Standards and Technology Gaithersburg, Md. 20899.
  12. Ellen M. Voorhees and Donna Harman. Overview of TREC-2002National Institute of Standards and Technology, Gaithersburg, Md. 20899.
  13. Ellen M. Voorhees and Donna Harman. Overview of TREC-2003National Institute of Standards and Technology, Gaithersburg, Md. 20899.
  14. Ellen M. Voorhees and Donna Harman. Overview of TREC-2004National Institute of Standards and Technology, Gaithersburg, Md. 20899.
  15. Ellen M. Voorhees and Donna Harman. Overview of TREC-2005National Institute of Standards and Technology, Gaithersburg, Md. 20899.
  16. Ellen M. Voorhees and Donna Harman. Overview of TREC-2006National Institute of Standards and Technology, Gaithersburg, Md. 20899.
  17. Ellen M. Voorhees and Donna Harman. Overview of TREC-2007National Institute of Standards and Technology, Gaithersburg, Md. 20899.
  18. Iadh Ounis, Craig Macdonald, University of Glasgow, UK {ounis, craigm}@dcs.gla.ac.uk and Ian Soboroff NIST, Gaithersburg, MD, USA This e-mail address is being protected from spambots. You need JavaScript enabled to view it Overview of the TREC-2008 Blog Track.
  19. Craig Macdonald, Iadh Ounis {craigm, ounis}@dcs.gla.ac.uk,,, Ian Soboroff University of Glasgow, Glasgow, UK, Overview of the TREC-2009 Blog Track.
  20. Iadh Ounis, Craig Macdonald, University of Glasgow, UK {earth, ounis, craigm}@dcs.gla.ac.uk and Ian Soboroff NIST, Gaithersburg, MD, USA This e-mail address is being protected from spambots. You need JavaScript enabled to view it Overview of the TREC-2010 Blog Track
  21. Chris Buckley, Sabir Research, Stephen Robertson, Microsoft, Relevance Feedback Track Overview: TREC-2008
  22. Krisztian Balog ISLA, University of This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Paul Thomas CSIRO, This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Nick Craswell MSR Cambridge, UK This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Ian Soboro NIST, This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Peter Bailey Microsoft, This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Arjen P. de Vries CWI, The Netherlands This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Overview of the TREC 2 008 Enterprise Track.
  23. Douglas W. Oared, oard@umd.eduCollege of Information Studies and Institute for Advanced Computer Studies, University of Maryland, College Park, MD 20742, USA, Bruce Hedin, bhedin@h5.comH5, 71 Stevenson St., San Francisco, CA 94105, USA, Stephen Tomlinson, stomlins@opentext.comOpen Text Corporation, Ottawa, Ontario, Canada, Jason R. Baron, This e-mail address is being protected from spambots. You need JavaScript enabled to view it National Archives and Records Administration, Office of the General Counsel, Suite 3110, College Park, MD 20740, USA, Overview of the TREC-2008 Legal Track.
  24. Bruce Hedin, This e-mail address is being protected from spambots. You need JavaScript enabled to view it H5, 71 Stevenson St., San Francisco, CA 94105, USA, Stephen Tomlinson, This e-mail address is being protected from spambots. You need JavaScript enabled to view it Open Text Corporation, Ottawa, Ontario, Canada., Jason R. Baron, This e-mail address is being protected from spambots. You need JavaScript enabled to view it , National Archives and Records Administration, Office of the General Counsel, Suite 3110, College Park, MD 20740, USA., Douglas W. Oared, This e-mail address is being protected from spambots. You need JavaScript enabled to view it , College of Information Studies and Institute for Advanced Computer Studies, University of Maryland, College Park, MD20742, USA, Overview of the TREC-2009 Legal Track
  25. Gorden V. Cormark, This e-mail address is being protected from spambots. You need JavaScript enabled to view it , University of Waterloo, Ontano N2L 3G1, Canada, Maura R. Grossman, This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Wachtell, Lipton, Rosen & Katz, 51 West 52nd Street, New York, NY 10019, USA, Bruce Hedin, This e-mail address is being protected from spambots. You need JavaScript enabled to view it H5, 71 Stevenson St., San Francisco, CA 94105, USA, Douglas W. Oared, This e-mail address is being protected from spambots. You need JavaScript enabled to view it , College of Information Studies and Institute for Advanced Computer Studies, University of Maryland, College Park, MD20742, USA, Overview of the TREC-2010 Legal Track.
  26. Maura R. Grossman, Wachtell, Lipton, Rosen & Katz, New York, NY (USA) Gordon V. Cormack, University of Waterloo, Waterloo, ON (Canada),.Bruce Hedin, H5, San Francisco, CA (USA),Douglas W. Oared, University of Maryland, College Park, MD (USA), Overview of the TREC 2011 Legal Track.
  27. James Allan, Javed A. Aslam Ben Carterette, Virgil Pavlu, Evangelos Kanoulas, Department of Computer Science, University of Massachusetts Amherst, Amherst, Massachusetts, College of Computer and Information Science, Northeastern University, Boston, Massachusetts, Department of Computer and Information Sciences,University of Delaware, Newark, Delaware,Million Query Track 2008 Overview.
  28. Ben Carterette, Virgil Pavlu, Hui Fang, EvangelosKanoulas, Million Query Track 2009 Overview.
  29. Mihai Lupu, Florinapiroi, Xiangjy (Jimmy) Huang, Jianhan Zhu, John Tait, Information Retrieval Facility (IRF), Vienna, Austria; Information Retrieval Lab, York University, Toronto, Cnada; Department of Computer Science, University College London, London, UK; {m. Lupu, f. Peru, john.tait}@ir-facility.org,,, This e-mail address is being protected from spambots. You need JavaScript enabled to view it , This e-mail address is being protected from spambots. You need JavaScript enabled to view it Overview of the TREC-2009 Chemical IR
  30. Milahi Lupu, John Tait, Jimmy Huang, Jianhan Zhu, October 24, 2010, TREC-CHEM 2010: Notebook report.
  31. Mihai Lupu, Vienna University of Technology, Vienna, Austria., Zhao Jiashu, Jimmy Huang, Information Retrieval Lab, York University, Toronto, Canada., HarshaGurulingappa, JulianeFluck, Marc Zimmermann, Fraunhofer SCAI, St. Augustin, Germany., Igor Filippov National Institutes of Health, USA., John Tait, johntait.net Ltd, UK, Overview of TREC 2011 Chemical IR Track.
  32. KrisztianBalogISLA, University of This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Arjen P. de Vries CWI, The This e-mail address is being protected from spambots. You need JavaScript enabled to view it ,PavelSerdyukov TU Delft, The Netherlands, This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Paul Thomas CSIRO, Australia This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Thijs WesterveldTeezir, Utrecht, The Netherlands, This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Overview of the TREC-2009 Entity Track.
  33. KrisztianBalogISLA, University of This e-mail address is being protected from spambots. You need JavaScript enabled to view it , PavelSerdyukov TU Delft, The Netherlands, This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Arjen P. de VriesCWI, The Netherlands This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Overview of the TREC-2010 Entity Track
  34. Charles L.A. Clarke University of Waterloo, Nick Craswell Microsoft, Ion Soboroff NIST, Overview of the TREC 2009 Web Track.
  35. Nick Craswell, Dennis Fetterly, Marc Najorak Microsoft, Microsoft Research at TREC 2010 Web Track.
  36. Charles L. A. Clarke, University of Waterloo, Nick Craswell Microsoft, Ian Soboroff NIST Ellen M. Voorhees NIST Overview of the TREC 2011 Web Track
  37. Charles L. A. Clarke University of Waterloo, Nick Craswell Microsoft, Ellen M. Voorhees NIST, Overview of the TREC 2012 Web Track.
  38. Kevyn Collins-Thompson University of Michigan, Paul Bennett, Fernando Diaz Microsoft Research, Charles L. A. Clarke University of Waterloo, Ellen M. Voorhees NIST, TREC 2013 Web Track Overview.
  39. EvangelosKonoulas, Ben Cartette, Paul Clough, Mark Sanderson, Overview of TREC 2010 Session Track.
  40. Evangelos Kanoulas_ Ben Carterettey Mark Hallz Paul Cloughx Mark Sanderson, Overview of the TREC 2011 Session Track.
  41. Evangelos Kanoulas, Ben Carterettey Mark Hallz, Paul Clough, Mark Sanderson, Overview of the TREC 2012 Session Track
  42. Ben Carterette, Evangelos Kanoulas, Mark Hall, Ashraf Bah, and Paul Clough Overview of the TREC 2013 Session Track.
  43. Ben Carterette, Evangelos Kanoulas, Mark Hall, Ashraf Bah, and Paul Clough Overview of the TREC 2014 Session Track
  44. IadhOunis, Craig Macdonald,University of Glasgow, Glasgow, UK., Jimmy Lin, Twitter, San Francisco, CA, USA424  University of Maryland, College Park, MD, USA; Ian SoboroffNIST, Gaithersburg, MD, USA fi This e-mail address is being protected from spambots. You need JavaScript enabled to view it , This e-mail address is being protected from spambots. You need JavaScript enabled to view it , This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Overview of the TREC-2011 Microblog Track.
  45. Ian Soboroff NIST, Gaithersburg, MD, USA, Iadh Ounis and Craig Macdonald University of Glasgow, Glasgow, UK; Jimmy Lin Twitter, San Francisco, CA, USA and University of Maryland, College Park, MD, USA This e-mail address is being protected from spambots. You need JavaScript enabled to view it , This e-mail address is being protected from spambots. You need JavaScript enabled to view it , This e-mail address is being protected from spambots. You need JavaScript enabled to view it , This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Overview of the TREC2012 Microblog Track.
  46. Jimmy Lin, Yulu Wang University of Maryland, College Park, Miles Efron, and Garrick Sherman University of Illinois, Urbana-Champaign This e-mail address is being protected from spambots. You need JavaScript enabled to view it , This e-mail address is being protected from spambots. You need JavaScript enabled to view it , This e-mail address is being protected from spambots. You need JavaScript enabled to view it , This e-mail address is being protected from spambots. You need JavaScript enabled to view it Overview of the TREC-2014 Microblog Track
  47. Adriel Dean-Hall University of Waterloo, Charles L. A. Clarke University of Waterloo, Jaap Kamps University of Amsterdam, Paul Thomas CSIRO, Ellen Voorhees NIST, Overview of the TREC 2012 Contextual Suggestion Track.
  48. Adriel Dean-Hall University of Waterloo, Charles L. A. Clarke University of Waterloo, Jaap Kamps University of Amsterdam, Paul Thomas CSIRO, Nicole Simone University of Waterloo, Ellen Voorhees NIST, Overview of the TREC 2013 Contextual Suggestion Track.
  49. Adriel Dean-Hall, Charles L. A. Clarke University of Waterloo, Paul Thomas CSIRO, Ellen Voorhes NIST Jaap Kamps, University of Amsterdam Overview of the TREC 2014 Contextual Suggestion Track.
  50. Mark D. Smucker, Department of Management Sciences, University of Waterloo, Gabriella Kazai, Microsoft Research, Cambridge, UK and Matthew Lease School of Information, University of Texas at Austin, Overview of the TREC 2012 Crowdsourcing Track.
  51. Mark D. Smucker Department of Management Sciences, University of Waterloo, Gabriella Kazai Microsoft Research, Cambridge, UK, and Matthew Lease School of Information,University of Texas at Austin, Overview of the TREC 2013 Crowdsourcing Track.
  52. John R. Frank, Max Kleiman-Weiner and Daniel A. Roberts, KBA Organizers, Massachusetts Institute of Technology, This e-mail address is being protected from spambots. You need JavaScript enabled to view it ,Feng Niu, Ce Zhang, Christopher Ré, University of Wisconsin-Madison, Ian Soboroff, National Institute of Standards and Technology Gaithersburg, MD This e-mail address is being protected from spambots. You need JavaScript enabled to view it , Building an Entity-Centric Stream Filtering Test Collection for TREC 2012.
  53. John R. Frank, Steven J. Bauer,Max Kleiman-Weiner, Daniel A. Roberts and Nilesh Tripuraneni KBA Organizers, Massachusetts Institute of Technology, This e-mail address is being protected from spambots. You need JavaScript enabled to view it ,Ce Zhang and Christopher Ré Stanford University and University of Wisconsin, Ellen Voorhees and Ian Soboroff National Institute of Standards and Technology Gaithersburg, MD This e-mail address is being protected from spambots. You need JavaScript enabled to view it Evaluating Stream Filtering for Entity Profile Updates for TREC 2013 (KBA Track Overview).
  54. John R. Frank, Steven J. Bauer,Max Kleiman-Weiner, Daniel A. Roberts and Nilesh Tripuraneni KBA Organizers, Massachusetts Institute of Technology, This e-mail address is being protected from spambots. You need JavaScript enabled to view it ,Ce Zhang and Christopher Ré Stanford University and University of Wisconsin, Ellen Voorhees and Ian Soboroff National Institute of Standards and Technology, Gaithersburg, MD This e-mail address is being protected from spambots. You need JavaScript enabled to view it Evaluating Stream Filtering for Entity Profile Updates in TREC 2012, 2013, and 2014 (KBA Track Overview, Notebook Paper)  
  55. Ellen M. Voorhees, National Institute of Standards and Technology, William Hersh Oregon Health & Science University, Overview of the TREC 2012 Medical Records Track.
  56. Thomas Demeester Ghent University - iMinds, Belgium , Dolf Trieschnigg, Dong Nguyen and Djoerd Hiemstra University of Twente, The Netherlands, This e-mail address is being protected from spambots. You need JavaScript enabled to view it ,{d.trieschnigg, d. Nguyen, d.hiemstra}@utwente.nl Overview of the TREC 2013 Federated Web Search Track.
  57. Thomas Demeester Ghent University - iMinds, Belgium , Dolf Trieschnigg, Dong Nguyen and Djoerd Hiemstra University of Twente, The Netherlands, This e-mail address is being protected from spambots. You need JavaScript enabled to view it ,{d.trieschnigg, d. Nguyen, d.hiemstra}@utwente.nl Overview of the TREC 2014 Federated Web Search Track.
  58. Javed Aslam, Fernando Diaz Matthew, Ekstrand-Abueg, Virgi Pavlu and Tetsuya Sakai TREC 2013 Temporal Summarization.
  59. Javed Aslam, Fernando Diaz Matthew, Ekstrand-Abueg, Virgi Pavlu and Tetsuya Sakai TREC 2014 Temporal Summarization.
  60. Matthew S. Simpson Lister Hill National Center for Biomedical Communications, U.S. National Library of Medicine, National Institutes of Health, Bethesda, MD, Ellen M. Voorhees, National Institute of Standards and Technology, Gaithersburg, MD, and William Hersh, Department of Medical Informatics and Clinical Epidemiology, Oregon Health & Science University, Portland, Overview of the TREC 2014 Clinical Decision Support Track
  61. http://trec.nist.gov.

Keywords

TRECs (Text REtrieval Conferences).