Speechbot Explained
SpeechBot was a web search engine for streaming media content[1] developed at Compaq's (later HP) research laboratories in Cambridge, MA and Australia.[2] Compaq launched the website at Streaming Media West 1999 in San Jose, CA.[3] [4] [5] The internet radio shows indexed by SpeechBot included The Motley Fool, Fresh Air, Talk of the Nation, The Dr. Laura Program, and Dreamland with Art Bell. By June 2003, the service had indexed over 17,000 hours of multimedia content. The website was taken offline in 2005, after HP closed their Cambridge research lab.[6]
The SpeechBot indexing workflow involved a farm of Windows workstations that retrieved the streaming content; and a Linux cluster running speech recognition to transcribe the spoken audio. The web server, search index and metadata library were hosted on AlphaServers running Tru64 UNIX.
If transcripts were already available, then these were aligned to the audio stream; otherwise, an approximate transcript was produced using speech recognition. The Calista recognizer that was used was derived from Sphinx-3. Due to the low quality of streaming audio at the time, the word error rate was quite high, but most searches were still able to retrieve relevant hits.[7] The search results linked to the offset in the stream that corresponded to the search phrase, so that users did not need to listen to the entire program to find the section of interest.
Further reading
- Swain . Michael J. . Searching for Multimedia on the World Wide Web . Compaq Technical Report . March 1999 . CRL 99/1 . unfit . https://web.archive.org/web/20051031113112/http://hpl.hp.com/techreports/Compaq-DEC/CRL-99-1.pdf . October 31, 2005 .
- Eberman . B. . Fidler . B. . Iannucci . R.A. . Joerg . C. . Kontothanassis . L. . Kovalcin . D.E. . Moreno . P. . Swain . M.J. . Van Thong . J-M . Indexing Multimedia for the Internet . Compaq Technical Report . March 1999 . CRL 99/2 . unfit . https://web.archive.org/web/20060320223954/http://www.hpl.hp.com/techreports/Compaq-DEC/CRL-99-2.html . March 20, 2006 .
- F.. Dufaux. B.. Eberman. L.. Kontothanassis. P.. Moreno. M.. Swain. C.. Weikart. A system for indexing web multimedia. Compaq Technical Report. March 1999. CRL 99/3.
- Kontothanassis . Leonidas . Joerg . Chris . Swain . Michael J. . Eberman . Brian . Iannucci . Robert A. . Design Implementation and Analysis of a Multimedia Indexing and Delivery Server . Compaq Technical Report . August 1999 . CRL 99/5 . unfit . https://web.archive.org/web/20060320225546/http://www.hpl.hp.com/techreports/Compaq-DEC/CRL-99-5.html . March 20, 2006 .
- Moreno. P.J.. Van Thong. J.-M.. Logan. B.. Jones. G.J.F.. From multimedia retrieval to knowledge management. Computer. 1 January 2002. 35. 4. 58–66. 10.1109/MC.2002.993772.
- Van Thong. J.-M.. Moreno. P.J.. Logan. B.. Fidler. B.. Maffey. K.. Moores. M.. Speechbot: an experimental speech-based search engine for multimedia content on the web. IEEE Transactions on Multimedia. March 2002. 4. 1. 88–96. 10.1109/6046.985557.
- Book: 10.1109/ICASSP.2005.1416475. March 2005. Logan. Beth. Goddeau. Dave. Van Thong. Jean-Manuel. Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005 . Real-World Audio Indexing Systems . Proc. ICASSP'05. 5. 1001–1004. 0-7803-8874-7. 30576691 .
- News: Olsen. Stefanie. Search engines try to find their sound. 18 June 2012. 27 May 2004. CNET News.
Notes and References
- Book: Gibbon, David C.. Introduction to video search engines. 2008. Springer. Berlin. 978-3540793366. 226–227. Zhu Liu .
- News: Australian research gives Compaq a voice. Byron. Kaye. 10 January 2000. PC World.
- News: Compaq Unveils First Website for Indexing Spoken Streamed Media; SpeechBot Research and Development Site Furthers Innovation Leadership.. PR Newswire. 7 December 1999.
- News: Linda. Leung. Compaq's Speechbot site is an Internet first. 18 June 2012. 8 December 1999. V3.
- News: Internet Search Engine Update. ONLINE. March 2000. Notess. Greg.
- News: Price. Gary. Multimedia Searching: Speechbot is No Longer Available. 4 November 2005. Search Engine Watch.
- The relationship of word error rate to document ranking. 2004. Mang Shou. X.. Sanderson. M.. Tuffs. N.. Proceedings of the AAAI Spring Symposium Intelligent Multimedia Knowledge Management Workshop. 28–33. 1577351908.
