Show Summary Details

Page of

PRINTED FROM OXFORD HANDBOOKS ONLINE (www.oxfordhandbooks.com). © Oxford University Press, 2018. All Rights Reserved. Under the terms of the licence agreement, an individual user may print out a PDF of a single chapter of a title in Oxford Handbooks Online for personal use (for details see Privacy Policy and Legal Notice).

date: 22 January 2019

Abstract and Keywords

Current mainstream natural language processing tasks rely heavily on the use of statistical methods. This chapter presents statistical methods from their fundamentals to more complex methods, including hidden Markov and maximum entropy models applied in language modelling, and the expectation maximization method used in machine translation. It also introduces robust estimation and the methods for calculating inter-annotator agreement and statistical significance, as well as suggestions for further reading and some mathematical details of the presented statistical methods.

Keywords: mathematical statistics, language modelling, hidden Markov model, maximum entropy, expectation maximization, inter-annotator agreement, statistical significance testing

Access to the complete content on Oxford Handbooks Online requires a subscription or purchase. Public users are able to search the site and view the abstracts and keywords for each book and chapter without a subscription.

Please subscribe or login to access full text content.

If you have purchased a print title that contains an access token, please see the token for information about how to register your code.

For questions on access or troubleshooting, please check our FAQs, and if you can''t find the answer there, please contact us.