Machine learning for natural language processing

Education facts

Code: DIT247

<p>The course gives an introduction to machine learning models and architectures used in modern natural language processing (NLP) systems.</p> <p>Rapid developments in machine learning have revolutionized the field of NLP, including for commerically important applications such as translation, summarization,and information extraction. However, natural language data exhibit a number of peculiarities that make them more challenging to work with than many other types of data commonly encountered in machine learning: natural language is discrete,structured, and highly ambiguous. It is extremely diverse: not only are there thousandsof languages in the world, but in each language there is substantial variation in style and genre.<br /> Furthermore, many of the phenomena encountered in language follow long-tailstatistical distributions, which makes the production of training data more costly. For these reasons, machine learning architectures for NLP applications tend to be quite different from those used in other fields.</p> <p>The course covers the following broad areas:</p> <ul> <li>Working practically with text data, including fundamental tasks such as tokenization and word counting.</li> <li>Probabilistic models for text, such as topic models.</li> <li>Overview of the most common types of NLP applications</li> <li>Architectures for representation in NLP models, including word embeddings, convolutional and recurrent neural network, and attention models.</li> <li>Machine learning models for common types of NLP problems, mainlycategorization, sequence labeling, structured prediction and generation.</li> <li>Approaches to transfer learning in NLP.</li> </ul>

Entry requirements

To be eligible to the course, the student should have a Bachelor's degree in any subject. In addition, the course requires: 7.5 credits of courses in programming or equivalent a course including probability and statistics, such as DIT862 Statistical Methods for Data Science or MSG810 Mathematical Statistics and Discrete mathematics a first course in machine learning, such as DIT866 Applied Machine Learning, DIT381 Algorithms for Machine Learning and Inference, or MSA220 Statistical Learning for Big Dat Applicants must prove knowledge of English: English 6/English B or the equivalent levelof an internationally recognized test, for example TOEFL, IELTS. 

Education offerings

Each offering has its own dates and conditions. Closed offerings are retained as history and do not mean that a new application is open.

• Machine learning for natural language processing

  University of Gothenburg

  Start date: 4 November 2024

  End date: 19 January 2025

  Pace of study: 50 %