Machine Learning – Digital NK

Language Models & Literary Clichés: Analyzing North Korean Poetry with BERT

Using masked language modeling as a way to detect literary clichés. Training BERT to use on North Korean language data. Borrowing a pseudo-perplexity metric to use as a measure of […]

BenOctober 1, 2020BERT, Digital Humanities, Language models, Literature, Machine Learning, NLP, Poetry, Python

Machine Learning and the Bane of Romanization

An attempt to develop a quick and dirty method to automatically transliterate Korean using the McCune-Reischauer system with NLP, neural networks and character level sequence to sequence models. 0. IntroductionI […]

BenJanuary 2, 2018Conditional Random Fields, Hangul, Keras, Machine Learning, McCune-Reischauer, Natural Language Processing, Neural Networks, Python, RNN, Romanization, Sequence-to-Sequence, Unicode