For a fistful of blogs: Discovery and comparative benchmarking of republishable German contentReport as inadecuate




For a fistful of blogs: Discovery and comparative benchmarking of republishable German content - Download this document for free, or read online. Document in PDF available to download.

1 BBAW - Berlin-Brandenburgische Akademie der Wissenschaften

Abstract : We introduce two corpora gathered on the web and related to computer-mediated communication: blog posts and blog comments. In order to build such corpora, we addressed following issues: website discovery and crawling, content extraction constraints, and text quality assessment. The blogs were manually classified as to their license and content type. Our results show that it is possible to find blogs in German under Creative Commons license, and that it is possible to perform text extraction and linguistic annotation efficiently enough to allow for a comparison with more traditional text types such as newspaper corpora and subtitles. The comparison gives insights on distributional properties of the processed web texts on token and type level. For example, quantitative analysis reveals that blog posts are close to written language, while comments are slightly closer to spoken language.

Keywords : Corpus Construction Web Crawling Computer-Mediated Communication CMC Creative Commons Blogosphere Text Extraction Quality Assessment Visualization





Author: Adrien Barbaresi - Kay-Michael Würzner -

Source: https://hal.archives-ouvertes.fr/



DOWNLOAD PDF




Related documents