Inproceedings,

Generating an NLP Corpus from Java Source Code: The SSL Javadoc Doclet

, , and .
New Challenges for NLP Frameworks, page 41--45. Valletta, Malta, ELRA, (May 2010)

Abstract

Source code contains a large amount of natural language text, particularly in the form of comments, which makes it an emerging target of text analysis techniques. Due to the mix with program code, it is difficult to process source code comments directly within NLP frameworks such as GATE. Within this work we present an effective means for generating a corpus using information found in source code and in-line documentation, by developing a custom doclet for the Javadoc tool. The generated corpus uses a schema that is easily processed by NLP applications, which allows language engineers to focus their efforts on text analysis tasks, like automatic quality control of source code comments. The SSLDoclet is available as open source software.

Tags

Users

  • @renew

Comments and Reviews