developing machine learning coding similarity indicators for c & c++ corpora
abstract
the digital data in this modern world is vulnerable to copying, altering and claiming
someone else’s work as their own. performing the same activity in programming
assignments can be referred to as source-code theft or e-plagiarism. despite years of
efforts, the already existing similarity detection engines perform pretty well in detecting
plagiarism for novice programmers, but provides insufficient results when a student uses
complex and smart plagiarism hacks such as word substitution, structure change, line
spacing placeholder comments. this thesis research aims to deliver an assistive forensic
engine named ‘simdec’, for the evaluators to help detect similar assignments to address
the aforementioned issues. the system's primary objective is to aid the assignment
evaluators to get closer to the code thieves and abide by the university's dishonesty
regulations. the forensic engine has been developed in java programming language to
detect c and c++ source code's similarities. the research has been split into two modules
labelled as ‘software forensic engine development’ and ‘similarity level classification with
machine learning’. the proposed system has a workflow of three stages starting with
lexical analysis, tokenizer customization and the final stage displaying similarity
percentage and the corresponding level of ‘low’, ‘average’ and ‘high’. the combination
of similarity algorithms integrated in the engine are levenshtein distance, jaro & jarowinkler measure, dice coefficient and cosine similarity. the workflow of lexical analysis
and implementing the set of similarity measures on token categories is defined as the first
module. the machine learning algorithms selected for performing the classification task
are multi-class svm, logistic regression and a simple neural network. in this second
module, the data gathered and generated by the similarity detection engine is fed to the
ml algorithms to train the models and make them efficient for predicting the plagiarism or
similarity level of newly entered data. this hybrid approach would be impactful in reducing
the time complexity and processing speed for the software engine.