Our contribution to the GermEval 2021 shared task on the identification of toxic, engaging, and fact-claiming comments made first place in subtask 2 (engaging comment classification). Additional information about the shared task and all submitted contributions can be found in the workshop proceedings.