OtterlyObsessedWithSemantics at SemEval-2024 Task 4: Developing a Hierarchical Multi-Label Classification Head for Large Language Models

, , , , , and . Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024), page 602--612. Mexico City, Mexico, Association for Computational Linguistics, (June 2024)


For our submission for Subtask 1, we developed a custom classification head that is designed to be applied atop of a Large Language Model. We reconstructed the hierarchy across multiple fully connected layers, allowing us to incorporate previous foundational decisions in subsequent, more fine-grained layers. To find the best hyperparameters, we conducted a grid-search and to compete in the multilingual setting, we translated all documents to English.

Links and resources



  • @dmir
  • @janpf
@dmir's tags highlighted