This article describes the creation of the first public audio dataset for coffee roasting first crack detection, addressing a significant gap in available resources. The dataset, comprising 973 annotated 10-second segments, was meticulously built from scratch and led to a model achieving 100% precision thanks to careful data splitting and loss weighting.
Apesar da estagnação da precisão em benchmarks acadêmicos de fala para texto, as aplicações industriais exigem melhor reconhecimento de vocabulário raro e contextual. Este artigo introduz o Contextual Earnings-22, um novo dataset e benchmark para promover a pesquisa e revelar avanços no reconhecimento contextual de fala com vocabulário personalizado.
This paper introduces DraDDP, the first publicly available English multimodal dataset for multi-party dialogue discourse parsing, based on American TV dramas. It contains 495 dialogue segments and demonstrates the value of multimodal information in capturing dialogue structures and relation types.
FairFace is a face attribute dataset designed to mitigate biases in AI models by providing balanced representation across race, gender, and age. It aims to improve the fairness and robustness of computer vision systems, ensuring more equitable performance.
This article details the development of OmniSign, a real-time Lebanese Sign Language (LSL) translator, addressing the challenges of building AI for a language with an almost non-existent dataset. The author emphasizes that the hardest problems encountered were not technical but human. The inspiration came from witnessing communication difficulties between a deaf man and a barista in Beirut.
Este estudo apresenta o dataset TR-EduVSum, focado em vídeos educacionais turcos, e propõe o método AutoMUP. Este método gera resumos padrão-ouro de forma automática e reproduzível a partir de múltiplos resumos humanos, usando agrupamento de unidades de significado e modelagem estatística de consenso.
This paper introduces MATH-PT, a novel dataset of 1,729 mathematical problems in European and Brazilian Portuguese, to address the linguistic bias in LLM mathematical reasoning evaluations. The benchmark reveals that frontier reasoning models achieve strong performance in multiple-choice questions but their performance decreases for open-ended questions.
This article introduces ViLegalNLI, the first large-scale Vietnamese Natural Language Inference (NLI) dataset specifically constructed for the legal domain. It consists of 42,012 premise-hypothesis pairs derived from official statutory documents, developed using a semi-automatic framework that integrates large language models for hypothesis generation and quality validation.
CFMS introduces the first fine-grained Chinese multimodal sarcasm detection benchmark, comprising 2,796 image-text pairs with triple-level annotations. This dataset aims to improve AI's fine-grained semantic understanding and metaphoric reasoning, addressing limitations in existing benchmarks.
This research paper investigates global narrative dominance in Large Language Models (LLMs), where local cultural knowledge is often overshadowed by global narratives. It introduces the CulturalNB dataset for Bengali cultural contexts and demonstrates that questions asked in English tend to increase global substitution and institutional framing, reducing local perspective coverage.
ThermoQA is a new three-tier benchmark of 293 open-ended engineering thermodynamics problems introduced to evaluate thermodynamic reasoning in LLMs. Leading LLMs like Claude Opus 4.6 and GPT-5.4 achieve high scores, but cross-tier degradation confirms that property memorization does not imply thermodynamic reasoning, with the dataset and code being open-source.
Charades-Ego is a large-scale dataset featuring paired third and first-person videos. This resource is valuable for research in computer vision and video analysis.