SKG-Eval: Stateful Evaluation of Multi-Turn Dialogue via Incremental Semantic Knowledge Graphs
SKG-Eval addresses the challenge of evaluating multi-turn dialogue systems by modeling dialogue as an evolving Semantic Knowledge Graph (SKG). This framework incrementally updates the graph through structured triple extraction to detect long-range issues like contradiction and inconsistency, offering improved evaluation beyond turn-isolated representations.