GraphBench: Next-generation graph learning benchmarking

2512.04475v1 cs.LG, cs.AI, cs.NE, stat.ML 2025-12-05
Авторы:

Timo Stoll, Chendi Qian, Ben Finkelshtein, Ali Parviz, Darius Weber, Fabrizio Frasca, Hadar Shavit, Antoine Siraudin, Arman Mielke, Marie Anastacio, Erik Müller, Maya Bechler-Speicher, Michael Bronstein, Mikhail Galkin, Holger Hoos, Mathias Niepert, Bryan Perozzi, Jan Tönshoff, Christopher Morris

Abstract

Machine learning on graphs has recently achieved impressive progress in various domains, including molecular property prediction and chip design. However, benchmarking practices remain fragmented, often relying on narrow, task-specific datasets and inconsistent evaluation protocols, which hampers reproducibility and broader progress. To address this, we introduce GraphBench, a comprehensive benchmarking suite that spans diverse domains and prediction tasks, including node-level, edge-level, graph-level, and generative settings. GraphBench provides standardized evaluation protocols -- with consistent dataset splits and performance metrics that account for out-of-distribution generalization -- as well as a unified hyperparameter tuning framework. Additionally, we benchmark GraphBench using message-passing neural networks and graph transformer models, providing principled baselines and establishing a reference performance. See www.graphbench.io for further details.

Ссылки и действия

Связанные статьи

Gradient Interference-Aware Graph Coloring for Multitask Learning

## Контекст В многозадачном обучении (multi-task learning) существуют ситуации, когда цели разных задач противоречат дру...

2025-09-24

Hierarchical Self-Attention: Generalizing Neural Attention Mechanics to Multi-Sc...

## Контекст В последние годы трансформеры и их механизм внимания стали одной из фундаментальных составляющих искусственн...

2025-09-23