EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observations
2510.00405v1
cs.CV, cs.AI, cs.RO
2025-10-04
Авторы:
Jiayi Liu, Jiaming Zhou, Ke Ye, Kun-Yu Lin, Allan Wang, Junwei Liang
Abstract
Reliable trajectory prediction from an ego-centric perspective is crucial for
robotic navigation in human-centric environments. However, existing methods
typically assume idealized observation histories, failing to account for the
perceptual artifacts inherent in first-person vision, such as occlusions, ID
switches, and tracking drift. This discrepancy between training assumptions and
deployment reality severely limits model robustness. To bridge this gap, we
introduce EgoTraj-Bench, the first real-world benchmark that grounds noisy,
first-person visual histories in clean, bird's-eye-view future trajectories,
enabling robust learning under realistic perceptual constraints. Building on
this benchmark, we propose BiFlow, a dual-stream flow matching model that
concurrently denoises historical observations and forecasts future motion by
leveraging a shared latent representation. To better model agent intent, BiFlow
incorporates our EgoAnchor mechanism, which conditions the prediction decoder
on distilled historical features via feature modulation. Extensive experiments
show that BiFlow achieves state-of-the-art performance, reducing minADE and
minFDE by 10-15% on average and demonstrating superior robustness. We
anticipate that our benchmark and model will provide a critical foundation for
developing trajectory forecasting systems truly resilient to the challenges of
real-world, ego-centric perception.
Ссылки и действия
Дополнительные ресурсы: