ERC Advanced Grant · 2022
Federated foundational models for embodied perception
Computer vision is beginning to see a paradigm shift with large-scale foundational models that demonstrate impressive results on a wide range of recognition tasks. While achieving impressive results, these models learn only static 2D image representations based on observed correlations between still images and natural language. However, our world is three-dimensional, full of dynamic events and causal interactions. We argue that the next scientific challenge is to invent foundational models for embodied perception – that is perception for systems that have a physical body, operate in a dynamic 3D world and interact with the surrounding environment. The FRONTIER proposal addresses this…
From the public funding record at EU CORDIS. Describes the funded project, not the reviews below.