ERC Starting Grant · 2025
Adaptive Tokenization and Memory in Foundation Models for Efficient and Long-Horizon AI
The recent revolution in generative AI is powered by the ever-growing scale of Foundation Models (FMs). This, however, causes a series of harmful ramifications, such as their unsustainable energy demand and environmental pollution, which accelerate climate change. Moreover, the scale of FMs jeopardises data privacy, as it compels users to deploy them on third-party servers rather than edge devices. AToM-FM sets out to reverse this trend by remedying a fundamental source of inefficiency in FMs: the granularity of the "atomic" units for representing information in current FMs is fixed, as it entirely depends on how they update their memory and segment input data (a process known as…
From the public funding record at EU CORDIS. Describes the funded project, not the reviews below.