PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
March 24, 20260 citationsOpen Access

The marginal energy and water cost of AI inference

View Full Paper
IPIvann PusleckiJMjoseph Morlier

Key Points

  • This research aims to accurately estimate the energy and water costs associated with large language model inference.
  • Conducted bottom-up estimations of energy and water use.
  • Employed explicit computational, hardware, and infrastructure parameters.
  • Analyzed a single query's consumption of electricity and water.
  • Estimated energy consumption is approximately 1.3 Wh per query.
  • Estimated water consumption is around 4.3 milliliters per query.
  • Findings imply that marginal impacts of AI inference may be lower than existing estimates.

Abstract

Public debate frequently portrays artificial intelligence inference as highly energy- and water- intensive, often based on opaque or inconsistent assumptions. In this paper, we provide a bottom-up estimation of the marginal electricity and water footprint of large language model inference using top level hypothesis. Using explicit computational, hardware, and infrastructure parameters, we demonstrate that a single query typically consumes around 1.3 Wh of electricity and 4.3 milliliters of water. These estimates suggest that marginal impacts may be lower than previously estimated through top-down attribution methods.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Puslecki et al. (2026) studied this question.

synapsesocial.com/papers/69c229a5aeb5a845df0d4659https://doi.org/10.5281/zenodo.19160820
Ask AI
Helpful
Bookmark
Share
View Full Paper