Study 01: How Quickly Does Weather Data Reach the Public?
The Question Behind This Study
When someone glances at a weather app at 7:15 PM, the temperature shown isn't always from 7:15 PM — it might be from 6:54 PM or earlier, depending on which channel the app reads from and how recently that channel updated. The "freshness" of weather information varies in ways most people never see. This study aims to document, in clear and reproducible terms, how long an observation actually takes to travel from the sensor at a major US airport to the consumer-facing weather products people see.
Background
Each major US city has an automated surface weather sensor that records temperature, wind, pressure, and visibility on a regular schedule. From the moment of measurement, the observation passes through NOAA's processing pipeline and emerges on several public information channels — each maintained for a different audience and updating on its own rhythm. NOAA's Synoptic Data documentation describes high-frequency observation availability as typically arriving "between 2 and 5 minutes" after the observation [1]. The Aviation Weather Center service refreshes its data approximately once a minute [2]. NOAA's Telecommunications Gateway file distribution updates approximately every five minutes [3].
Those rhythms are documented in technical specifications, but their practical day-to-day behavior — how consistent the timing actually is, how often a particular channel falls behind, what time-of-day patterns exist — is rarely characterized for individual cities in publicly accessible writing. The aim of this study is to produce that characterization in a form a general reader can understand and a science journalist can cite.
Research Questions
- From the moment a sensor at a major US city records an observation, how long does it take for that observation to be available through each of the public NOAA channels? What is the typical case, and what are the worst cases?
- Do these timing patterns differ from city to city? From morning to afternoon? Between weekdays and weekends?
- How often does an individual city experience an unusually long delay — a stall — and what does this look like when it happens?
- When two channels both eventually deliver the same observation, what's the typical timing relationship between them?
Proposed Approach
Observations from approximately 10–15 major US cities will be collected concurrently from each public channel, with care taken to record the moment each observation arrives at the collection point. The collection runs continuously for a period sufficient to characterize day-to-day variation, after which the resulting dataset is analyzed and the findings are written up in plain language with supporting visualizations.
Who Benefits From This Work
A clear, public-facing characterization of how weather observations move through NOAA's information channels is useful in several practical ways:
- Weather app users gain a clearer mental model of how recent the data they're seeing actually is, and why two apps consulted at the same moment can show slightly different conditions.
- Journalists and science communicators writing about severe weather events benefit from a documented reference for how quickly observations from a stricken area become publicly visible.
- Educators in atmospheric science and data communication courses gain accessible material illustrating how a real-world data pipeline behaves.
- Software developers building tools that depend on weather data — from agricultural apps to construction-safety systems to small-airport ops — gain a documented reference for what they can plan around.
- Researchers using surface observations in retrospective studies gain an accessible documentation of the data they're working with.
Anticipated Findings
- Different channels deliver observations on different timescales, with the spread between them being more interesting and more variable than the documented nominal values would suggest.
- Specific cities and specific channels likely experience occasional long delays, the frequency and severity of which has not previously been publicly characterized.
- The level of agreement between channels — when both deliver the same observation — is expected to provide a useful diagnostic signal.
Cross-References to Other Studies
- → Study 02: Some channels carry detailed sampling information used in the sampling granularity study. Documenting which channels deliver what is part of the foundation for that research.
- → Study 03: The consumer-app comparison study draws on this latency analysis to explain why some weather apps display "fresher" data than others for the same moment in the same place.
References
- Synoptic Data PBC. High Frequency ASOS — Documentation. docs.synopticdata.com
- NOAA Aviation Weather Center. Data API. aviationweather.gov/data/api
- NOAA NWS. Telecommunications Gateway Data Help. weather.gov/tg/datahelp
- NOAA NWS. MADIS — METAR Data. madis.ncep.noaa.gov
- Iowa Environmental Mesonet. METAR datasets. mesonet.agron.iastate.edu