1

Good afternoon,

I'm working on an application makes calls to a weather API for different coordinates across the United States.

Instead of getting the weather at each and every point, I'm planning on clustering coordinates together based on how close they are to each other. That way, I can take an average of coordinates and get a single weather forecast that is representative for the group.

This raises the question, how close do these points need to be? Would a cluster of radius 50 Miles be sufficient? What about 250?

I'm really only gathering these features from my Weather source:

  • Temperature
  • Category (Rain, Cloudy, Hail, etc.)
  • Visibility

I don't really need a high degree of precision. In fact, the coordinates I'm using are going to have a 25-50 mile variation from their "true position."

I'm not a climate scientist, so I apologize if this question is a little rudimentary. I just wanted a second opinion on the topic so I can balance the trade-off between number of API Calls and fidelity to regional weather.

  • 1
    Topography & proximity to coastlines would be factors. Over a large plain weather can be "constant" over a large area. With hills & mountains, it gets more complicated. Coastal regions can be different from inland regions. – Fred Nov 29 '20 at 07:29
  • 1
    @Fred and then you have different parts of a cricket stadium have rain and clear weather at the same time. –  Nov 29 '20 at 12:45
  • @Fred https://earthscience.stackexchange.com/questions/18594/how-to-interpret-precipitation-probability/18851#18851 –  Nov 29 '20 at 12:51
  • Mountains can make rainfall vary by 500% over a 35 mile distance, and weather prediction also uses super precise cloud albedo and temperature satellite data. The average can probably obscure data from areas with high altitude variablity. – bandybabboon Dec 03 '20 at 09:20

3 Answers3

4

Weather is subject to Tobler's First Law of Geography: Everything is related to everything else, but near things are more related than distant things.

Temperature- this changes not only by the feature, but also the day of the year. The winter months, as well as the fall and spring, will have much more drastic temperature changes. This may be due to things like fronts, but is ultimately caused by heating differences from the sun. However, a few miles can yield quite a drastic change. Things become even more complicated when elevation is involved.

Precipitation- This is even more variable. Snow can be happening on a mountain, but have rain in a valley. Even the side of a mountain can influence how much rain is seen. I have seen it rain on one side of a building, but not the other. Precipitation is a tricky thing to forecast.

Visibility There are several factors that influence visibility. Fog and precipitation are probably the most common meteorological factors. Elevation can really influence your line of sight. Obviously, visibility is also influenced by the presence of smoke as well as dust.The smaller the particle, the more likely it will obscure vision. And snow tends to be more reflective than rain. Something else that may influence visibility is wind speed, as aforementioned particles can be kicked up from the surface. So visibility will change depending on how all of these change. It may even change depending on the direction you look.


All of this to say is that it really depends and there is rule of thumb.

BarocliniCplusplus
  • 8,799
  • 16
  • 42
3

I’m a pilot and deal with meteorology on a day to day basis and have just started to write my first App, albeit with very slow progress -so this is a really interesting question. I’m not sure if you’re aware but virtually all weather observations come from airports and this collective data along with computer modelling forms the basis of all weather reports and forecasts. It will be this data that your API is based on. If you wish to present ‘actual’ conditions your data points need to be close to where the observations are being made for obvious reasons. If your app is for a forecast area then the data points can be much further apart perhaps 30 to 50 miles with any error being time related not necessarily weather. You are most unlikely to be able to cover local effects so some users of your app may be disappointed. If you are interested in gaining specific weather information either actual or forecast in a specific area just type the nearest airport followed by TAF into google. This will give you the forecast, it will also bring up a METAR which are the actual conditions updated hourly.

  • 1
    "virtually all weather observations come from airports" What about satellite imagery of pixel precise rainfall and cloud albedo, altitude maps and ground temperature sattelites? Those contruibute huge datasets that go into numeric weather prediction models. In France there is a specialized weather station for every region of about 75 miles radius, which is more weather stations than airports. Locally the rainfall can vary by about 300% on average, on east and west side of a mountain, 35 miles distance. – bandybabboon Dec 03 '20 at 09:17
  • “What about satellite imagery of pixel precise rainfall and cloud albedo, altitude maps and ground temperature satellites?” You are quite correct this is precisely the equipment meteorologists use for forecasting along with observations primarily from major airports. – Rob Wilkinson Dec 03 '20 at 19:49
  • Are you able to confirm your calculation “In France there is a specialized weather station for every region of about 75 miles radius, which is more weather stations than airports” A specialised weather station every 75miles radius would cover an area of 17,671 Sq Miles. France has a total area of 248,572 Sq Miles. This would equate to 14 Specialised Weather Stations. There are 170 airports in France of which half receive commercial traffic. – Rob Wilkinson Dec 03 '20 at 19:59
  • Hey they said that there are professional weather ststions from the radome project every 30km, so 554 in France and 74 on overseas zones. I dunno precisely if the radome is very frequently updated. Also there are 42 synop stations on radio towers which are updated every 20 minutes. The uk is samish at 200 automated weather collection stations from the m.e.t. – bandybabboon Dec 04 '20 at 08:00
  • It's different here in every region because of the dense population, this website sais that there are 1100 stations in the official meteorology program including Radome which updates from 24 to 240 times daily: https://donneespubliques.meteofrance.fr/?fond=produit&id_produit=93&id_rubrique=32 – bandybabboon Dec 04 '20 at 08:19
-1

It very much depends on what you are modelling. For example, it's well known that tornados require much more precise modelling than say rainfall.

In fact, good data on tornado formation is scarce given that they are unpredictable and highly localised phenomena.

Even the nationwide scan in the USA that does a scan every five minutes is problematic. Artifacts from this dataset has suggested that they are top down formed whereas recent data from a highly mobile monitoring equipment has suggested it is exactly the opposite - they are formed bottom-up.

  • 1
    Providing links can sometimes help give power to your message... it might be helpful to give one about the revelation on radar scan artifacts data? – JeopardyTempest Dec 03 '20 at 03:31
  • @jeopardyTempest: These days when search engines are ubiquitous all it takes is someone to enter a few key words in to locate useful referemces ... but I'll think about it. Thanks for the advice. – Mozibur Ullah Dec 03 '20 at 03:34
  • Hi Mozibur, to be honest I did Google as you suggested, but couldn't find anything. I'm decently familiar with like energy cascade and radar concepts (it sounds like you may be referencing radar when talking about 5 minute scans?), and so your input sounded interesting, but unfortunately can't seem to turn up much on Google. – JeopardyTempest Dec 05 '20 at 07:50
  • 1
    @JeopardyTempest: Well, I typed 'tornado formation down-up' into Duck Duck Go and the first search result mentioned this. I also got very similar results on Google. – Mozibur Ullah Dec 05 '20 at 21:10
  • @jeopardyTempest: All three keywords are mentioned in my post ... – Mozibur Ullah Dec 05 '20 at 21:11
  • @jeopardyTempest: Feel free to update my post with the links... – Mozibur Ullah Dec 05 '20 at 21:13
  • 1
    I usually don't down vote good answers and especially not for new users, but I'm leaving a temporary and quickly-reversible donwvote here to further encourage you to update your own post and bring it up to the level of a proper Stack Exchange answer. SE works differently than other Q&A sites, and supporting statements in answers with citations and/or links is strongly encouraged in science and fact-based SE sites. I see that you are very active in many sites and in most of them (and especially in things like Mathematics) and answer can be seen to be self-evident. – uhoh Dec 06 '20 at 02:54
  • 1
    But here in Earth Science SE there is some history of problematic and unsupported answers and so we're trying to be vigilant and as much as possible maintain a supported-answer practice. So in this case "Feel free to update my post with the links..." and "These days when search engines are ubiquitous..." is probably not the best response here, and down voting and eventual voting to delete an unsupported answer and perhaps converting it to a comment may ensue. Welcome to Earth Science Stack Exchange! Please consider editing your post, or deleting it and posting a comment instead. Thanks! – uhoh Dec 06 '20 at 02:59
  • @uhoh: You're entitled to your downvote. – Mozibur Ullah Dec 06 '20 at 06:01
  • @JeopardyTempest: As you can see, I thought about my answer; but did you think about yours? – Mozibur Ullah Dec 06 '20 at 06:02
  • Ok, I see where my confusion came about now... having it as a separate paragraph, I thought the subject of the last paragraph was the 5 minute scans or rainfall, so I thought you were suggesting radar\rainfall errors snowballed from the small-scale to the larger-scale (which is what bottom-up often refers to in some scientific circles). Makes a lot more sense now that we've worked past that, no problem with how you wrote it, just read it differently than you intended and brought about confusion :-) – JeopardyTempest Dec 07 '20 at 09:05
  • Now that you say it, I did hear something about that. (https://www.livescience.com/64309-weird-way-tornadoes-form.html) Funny enough, happened to witness 2 of the 4 tornadoes mentioned, though caught both in progress. A pity that so far Jana (the main author) hasn't published anything in a journal, so wonder what's become of that... as it does seem perhaps significant if can continue to be verified. The topic is a bit tangential to the question perhaps, but good answers sometimes throw in interesting tidbits as such, and your main idea is a valid point and more succinct on that than the others – JeopardyTempest Dec 07 '20 at 09:11
  • I did think about answering the question myself, but figured if doing another answer, it'd best done from a mathematical standpoint, and didn't have the info at hand to really put together anything too sharp. We'll see, but all 3 answers are reasonable. As all answers lead towards, I'd emphasize that in some seasons\environments, temperature can be fine over a large distance, but in front a few miles can mean double digit degree differences. It's an interesting question to me, going into the challenges for weather apps of data validity and efficiency, so maybe will come back to it, will see. – JeopardyTempest Dec 07 '20 at 09:19
  • @JeopardyTempest: I'm not interested in your rants. What I'm interested in is why you said you couldn't find the information I referred to when I demonstrated that it was easily discoverable on two search engines. An apology is called for. – Mozibur Ullah Dec 07 '20 at 18:32
  • Rants? Brother I was trying to be friendly, seeing there was some miscommunication between us, and trying to further the topic discussion. I promise you there was no malicious intent, elist undertone, or attack to what I said. I was honestly trying to work out the struggles I had finding the info because it's something I'm interested in. At this point you come across a bit like you're on a mission for argument rather than pleasant exchange and growing community understanding :-\ You can have any last word here, but otherwise we should go to chat\limit to the topic here, so I'll say no more :-( – JeopardyTempest Dec 09 '20 at 03:15
  • @JeopardyTempest: I don't believe you. – Mozibur Ullah Dec 12 '20 at 04:29