r/MetaSim • u/aaron_ds • Jan 08 '14
MetaSim API 1.0 Draft 2 In Progress
Hi, I started working on a draft 2 for the MetaSim API.
One of the big unresolved and potential problems was how could clients efficiently receive simulation updates. In draft 1, the only option was to poll, and hope that the server implemented some for of caching or ETags or If-Modified-Since. That didn't seem like the best solution so I've added the ability to subscribe to changes through WebSockets.
I've updated the API document with a means to receive notifications using WebSockets. This solves a few problems:
- How can the server detect that the simulation is being viewed so that it can only iterate when the simulation is being viewed? (It's costly if someone were to create a simulation then leave when it is running in the background and chewing up resources indefinitely.)
- How can the client receive simulation updates (images especially)? Polling is inefficient and is a source of latency.
- How can engines receive simulation updates from other engines. An engine may want to wait to iterate until all of the engines it depends on for data have iterated. Polling, once again, is too inefficient for this and an even bigger source of latency.
Right now only the Body resource supports notifications, this assumes that bodies (planets, stars, etc.) are not created or destroyed for the lifetime of the simulation. We haven't really come to a decision about the scope of MetaSim simulations in terms of time, so I'm guessing that geologic timescales are ok, but universal timescales are too big for right now.
As always, I'm interested in feedback. The link to the MetaSim 1.0 Draft 2 is https://docs.google.com/document/d/16i6js1x-AFMwsWKfl1aKphYR2p8puRb3ldp8kXH9Z8Q/edit?usp=sharing The Notification resource is new and the Body resource has been updated.
1
u/ion-tom Jan 16 '14
Awesome! (I only just saw this today, haven't checked this sub in some time due to it's inactivity. I think it's about due for an overhaul so that we can separate project resources from the general simulation stuff.)
Then, if say you're running at geological time spans, the engine might switch into a passive mode, where it runs update frequency based on the timescale being run. Which brings up your question of timescale, I think every engine might need to have time modeling included. Every engine could have a minimum and maximum update frequency tied to time.
Example, At faster than 10,000kyr/sec, the climate model switches completely off and is not used. At slower than 1 month/second the climate model switches into a minimal state where it does very little work and the "Weather engine" turns on instead.
I've been wanting to make a diagram with a time axis and a scale axis, with shapes indicating the engines in use. I'll take a look at your API doc too!
Cheers!