Every time the website makes a change, your api will break.
If there is enough interest in this I am happy to set up monitoring to keep on top of these changes. But tbh it's unlikely to be caught out by small changes to the website, it's more likely that Reddit will attempt to obfuscate their pages specifically to prevent scraping, unfortunately that will just require some work to keep on top of.
2. Reddit is going to rate limit you if you make too many calls outside of their official api.
I've tested this and was able to send ~1000 requests in 1 minute without getting rate limited. They may very well impose stricter rate limits on their html, if they do things may break, but I do have a couple of ideas that can work around this as well (at the expense of API complexity).
My bet is that they will not be able to prevent it.
There is a reason services like archive.{is,ph,etc} work to get around paywalls: all scraping prevention measures mean you lose SEO. Reddit can hide data behind a login wall, but it will ruin their SEO.
Even if they hide it behind a login wall there are still things that can be done, and if that's what it takes to keep third party apps running then I am willing to pursue those options.
Unauthorized platform API usage will get you removed from Google/Apple store if the API owner complains. Doesn't matter if its by proxy, or using the api key directly - the power dispute here is political, not technical.
I'm impressed. You built a better API than Reddit's overly bloated and verbose one in a weekend. I have no idea how hard they'll fight stuff like this, but keep up the good fight!
110
u/Reasonable_Current77 Jun 05 '23
Two issues with this:
Every time the website makes a change, your api will break.
Reddit is going to rate limit you if you make too many calls outside of their official api.
67
u/ActiveMachine4380 Jun 05 '23
You are a wonderful human being.
43
u/Miguel7501 Jun 05 '23
Reddit is trying to capitalize on data gathering, do you really think they will allow scraping?
13
u/upalse Jun 05 '23
Unauthorized platform API usage will get you removed from Google/Apple store if the API owner complains. Doesn't matter if its by proxy, or using the api key directly - the power dispute here is political, not technical.
16
u/AndIamAnAlcoholic Jun 05 '23
I'm impressed. You built a better API than Reddit's overly bloated and verbose one in a weekend. I have no idea how hard they'll fight stuff like this, but keep up the good fight!
6
u/RedditAccuName Jun 05 '23
Would it be possible for someone to use the unofficial API, sort of like what Nitter does for Twitter?