Share your repls and programming experiences

← Back to all posts
Reddit Scraper using Reddit API (unblocked)
h
nithilan4 (242)

totally not created to unblock reddit nope couldn't be me

Commentshotnewtop
LeoChristensen (9)

honestly this is so cool its a shame my school blocked it ( i can still view it on repl tho)

LeoChristensen (9)

maybe updating the web viewer link to thenew url would help, the old ones at V2

nithilan4 (242)

@LeoChristensen are all repl.co urls blocked?

LeoChristensen (9)

@nithilan yes I think so. the only way to view it is to downgrade to v2 or to view it using web viewer. but the web viewer has a v2 link. what would help is if the web viewer was updated to v3

nithilan4 (242)

@LeoChristensen you can always just embed the site in a repl with a web view and try

LeoChristensen (9)

@nithilan4 how do i get the web view to be your url and not my repl url

awesomej (3)

I agree!. This is a great way to view reddit at school, and it works very well, except for one issue. I don't know if this is my school's fault, but when I try to load it, it just pops up with a page that says, Hmmmm.... We Couldn't Reach Your Repl
Make sure your repl has a port open and is ready to receive HTTP traffic. Can you try and fix this? Otherwise, this is just great!

nithilan4 (242)

@awesomej this is the old version of it, I made a better one at the url "https://scraper.nithilan4.repl.co"

LeoChristensen (9)

still says that @nithilan4 all urls of V3 dont work

awesomej (3)

@nithilan4 I know. I used this link and it still does that.

LeoChristensen (9)

@awesomej i think it has nothing to do with school they would just block the website.

hunter12756 (4)

This is awesome, also actually unblocks reddit in school! Only complaint is that when I click posts sometimes it loads random posts, typically one up or one down, other than that it is fantastic and showcases just how powerful flask can be.

nithilan4 (242)

@hunter12756 ah i know why. basically when you click the back button, it loads the same page, but the database updates because it gets the stuff in hot, which is subject to change. if you click that green button with the subreddit at the top of the post list, then you refresh the list. sorry about that!

LeoChristensen (9)

Great Job with V3! This makes Scraper even better. One bug or limitation i found is that subrettits only show about 50 or so posts down before it stops and doesnt load more. other that that great repl! A YouTube scraper would be cool too

LeoChristensen (9)

also anything that has the word unbl ocked in our school gets banned. Chaning all of those into u n b l o c k e d bypasses schol filters.

nithilan4 (242)

@LeoChristensen it should have a ... button that gets more posts now.

LeoChristensen (9)

@nithilan4 only problem is the "we couldnt reach your repl" bug. I hope thats fixed soon

nithilan4 (242)

@LeoChristensen server errored and shut down, try now

DylanCha (2)

LOOK HERE, LOOK LISTEN. Thanks for allowing me to view reddit.

JotsarupNarula (4)

OP just wanted to let you know that pretty much everyone in my school uses this now lol, this code is helping us make it through this last 2 years thank you.

nithilan4 (242)

@JotsarupNarula you're welcome
if you have any suggestions I can try to implement them, just put them in the comments again.

nithilan4 (242)

@JotsarupNarula also are you talking about this repl or the v3 version

JotsarupNarula (4)

@nithilan4 this version, in V3 the text was too big for phones which is what I usually browse on but I did give the V3 link to 1/2 people. As for the suggestions I would love to be able to sort by new for some of the less popular subs!

nithilan4 (242)

@JotsarupNarula I can fix the text and add sorting, thanks!

JotsarupNarula (4)

@nithilan4 you really are awesome lol

nithilan4 (242)

@JotsarupNarula fixed mobile styling for v3

JotsarupNarula (4)

@nithilan4 thank you so much! That's awesome. Btw I wanted to ask, how hard was it do do something of this level? I'm at a high school level of programming so I'd probably not understand but could you give a estimate of what kind of a level I'd have to be in to be able to do something like this? And again, thank you so much dude

nithilan4 (242)

@JotsarupNarula pretty basic nodejs with sockets and in the client-side just some dom manipulation

JotsarupNarula (4)

Yo this actually works in school, finally got to use Reddit thanks man