Ask coding questions

← Back to all posts
Is it possible to build python webscrapers on repl.it?
ArjunSS1 (106)

I've created some very simple web scrapers and I'm unable to create any on repl. Is it possible to create web scrapers/bots on repl, and if so how?

Answered by Scoder12 (733) [earned 5 cycles]
View Answer
Commentshotnewtop
Scoder12 (733)

You can probably use scrapy but selenium wouldn't work. (Maybe in a graphics repl, but that would be hard to set up)

ArjunSS1 (106)

@Scoder12 What do you mean by a graphics repl?

ArjunSS1 (106)

@Scoder12 Using repl.it + pygame I was able to use webbot. Thank You!

Scoder12 (733)

@ArjunSS1 I would recommend using polygott - an experimental repl where you can install packages using the install-pkg command. Just follow the install instructions for chrome and whatever else for linux (ubuntu specifically) just replace apt-get with install-pkg and don't use sudo