dear websites that don’t load without javascript
fuck you
@icedquinn web apps should use javascript; that's what it is for, and it is a decent language. But the VAST majority of websites are not web apps, and shouldn't try to be.
@worldsendless it's just a forums. but you can't even view a page without javascript. which means now i gotta wrangle selenium or puppeteer which is obnoxious
@icedquinn sounds like you are trying to scrape stuff, if you need automation tools?
@icedquinn They must really not want you scraping them!
@worldsendless nah its issues getting the webdrivers to work. i guess the julia lib i found doesn't quite work
@worldsendless i did manage to get the stack of julia->selenium->webdriver->browser to work and download a single thread page, and rip the posts. there's annoying "click to expand" parts too and some scrubbing. i got tired of working on it.
i maybe just want to read a 200 page thread on an ebook reader y'know
i maybe just want to read a 200 page thread on an ebook reader y'know
Follow
@icedquinn Oh, I understand that. So much learning that probably will have 0 value after this project... that's web scraping for you.
