Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Good luck with that :) Any modern website requires javascript interpreter on client side, so unless you provide some sort of javascript interpretation (which can be messy), you'll be able to scrape only simple content with scrapy/BS.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: