linkding

#.blogit #archive #cli #download #scraper #wayback | I had cause to need to recover an entire defunct section of a website recently. It existed in good shape on the Wayback Machine, but downloading sites isn't easy there. I searched for solutions a while, and eventually found wayback-machine-downloader. Worked like a charm.

7 years ago | View Shared by ttscoff

jq

#blogit #cli #json #scraper | CLI query tool for JSON. Great for handling JSON responses in command line scripts.

10 years ago | View Shared by ttscoff

EricChiang/pup

#blogit #cli #html #scraper | This CLI is awesome for parsing HTML on the command line. Crawling, scraping, and grabbing elements and their contents is a breeze. Try `curl brettterpstra.com | pup h2.entry-title text{}`. Binaries available on the releases page. [Via OneThingWell.](http://onethingwell.org/post/97887596570)

10 years ago | View Shared by ttscoff

pjscrape: A web-scraping framework written in Javascript, using PhantomJS and jQuery

#cli #javascript #jquery #scraper | pjscrape is a framework for anyone who's ever wanted a command-line tool for web scraping using Javascript and jQuery. Built to run with PhantomJS, it allows you to scrape pages in a fully rendered, Javascript-enabled context from the command line, no browser required.

13 years ago | View Shared by ttscoff

LINKDING

Shared bookmarks

User

Tags