webscraper-pulpminer
Convert any webpage into structured JSON data using AI.
Setup & Installation
Install command
clawhub install melvin2016/webscraper-pulpminerIf the CLI is not installed:
Install command
npx clawhub@latest install melvin2016/webscraper-pulpminerOr install with OpenClaw CLI:
Install command
openclaw skills install melvin2016/webscraper-pulpmineror paste the repo link into your assistant's chat
Install command
https://github.com/openclaw/skills/tree/main/skills/melvin2016/webscraper-pulpminerWhat This Skill Does
PulpMiner converts any webpage into structured JSON using AI. You provide a URL and an optional JSON schema, and it scrapes the page, processes it through an LLM, and returns clean data. APIs can be saved and called programmatically with static or dynamic URLs.
Handles JavaScript-rendered SPAs and lets you define exact output schemas, which removes the need to write and maintain custom scraper code.
When to Use It
- Track competitor prices across e-commerce pages
- Extract lead contact info from company directories
- Monitor job listings for new postings
- Pull structured product data from vendor catalogs
- Scrape paginated search results with dynamic query variables
Example Workflow
Here's how your AI assistant might use this skill in practice.
User asks: Track competitor prices across e-commerce pages
- 1Track competitor prices across e-commerce pages
- 2Extract lead contact info from company directories
- 3Monitor job listings for new postings
- 4Pull structured product data from vendor catalogs
- 5Scrape paginated search results with dynamic query variables
Convert any webpage into structured JSON data using AI.
Security Audits
These signals reflect official OpenClaw status values. A Suspicious status means the skill should be used with extra caution.