Web scraping is the process or service of automatically extracting data from websites.

Provided free and as is, without warranty of any kind — including merchantability, fitness for a particular purpose, and the accuracy or completeness of any result. See the licence. You are responsible for checking what this produces before relying on it.

Webscraping

Web scraping is the process or service of automatically extracting data from websites.

Base URL: https://api.webscraping.ai
Auth: query:api_key (pass your key via the apiKey input)

Operations

account — GET /account — Information about your account calls quota
gethtml — GET /html — Page HTML by URL
getselected — GET /selected — HTML of a selected page area by URL and CSS selector
getselectedmultiple — GET /selected-multiple — HTML of multiple page areas by URL and CSS selectors

Inputs

apiKey — your webscraping API key
operation — one of the operations above
path parameters when an operation's path contains {...}
query — optional JSON object of query params
body — JSON object for create/update ops

Example

operation: account
apiKey: <your key>

Publishes

The keys a later task may reference as {{taskName.key}}. Referencing anything not listed here resolves to nothing at run time.

error
operation
result
status

Input Properties

Every property this tool accepts, from its own tool.iml.

Property	Type	Required	Default	Description
`apiKey`	string	yes	—	DEPRECATED — bind an API Key credential to the task with `credentialName` instead. A key pasted here is stored in the workflow definition in clear and appears in every export of it. Still honoured for workflows built before the change.
`operation`	string	yes	—	One of: account, gethtml, getselected, getselectedmultiple
`query`	string	no	—	Optional query params as a JSON object string, e.g. {"limit": 10}.