Googleapis Dataproc

Googleapis Dataproc is a connector for the Google Cloud Dataproc API, used to manage cloud-based Apache Spark and Hadoop data processing clusters.

• Base URL: https://dataproc.googleapis.com
• Auth: OAuth 2.0 (user-delegated) — attach an InTouch oauth credential. Mint one with itcli.py /oauth <provider> (device-code) or /google-auth (Google); the server auto-refreshes the access token before each run, so the connector never handles or stores tokens.

Operations

• dataproc_projects_regions_clusters_list — GET /v1/projects/{projectId}/regions/{region}/clusters — Lists all regions/{region}/clusters in a project alphabetically.
• dataproc_projects_regions_clusters_get — GET /v1/projects/{projectId}/regions/{region}/clusters/{clusterName} — Gets the resource representation for a cluster in a project.
• dataproc_projects_regions_jobs_list — GET /v1/projects/{projectId}/regions/{region}/jobs — Lists regions/{region}/jobs in a project.
• dataproc_projects_regions_jobs_get — GET /v1/projects/{projectId}/regions/{region}/jobs/{jobId} — Gets the resource representation for a job in a project.
• dataproc_projects_regions_workflowtemplates_get — GET /v1/{name} — Retrieves the latest workflow template.Can retrieve previously instantiated temp
• dataproc_projects_regions_autoscalingpolicies_li — GET /v1/{parent}/autoscalingPolicies — Lists autoscaling policies in the project.

Inputs

• a linked oauth credential (no key inputs) — the server injects a fresh Authorization: Bearer from it
• operation — one of the operations above
• path parameters when an operation's path contains {...}
• query — optional JSON object of query params
• body — JSON object for create/update ops

Example

operation: dataproc_projects_regions_clusters_list
# (attach an 'oauth' credential to the task — no inline secrets)

Publishes

The keys a later task may reference as {{taskName.key}}. Referencing anything not listed here resolves to nothing at run time.

• error
• operation
• result
• status

Input Properties

Every property this tool accepts, from its own tool.iml.