Googleapis Dataflow
googleapis-dataflow is a generated connector for Google Cloud Dataflow, a managed service for running Apache Beam batch and streaming data processing jobs.
- Base URL:
https://dataflow.googleapis.com - Auth: OAuth 2.0 (user-delegated) — attach an InTouch
oauthcredential. Mint one withitcli.py /oauth <provider>(device-code) or/google-auth(Google); the server auto-refreshes the access token before each run, so the connector never handles or stores tokens.
Operations
dataflow_projects_jobs_list— GET /v1b3/projects/{projectId}/jobs — List the jobs of a project. To list the jobs of a project in a region, we recommdataflow_projects_jobs_get— GET /v1b3/projects/{projectId}/jobs/{jobId} — Gets the state of the specified Cloud Dataflow job. To get the state of a job, wdataflow_projects_jobs_messages_list— GET /v1b3/projects/{projectId}/jobs/{jobId}/messages — Request the job status. To request the status of a job, we recommend using `projdataflow_projects_jobs_getmetrics— GET /v1b3/projects/{projectId}/jobs/{jobId}/metrics — Request the job status. To request the status of a job, we recommend using `projdataflow_projects_jobs_aggregated— GET /v1b3/projects/{projectId}/jobs:aggregated — List the jobs of a project across all regions.dataflow_projects_locations_jobs_list— GET /v1b3/projects/{projectId}/locations/{location}/jobs — List the jobs of a project. To list the jobs of a project in a region, we recomm
Inputs
- a linked
oauthcredential (no key inputs) — the server injects a freshAuthorization: Bearerfrom it operation— one of the operations above- path parameters when an operation's path contains
{...} query— optional JSON object of query paramsbody— JSON object for create/update ops
Example
operation: dataflow_projects_jobs_list
# (attach an 'oauth' credential to the task — no inline secrets)
Publishes
The keys a later task may reference as {{taskName.key}}. Referencing anything not listed here resolves to nothing at run time.
erroroperationresultstatus
Input Properties
Every property this tool accepts, from its own tool.iml.
| Property | Type | Required | Default | Description |
|---|---|---|---|---|
operation |
string | yes | — | One of: dataflow_projects_jobs_list, dataflow_projects_jobs_get, dataflow_projects_jobs_messages_list, dataflow_projects_jobs_getmetrics, dataflow_projects_jobs_aggregated, dataflow_projects_locations_jobs_list |
jobId |
string | no | — | Path parameter jobId (required by some operations). |
location |
string | no | — | Path parameter location (required by some operations). |
projectId |
string | no | — | Path parameter projectId (required by some operations). |
query |
string | no | — | Optional query params as a JSON object string, e.g. {"limit": 10}. |