Mouse Nodes
Mouse nodes simulate real pointer actions and include MouseMove (movement) and MouseClick (click) variants. They typically run right after an image-recognition node so the workflow can “locate → move → click” seamlessly.
MouseClick Node
MouseClick presses single, double, or right clicks.
Configuration
| Field | Type | Required | Description |
|---|---|---|---|
name | string | ✔️ | Node name, e.g. click-submit. |
retry | number | ✔️ | Retry attempts on failure. |
interval | number | ✔️ | Retry interval in ms. |
params | MouseClickParams | ✔️ | Click configuration. |
conditions | Conditions | Guards combining exist/not_exist/condition. | |
err_return | boolean | Stop immediately on failure (default true). |
MouseClickParams
| Field | Type | Required | Description |
|---|---|---|---|
value | string | ✔️ | Click style such as left, right, or double. |
YAML Example
- action_type: MouseClick
name: click-submit
duration: 120
retry: 2
interval: 400
params:
value: left
conditions:
exist: "find-submit.submit.png"
err_return: trueUsage Tips
- Combine with image recognition or context checks to ensure the element exists before clicking.
durationcan mimic a press-and-hold; omit it for standard clicks.- For double-clicks, set
value: doubleinstead of chaining two nodes.
MouseMove Node
MouseMove positions the cursor using absolute coordinates, variables, or expressions.
Configuration
| Field | Type | Required | Description |
|---|---|---|---|
name | string | ✔️ | Node name, e.g. move-to-login. |
retry | number | ✔️ | Retry attempts. |
params | MouseMoveParams | ✔️ | Coordinate configuration. |
conditions | Conditions | Guards combining exist/not_exist/condition. | |
err_return | boolean | Stop on failure if needed. |
MouseMoveParams
| Field | Type | Required | Description |
|---|---|---|---|
x | string | ✔️ | Target X coordinate. Supports expressions like ${find-dot.dot.png.x}. |
y | string | ✔️ | Target Y coordinate. |
YAML Examples
- action_type: MouseMove
name: move-to-input
retry: -1
params:
x: 820
y: 460- action_type: MouseMove
name: move-to-dynamic
retry: 3
params:
x: "${find-input.input.png.x}"
y: "${find-input.input.png.y}"
conditions:
exist: "find-input.input.png"Usage Tips
- In most flows, capture coordinates via image recognition and pass them in as variables.
- Chain with
Keyboardnodes for natural “move → click/input” sequences.
Last updated on: