Skip to Content
👋 Hey, welcome to Auto Engine! We've just released the latest Beta version 0.2.0 Check it out

Mouse Nodes

Mouse nodes simulate real pointer actions and include MouseMove (movement) and MouseClick (click) variants. They typically run right after an image-recognition node so the workflow can “locate → move → click” seamlessly.


MouseClick Node

MouseClick presses single, double, or right clicks.

Configuration

FieldTypeRequiredDescription
namestring✔️Node name, e.g. click-submit.
retrynumber✔️Retry attempts on failure.
intervalnumber✔️Retry interval in ms.
paramsMouseClickParams✔️Click configuration.
conditionsConditionsGuards combining exist/not_exist/condition.
err_returnbooleanStop immediately on failure (default true).

MouseClickParams

FieldTypeRequiredDescription
valuestring✔️Click style such as left, right, or double.

YAML Example

- action_type: MouseClick name: click-submit duration: 120 retry: 2 interval: 400 params: value: left conditions: exist: "find-submit.submit.png" err_return: true

Usage Tips

  • Combine with image recognition or context checks to ensure the element exists before clicking.
  • duration can mimic a press-and-hold; omit it for standard clicks.
  • For double-clicks, set value: double instead of chaining two nodes.

MouseMove Node

MouseMove positions the cursor using absolute coordinates, variables, or expressions.

Configuration

FieldTypeRequiredDescription
namestring✔️Node name, e.g. move-to-login.
retrynumber✔️Retry attempts.
paramsMouseMoveParams✔️Coordinate configuration.
conditionsConditionsGuards combining exist/not_exist/condition.
err_returnbooleanStop on failure if needed.

MouseMoveParams

FieldTypeRequiredDescription
xstring✔️Target X coordinate. Supports expressions like ${find-dot.dot.png.x}.
ystring✔️Target Y coordinate.

YAML Examples

- action_type: MouseMove name: move-to-input retry: -1 params: x: 820 y: 460
- action_type: MouseMove name: move-to-dynamic retry: 3 params: x: "${find-input.input.png.x}" y: "${find-input.input.png.y}" conditions: exist: "find-input.input.png"

Usage Tips

  • In most flows, capture coordinates via image recognition and pass them in as variables.
  • Chain with Keyboard nodes for natural “move → click/input” sequences.
Last updated on: