MCPcopy Index your code
hub / github.com/octalmage/robotjs

github.com/octalmage/robotjs @v0.7.1

Chat with this repo
repository ↗ · DeepWiki ↗ · release v0.7.1 ↗ · + Follow
179 symbols 337 edges 60 files 30 documented · 17% 2 cross-repo links
What it actually does AI analysis from the code graph — generated when you open this
loading…
README

Node.js Desktop Automation. Control the mouse, keyboard, and read the screen.

RobotJS supports Mac, Windows, and Linux.

This is a work in progress so the exported functions could change at any time before the first stable release (1.0.0). Ideas?

Check out some of the cool things people are making with RobotJS! Have your own rad RobotJS project? Feel free to add it!

Contents

Installation

Install RobotJS using npm:

npm install robotjs

It's that easy! npm will download one of the prebuilt binaries for your OS.

You can get npm here if you don't have it installed.

If you need to build RobotJS, see the building section. Instructions for Electron.

Examples

Mouse

// Move the mouse across the screen as a sine wave.
var robot = require("robotjs");

// Speed up the mouse.
robot.setMouseDelay(2);

var twoPI = Math.PI * 2.0;
var screenSize = robot.getScreenSize();
var height = (screenSize.height / 2) - 10;
var width = screenSize.width;

for (var x = 0; x < width; x++)
{
    y = height * Math.sin((twoPI * x) / width) + height;
    robot.moveMouse(x, y);
}
Keyboard
// Type "Hello World" then press enter.
var robot = require("robotjs");

// Type "Hello World".
robot.typeString("Hello World");

// Press enter.
robot.keyTap("enter");
Screen
// Get pixel color under the mouse.
var robot = require("robotjs");

// Get mouse position.
var mouse = robot.getMousePos();

// Get pixel color in hex format.
var hex = robot.getPixelColor(mouse.x, mouse.y);
console.log("#" + hex + " at x:" + mouse.x + " y:" + mouse.y);

Read the Wiki for more information!

API

The RobotJS API is hosted at https://robotjs.dev/docs/syntax.

Building

Please ensure you have the required dependencies before installing:

  • Windows
  • windows-build-tools npm package (npm install --global --production windows-build-tools from an elevated PowerShell or CMD.exe)
  • Mac
  • Xcode Command Line Tools.
  • Linux
  • Python (v2.7 recommended, v3.x.x is not supported).
  • make.
  • A C/C++ compiler like GCC.
  • libxtst-dev and libpng++-dev (sudo apt-get install libxtst-dev libpng++-dev).

Install node-gyp using npm:

npm install -g node-gyp

Then build:

node-gyp rebuild

See the node-gyp readme for more details.

Plans

  • √ Control the mouse by changing the mouse position, left/right clicking, and dragging.
  • √ Control the keyboard by pressing keys, holding keys down, and typing words.
  • √ Read pixel color from the screen and capture the screen.
  • Find an image on screen, read pixels from an image.
  • Possibly include window management?

Progress

Module Status Notes
Mouse 100% All planned features implemented.
Keyboard 100% All planned features implemented.
Screen 85% Image search, pixel search.
Bitmap 0% Saving/opening, png support.

FAQ

Does RobotJS support global hotkeys?

Not currently, and I don't know if it ever will. I personally use Electron/NW.js for global hotkeys, and this works well. Later on I might add hotkey support or create a separate module. See #55 for details.

Can I take a screenshot with RobotJS?

Soon! This is a bit more complicated than the rest of the features, so I saved it for last. Luckily the code is already there, I just need to write the bindings, and I've already started. Subscribe to #13 for updates.

Why is <insert key> missing from the keyboard functions?

We've been implementing keys as we need them. Feel free to create an issue or submit a pull request!

How about multi-monitor support?

The library doesn't have explicit multi-monitor support, so anything that works is kind of on accident. Subscribe to #88 for updates.

For any other questions please submit an issue.

Story

I'm a huge fan of AutoHotkey, and I've used it for a very long time. AutoHotkey is great for automation and it can do a bunch of things that are very difficult in other languages. For example, it's imagesearch and pixel related functions are hard to reproduce on Mac, especially in scripting languages. These functions are great for automating apps that can't be automated like Netflix. This has never been a big deal since I've always used Windows at work, but for the past few years I've been using Mac exclusively.

I like AutoHotkey, but I like Node.js more. By developing RobotJS I get an AutoHotkey replacement on Mac (finally!), and I get to use my favorite language.

TLDR: There's nothing like AutoHotkey on Mac, so I'm making it.

License

MIT

Based on autopy. Maintained by Jason Stallings.

Extension points exported contracts — how you extend this code

Bitmap (Interface)
(no doc)
index.d.ts
Screen (Interface)
(no doc)
index.d.ts

Core symbols most depended-on inside this repo

microsleep
called by 12
src/microsleep.h
createMMBitmap
called by 8
src/MMBitmap.c
MMPointMake
called by 7
src/types.h
colorAt
called by 6
index.d.ts
toggleKeyCode
called by 6
src/keypress.c
XGetMainDisplay
called by 6
src/xdisplay.c
getMainDisplaySize
called by 4
src/screen.c
MMSizeMake
called by 4
src/types.h

Shape

Function 138
Class 26
Enum 11
Interface 2
Method 2

Languages

C60%
C++37%
TypeScript3%

Modules by API surface

src/robotjs.cc31 symbols
src/bmp_io.c13 symbols
src/mouse.c11 symbols
src/png_io.c9 symbols
src/keypress.c9 symbols
src/bitmap_find.c9 symbols
src/types.h8 symbols
src/uthash.h7 symbols
src/str_io.c6 symbols
src/MMBitmap.c6 symbols
src/snprintf.c5 symbols
src/rgb.h5 symbols

Used by 2 indexed graphs manifest dependencies, hub-wide

For agents

$ claude mcp add robotjs \
  -- python -m otcore.mcp_server <graph>

⬇ download graph artifact