Skip to content

SightLab VR Assistant

The SightLab VR Assistant (also called the SightLab AI Kit) is a free plugin from WorldViz that teaches your AI assistant how SightLab works. It answers SightLab questions, writes and fixes SightLab scripts, and, on a Windows PC with SightLab 2 and Vizard 8, checks and runs your experiment for you. It works in ChatGPT and the Codex app, and in the Claude desktop app and Claude Code. You can also open it directly on a project from the SightLab Dashboard.

Get it for ChatGPT / Codex Install in Claude

SightLab VR Assistant listing in ChatGPT's plugin directory

What it does

  • Answers questions about SightLab 2's GUI, Python API and data files, citing the real source.
  • Builds experiments from your description, a paper's methods section, or a Fit Check brief, in checked steps.
  • Checks scripts against the SightLab version you have installed.
  • Runs the experiment itself in desktop mode, drives the prompts and ratings like a participant, and reports what happened, when it runs in Codex or Claude Code on a PC with SightLab 2 and Vizard 8.

Requirements

App Plan Download
Claude desktop app (Mac or Windows) Claude Pro or higher claude.ai/download
Codex app (Mac or Windows) ChatGPT Plus or higher developers.openai.com/codex/app

The plugin is free from WorldViz; each app needs a paid plan from its maker. On the Windows PC that has SightLab 2 and Vizard 8, the assistant can also run its checks and launch your experiment. On any other computer it still answers questions and writes scripts.

Install in ChatGPT and Codex

The assistant is in OpenAI's plugin directory as SightLab VR Assistant, published by WorldViz.

  1. Open the Plugins page: in ChatGPT, go to chatgpt.com/plugins; in the Codex app, click the Plugins icon in the left rail.
  2. Search for SightLab VR Assistant.
  3. Open SightLab VR Assistant (WorldViz, "Build SightLab 2 experiments") and install it. The direct link is chatgpt.com/plugins/plugins_6abfde9851388191aa6d87959f4703c4.
  4. Start a new chat or thread. Plugins load when a thread starts, so an open thread will not see it.

To check and run experiments, use the Codex app on the SightLab PC; it is a separate download from ChatGPT. The Codex tab inside the ChatGPT desktop app and the Codex command line share the Codex app's installation, so one install covers all three. Available controls depend on your OpenAI account, workspace settings, and app version.

Install in Claude

The Claude version installs from WorldViz's plugin marketplace on GitHub. Installing in the Claude desktop app also installs it in Claude Code (Anthropic's terminal and VS Code tool) when you sign in there with the same account; Claude Code picks it up the next time it starts.

  1. Open Claude, click your name or initials in the lower-left corner, then Settings, and click Customize in the left column.
  2. Click the Plugins tab at the top.
  3. Click + Add in the upper right and choose Add marketplace.
  4. Choose Add from a repository and enter worldviz/sightlab-ai-kit in the URL field.
  5. Leave Sync automatically on, so updates reach you without any further steps.
  6. Click Sync.
  7. The Plugins page now lists Sightlab by sightlab-ai-kit.
  8. Click Add next to it. A notice says "Sightlab is installed and ready to use".
  9. Start a new chat.

If a notice asks you to grant the Claude GitHub App access so the marketplace can sync automatically, click Grant access and approve it. That is what lets updates reach you without any further steps.

The numbers in the screenshots match the steps above.

Claude settings: Customize, Plugins, Add, the URL field, Sync automatically and Sync

Claude settings: the Sightlab plugin listed after Sync, with its Add button

From the command line

Claude Code can add the same marketplace from a terminal:

claude plugin marketplace add worldviz/sightlab-ai-kit
claude plugin install sightlab@worldviz
claude plugin update sightlab@worldviz        # later, to update

A plugin installed in the Claude desktop app or at claude.ai syncs into Claude Code, but a plugin installed with the claude command stays in Claude Code and does not appear in the chat app. If you use both, install from the desktop app.

The Codex command line uses the plugins installed in the Codex app, so install SightLab VR Assistant there.

Open from the SightLab Dashboard

The SightLab Dashboard can open the assistant for you, either on its own or on a specific project. Nothing is sent until you send it.

Header button

Click SightLab Assistant in the upper right to open the assistant in your last-used app, or click the arrow to choose:

  • Open in Browser opens the SightLab VR Assistant plugin page in ChatGPT.
  • Open in ChatGPT / Codex Desktop starts a new Codex thread on your SightLab folder, with @SightLab VR Assistant already in the message box. If the app is not installed, the Dashboard offers to open the browser version or download the app.
  • Open in Claude Desktop works like the project button, using the main SightLab Projects folder, and the prompt it copies starts with /sightlab:new for a new experiment.
  • Install ChatGPT / Codex Desktop and Install Claude Desktop open the download pages.

The button remembers your choice. Until custom GPTs retire on December 11, 2026, the menu also lists the original SightLab GPT.

SightLab Assistant menu in the Dashboard header

Project button

For a project on this PC, the project's actions include a SightLab Assistant ▾ button. It opens a desktop app on that project's folder, so the assistant can read, check and run that project:

SightLab Assistant button in a project's actions, with its ChatGPT / Codex Desktop and Claude Desktop options

  • ChatGPT / Codex Desktop starts a new Codex thread in the project folder, with @SightLab VR Assistant already in the message box and a line asking it to read the AGENTS.md quick-edit guidance in the SightLab Projects folder. Add your request and send it.
  • Claude Desktop shows a short confirmation. Click Copy Prompt and Open Claude to copy a prompt with the folder path and open Claude Desktop on the folder. Paste the prompt, add your request and send it.

The copied Claude prompt looks like this:

My existing SightLab project folder is: <your project folder>
Help me work on this project.

Small changes are made as quick edits; larger requests go through the full build-and-test workflow. To start a new experiment in the folder instead, put /sightlab:new on the first line.

A few details about the Claude route:

  • If Claude Code is installed on the PC, the Dashboard opens Claude Desktop directly on the project folder (this needs a Claude Code version that supports claude --desktop). Otherwise it opens Claude Desktop and tells you which folder to choose in its Code tab.
  • The confirmation also says whether the Dashboard found the SightLab plugin in your Claude Code settings. If it could not confirm it, check that Sightlab is installed and enabled (see Install in Claude).
  • If Claude does not start, the prompt is still on the clipboard. Open Claude Desktop yourself, choose the project folder in the Code tab and paste it.

Using the assistant

Start a new chat or thread after installing, then just ask. The assistant wakes up whenever SightLab comes up, and you can also call it directly:

App How to call it
ChatGPT and Codex Type @ in the message box and pick SightLab VR Assistant.
Claude chat Type / in the message box and pick SightLab, or click +.
Claude Code (including the Code tab in Claude Desktop) Describe a change to the open project in plain words. Type /sightlab:new to start an experiment, /sightlab:check to check a script and test it in Vizard (it asks before launching), or /sightlab:review to write a review note for the current build step.

Mention your headset and whether you are using the GUI, Python, or both. In ChatGPT or Claude chat, also give your SightLab/Vizard version; in Codex or Claude Code on the SightLab PC, the assistant reads the installed version itself. Good first messages:

  • "Which SightLab version do I have, and what does sightlab.SightLab() take?"
  • "Here is my script. The ratings never save; why?" and paste the script.
  • "Build me a study: 12 images, 5 seconds each, rate each one 1 to 7, record gaze on each image."
  • Paste a paper's methods section and ask for a SightLab version of it.

Not sure the assistant is loaded? Ask: "Which SightLab skill do you have loaded?" The answer names sightlab-2. To see which plugin version Claude has, see Updates.

What you can do

Task Example request
Plan a study “Help me plan a three-condition visual-search study in SightLab. Outline the scenes, trial flow, gaze measures, and a pilot checklist.”
Learn the GUI “Walk me through setting up two trials in the GUI, with participant instructions and gaze tracking on selected objects.”
Extend an experiment “Draft a Python example that adds a grabbable object and a rating scale after each trial. Explain where it fits into my existing script.”
Troubleshoot code “Here is my script and error traceback. Identify the likely cause and suggest the smallest change for my SightLab version.”
Understand collected data “Using these synthetic CSV rows, explain the columns and draft a script to summarize dwell time by trial and object.”
Prepare study materials “Draft participant instructions, an experimenter checklist, and a short explanation of this experiment for a new lab member.”

Work with your own project

To work on an existing project, open Codex or Claude Code in the folder that holds it on the SightLab PC. The Dashboard's project button does this for you. The assistant can then read your scripts, propose edits, and check and run the experiment. File access and editing depend on the host app's tools and your permissions; installing the plugin does not by itself give it access to your project files.

For example:

Review the trial loop in this project. Propose a change that adds a rating scale after each trial, preserve the existing data collection, and explain the changes. Do not run the experiment.

You can also use the assistant's SightLab guidance alongside other tools or plugins available in your environment—for example, to draft a study handout or create a plot from synthetic data. Those additional capabilities come from the tools you choose, rather than from a direct connection between this plugin and SightLab.

Quick edits

Small changes to an existing project, such as a rating scale, an instructions screen, a wait or a data column, are made as quick edits: the assistant edits the main script, runs one check, and tells you in a few lines what changed. Larger requests, such as a new study design, a restructured trial flow, or a bug that only shows when the experiment runs, go through the full build-and-test workflow. To have a change tested as well, say so (for example, "and test it in Vizard"), or in Claude Code run /sightlab:check afterwards.

Quick edits are fastest when the assistant has the guidance files in the SightLab Projects folder, the default place for new projects: CLAUDE.md for Claude and AGENTS.md for Codex. They tell the assistant where SightLab is installed and which calls to use, so it does not have to look them up first. Do not delete them.

  • Claude reads CLAUDE.md in the project's folder and the folders above it. If you keep projects in another folder, copy CLAUDE.md into that folder as well.
  • Codex reads AGENTS.md when you open it from the Dashboard, wherever the project is, because the Dashboard's prompt points to the file. If you open Codex on a project yourself, it normally reads only an AGENTS.md in the project's own folder, so ask it to read AGENTS.md in the SightLab Projects folder, or copy the file into the project folder.

Check and run your experiment

In Codex or Claude Code on the SightLab PC, the assistant can check your script, run the experiment in desktop mode while driving the prompts and ratings like a participant, and report what happened.

  • The first time it wants to launch Vizard, it tells you what the run will check and asks once, unless you asked for the run yourself.
  • Runs write only inside a .autopilot folder next to your script, which keeps the last five runs. You can delete that folder at any time.
  • To stop it from ever launching in a project, put an empty file named NO_AUTOPILOT in the project folder.

Desktop runs do not replace testing headset behavior, tracking accuracy, timing, or participant experience on the actual study hardware.

Advanced desktop workflows

In the ChatGPT desktop app, you can combine the SightLab assistant's reference knowledge with separately enabled tools. GPT-6 Astra is an option where available; OpenAI recommends it for demanding visual tasks. Choosing a model alone does not enable access to your applications. See OpenAI's Computer Use guide for availability and setup.

Create 3D assets

With Blender installed and a compatible Blender MCP integration configured in your host app, you can ask the AI to create or modify models, arrange scenes, and save or export assets. The integration operates Blender; exported files can be used in other applications when their formats and materials are compatible. Check the export against your installed Vizard/SightLab version.

Example request:

Use the connected Blender tools to create a simple room with a table and three differently colored target objects. Save the Blender project and help me export the assets in a format supported by my Vizard version for a SightLab pilot study.

Blender MCP is a separate community integration with its own setup and terms; it is not included in the SightLab plugin.

Visual checks with Computer Use

The assistant's own check and run works through Codex or Claude Code and does not need Computer Use. With Computer Use enabled and access to your installed Vizard/SightLab applications allowed, you can also ask the AI to watch the screen while a demo runs, for example to confirm that instructions appear or to read an error dialog. This is an optional workflow to try with your setup, rather than a tested part of the plugin.

Example request:

Using a copy of my demo project and synthetic data, run a short test in my installed Vizard/SightLab environment. Check whether the instructions appear and the rating scale opens after the trial. Report what you observed, any errors, and anything you could not verify.

On Windows, Computer Use operates the active desktop. Like the assistant's own desktop runs, it does not replace testing on the actual study hardware.

Updates

  • ChatGPT and Codex: new versions arrive through OpenAI's plugin directory once OpenAI has reviewed them.
  • Claude: with Sync automatically on, updates arrive on their own. To update right away, run this in a terminal (needs Claude Code):

    claude plugin update sightlab@worldviz
    

    If it says you are up to date but a newer version has been announced, run claude plugin marketplace update worldviz first, then the update again.

  • After updating, restart Claude Desktop or start a new Claude Code session. Sessions that are already open keep the old version.

  • To see which version you have, run claude plugin list and look under sightlab@worldviz. Versions are dates, such as 2026.11.10.

Limitations

The plugin supplies instructions, reference materials and checks. To check and run an experiment, it uses the file and terminal tools of Codex or Claude Code on the PC where SightLab 2 and Vizard 8 are installed; in ChatGPT, or on a computer without SightLab, it answers questions and writes scripts but does not run them. It does not install software or control VR hardware, and the optional desktop workflows above depend on separately enabled tools and your permissions. Running generated experiment scripts requires a compatible SightLab/Vizard installation, the applicable product license, and any hardware needed for your study.

Answers and generated code can contain errors. Bundled references may differ from your installed version and do not automatically update whenever the documentation website changes. Review and test code in your own development environment before using it in a study.

Use synthetic or appropriately de-identified examples. Do not share participant-identifiable data, credentials, or confidential research without the necessary authorization and compliance with the service's rules.

Questions or problems: write to your WorldViz contact, or open an issue at github.com/worldviz/sightlab-ai-kit.

Privacy notice and assistant terms · WorldViz support