360 Moving Regions of Interest

Overview

This workflow shows how to record and replay a dynamic path for a Region of Interest (ROI) in a 360° video scene. First, you define a static ROI in the GUI, then trace your desired movement path using a debug ball. Next, you capture keyframes with the replay tool, which generates a CSV file. Finally, you replay the path in your main script and can fine tune scale if needed.

Note: As of SightLab 2.5, there is also a separate folder for adding multiple moving regions of interest, such as each moving football player on the field (this requires repeating the below workflow once per region and giving the name of each new .csv file to create for the paths)

Prerequisites

• SightLab GUI configured and connected to your Vizard session.
• An initial ROI added via the GUI. For instructions, see Creating a New Scene.
• The following scripts in your project folder:
• 360_moving_RegionsOfInterest.py
• 360_moving_RegionsOfInterest_Tagging.py
• Replay.py

Workflow Steps

1. Define your initial ROI

2. Launch the SightLab GUI and select your 360° video.

3. Add a starting region (“ROI”) where you want the path to begin.

4. Trace the desired movement path

5. Run:

   360_moving_RegionsOfInterest.py

6. In the Vizard window, use your mouse (and the green debug ball) to follow the path you want your ROI to take. Ignore that the initial region is static at this point.

7. Capture keyframe points

8. Run:

   360_moving_RegionsOfInterest_Tagging.py

9. Press keys 1–9 to record keyframe positions as you scrub through the video timeline.

10. Drag the slider along the bottom to navigate to segments where direction or speed change significantly, then set additional keyframes as needed.

11. Save the replay data

12. When you exit the replay tool, it automatically writes your keyframes into moving_regions.csv in the current directory.

13. Replay and verify

14. Re-run:

    python 360_moving_RegionsOfInterest.py

15. The ROI will now move along the captured path. To visualize it, set:

    REGION_ALPHA = 0.5

16. Observe the movement and ensure it aligns with your intended trajectory.

17. Adjust path timing

18. If you need to tweak timing edit the Time Difference column in moving_regions.csv.

19. Fine‑tune region scale

20. If the ROI appears too large or small at certain keyframes, edit the Scale values in the CSV (e.g., [1,1,1] → [0.8,0.8,0.8]).

21. Run Standard Replay with Visualizations

22. Afterwards run Replay.py to view the standard replay with visualizations like heatmaps and scan paths.