Getting/Importing 3D Models and Assets
Model types and media that can be imported into Vizard and SightLab VR Pro
3D Models: (including scanned or point cloud data), .glTF/.glb, .fbx, .ive, .obj, .wrl, .dae., dp, .ply, .osgb)
360 Videos: (2D and Spherical [mono and stereo]) .avi, .mpg, .mpeg, .mp4,.mov (note: may need to use a codec pack, like K-lite codec pack if the videos won't display)
360 Images: bmp, .jpg, .jpeg, .png, .tiff, .tif, .gif
Audio: (ambient and spatialized) .wav, .mp3
See also "Creating a Scene" for how to build a scene with these assets in SightLab
Content Libraries
-
Export options: glTF, .glb, FBX, .obj
-
Suggested workflow: glTF or .glb download option. See Fab to SightLab
Export Options from Third Party Software
Unity
- Export options: FBX exporter
- Suggested workflow: FBX exporter *Note: Can convert to glTF after export can use an online tool
- For a more comprehensive documentation on converting from Unity, see this tutorial
Unreal
- Export using glTF exporter (get from Marketplace and add to project). See this tutorial
Polygon Modeling Software
Blender (Extension - .blend)
- Export options: gltF exporter
- Suggested workflow: Built in glTF exporter
3DSMax (Extension - .max)
- Export options: Bablyon.js, Sketchfab exporter, export as .fbx then convert to .glTF/.glb via Blender
- Suggested workflow: GLTF via Babylon.js
Maya (Extension - .ma)
- Export options: Babylon.js, Sketchfab exporter, Ziriax, export as .fbx then convert to .glTF/.glb via Blender
- Suggested workflow: GLTF via Babylon.js
Modo (Extension - .lxo)
- Export options: Native
- Suggested workflow: Native GLTF exporter *Note: You must setup your materials for gltf in Modo first
Substance Painter (Extension - .spp)
- Export options: Native GLTF exporter
- Suggested workflow: Native GLTF exporter
ZBrush
- Export options: FBX exporter
- Suggested workflow: Best used in a “high poly to low poly” workflow by an expert user
NVidia Omniverse and OpenUSD
- Convert USD to glTF using online converter
- https://products.aspose.app/3d/conversion/usdz-to-gltf
CAD / Architecture Modeling Software
Revit (Extension - .rvt)
- Export options: Simlabs, Sketchfab Exporter, native FBX export, PIXYZ
- Suggested workflow: GLTF via PIXYZ *Note: Sketchfab exporter requires Revit 2018.1 and above
SketchUp (Extension - .skp)
- Export options: KhronosGroup exporter
- Suggested workflow: GLTF via KhronosGroup Exporter
Rhino
- Export options: FBX, .glTF exporter
- Suggested workflow: Shapedriver .glTF export
Solidworks
- Export options: Built in Extended Reality Plugin, Simlabs
- Suggested workflow: glTF via Extended Reality Plugin
Photogrammetry
Apps to scan and create 3d Models and Environments:
3D scanning/ NerFs
Desktop Photogrammetry Applications AutoDesk Recap Pro Reality Capture Metashape
AI Tools (Text to 3D)
- Luma Labs Genie (Text to 3D Model)
- Luma Labs Imagine (Create 3D Rendered Scenes from Video)
- https://www.meshy.ai/
- https://www.masterpiecex.com/
- 3d.csm.ai ▪ Tutorial
- https://skybox.blockadelabs.com/ ▪ Tutorial
- Rodin
- Tripo3D (Fully rigged, high quality 3D models from prompts or images)
- CGDream
-
https://huggingface.co/spaces/shariqfarooq/ZoeDepth ▪ Tutorial
-
https://app.alpha3d.io/
- Stable Zero 1,2,3
- https://huggingface.co/spaces/hysts/Shap-E
- https://spline.design/ai
- https://3dfy.ai/
- https://app.sloyd.ai/
- Meshcapade
- Spline
- More to come soon
- See this tutorial for more information
Point Clouds
For information on how to bring point cloud data into Vizard, please see this knowledge base article.
Point clouds of the format .dp, .ply, .3dc and .asc are supported
Miscellaneous
Other content from additional sources will work as well if the format is one of the supported file types, preferably .glTF/.glb or .fbx.
There are also included assets in the sightlab_resources- folder (environments, objects, media and avatars) See here
Download additional environments, avatars and assets pack here (can unzip into C:\Program Files\WorldViz\Sightlab2 if want to access from anywhere)
Avatars
Avatar models can be brought in if they are in either the .fbx, .glTF or .cfg (cal3D) format. See this page for more details.
Avatar Libraries
- FBX Avatars
- Mixamo Avatars ▪ Tutorial ▪ [https://www.mixamo.com/](https://www.mixamo.com
- MetaPerson
- Reallusion Avatars ▪ Tutorial ▪ Website ▪ ActorCore Library
- Ready Player Me Avatars ▪ Tutorial
- Avaturn
- RocketBox Avatars
- https://meshcapade.com/ (Go through Blender to get textures)
Code to manually add an avatar to your scene
avatar =vizfx.addAvatar('vcc_male.cfg')
#set the position
avatar .setPosition(0,0,1)
#choose the animation state
avatar .state(1)
To use a full body avatar with the Meta Quest Pro add the line "from sightlab_utils import body_tracking" under the sightlab import
Avatar Rigging
- Auto rigging with Mixamo
- Auto rigging with Accurig from Reallusion
- Facial morph rigging with Face-It Blender add-on
Avatar Animations
There are many options for motion capture to create animations. Here are just a few examples. Refer to the Vizard documentation for more supported devices for motion capture.
- Using a standard video captured with a phone or camera (AI algorithm for converting to animation):
- DeepMotion - AI-based animation creation
- Kinetix Tech - Animation and motion capture
-
Rokoko - Motion capture suits and software
-
High-end motion capture:
- Xsens
- Optitrack
- Vicon
- AR51 Markerless
360 Videos and Images
360 Video Content: You can bring in content such as 360 videos (stereoscopic and monoscopic), 2D videos, images, audio (3D and stereo), and more. | |
360 Media in your Project: To use them in SightLab, simply place them in your project folder (default location is resources/media ) and choose "360 Media" in the GUI. Alternatively, you can use this code: ``json <br> video1 = viz.addVideo('sightlab_resources/media/name.avi') <br> sightlab.setEnvironment(video1, mode=MEDIA_360, mediaType="video", mediaFormat="Stereoscopic T/B") |
|
360 Image Options: For creating 360 videos and pictures, use any 360 video camera (stereo or monoscopic) or a phone app like "360 Photosphere." Other resources include Skybox AI for AI-generated images, Leonardo.ai or Chat-GPT Dall-E with prompts like "Equirectangular 360-degree image...", and Pexels for free downloads. | |
Downloading 360 Videos: To download 360 videos off YouTube, use the 4K Video Downloader. If videos are in a strange format, see this tutorial on adjusting formats using FFMPEG. RunwayML can also help in converting or modifying 360 video content |
2D or Virtual Screen Video
See the example script for displaying a virtual screen. SightLab can also support playback of any video type that you have a codec for.
Video can be sourced from many locations. Here's one good stock footage source https://www.pond5.com/ Free, open source video editors https://www.openshot.org/ https://shotcut.org/
Audio Creation and Libraries
Audio: (ambient and spatialized) .wav, .mp3 Good source for free audio https://freesound.org/ Free audio editing and recording software [https://www.audacityteam.org/
](https://www.audacityteam.org/)A good tool for creating audio narrations is ElevenLabs. You can also use a large language model such as ChatGPT or Claude for help with creating the narration text.[
https://elevenlabs.io/ ](https://www.audacityteam.org/)