Vision sensor properties

The vision sensor properties are part of the scene object properties dialog, which is located at [Menu bar --> Tools --> Scene object properties]. You can also open the dialog with a double-click on an object icon in the scene hierarchy, or with a click on its toolbar button:

[Scene object properties toolbar button]

In the scene object properties dialog, click the Vision sensor button to display the vision sensor dialog (the Vision sensor button only appears if the last selection is a vision sensor). The dialog displays the settings and parameters of the last selected vision sensor. If more than one vision sensor is selected, then some parameters can be copied from the last selected vision sensor to the other selected vision sensors (Apply to selection-buttons):

[Vision sensor dialog]

  • Enable all vision sensors: turns the vision sensor functionality on and off for all vision sensors.
  • Explicit handling: indicates whether the sensor should be explicitely handled. If checked, the sensor will not be handled when sim.handleVisionSensor(sim.handle_all_except_explicit) is called, but only if sim.handleVisionSensor(sim.handle_all) or sim.handleVisionSensor(visionSensorHandle) is called. This is useful if the user wishes to handle the sensor in a child script rather than in the main script (if not checked the sensor will be handled twice, once when sim.handleVisionSensor(sim.handle_all_except_explicit) is called in the main script, and once when sim.handleVisionSensor(visionSensorHandle) is called in the child script). Refer also to the section on explicit and non-explicit calls.
  • External input: when selected, then the vision sensor's normal operation will be altered so as to be able to handle external images instead (e.g. video images).
  • Perspective mode: allows selecting between the perspective projection type and the orthogonal projection type vision sensor.
  • Ignore RGB info (faster): if selected, the RGB information of the sensor (i.e. the color) will be ignored so that it can operate faster. Use this option if you only rely on the depth information of the sensor.
  • Ignore depth info (faster): if selected, the depth information of the sensor will be ignored so that it can operate faster. Use this option if you do not intend to use the depth information of the sensor.
  • Packet1 is blank (faster): if selected, then CoppeliaSim won't automatically extract specific information from acquired images, so that it can operate faster. Use this option if you do not intend to use the first packet of auxiliary values returned by API functions sim.readVisionSensor or sim.handleVisionSensor.
  • Use local lights: if enabled, then only local lights parented with this vision sensor (i.e. built on top of this vision sensor) will be activated when displaying this vision sensor's image content. Lights can be made local in the light properties.
  • Show fog if enabled: if disabled, then this vision sensor won't see any fog if fog is enabled. Also refer to the environment dialog.
  • Render mode: three modes are currently available:
  • OpenGL (default): renders the visible color channels of objects.
  • OpenGL, auxiliary channels: renders the auxiliary color channels of objects. The auxiliary channels red, green and blue colors are meant to be used in following way: red is the temperature channel (0.5 is the ambient temperature), green is the user defined channel, and blue is the active light emitter channel.
  • OpenGL, color coded handles: renders the objects by coding their handles into the colors. The first data packet returned by the sim.readVisionSensor or sim.handleVisionSensor API functions represent the detected object handles (round the values down).
  • POV-Ray: uses the POV-Ray plugin to render images, allowing for shadows (also soft shadows) and material effects (much slower). The plugin source code is located here.
  • External renderer: uses an external renderer implemented via a plugin. The current external renderer source code is located here.
  • External renderer, windowed: uses an external renderer implemented via a plugin, and displays the image in an external window (during simulation only). The current external renderer source code is located here.
  • OpenGL3: uses the OpenGL3 renderer plugin, courtesy of Stephen James. The plugin offers shadow casting, which is currently not possible natively, in CoppeliaSim. Light projection and shadows can be adjusted for each light, via the object's extension string, e.g. openGL3 {lightProjection {nearPlane {0.1} farPlane {10} orthoSize {8} bias {0.001} normalBias {0.005} shadowTextureSize {2048}}}
  • OpenGL3, windowed: same as above, but windowed.
  • Near / far clipping plane: the minimum / maximum distance from which the sensor will be able to detect.
  • Perspective angle: the maximum opening angle of the detection volume when the sensor is in perspective mode.
  • Orthographic size: the maximum size (along x or y) of the detection volume when the sensor is not in perspective mode.
  • [Detection value parameters of the orthographic-type vision sensor]

    [Detection value parameters of the perspective-type vision sensor]

  • Resolution X / Y: desired x- / y-resolution of the image captured by the vision sensor. Carefully chose the resolution depending on your application (high resolution will result in slower operation). With older graphic card models, the actual resolution might be different from what is indicated here (old graphic card models only support resolutions at 2^n, where n is 0, 1, 2, etc.).
  • Entity to detect: allows specifying what entity should be rendered.
  • Adjust default image color: allows specifying the color that should be used in areas where nothing was rendered. By default, the environment fog color is used.
  • Object size X / Y / Z: size of the body-part of the vision sensor. This has no functional effect.
  • Show volume when not detecting: if selected, the detection volume is shown when the sensor didn't trigger.
  • Show volume when detecting: if selected, the detection volume is shown when the sensor triggered.
  • Object colors: allows adjusting the various colors of a vision sensor.

  • Recommended topics

  • Vision sensors
  • Vision sensor types and mode of operation
  • Renderable objects
  • Object common properties