Overview | Enable Speaker View | Speed Controls | RightSight 2 & Google Meet

CollabOS Guide > 3. Features > 3.4 Rightsight 2 Speaker View - CollabOS Guide

Overview

Two-Camera System | Framing with Speaker View | Compatible Platforms

RightSight 2, available with CollabOS 1.5 or higher, is a collection of advanced technologies designed to create a better, more equitable far-end video experience. In addition to the existing group framing technology (Group View), RightSight 2 adds an entirely new option called Speaker View (Beta).

Speaker View is currently in beta; while it’s being refined, we welcome your feedback at rightsight2-beta@logitech.com.

Two-Camera System

Speaker View uses the two-camera system in Rally Bar and Rally Bar Mini to show the active speaker while also showing the entire room. By default, this view of the room is shown as a smaller picture-in-picture inset within the main view of the person speaking.

Showing the two views together gives remote meeting participants both a close up of the active speaker and situational context of what’s happening in the room. The picture-in-picture view gives remote meeting participants a persistent view of the entire room so they have situational context while they focus on the person actively speaking. Having both views approximates the experience of people in the meeting room, creating a more equitable video experience over all.

Rally Bar and Rally Bar Mini use their built-in AI Viewfinder camera and mics to detect 1) all participants in the room and 2) which person is speaking. The AI Viewfinder is used as the source for the view of the room, and the main camera is used as the source for the view of the active speaker.

If the picture-in-picture view of the room is the same as the view of the active speaker, that is because RightSight 2 technology recognizes when the AI Viewfinder and the main camera are each capturing all the same people in the frame, and thus does not show the picture-in-picture view of the room. For example, when there is only one person in the room, the view of the room and Speaker View would be redundant, so there’s no need to show both.

Notes:

• Factors such as gender, skin tone, facial features, height, or weight do not affect how Speaker View functions. RightSight 2 has even been adapted to detect participants wearing face masks.
• Speaker View requires an integrated two-camera system, which is currently only offered with Rally Bar and Rally Bar Mini. Systems using MeetUp, Rally, Rally Camera, or Rally Plus only have one camera.
• Speaker View, with the active speaker framed by the main camera and the view of the room picture-in-picture, remains as one video stream in multi-display environments, and the default service provider behavior would apply.

Framing with Speaker View

RightSight 2 uses data from both computer vision and direction of audio to determine the active speaker. Speaker View is designed with thresholds in place to avoid rapid camera movements that could negatively impact the viewing experience. As a result, the camera may not switch between speakers as quickly as you might expect. Here are some scenarios:

• Multiple people are speaking

• • If another person starts speaking when someone is already framed, Speaker View will frame both the initial speaker and the new speaker (with a brief delay of up to ~10 seconds).
  • Speaker View will eventually frame the new speaker unless interrupted (delay: up to 15 sec).

• No one is speaking

• • If no one speaks (either in the room or remote) after someone is already framed, Speaker View will re-frame all participants in the room (delay: up to 60 sec).
  • If a remote participant starts speaking after someone is already framed, Speaker View will frame all participants in the room (delay: up to 120 sec).

• Walking and talking

• • Speaker tracking confidence will depend on the active speaker’s walking speed and the acoustics of the room.

Speaker View can use the full extent of zoom possible with Rally Bar and Rally Bar Mini. (Refer to their camera specifications information for details by device.) Speaker View uses both audio intelligence and the two-camera system in Rally Bar and Rally Bar Mini to detect people speaking. Speaker View can therefore detect active speakers within the microphone pickup range of these cameras, which is 15 ft (4.5 m). The following conditions may impact the zoom range while in Speaker View:

• Active speakers sitting at the edges of the camera’s field of view
• Acoustic properties of the meeting room, such as high reverb
• Glass panels in the meeting room
• Distance of the active speaker from the camera
• Multiple speakers sitting next to each other

You can test Speaker View in the on-device camera settings by selecting Camera test.

Compatible Platforms

RightSight 2 provides unique, platform-specific experiences. For example, we’ve integrated Speaker View with Zoom Rooms Smart Gallery, which provides a multi-stream experience for remote participants. Additional platform integrations will be released through future CollabOS updates.

Platforms that currently support RightSight 2:

• Microsoft Teams Rooms on Android and Windows
• Zoom Rooms
• Google Meet
• GoTo Room
• Pexip Rooms
• RingCentral Rooms
• Tencent Meeting Rooms

Enable Speaker View

With On-device Settings | With the Sync Portal | With Local Network Access

RightSight 2’s Speaker View can be enabled on devices on an individual level and does not have to be enabled on every Rally Bar or Rally Bar Mini in your deployment. Some organizations may find that certain meeting rooms are better suited with Speaker View enabled by default. For example: rooms often used for presentations or instruction where typically only one or two people are speaking.

If Speaker View is not on by default, the video conferencing service provider may limit the ability of meeting participants to turn Speaker View on during a meeting in progress. If allowed, meeting participants can use the touch controller or handheld remote to enable or disable this viewing mode. Meeting participants can also use the touch controller or handheld remote to manually activate PTZ controls, which effectively turns off RightSight 2 and Speaker View. To reactivate RightSight 2 and Speaker View, meeting participants can double-tap the center button on the handheld remote.

Note: The camera will automatically reset to the default mode (with Speaker View enabled) for the next meeting.

With On-device Settings

1. Open Logitech system settings and select Camera.
2. Enable RightSight 2.
3. Choose between Group View and Speaker View (Beta)

• Group View: Frames the group in the room.

• Speaker View (Beta): Frames the active speaker in the room and provides a picture-in-picture view of the room.

• • Note: The picture-in-picture (PIP) view will be shown only when it makes sense. When there are only one or two people in the room and the PIP view duplicates the speaker view, the PIP view will not be shown.

4. (CollabOS 1.6 or higher) Select a speed to choose how fast RightSight 2 frames and detects meeting participants. For more information, see the section Speed Controls (below).

With the Sync Portal

1. Login to your Sync Portal account.
2. Select the organization and room in which the device is deployed .
3. Select the Rally Bar or Rally Bar Mini device.
4. Select Camera and enable RightSight 2.

5. Choose between Group View and Speaker View (Beta).

• Group View: Frames the group in the room.
• Speaker View (Beta): Frames the active speaker in the room and provides a picture-in-picture view of the room.

6. (CollabOS 1.6 or higher): Select a speed to choose how fast RightSight 2 frames and detects meeting participants. For more information, see the section Speed Controls (below).

With the Sync App

1. Connect Rally Bar or Rally Bar Mini to the room PC and open the Sync App (Download here).
2. Select the Rally Bar or Rally Bar Mini device.
3. Select Camera and enable RightSight 2.
4. Choose between Group View and Speaker View (Beta).

• Group View: Frames the group in the room.
• Speaker View (Beta): Frames the active speaker in the room and provides a picture-in-picture view of the room.

5. (CollabOS 1.6 or higher): Select a speed to choose how fast RightSight 2 frames and detects meeting participants. For more information, see the section Speed Controls (below).
   

With Local Network Access

1. Login to your Local Network Access portal.
2. Select Camera and enable RightSight 2.
3. Choose between Group View and Speaker View (Beta).

• Group View: Frames the group in the room.
• Speaker View (Beta): Frames the active speaker in the room and provides a picture-in-picture view of the room.

4. (CollabOS 1.6 or higher): Select a speed to choose how fast RightSight 2 frames and detects meeting participants. For more information, see the section Speed Controls (below).
   

Speed Controls

Configure in Group View | Configure in Speaker View

Available for Rally Bar or Rally Bar Mini running CollabOS 1.6 or higher.

Configure in Group View

1. Navigate to Group View in device settings, Sync Portal, Sync App, or Local Network Access.
2. Choose your Framing speed. Changing the Framing speed affects how quickly the camera will zoom in on the active speakers who are currently within view of the main camera and frame all meeting participants. You have the option to make framing faster or slower based on your preferences. Faster, Default, and Slower framing speeds will typically reframe participants after roughly 5-7, 7-10, and 10-12 seconds respectively.

• Note: Speeds can vary depending on the location of speakers, the number of active speakers in the room, and the room configuration. Fast framing works best in rooms in which participants are within 5 meters of the camera. In Group View, the default time to frame speakers is typically 5 to 8 seconds. Changing the Framing speed setting can speed up or slow down the transition by a few seconds.

Configure in Speaker View

1. Navigate to Speaker View in device settings, Sync Portal, Sync App, or Local Network Access.
2. Choose your Speaker Detection speed. Speaker Detection speed refers to how quickly the camera will react to an active speaker who is not currently in view of the main camera when they begin talking. While we recommend using Default speed, you can use this setting to have the camera react faster or slower based on your preferences. Slower, Default, and Faster Speaker Detection speeds will react to a new speaker in roughly 2-4, 4-5, and 5-7 seconds respectively.

• Note: Speaker View relies on audio data to detect the active speaker. Speeds will vary depending on the location of speakers, how loudly they’re talking, how continuous their speech is, the number of active speakers in the room, and the room configuration. You can customize this experience by changing the Speaker Detection speed and Framing speed.

3. Choose your Framing speed. Framing speed in Speaker View affects how quickly the camera zooms in and frames the active speaker. While we recommend using Default speed, you can have the camera focus on a single speaker faster or slower based on your preferences.  Faster, Default, and Slower Framing speeds in Speaker View will frame the active speaker in roughly 10-20, 20-25, and 25-30 seconds respectively.

Note: Fast framing and speaker detection work best in rooms in which participants are within 5 meters of the camera.

RightSight 2 & Google Meet

Enable with On-Device Settings or Sync Portal | Enable with Sync App

What you need to get started:

• Google Meet room kit with Rally Bar or Rally Bar Mini, including:

• Rally Bar or Rally Bar Mini running CollabOS 1.5 or higher
• Logitech Tap
• Google Meet compute system

Enable with On-Device Settings or Sync Portal

1. Set up your Google Meet room kit with the recommended configuration. For more information on this step, see the Room Solutions Configuration Guide.
2. Using the HDMI OUT 1 port, connect Rally Bar or Rally Bar Mini to an external display.
3. The display should show instructions to set up Rally Bar or Rally Bar Mini in BYOD mode. Follow the on-screen instructions using the device remote to complete setup.
4. Press and hold the “end call” button on the remote for five seconds to access device settings.
5. Finish by completing the steps from Enable RightSight 2 above.

Enable with Sync App

1. Set up your Google Meet room kit with the recommended configuration. For more information on this step, see the Room Solutions Configuration Guide.
2. Using USB-C, connect Rally Bar or Rally Bar Mini to a PC or Mac with Sync App installed and running.
3. Wait for Sync App to identify Rally Bar or Rally Bar Mini, and then select the device in the list on the left.
4. Select Camera and enable RightSight 2.
5. Choose between Group View and Speaker View (Beta)

• Group View: Frames the group in the room
• Speaker View (Beta): Frames the active speaker in the room and provides a picture-in-picture view of the room

Back to Top | Next Article: 3.5 How to Submit a Bug Report