Speaker View & Group View | How to Enable | Speed Controls | Google Meet | Grid View | FAQs

CollabOS Guide > 3. Features > 3.4 RightSight 2: Speaker View, Group View, & Grid View

Speaker View & Group View

Two-Camera System | Framing with Speaker View | Compatible Platforms

RightSight 2, available with CollabOS 1.5 or higher, is a collection of advanced technologies designed to create a better, more equitable far-end video experience. In addition to the existing group framing technology (Group View), RightSight 2 adds an entirely new option called Speaker View (Beta).

Speaker View is currently in beta; while it’s being refined, we welcome your feedback at rightsight2-beta@logitech.com.

Note: CollabOS 1.8 release added support for Grid View. Grid View enables equitable representation in meetings by cutting out empty space and zooming in on people to fill their frame. You can find more information below in the section Grid View.

Two-Camera System

Speaker View uses the two-camera system in Rally Bar and Rally Bar Mini to show the active speaker while also showing the entire room. By default, this view of the room is shown as a smaller picture-in-picture inset within the main view of the person speaking.

Showing the two views together gives remote meeting participants both a close up of the active speaker and situational context of what’s happening in the room. The picture-in-picture view gives remote meeting participants a persistent view of the entire room so they have situational context while they focus on the person actively speaking. Having both views approximates the experience of people in the meeting room, creating a more equitable video experience over all.

Rally Bar and Rally Bar Mini use their built-in AI Viewfinder camera and mics to detect 1) all participants in the room and 2) which person is speaking. The AI Viewfinder is used as the source for the view of the room, and the main camera is used as the source for the view of the active speaker.

If the picture-in-picture view of the room is the same as the view of the active speaker, that is because RightSight 2 technology recognizes when the AI Viewfinder and the main camera are each capturing all the same people in the frame, and thus does not show the picture-in-picture view of the room. For example, when there is only one person in the room, the view of the room and Speaker View would be redundant, so there’s no need to show both.

Notes:

• Factors such as gender, skin tone, facial features, height, or weight do not affect how Speaker View functions. RightSight 2 has even been adapted to detect participants wearing face masks.
• Speaker View requires an integrated two-camera system, which is currently only offered with Rally Bar and Rally Bar Mini. Systems using MeetUp, Rally, Rally Camera, or Rally Plus only have one camera.
• Speaker View, with the active speaker framed by the main camera and the view of the room picture-in-picture, remains as one video stream in multi-display environments, and the default service provider behavior would apply.

Framing with Speaker View

RightSight 2 uses data from both computer vision and direction of audio to determine the active speaker. Speaker View is designed with thresholds in place to avoid rapid camera movements that could negatively impact the viewing experience. As a result, the camera may not switch between speakers as quickly as you might expect. If you’d like to customize the RightSight 2 experience, CollabOS 1.6+ offers Speed Controls to provide additional controls. See the section Speed Controls for more information. Here are some scenarios: 

• Multiple people are speaking
• If another person starts speaking when someone is already framed, Speaker View will frame both the initial speaker and the new speaker (with a brief delay based on speed controls). 
• Speaker View will eventually frame only the new speaker unless interrupted. 
• No one is speaking
• If no one speaks (either in the room or remote) after someone is already framed, Speaker View will re-frame all participants in the room based on the “Framing Speed” setting. Faster, Default, and Slower framing speeds will show the full room in 20s, 30s, and 40s respectively.
• Walking and talking
• Speaker tracking confidence will depend on the active speaker’s walking speed and the acoustics of the room.

Speaker View can use the full extent of zoom possible with Rally Bar and Rally Bar Mini. (Refer to their camera specifications information for details by device.) Speaker View uses both audio intelligence and the two-camera system in Rally Bar and Rally Bar Mini to detect people speaking. Speaker View can therefore detect active speakers within 15 ft (4.5 m). The following conditions may impact the zoom range while in Speaker View:

• Active speakers sitting at the edges of the camera’s field of view
• Acoustic properties of the meeting room, such as high reverb
• Glass panels in the meeting room
• Distance of the active speaker from the camera
• Multiple speakers sitting next to each other

You can test Speaker View in the on-device camera settings by selecting Camera test.

Compatible Platforms

RightSight 2 provides unique, platform-specific experiences. For example, we’ve integrated Speaker View with Zoom Rooms Smart Gallery, which provides a multi-stream experience for remote participants. Additional platform integrations will be released through future CollabOS updates.

Platforms that currently support RightSight 2:

• Microsoft Teams Rooms on Android and Windows
• Zoom Rooms
• Google Meet
• GoTo Room
• Pexip Rooms
• RingCentral Rooms
• Tencent Meeting Rooms

How to Enable

With On-device Settings | With the Sync Portal | With Local Network Access

RightSight 2’s Speaker View can be enabled on devices on an individual level and does not have to be enabled on every Rally Bar or Rally Bar Mini in your deployment. Some organizations may find that certain meeting rooms are better suited with Speaker View enabled by default. For example: rooms often used for presentations or instruction where typically only one or two people are speaking.

If Speaker View is not on by default, the video conferencing service provider may limit the ability of meeting participants to turn Speaker View on during a meeting in progress. If allowed, meeting participants can use the touch controller or handheld remote to enable or disable this viewing mode. Meeting participants can also use the touch controller or handheld remote to manually activate PTZ controls, which effectively turns off RightSight 2 and Speaker View. To reactivate RightSight 2 and Speaker View, meeting participants can double-tap the center button on the handheld remote.

Note: The camera will automatically reset to the default mode (with Speaker View enabled) for the next meeting.

With On-device Settings

1. Open Logitech system settings and select Camera.
2. Enable RightSight 2.
3. Choose between Group View and Speaker View (Beta)

• Group View: Frames the group in the room.

• Speaker View (Beta): Frames the active speaker in the room and provides a picture-in-picture view of the room.

• • Note: The picture-in-picture (PIP) view will be shown only when it makes sense. When there are only one or two people in the room and the PIP view duplicates the speaker view, the PIP view will not be shown.

4. (CollabOS 1.6 or higher) Select a speed to choose how fast RightSight 2 frames and detects meeting participants. For more information, see the section Speed Controls (below).

With the Sync Portal

1. Login to your Sync Portal account.
2. Select the organization and room in which the device is deployed .
3. Select the Rally Bar or Rally Bar Mini device.
4. Select Camera and enable RightSight 2.

5. Choose between Group View and Speaker View (Beta).

• Group View: Frames the group in the room.
• Speaker View (Beta): Frames the active speaker in the room and provides a picture-in-picture view of the room.

6. (CollabOS 1.6 or higher): Select a speed to choose how fast RightSight 2 frames and detects meeting participants. For more information, see the section Speed Controls (below).

With the Sync App

1. Connect Rally Bar or Rally Bar Mini to the room PC and open the Sync App (Download here).
2. Select the Rally Bar or Rally Bar Mini device.
3. Select Camera and enable RightSight 2.
4. Choose between Group View and Speaker View (Beta).

• Group View: Frames the group in the room.
• Speaker View (Beta): Frames the active speaker in the room and provides a picture-in-picture view of the room.

5. (CollabOS 1.6 or higher): Select a speed to choose how fast RightSight 2 frames and detects meeting participants. For more information, see the section Speed Controls (below).
   

With Local Network Access

1. Login to your Local Network Access portal.
2. Select Camera and enable RightSight 2.
3. Choose between Group View and Speaker View (Beta).

• Group View: Frames the group in the room.
• Speaker View (Beta): Frames the active speaker in the room and provides a picture-in-picture view of the room.

4. (CollabOS 1.6 or higher): Select a speed to choose how fast RightSight 2 frames and detects meeting participants. For more information, see the section Speed Controls (below).
   

Speed Controls

Configure in Group View | Configure in Speaker View

Available for Rally Bar or Rally Bar Mini running CollabOS 1.6 or higher.

Configure in Group View

1. Navigate to Group View in device settings, Sync Portal, Sync App, or Local Network Access.
2. Choose your Framing speed. Changing the Framing speed affects how quickly the camera will zoom in on the active speakers who are currently within view of the main camera and frame all meeting participants. You have the option to make framing faster or slower based on your preferences. Faster, Default, and Slower framing speeds will typically reframe participants after roughly 5-7, 7-10, and 10-12 seconds respectively.

• Note: Speeds can vary depending on the location of speakers, the number of active speakers in the room, and the room configuration. Fast framing works best in rooms in which participants are within 5 meters of the camera. In Group View, the default time to frame speakers is typically 5 to 8 seconds. Changing the Framing speed setting can speed up or slow down the transition by a few seconds.

Configure in Speaker View

1. Navigate to Speaker View in device settings, Sync Portal, Sync App, or Local Network Access.
2. Choose your Speaker Detection speed. Speaker Detection speed refers to how quickly the camera will react to an active speaker who is not currently in view of the main camera when they begin talking. While we recommend using Default speed, you can use this setting to have the camera react faster or slower based on your preferences. Slower, Default, and Faster Speaker Detection speeds will react to a new speaker in roughly 2-4, 4-5, and 5-7 seconds respectively.

• Note: Speaker View relies on audio data to detect the active speaker. Speeds will vary depending on the location of speakers, how loudly they’re talking, how continuous their speech is, the number of active speakers in the room, and the room configuration. You can customize this experience by changing the Speaker Detection speed and Framing speed.

3. Choose your Framing speed. Framing speed in Speaker View affects how quickly the camera zooms in and frames the active speaker. While we recommend using Default speed, you can have the camera focus on a single speaker faster or slower based on your preferences.  Faster, Default, and Slower Framing speeds in Speaker View will frame the active speaker in roughly 10-20, 20-25, and 25-30 seconds respectively.

Note: Fast framing and speaker detection work best in rooms in which participants are within 5 meters of the camera.

RightSight 2 & Google Meet

Enable with On-Device Settings or Sync Portal | Enable with Sync App

What you need to get started:

• Google Meet room kit with Rally Bar or Rally Bar Mini, including:

• Rally Bar or Rally Bar Mini running CollabOS 1.5 or higher
• Logitech Tap
• Google Meet compute system

Enable with On-Device Settings or Sync Portal

1. Set up your Google Meet room kit with the recommended configuration. For more information on this step, see the Room Solutions Configuration Guide.
2. Using the HDMI OUT 1 port, connect Rally Bar or Rally Bar Mini to an external display.
3. The display should show instructions to set up Rally Bar or Rally Bar Mini in BYOD mode. Follow the on-screen instructions using the device remote to complete setup.
4. Press and hold the “end call” button on the remote for five seconds to access device settings.
5. Finish by completing the steps from Enable RightSight 2 above.

Enable with Sync App

1. Set up your Google Meet room kit with the recommended configuration. For more information on this step, see the Room Solutions Configuration Guide.
2. Using USB-C, connect Rally Bar or Rally Bar Mini to a PC or Mac with Sync App installed and running.
3. Wait for Sync App to identify Rally Bar or Rally Bar Mini, and then select the device in the list on the left.
4. Select Camera and enable RightSight 2.
5. Choose between Group View and Speaker View (Beta)

• Group View: Frames the group in the room
• Speaker View (Beta): Frames the active speaker in the room and provides a picture-in-picture view of the room

Grid View

Compatibility | Enable Grid View

RightSight 2 Grid View, available with CollabOS 1.8 or higher, brings an entirely new experience to RightSight in addition to existing group framing technology (Group View) and active speaker framing technology (Speaker View). Grid View enables equitable representation in meetings by cutting out empty space and zooming in on people to fill their frame. In-person meeting participants can be displayed in up to four different grids.

Grid View is currently in beta; while it’s being refined, we welcome your feedback at rightsight2-beta@logitech.com.

RightSight 2 Grid View uses the two-camera system in Rally Bar and Rally Bar Mini to detect and frame all meeting participants clearly. Grid View gives everyone more equitable representation in the meetings by cutting out empty space and zooming in on people to fill their frame.

When Grid View is enabled, Rally Bar and Rally Bar Mini will return to their center position. Mechanical PTZ of the camera will be disabled as the camera utilizes digital PTZ to frame participants in Grid View.

Participants who are close to each other from the camera’s point of view will be grouped together to avoid duplicating them in multiple streams. In the example below, the right two participants are grouped because they are sitting close together. If you’d like to avoid grouping, participants can be spaced further apart.

Note: Participants sitting at the edge of the camera’s field of view (FOV) may create large groups that include people sitting at the center of the table.

In Zoom Rooms (Appliance), Rally Bar or Rally Bar Mini provides one full room view stream and up to four participant streams, for a total of five streams. For other supported platforms, each participant grid will be combined to fit into a single video stream.

Compatibility

Supported Devices:

• Rally Bar running CollabOS 1.8 and above.
• Rally Bar Mini running CollabOS 1.8 and above.

General Support

• Zoom Rooms Appliance
• Microsoft Teams Rooms on Windows

Multi-Stream Support

• Zoom Rooms Appliance

Note: Additional platforms will be supported in upcoming releases.

For Zoom Rooms Appliance, Grid View on Rally Bar and Rally Bar Mini will produce up to five individual video streams in the Zoom call. The first stream will be a full room view.

For Microsoft Teams Rooms on Windows, Grid View on Rally Bar and Rally Bar Mini will produce up to one video stream with up to four individual grids. This will not include a full room view.

Enable Grid View

Zoom Rooms (Appliance)

1. In Zoom Device Manager (ZDM), go to Room Management > Zoom Rooms > Account Settings > Devices and set "Maximum Stream Count" to 5. This can be done in room level settings or account level settings to apply to all rooms.

2. In Zoom Rooms Controller or Zoom Device Manager, enable "Multi-Stream."

3. If you prefer the single-stream Grid View experience, select "Auto-Framing + Multi-Focus Framing."

Frequently Asked Questions

How does Speaker View work with Zoom Rooms and Smart Gallery?

• Zoom Rooms leverages Speaker View for two platform-specific viewing modes: Speaker Focus and Multi-Stream, a Smart Gallery setting.
• With the Speaker Focus setting enabled, remote participants will see the meeting room in the standard RightSight 2 Speaker View mode, which is the active speaker framed by the main camera with the view of the room inset as a picture-in-picture view.
• With the Multi-Stream setting enabled, remote participants will see the stream of the active speaker and the stream of the view of the room as two separate gallery tiles. The gallery tile of the room view will disappear whenever the main camera is capturing the same group of people.
• IT admins can enable either Speaker Focus or Multi-Stream as the default viewing experience. If neither is set as the default, in-room participants can also enable either viewing mode during a meeting using a Zoom Rooms controller.

How much does access to RightSight 2 Speaker View cost?

CollabOS updates are provided at no additional cost to Logitech customers. RightSight 2 Speaker View is available with CollabOS 1.5 as a beta feature for Rally Bar and Rally Bar Mini.

Why does the camera not zoom all the way into the active speaker?

RightSight 2 uses data from both computer vision and direction of audio to determine the active speaker. The following conditions may impact the zoom range while in Speaker View:

• Active speakers sitting at the edges of the camera’s field of view
• Acoustic properties of the meeting room, such as high reverb
• Glass panels in the meeting room
• Distance of the active speaker from the camera
• Multiple speakers sitting next to each other

Why am I seeing fewer than five streams?

If you are a Zoom Rooms customer, make sure that ZDM settings have been modified to allow five streams. Make sure there are at least four participants in the room; Grid View assigns a minimum of one person per stream.

If you have modified your settings and have four people in the room, you may be seeing fewer streams due to Grid View’s grouping capability. On screen, Grid View groups meeting participants who are close to each other to avoid showing duplicates of them in multiple streams. To see more streams, participants can sit further apart.

What upcoming improvements to Grid View can I expect?

• Fixes to known issues
• Improved grouping logic
• Removal of the additional streams when there is only one meeting room participant
• Support for additional platforms, including Microsoft Teams Rooms on Android, Google Meet, and others.
• Ability to specify camera zones that limit the area in the room from which participants will be detected and framed.

Why can’t I enable Grid View in MTRoW?

Enabling Grid View in an MTRoW room requires the latest version of Sync App (minimum version 2.5.293). If you still cannot enable Grid View, it may help to reset your device.

Why is the camera image quality different between Grid View and Speaker View?

Grid View uses digital zoom to create video streams of individual meeting participants. In comparison, Speaker View leverages the optical zoom capabilities of Rally Bar and Rally Bar Mini to frame the active speaker(s).

If you are facing a device specific issue, we recommend opening a ticket with Prosupport.

Back to Top | Next Article - 3.5 Power Saving & Management