Logitech G's Streamlabs unveils Intelligent Streaming Assistant collaboration with Inworld and NVIDIA

Today at CES 2025, Logitech G’s Streamlabs unveiled its Intelligent Streaming Assistant, powered by technologies from Inworld AI and NVIDIA.

Livestreaming has never been more popular—or more demanding. While millions of creators captivate audiences worldwide, the challenges of managing production, engaging with viewers, and delivering entertaining commentary simultaneously can be overwhelming. From juggling scene transitions to responding to chat, streamers must navigate a complex mix of technical and creative demands, often with limited resources. For new and smaller creators, these hurdles can be even steeper, making it harder to grow their audience and maintain consistency. 

The Streamlabs Intelligent Streaming Assistant was designed to help address these challenges. Whether acting as a dynamic co-host by engaging with the audience through real-time interaction or as a producer streamlining technical workflows, the assistant empowers creators to focus on what matters most—engaging their audience.

Inworld at the cognitive core of Streamlabs Intelligent Streaming Assistant

Livestreaming has become central to modern video game marketing, providing developers with access to millions of potential players. The Intelligent Streaming Assistant is an AI agent designed to provide real-time commentary during downtime and amplify excitement during high-stakes moments like boss fights or chases. Analysis has shown that these types of optimizations can significantly increase view durations and retention rates, driving virality and exponentially boosting user views.

Leveraging multimodal AI and agentic frameworks, Inworld transforms the Streamlabs Intelligent Streaming Assistant into an interactive co-host, expert producer, and technical assistant. By powering systems capable of perceiving, reasoning, and responding in real-time, Inworld enables the assistant to become an:

• Interactive Co-Host: Leveraging NVIDIA’s computer vision capabilities to detect events in real time with Inworld’s ability to drive real-time agent behavior based on game state and contextual understanding of games like Fortnite, the Intelligent Streaming Assistant can offer contextually relevant commentary at the creator’s request. This awareness enables the assistant to do things like highlight a well-timed build, provide commentary during a dramatic Victory Royale, or shoutout audience members for sending tips
• Stream Producer: Like a producer overseeing the flow of a live show, the Intelligent Streaming Assistant can trigger audio and visual effects to enhance high-impact gameplay or clip the best highlights for replay. Inworld processes multimodal inputs from the creator, chat, and game, to execute these Producer Actions through the Streamlabs API, giving the creator full control over how their stream unfolds.
• Technical Assistant: The Intelligent Streaming Assistant also helps with setup of Streamlabs Desktop and troubleshooting. Inworld processes inputs from the creator to execute scene transitions or animations through the Streamlabs API, helping ensure the stream runs smoothly.

Creators can select from assistant personalities that complement the tone of their stream, whether they’re looking for subtle behind-the-scenes support or a lively co-host.

Powering game state awareness with Inworld

An interactive co-host needs to be able to seamlessly integrate into the flow of a livestream, offering timely and contextually relevant input that enhances both the creator’s performance and the audience's experience. This involves adapting to real-time changes in gameplay, engaging the audience with dynamic commentary, and complementing the creator’s vision for the stream.  

While large language models (LLMs) have revolutionized text generation, they fall short in environments requiring real-time contextual awareness—like in gaming. Here’s how Inworld powers game state awareness in the Intelligent Streaming Assistant:

• Multimodal Input Processing: Vision models from NVIDIA ACE and perception models from Inworld capture and process multiple streams of input such as gameplay, audience chat, or streamer audio.
• Contextual Reasoning: Inworld synthesizes these inputs into a coherent understanding of what’s happening in the game. This includes analyzing the game map to identify strategic opportunities, assessing player status to recognize critical moments like low health or resource scarcity, and evaluating historical performance to make recommendations based on past behavior or outcomes.
• Adaptive Output: The assistant generates commentary or recommendations that align with the current livestream state. For example, in response to a question from the streamer, it might analyze the map and suggest strategies, while in a high-pressure moment, it might deliver quippy commentary to keep the audience engaged.

Enabling Producer Actions with voice commands

For independent streamers, the Intelligent Streaming Assistant serves as an invaluable tool to elevate production quality. The assistant works seamlessly in the background, responding to the streamer’s commands and cues. Whether switching scenes, adding overlays, responding to chat, or replaying clutch victories, the assistant enhances the creator’s vision for their livestream. Inworld processes multimodal inputs to execute these Producer Actions through the Streamlabs API, giving the creator full control over how their stream unfolds.

Collaborating with Logitech G’s Streamlabs and NVIDIA

The collaboration brings together Streamlabs' expertise in live streaming tools; NVIDIA ACE technology for digital humans, including audio-to-face animations and 3D rendering technology, as well as AI vision models that can understand what is happening on screen; and Inworld’s advanced generative AI capabilities for perception, cognition, and adaptive output. Together, these technologies simplify streaming while empowering creators to produce high-quality, engaging content. 

The world’s first Intelligent Streaming Assistant will be available via the Streamlabs App Store when the product launches later in 2025. 

In the meantime, if Inworld can help you add fully adaptive interactive agents to your gaming or entertainment experience, please reach out.