Skip to content

AI Ready Architecture

Enhance your Virtual Situation Rooms with Eyeson's AI Ready Architecture, seamlessly integrating your AI models with real-time streams for enriched, automated content.

Plug in your own AI

Use Eyeson AI APIs to seamlessly connect your AI models to real-time video, audio, and visual streams. With the Eyeson One View API, you can access and control streams at various stages – filter, prioritize, detect, and enrich content – enabling your AI to manage calls, adjust layouts, prioritize feeds, and enhance media with features like action detection, object recognition, and captioning.

Artificial Intelligence Platform

Discover the Main Advantages

1cross Platform v2
Flexible & scalable deployment of AI
Deploy Eyeson in your cloud, at the edge, or embedded. Leverage AI within the communication infrastructure where streams are managed. Easily adapt to new AI models for flexible, scalable deployments.
1Flexible Layers Kopie_2
Open
architecture
Eyeson transcodes streams, allowing AI use in the network, not just at source or destination. Broad codec support ensures compatibility with various devices, even older or consumer-grade ones. Leverage AI with any camera or drone.
1ai-stream
Specialized AI on
Select streams
Connect specialized AIs to relevant streams for optimal performance. Choose the right dataset (compressed, decompressed, or composed) based on the use case and precision needs. Minimize computing and energy consumption.
Use Case

AI Automated Layout in Virtual Situation Rooms

Set up your call and add all the sources, layout parameters, and participants. Use the Eyeson AI connector to connect the call streams with your AI models. Connect your pre-trained or generic OOTB models like OpenAI real-time API or Yolo. You can distinguish if each stream's video and/or audio gets sent to your pipelines. This will help you identify the triggers for layout actions in greater detail. Finally, this can trigger layout changes like enlarging a small stream into focus, putting alerts into the call or even creating and setting up a virtual situation room.

Use Case Examples

  • Highlight teams who ask for assistance on an audio channel by putting their video streams onto the screen
  • Detect guns in train surveillance and enlarge the feed, displaying address, schedule, and nearby units.
  • Marking cameras where a particular license plate showed up and track that vehicle, create a room and push to closeby units
AI-usecase-benefit

AI Triggers in Eyeson: An Overview

AI triggers automate actions in Eyeson video calls based on real-time AI insights. These features transform video calls into responsive environments that adapt to changing situations and participant needs. Examples include:

Layout

Dynamic layout adjustments to highlight important video streams

Alerts

Real-time alerts based on AI detection of keywords or events

Participants

Automated participant management (invites, muting, removal)

Prioritization

Smart stream prioritization for bandwidth and resolution

Content

AI-powered content additions like captions and object labels

Recording

Automated recording of important call segments
FAQs

Frequently Asked Questions

We want to simplify your life. In the following you see answers to some questions that might arise. 

How does AI integration work with the Eyeson platform?

Eyeson provides AI APIs that allow you to connect your AI models directly to real-time video, audio, and visual streams. Using the One View API, you can access and control streams at different stages to filter, prioritize, detect, and enrich content. Your AI can manage calls, adjust layouts, prioritize feeds, and enhance media with features like action detection, object recognition, and captioning.

What types of AI models can be connected to Eyeson's streaming services?

Eyeson supports pre-trained and generic out-of-the-box models, including OpenAI real-time API and Yolo. Based on your use case requirements, you can connect one or more specialized AI models to specific streams and choose whether to process video streams, audio streams, or both.

Can I deploy AI features in both cloud and edge environments? Yes, Eyeson offers flexible deployment options. You can deploy AI capabilities in your cloud environment, at the edge, or in embedded systems. The platform is designed to adapt to new AI models and can be implemented wherever your communication infrastructure manages streams.
How does stream selection work for AI processing? Eyeson allows you to selectively connect specialized AIs to relevant streams for optimal performance. Based on your use case and precision requirements, you can choose the appropriate point (compressed, decompressed, or composed). This selective approach helps minimize computing resources and energy consumption while maintaining effectiveness.
cross-references

Explore More Benefits

fusion Omnimedia Fusion One View injects live streams from drones, bodycams, system interfaces, data and live video from multiple participants into a single, easy to manage Omnimedia stream. Read More crowd Multiparty Interactivity One View is not limited to oneway videos, it includes a native and high performance multiparty video call capability for easy cross agency communication. Read More realtime Real-time Synchronization The One View Omnimedia stream is presented synchroneously to all participants via a fully programmable & dynamic layout (adapts in <40 ms). Read More rest api Full Programmability One View is a full set of APIs and SDKs to manage layouts, flows, calls, performances and integration with third party AI or other systems. Read More multiple_devices Instant access Share a private URL or QR code with participants to allow an instant access to a One View session, from wherever they are with any device. Read More rocket Deployment versatility Deploy on public cloud, private cloud, or customer-managed cloud. Even deploy embedded, while delivering the reliability and security you need. Read More speedometer Smart Bandwidth One View dynamically adjusts bandwidth by modifying each client's audio and video frame and bit rate. This creates a resilient connection for challenging settings. Read More icons8-security_shield Compliant and secure One View is natively encrypted and can be deployed in private networks. Omnimedia recording and detailed logs options are available for compliance and analysis. Read More
artificial_intelligence AI ready architecture Inject your AI (NLP, Vision) into One View sessions at different stages to filter, prioritize, detect, enrich and assist.  
line-dark-gradient

Developer-Friendly Resources

Our documentation provides detailed guides, API references, example code, and best practices.
eyeson-docs-web
Eyeson Documentation
Nothing is better than some code & documentation
Eyeson GitHub
Find SDKs, Examples & library implementations
github-eyeson
Tech Blog
News, Tips & Tricks
Our developers post regularly to provide helpful info.
key
Get your free API key and start building your own solutions.