Tag
multimodal agents
Multimodal agents combine text, audio, video, and tool use so models can interpret context and act in real time. The hard part is not only accuracy, but deciding when to call tools, when to reason directly, and how to keep latency and reliability in balance.
5 articles
AVA-Encoder turns films into editable knowledge graphs
AVA-Encoder turns video into a knowledge graph so agents can reason about and reconstruct films.
Awesome-Agent-Memory maps the field of LLM memory
A GitHub list tracks systems, benchmarks, and papers on memory for LLMs and multimodal agents.
OmniAgent brings active perception to video understanding
OmniAgent turns long-video understanding into an active reasoning loop that scales with turns, not video length.
Act Wisely: Teaching Agents When Not to Call Tools
A new training scheme, HDPO, aims to cut blind tool use in multimodal agents by separating accuracy from tool efficiency.
Google's Gemini 3.1 Flash Live Targets Real-Time Voice AI
Gemini 3.1 Flash Live brings low-latency audio, video, and tool use to Google’s Live API, with 90.8% on ComplexFuncBench Audio.