vff
News

Bedrock AgentCore adds stateful MCP for interactive agent workflows

Evandro FrancoRead original
Share
Bedrock AgentCore adds stateful MCP for interactive agent workflows

Amazon Bedrock AgentCore Runtime now supports stateful Model Context Protocol (MCP) client capabilities, enabling AI agents to pause execution for user input, request LLM-generated content, and stream real-time progress updates. Previously, stateless MCP implementations could only execute one-way tool calls without bidirectional communication. The update introduces three new capabilities: elicitation for mid-execution user requests, sampling for dynamic LLM content generation, and progress notification for long-running tasks. Stateful mode provisions dedicated microVMs per user session with up to 8 hours persistence, maintaining conversation continuity through session identifiers.

Amazon Bedrock AgentCore Runtime now supports stateful Model Context Protocol (MCP) client capabilities, enabling AI agents to pause execution for user input, request LLM-generated content, and stream real-time progress updates. Previously, stateless MCP implementations could only execute one-way tool calls without bidirectional communication. The update introduces three new capabilities: elicitation for mid-execution user requests, sampling for dynamic LLM content generation, and progress notification for long-running tasks. Stateful mode provisions dedicated microVMs per user session with up to 8 hours persistence, maintaining conversation continuity through session identifiers.

  • Bedrock AgentCore Runtime adds stateful MCP support, enabling interactive multi-turn agent workflows that can pause for user input or LLM sampling
  • Three new client capabilities: elicitation (request user input), sampling (request LLM content), and progress notification (stream real-time updates)
  • Stateful mode provisions isolated microVMs per session lasting up to 8 hours, replacing stateless HTTP model that couldn't maintain conversation context
  • Completes bidirectional MCP protocol implementation, allowing servers to initiate requests back to clients rather than only responding to tool calls

Stateful MCP support removes a fundamental constraint in agent design: the inability to maintain conversation threads or request clarification mid-execution. This capability gap has forced developers to work around limitations in long-running workflows, interactive debugging, and real-time feedback loops. The addition brings MCP implementations closer to practical agent requirements where workflows often need human-in-the-loop validation or dynamic content generation during execution.

  • Developers can now build agents that pause mid-execution for user input or LLM sampling, enabling interactive workflows previously impossible with stateless implementations
  • Session-based architecture with dedicated microVMs per user creates isolation and state persistence, but introduces operational considerations around resource allocation and session lifecycle management
  • Bidirectional MCP protocol support positions Bedrock as a more complete MCP runtime, potentially increasing adoption among developers already invested in the open standard
  • The 8-hour session limit and 15-minute idle timeout create practical constraints for long-running or intermittent workflows that may require external session management
Share

Our Briefing

Weekly signal. No noise. Built for founders, operators, and AI-curious professionals.

No spam. Unsubscribe any time.

Related stories

AI Discovers Security Flaws Faster Than Humans Can Patch Them

AI Discovers Security Flaws Faster Than Humans Can Patch Them

Recent high-profile breaches at startups like Mercor and Vercel, combined with Anthropic's disclosure that its Mythos AI model identified thousands of previously unknown cybersecurity vulnerabilities, underscore growing demand for AI-powered security solutions. The article argues that cybersecurity vendors CrowdStrike and Palo Alto Networks, which are integrating AI into their threat detection and response capabilities, represent undervalued investment opportunities as enterprises face mounting pressure to defend against both conventional and AI-discovered attack vectors.

21 days ago· The Information
AWS Launches G7e GPU Instances for Cheaper Large Model Inference
TrendingModel Release

AWS Launches G7e GPU Instances for Cheaper Large Model Inference

AWS has launched G7e instances on Amazon SageMaker AI, powered by NVIDIA RTX PRO 6000 Blackwell GPUs with 96 GB of GDDR7 memory per GPU. The instances deliver up to 2.3x inference performance compared to previous-generation G6e instances and support configurations from 1 to 8 GPUs, enabling deployment of large language models up to 300B parameters on the largest 8-GPU node. This represents a significant upgrade in memory bandwidth, networking throughput, and model capacity for generative AI inference workloads.

29 days ago· AWS Machine Learning Blog
Anthropic Launches Claude Design for Non-Designers
Model Release

Anthropic Launches Claude Design for Non-Designers

Anthropic has launched Claude Design, a new product aimed at helping non-designers like founders and product managers create visuals quickly to communicate their ideas. The tool addresses a gap for early-stage teams and individuals who need to share concepts visually but lack design expertise or resources. Claude Design integrates with Anthropic's Claude AI platform, leveraging its capabilities to streamline the visual creation process. The launch reflects growing demand for AI-powered design tools that lower barriers to entry for non-technical users.

about 1 month ago· TechCrunch AI
Google Splits TPUs Into Training and Inference Chips

Google Splits TPUs Into Training and Inference Chips

Google is splitting its eighth-generation tensor processing units into separate chips optimized for AI training and inference, a shift the company says reflects the rise of AI agents and their distinct computational needs. The training chip delivers 2.8 times the performance of its predecessor at the same price, while the inference processor (TPU 8i) achieves 80% better performance and includes triple the SRAM of the prior generation. Both chips will launch later this year as Google continues its effort to compete with Nvidia in custom AI silicon, though the company is not directly benchmarking against Nvidia's offerings.

28 days ago· Direct