Skip to content

Commit e10f3b8

Browse files
feat: pass provider to context.get_messages_for_request()
Enable dynamic token budget calculation by passing provider reference to context manager's get_messages_for_request() method. 🤖 Generated with [Amplifier](https://github.com/microsoft/amplifier) Co-Authored-By: Amplifier <240397093+microsoft-amplifier@users.noreply.github.com>
1 parent ea64022 commit e10f3b8

1 file changed

Lines changed: 3 additions & 2 deletions

File tree

amplifier_module_loop_basic/__init__.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -92,8 +92,9 @@ async def execute(
9292
return f"Operation denied: {result.reason}"
9393

9494
# Get messages for LLM request (context handles compaction internally)
95+
# Pass provider for dynamic budget calculation based on model's context window
9596
if hasattr(context, "get_messages_for_request"):
96-
message_dicts = await context.get_messages_for_request()
97+
message_dicts = await context.get_messages_for_request(provider=provider)
9798
else:
9899
# Fallback for simple contexts without the method
99100
message_dicts = getattr(context, "messages", [{"role": "user", "content": prompt}])
@@ -412,7 +413,7 @@ async def execute_single_tool(tc: Any, group_id: str) -> tuple[str, str]:
412413

413414
# Get one final response with the reminder (context handles compaction internally)
414415
if hasattr(context, "get_messages_for_request"):
415-
message_dicts = await context.get_messages_for_request()
416+
message_dicts = await context.get_messages_for_request(provider=provider)
416417
else:
417418
message_dicts = getattr(context, "messages", [{"role": "user", "content": prompt}])
418419
message_dicts = list(message_dicts)

0 commit comments

Comments
 (0)