[Feature Request]: Structured Output/ Formatted Output

[Hk669]

Is your feature request related to a problem? Please describe.

Ive came across many comments from the community, asking for the formatted output/ structural output from the Agentic chat (initate_chat and groupchat ). I believe generating the expected response after the agentic chat can be the biggest improvement in AutoGen.

Me, @marklysze and @sonichi discussed about adding this feature over a call.

Describe the solution you'd like

There should be an output message after the completion of the chat, i can see there is last_message, but that doesn't serve the exact feature. adding this feature can help production apps use AutoGen.

solution: TBD ( help and ideas are appreciated )

Additional context

We can get started with the openai structured output and final goal should be the structured output for the complete chat.

cc @sonichi @BeibinLi @qingyun-wu @marklysze @yiranwu0 @skzhang1

[davorrunje]

I already implemented one version of structured input/output messages for internal usage. I could take this one.

[r4881t]

Another feature request and discussion on the same lines. @davorrunje @Hk669 microsoft#3442 @davorrunje i would love to help, please let me know if i can. My discord is xpranav on Autogen server

[marklysze]

Great to get a discussion here on approaches (and @davorrunje what you are doing already) and see if we can come to a consensus on a way forward.

[Hk669]

Great to get a discussion here on approaches (and @davorrunje what you are doing already) and see if we can come to a consensus on a way forward.

it's at fastagency.ai, I believe it's only using the chat.summary() method for the output. correct me if I'm wrong. @davorrunje

[marklysze]

Feel free to put down what you'd like to see and how you could see it working. OpenAI's Structured Outputs is a starter.

[tylerprogramming]

@davorrunje Hey! Just curious if there was any update to this or if it's still being worked on?