Bug Report for Crawl4A multiple async

[jmontoyavallejo]

Hi UncleCode,
I hope you are doing well!

First of all, I want to express my gratitude for creating Crawl4AI It’s a fantastic tool for what I’m exploring

I did come across a small bug that I wanted to bring to your attention. When I try to run the scraper with LLMs in concurrency, the output format doesn’t seem to align with the Pydantic schema, and it crashes.

This only happens when I’m running it with concurrency and combining it with other async scrapers. the output schema turns into index,tags and content

[unclecode]

Hello @jmontoyavallejo , thank you so much for your kind words. I would greatly appreciate it if you could provide a code sample that I can run and replicate the error I'm facing. What you're saying sounds interesting. Please share a sample code that demonstrates the issue when making concurrent requests to multiple URLs using the LLM. Thx