CAMEL-20593: use ASF docker image

[jonomorris]

Description

Updated the kafka test infrastructure to use the Apache Kafka docker image v3.8.0.

The latest Kafka module in Testcontainers has no option to use zookeeper. (Kafka introduced KRaft to remove it's dependence on zookeeper for metadata management.)

Topics were created explicitly in a number of tests since relying 'autocreation' to create new topics while retrieving topic metatdata often returned no partition information even thought the topic had been created.

Target

• I checked that the commit is targeting the correct branch (note that Camel 3 uses camel-3.x, whereas Camel 4 uses the main branch)

Tracking

• If this is a large change, bug fix, or code improvement, I checked there is a JIRA issue filed for the change (usually before you start working on it).

Apache Camel coding standards and style

• I checked that each commit in the pull request has a meaningful subject line and body.

• I have run mvn clean install -DskipTests locally from root folder and I have committed all auto-generated changes.

[jonomorris]

/component-test kafka

Result ✅ The tests passed successfully

[github-actions]

🌟 Thank you for your contribution to the Apache Camel project! 🌟

🤖 CI automation will test this PR automatically.

🐫 Apache Camel Committers, please review the following items:

• First-time contributors require MANUAL approval for the GitHub Actions to run

• You can use the command /component-test (camel-)component-name1 (camel-)component-name2.. to request a test from the test bot.

• You can label PRs using build-all, build-dependents, skip-tests and test-dependents to fine-tune the checks executed by this PR.

• Build and test logs are available in the Summary page. Only Apache Camel committers have access to the summary.

• ⚠️ Be careful when sharing logs. Review their contents before sharing them publicly.

[github-actions]

🤖 The Apache Camel test robot will run the tests for you 👍