Guidance for legacy workspaces & alternate VM SKUs

[SenthuranSivananthan]

Overview/Summary

Added two Azure Databricks Guidance:

• DBW-29 - Migrate Legacy Workspaces
• DBW-30 - Define alternate VM SKUs

Related Issues/Work Items

N/A

This PR fixes/adds/changes/removes

• Closes 💡 Feature Request - Guidance for migrating from legacy Azure Databrick workspaces #430
• Closes 💡 Feature Request - Guidance for selecting alternate VM SKUs for Databricks jobs #431

Breaking Changes

None

As part of this Pull Request I have

• Read the Contribution Guide and ensured this PR is compliant with the guide
• Checked for duplicate Pull Requests
• Associated it with relevant GitHub Issues or ADO Work Items (Internal Only)
• Ensured my code/branch is up-to-date with the latest changes in the main branch
• Ensured PR tests are passing
• Performed testing and provided evidence (e.g. screenshot of output) for any changes associated to ARG queries and/or scripts
• Updated relevant and associated documentation (e.g. Contribution Guide, Docs etc.)

[rodrigosantosms]

Please remove all links from the "Guidance/Description", they should only exist in the "Reference Links" section, otherwise it could break some of our automations.

[SenthuranSivananthan]

@oZakari / @rodrigosantosms - links in the descriptions have been removed. Are there other changes to make?

[rodrigosantosms]

I've made some changes to avoid breaking our automation. I'll sync with Senthu later about the changes. PR Approved.