Creating an Azure Databricks Service

Azure tutorial · PySpark.in

Step 1: Open the Azure Portal

Go to the Azure Portal.
From the top-left menu, click Create a Resource.
Search for Azure Databricks and select it.
Click Create to start the setup wizard.

Step 2: Configure Basic Settings

Subscription: Choose your Azure subscription (e.g., Azure Subscription 1).
Resource Group: Create a new one (e.g., DatabricksCourseRG).
- Tip: Follow a naming standard (e.g., RG = Resource Group).
Workspace Name: Example – DatabricksCourseWS (WS = Workspace).
Region: Choose the region closest to you.
- UK South is a safe option if unsure.
- Note: Smaller regions may not support advanced features or may have limited capacity.
Pricing Tier:
- Standard – basic features.
- Premium – includes advanced features like role-based access control, Unity Catalog, Databricks SQL, and Delta Live Tables.
- Recommendation: Choose Premium for learning and real-world relevance.

Step 3: Networking Options

Private Workspace Access: Set to No (to keep costs low).
Virtual Network: Leave as default (let Azure manage it).
Secure Cluster Connectivity: Select No (sufficient for learning).

Summary: Select No for both options to reduce cost.

Step 4: Security & Encryption

Azure automatically encrypts storage data.
Optionally, enable custom encryption keys (Premium only).
For this course, leave defaults and continue.

Step 5: Review & Create

Click Review + Create.
Validate the configuration.
Click Create to deploy.
Deployment usually takes a few minutes.

Step 6: Access Your Databricks Workspace

Once deployment is complete, click Go to Resource.
Pin the workspace to a new dashboard for quick access:
- Click the Pin icon.
- Create a new dashboard (e.g., Databricks Dashboard).
- Customize tile sizes and positions.
- Share with your team if needed.
Click Launch Workspace to log into Databricks (via single sign-on).

Final Note

You now have a fully functional Azure Databricks Workspace. From here, you’ll be able to create clusters, run notebooks, and explore the advanced features we’ll cover in the upcoming lessons.