Category: Azure

  • dbfs init script – depreciated – databricks

    Starting from 1st of April 2024 dbfs init scrips are depreciated. They do provide an option to extend this function until end of September 2024. In any case its the customer responsibility to migrate out of dbfa init scripts which are ow called as legacy init script. The other alternate approach is to host the…

  • Know Your Cloud (KYC): Azure Databricks Spot Instances

    Ever wonder how to slash your Databricks costs? Look no further than spot instances! What are Spot Instances? Think of them as discounted virtual machines offered by cloud providers like Azure, AWS and GCP. They’re much cheaper (up to 90%!), but with a catch: they can be interrupted by the cloud provider at any time.…

  • Get Azure Function AzureWebJobsDashboard Storage Usage Script

    Last week on the Twitter while checking I noticed a thread related to the Azure web job storage size. The issue is that the Azure storage used has grown tremendously, close to 2 TB. By default, this storage account is supposed to be used for storing checkpoints, trigger and metadata related to the functions, so…

  • Azure Databricks Workspace Subnet CIDR Change

    It’s been a while I wrote a technical article in this blog. I was busy in too many things and didn’t get a chance to focus on this website. Saying that, I had a steep learning curve in Azure cloud & it’s related technologies. I’m happy that I wrote this article and got a chance…

  • Provisioning Azure Cosmos DB using Powershell

    Provisioning Azure Cosmos DB using Powershell

    Azure Cosmos database is one of the NoSQL database that is available in Microsoft Azure cloud platform. Azure Cosmos db is getting more popular compared to other NoSQL databases in the cloud market so many organisations started using Cosmos database with their organization. When we started incorporating Cosmos database into our project we provisioned it…