https://mayursurani.medium.com/the-ultimate-data-engineers-guide-to-essential-pyspark-functions-fb6e2ee6e2f9