Description
¿ 6+ yrs. of total exp. and 5+ yrs. in Azure Databricks
technologies. ¿ Good understanding of ETL , BI and DW technologies. ¿ Design,
implement, and maintain data pipelines for data ingestion, processing, and
transformation in Azure. ¿ Work together with data scientists and analysts to
understand the needs for data and create effective data workflows. ¿ Create and
maintain data storage solutions including Azure SQL Database, Azure Data Lake,
and Azure Blob Storage. ¿ Utilizing Azure Data Bricks to create and maintain
ETL (Extract, Transform, Load) operations. ¿ Implementing data validation and
cleansing procedures will ensure the quality, integrity, and dependability of
the data. ¿ Improve the scalability, efficiency, and cost effectiveness of data
pipelines. ¿ Monitoring and resolving data pipeline problems to guarantee
consistency and availability of the data. ¿ Experience in PySpark or Spark. ¿
Good communication skills ¿ Oral & Written
