Job Responsibilities

• Develop and maintain Azure Data Architecture, ensuring compliance with data-related policies and standards.
• Design and implement data solutions using Databricks, including data pipelines, ETL processes, and data lakes.
• Analyse data-related system integration challenges and propose appropriate solutions.
• Work with data engineer and IT team members to assist with data-related technical issues and support their data infrastructure needs.
• Implement data security and privacy protection measures.
• Develop and implement strategies for data acquisitions, archive recovery, and database implementation.
• Work with data governance teams to ensure data solutions are compliant with regulations.
• Monitor system performance and troubleshoot issues.
• Maintain updated knowledge of the Azure platform, Databricks, and best practices.

Job Requirements

• Bachelor's degree in computer science, computer engineering, information systems or related discipline.
• Extensive experience with Azure services like Azure SQL Database, Data Factory, Data Lake Store, Data Lake Analytics, Stream Analytics, Azure Storage, Cosmos DB, and Databricks.
• Proven experience in designing and implementing solutions using Databricks, including Spark, Delta Lake, and MLflow.
• Good analytical and problem-solving skills.
• Excellent communication and collaboration skills.
• Proven experience in data architecture and management, preferably in a cloud environment