Job Description

Skill: Databricks Tech Lead

• Responsible for designing, building, and maintaining pipelines that transform raw data into actionable insights in the Databricks environment.
• They utilize tools like Apache Spark to manage large datasets, optimize data flow, and ensure efficient data processing.
• Experience in generating data models, delivering data collection, storage, access, and analytics data platform solutions, and implementing database back-up, recovery, and archiving strategy.
• Real time data ingestion using Stream sets.
• Experience UDM Model.
• Experience in Dimensional Modelling, Data Migration, Data Cleansing, Data conversion and bridging, and ETL techniques on multiple databases and operating systems.
• Python, Databricks, perl, spark, Kubernetes, dockers and other cloud native tools and technologies.
• Provide solution design guidance to other technical staff, and assist in integrating various systems.
• Consult with users to determine requirements needed to guide development of the data models.
• Collaborate with Azure stack modules like Data Lakes and SQL DW to build robust data solutions.
• Write SQL, Python, and PySpark code for efficient data processing and transformation.
• Understand and translate business requirements into technical designs.
• Develop mapping documents and transformation rules as per project scope.
• Communicate project status with stakeholders, ensuring smooth project execution.

Job Tags

Similar Jobs