Role : Data Architect with Databricks
Location : Remote
Seeking a skilled Data Architect to design and implement data architecture solutions for data-centric projects. The role involves leading the development of enterprise data strategies, creating real-time analytics models, managing data pipelines, and optimizing data processing using various technologies.
Key Responsibilities:
Design and implement data architecture solutions for data-centric projects.
Lead the development of enterprise data strategies, standards, processes, and tools.
Create real-time analytics models using DataBricks for actionable insights.
Manage and schedule data pipelines in Azure Data Factory for seamless data ingestion.
Optimize data processing and perform transformations using Apache Spark, Scala, and Python.
Implement Delta Lake and Adaptive Query Execution frameworks for efficient data handling.
Ensure data security by implementing dynamic data masking in Azure SQL DB.
Generate insightful reports using Power BI for data visualization.
Maintain pipeline schedules, triggers, and logs for effective data management.