Sr. Principal Consultant (Senior Data Engineer, Compliance Engineering & Technology)
3 resources
Subcontracting roles
Location: Remote & (US-PST time zone)
Responsibilities
Resources should have experience with AML & KYC.
• Work with engineering and product teams to design, develop, and manage scalable ETL pipelines to unblock new product launches.
• Create brand new and optimize existing data models and schemas on top of Block data including but not limited to eventing, customer level, and process level data.
• Build monitoring to assess the health of the team's infrastructure as well as data quality and lineage.
• Participate in on-call rotation, monitor daily execution, diagnose and log issues, and fix business critical pipelines to ensure SLAs are met with internal stakeholders
• Work with non-technical partners and product teams to understand their needs, translate business requirements into applicable data requirements, and come up with automated end-to-end solutions.
• Standardize business and product metric definitions in curated and optimized datasets and develop data dictionaries and other related documentation.
• Teach and encourage others to self-serve by building tools that make it simpler and faster for them to do so.
• Should have experience working on below technology
• Snowflake
• Databricks
• Dbt
• Github
• Airflow
• Prefect
• Tableau
Qualifications we seek in you!
Minimum Qualifications / Skills
• B.E/B.TECH/ Any Graduation Equivalent
Preferred Qualifications/ Skills
• A minimum of 8 years of related experience with a bachelor's degree; or 6 years and a master's degree; or equivalent experience.
• High proficiency in SQL
• Working experience with Python, and Terraform
• Experience designing medium-to-large data engineering solutions and responsible for the entire lifecycle of projects including scoping, design, development, testing, deployment, and documentation
• Experience with ETL scheduling technologies with dependency checking, such as Airflow or Prefect, as well as schema design and dimensional data modeling
• Experience with setting up data quality and data lineage monitoring
• Experience with financial crimes compliance systems, technologies, and processes is a big plus
• Experience driving data-driven decisions for AI initiatives / agent building is a big plus
Apply Now
Apply Now