Senior Data Engineer

Descripción del puesto

5+ years of experience in data engineering with a strong focus on pipeline development. Hands-on expertise with Databricks, including Delta Lake, Databricks Workflows, and Unity Catalog. Proficiency in PySpark and Apache Spark for large-scale distributed data processing. Experience building pipelines with Spark Declarative Pipelines (Delta Live Tables). Working knowledge of dbt for SQL-based transformation development and testing. Experience processing healthcare data including claims, clinical, EMR/EHR, eligibility, or provider data. Proficiency in Python and SQL with a disciplined approach to code quality and testing. Experience with cloud infrastructure (Azure, AWS, or GCP) and CI/CD pipeline tooling. Understanding of data modeling methodologies: Data Vault 2.0, 3NF, and dimensional modeling (Kimball). Familiarity with healthcare data compliance considerations (HIPAA) and data standards (HL7, FHIR, ICD-10, CPT, NPI). Experience with data orchestration tools such as Apache Airflow or Azure Data Factory. Exposure to streaming data pipelines using Kafka or Databricks Structured Streaming. Databricks Certified Data Engineer Associate or Professional certification. Healthcare data experience is essential.