Chief Data Software Engineer

We are seeking a Chief Data Software Engineer to build cloud-scale data pipelines and platforms for analytics, reporting, and AI-driven initiatives. You will partner with Product, Engineering, and Business to ship dependable solutions on Azure Databricks, Spark, Kafka, and modern governance practices. Responsibilities Architect scalable batch and streaming data pipelines Engineer and optimize Databricks, Spark, and Kafka-based solutions Establish data quality, governance, and observability standards Create data models and reporting foundations for analytics and AI initiatives Partner with Product, Engineering, and Business teams to deliver data-driven solutions Enable enterprise reporting, dashboards, and self-service analytics platforms Use AI tools such as Claude Code, GitHub Copilot, and similar platforms for development, testing, and productivity improvements Apply MCP, prompt engineering, and multiple LLMs in AI-assisted development workflows Requirements Proven track record with 7+ years of experience in data engineering or a related field Hands-on proficiency in SQL, Python, PySpark, Scala, and Java Deep expertise in Apache Spark, Spark SQL, Kafka, and Delta Lake Strong experience with Azure Databricks, Unity Catalog, and Databricks Asset Bundles (DAB) Solid familiarity with Azure Data Factory (ADF), ADLS Gen2, Azure Key Vault, Azure Cosmos DB, and Azure Monitor Thorough knowledge of Data Modeling, Data Quality, Data Governance, and PII Handling Demonstrated background in Medallion Architecture (Bronze/Silver/Gold), CDC, and SCD Type 1 & Type 2 Practical competency in Azure DevOps, Git, CI/CD, and Gradle English proficiency at B2+ (Upper-Intermediate) level Nice to have Familiarity with Tableau, ThoughtSpot, Cognos, and Data Visualization Best Practices Knowledge of Semantic Layer Concepts, AI/BI Dashboards, and Databricks Genie Understanding of scalable data platforms, analytics, and reporting solutions We offer International projects with top brands Work with global teams of highly skilled, diverse peers Healthcare benefits Employee financial programs Paid time off and sick leave Upskilling, reskilling and certification courses Unlimited access to the LinkedIn Learning library and 22,000+ courses Global career opportunities Volunteer and community involvement opportunities EPAM Employee Groups Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn EPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.