摘要
We are seeking a highly skilled Data Engineer with hands-on experience in SQL, PySpark, Databricks, Snowflake and CI/CD processes. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support our data analytics and business intelligence needs. You will work closely with data scientists, analysts, and Novartis internal customers (CPOs & Regional marketing and sales teams) to ensure the efficient processing and delivery of high-quality data.
About the Role
Key Responsibilities:
Design, develop, and optimize data pipelines using Python / PySpark to process and analyze large datasets. Write complex SQL queries for data extraction, transformation, and loading (ETL). Work with Databricks to build and maintain collaborative and scalable data solutions. Implement and manage CI/CD processes for data pipeline deployments to ensure seamless and efficient integration and deployment. Collaborate with data scientists and business analysts to understand data requirements and deliver appropriate solutions. Ensure data quality, integrity, and security across all data processes. Monitor and troubleshoot data pipelines and workflows to resolve issues promptly. Continuously improve data and code quality through automation and best practices. Ensure projects are delivered on schedule and within established deadlines. Aid in the creation and maintenance of Standard Operating Procedures (SOPs). Support the development and upkeep of knowledge repositories that capture both qualitative and quantitative reports.
Qualifications:
Bachelor’s degree in computer science, Engineering, Information Technology, or a related field with 4+ years of relevant work experience. Proven experience with PySpark, including developing and tuning data processing applications. Advanced proficiency in SQL and experience in writing complex queries and optimizing them for performance. Hands-on experience with Databricks, including notebooks, clusters, and integration with other data tools. Strong understanding of CI/CD pipelines and experience with tools such as Jenkins, GitLab CI/CD, or Azure DevOps. Familiarity with cloud platforms (e.g., AWS, Azure, Google Cloud) and related data services. Good understanding on data quality management concepts Ability to lead and own engagements independently with Excellent problem-solving skills and attention to detail. Strong communication and collaboration skills, with the ability to work effectively in an Agile team environment. Preferred Skills:
Understanding of healthcare / life sciences domain data and know-how of pharma ecosystem Knowledge of data warehousing concepts and tools (e.g., Snowflake, Redshift). Good to have knowledge on kedro framework. Understanding and applying effective data governance methods
Why Novartis: Helping people with disease and their families takes more than innovative science. It takes a community of smart, passionate people like you. Collaborating, supporting and inspiring each other. Combining to achieve breakthroughs that change patients’ lives. Ready to create a brighter future together? https://www.novartis.com/about/strategy/people-and-culture
Join our Novartis Network: Not the right Novartis role for you? Sign up to our talent community to stay connected and learn about suitable career opportunities as soon as they come up: https://talentnetwork.novartis.com/network
Benefits and Rewards: Read our handbook to learn about all the ways we’ll help you thrive personally and professionally: https://www.novartis.com/careers/benefits-rewards
Business Unit
Universal Hierarchy Node
Company / Legal Entity
IN10 (FCRS = IN010) Novartis Healthcare Private Limited
Functional Area
Marketing
Apply to Job
Accessibility and accommodation Novartis is committed to working with and providing reasonable accommodation to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the recruitment process, or in order to perform the essential functions of a position, please send an e-mail to [email protected]
Novartis is committed to building an outstanding, inclusive work environment and diverse teams' representative of the patients and communities we serve.