Novartis
Hyderabad, Telangana, India Posted 2d ago
This role leads the design and delivery of enterprise data platforms and AI-ready solutions using AWS, Databricks, Snowflake, Spark, and Python at Novartis.
Key Responsibilities
Design, build, and optimize scalable batch, streaming, CDC, and event-driven data pipelines using Python and SQL.
Architect secure, resilient, high-performance data platforms and translate business requirements into scalable cloud-based solutions.
Lead hands-on development and optimization of Databricks, Apache Spark, Delta Lake, and Lakehouse solutions.
Design and implement Snowflake data engineering solutions.
Engineer enterprise data platforms on AWS leveraging cloud-native services.
Develop reusable integration frameworks, APIs, CDC processes, and connectivity patterns across enterprise applications.
Build AI-ready data foundations, including RAG pipelines, vector retrieval, context engineering, and agentic workflows.
Drive engineering excellence through CI/CD, Infrastructure as Code, and security-by-design.
Requirements
Bachelor's or Master's degree in Computer Science, Software Engineering, Data Engineering, Information Technology, or a related discipline.
12+ years of experience in software engineering and/or data engineering.
Advanced hands-on expertise in Python, SQL, data modeling, ETL/ELT, CDC, batch, and streaming architectures.
Strong experience with Apache Spark (PySpark) and distributed data processing.
Proven hands-on experience with Databricks, Delta Lake, and Snowflake.
Deep knowledge of AWS cloud services and cloud-native data architectures.
Practical exposure to Generative AI technologies, including RAG architectures and vector search.
