State Street
Bengaluru, Karnataka, India Posted 2d ago
State Street Investment Management’s Data, Analytics and AI Services team is seeking a Senior Data Engineering Lead for our Bangalore office. This role is accountable for the design, build, and operation of modern data platform and software capabilities that enable investment management business.
Key Responsibilities
Design, build, and operate modern data platform capabilities across lakehouse, batch, streaming, metadata, observability, security, and governed consumption layers.
Develop scalable batch and streaming data pipelines using Apache Spark, Snowflake, and/or Databricks.
Implement and optimize Apache Iceberg tables and open data formats.
Apply disciplined software and data engineering practices across CI/CD, Infrastructure as Code, and automated testing.
Partner with Product, Analytics, ML, and business SMEs to define data semantics, data product contracts, and schemas.
Engineer data governance capabilities across lineage, observability, and permissions.
Create AI-ready data assets by enforcing standards for completeness, accuracy, and lineage.
Optimize platform performance and cost through workload tuning and query optimization.
Own operational stability by troubleshooting production issues and driving incident response.
Provide technical leadership for a small team or pod.
Requirements
14+ years in software/data engineering; BS/MS in CS/Engineering or equivalent experience.
Strong hands-on coding in Python and SQL.
Proven delivery of lakehouse/data platform solutions using Databricks and/or Snowflake on AWS.
Strong Spark development and performance/cost tuning.
Experience with Apache Iceberg and table/catalog governance concepts.
Production engineering practices including CI/CD, IaC, automated testing, and observability.
Preferred Qualifications
Financial services experience, asset management preferred.
Experience across structured and alternative/unstructured data.
Use of AI-assisted coding tools.
