Kyndryl
Bengaluru, Karnataka, India Posted 2d ago
At Kyndryl, we run and reimagine the mission-critical technology systems that drive advantage for the world’s leading businesses. As a Data Engineer, you will design, develop, and optimize scalable data pipelines and cloud-native data solutions on Google Cloud Platform (GCP).
Key Responsibilities
Architect for RAG: Design and scale pipelines for Retrieval-Augmented Generation, transforming massive volumes of unstructured IT logs and documentation into optimized Vector Embeddings.
Scale vector infrastructure: Responsible for the health and performance of vector databases (e.g., Pinecone, Milvus, or Weaviate).
Engineer semantic layers: Move beyond simple ETL to build knowledge graphs and semantic layers.
Automate data excellence: Build automated data guardrails to detect noise, bias, or PII before it reaches the model.
Progress to production: Build, deploy, and maintain CI/CD pipelines for data infrastructure.
Requirements
Overall 6+ Years of experience into IT.
Expertise in data mining, data storage and Extract-Transform-Load (ETL) processes.
Experience in data pipelines development and tooling, e.g., Glue, Databricks, Synapse, or Dataproc.
Experience with both relational and NoSQL databases, PostgreSQL, DB2, MongoDB.
Excellent problem-solving, analytical, and critical thinking skills.
Preferred Qualifications
Experience working as a Data Engineer and/or in cloud modernization.
Experience in Data Modelling.
Professional certifications such as Open Certified Technical Specialist or Cloud platform certifications.
