Data Engineer or Architect
QuantiphiFull Description
About the Role
We are seeking experienced Senior Data Engineers or Data Architects with deep expertise in to design and build scalable, high-performance data platforms. A key focus of this role is working with Google Cloud Spanner, including modernization and migration from distributed NoSQL systems such as Couchbase to Spanner.
You will play a critical role in architecting next-generation data systems that support analytics, transactional workloads, and business-critical applications.
Key Responsibilities
* Define and own end-to-end data architecture on GCP, with a focus on Cloud Spanner, BigQuery, and Cloud Composer (Airflow)
* Design scalable data models for both transactional (OLTP) and analytical (OLAP) systems
* Lead database modernization initiatives, especially Couchbase to Cloud Spanner migrations
* Architect data ingestion and transformation pipelines (batch & streaming) using SQL and ELT frameworks
* Design multi-layered data platforms (staging → raw → curated → analytics)
* Collaborate with Business Analysts and stakeholders to translate requirements into robust data models
* Define schema design, indexing, partitioning, and query optimization strategies in Spanner and BigQuery
* Establish data governance, security (IAM/RLS), metadata management, and data quality standards
* Ensure system scalability, reliability, and cost optimization aligned with GCP best practices
* Provide technical leadership and mentorship to data engineering teams
* Partner with enterprise teams to ensure compliance with security and data privacy standards
Required Skills & Experience
* 10+ years of experience in Data Engineering or Data Architecture
* 6+ years of hands-on experience with Google Cloud Platform (GCP)
* Strong expertise in Google Cloud Spanner (schema design, performance tuning, distributed architecture)
* Proven experience in Couchbase to Spanner migration (highly preferred – “bullseye” skill)
* Deep understanding of distributed databases and consistency models
* Expertise in BigQuery for analytical workloads
* Hands-on experience with Cloud Composer (Airflow) for orchestration
* Strong SQL skills and experience with data modeling (relational + NoSQL paradigms)
* Experience building enterprise-grade ELT pipelines
* Familiarity with data governance, cataloging, and metadata tools
* Strong leadership and stakeholder management skills
Nice to Have
* Experience with streaming frameworks (Pub/Sub, Dataflow)
* Exposure to insurance domain data models (Policy, Claims, Billing)
* Knowledge of hybrid transactional/analytical processing (HTAP) systems
* Certification in Google Cloud (Professional Data Engineer / Architect)
What We Offer
* Opportunity to work with a high-growth AI-first company
* Exposure to cutting-edge cloud, AI/ML, and data technologies
* Work with Fortune 500 clients and industry disruptors
* A collaborative, high-energy, and growth-driven culture