As a Data Engineer, you will design, develop, and maintain scalable, high-performance batch and streaming data pipelines within the Google Cloud Platform ecosystem, ensuring robust data warehousing and seamless integration across systems.
Salary Package: Competitive salary based on your experience
Work Setup: Onsite - Cubao | Mandaluyong | Eastwood QC | Taguig
Responsibilities
- Design, develop, and maintain scalable batch and streaming data pipelines using GCP Dataflow (Apache Beam).
- Build robust ingestion frameworks to consume data from API endpoints, databases, and various file formats.
- Author, schedule, and monitor complex data workflows using Cloud Composer or Apache Airflow.
- Optimize data storage and retrieval in BigQuery while managing transactional data integrity within Cloud Spanner.
- Monitor pipeline health, troubleshoot data quality or performance bottlenecks, and tune complex SQL queries.
Qualifications
- Bachelor's Degree in a relevant field.
- Minimum of 2 years of experience working with Google BigQuery and the GCP ecosystem (Dataflow, Cloud Composer).
- Mastery of SQL (analytical and transactional) and proficiency in Python or Java.
- Strong understanding of data modeling, ETL/ELT processes, and real-time data streaming (Pub/Sub to Dataflow).
- Certifications or experience with Terraform, GitHub Actions, and GCP data governance/security practices are a plus.
- Must be willing to work on a shifting schedule across designated hubs (Cubao, Mandaluyong, Eastwood QC, or Taguig).
