About the role
Design and build scalable| secure| and high performance data pipelines on GCP. Develop and optimize ETLELT workflows using Cloud Composer| Dataflow| Dataproc| and BigQuery. Implement data ingestion frameworks for batch and streaming data (PubSub| Kafka| Dataflow). Model| partition| and optimize datasets in BigQuery for analytics use cases. Collaborate with data scientists| architects| and business teams to deliver end to end data solutions. Ensure data quality| reliability| and robustness through monitoring| validation| and automation. Implement CICD pipelines for data workflows using Cloud Build| Git| and Terraform. Optimize cost| performance| and scalability across GCP data services. Ensure security best practices| IAM policies| and compliance with organization standards. Write and execute queries GCP Big query and execute along with analysis in ETL and DB testing| Data migration| Report validations Expert in writing understanding complex SQL queries. Design and execute test cases in a Big Data environment
About Tekgence Inc
We accelerate business transformation by solving complex technology, business and talent challenges. A digital transformation Partner and Global consulting firm transforming clients business, operating and technology models for the digital era. Strong experience to support the industry providing change management and business process improvement services with a specialist knowledge in Procurement, Supply Chain and Logistics.
Similar Jobs
About the role
Design and build scalable| secure| and high performance data pipelines on GCP. Develop and optimize ETLELT workflows using Cloud Composer| Dataflow| Dataproc| and BigQuery. Implement data ingestion frameworks for batch and streaming data (PubSub| Kafka| Dataflow). Model| partition| and optimize datasets in BigQuery for analytics use cases. Collaborate with data scientists| architects| and business teams to deliver end to end data solutions. Ensure data quality| reliability| and robustness through monitoring| validation| and automation. Implement CICD pipelines for data workflows using Cloud Build| Git| and Terraform. Optimize cost| performance| and scalability across GCP data services. Ensure security best practices| IAM policies| and compliance with organization standards. Write and execute queries GCP Big query and execute along with analysis in ETL and DB testing| Data migration| Report validations Expert in writing understanding complex SQL queries. Design and execute test cases in a Big Data environment
About Tekgence Inc
We accelerate business transformation by solving complex technology, business and talent challenges. A digital transformation Partner and Global consulting firm transforming clients business, operating and technology models for the digital era. Strong experience to support the industry providing change management and business process improvement services with a specialist knowledge in Procurement, Supply Chain and Logistics.