Google Cloud Platform Data Lead – XFORIA Inc

Job Title: Sr. Data Engineer with Google Cloud Platform Cloud.

Location: Dallas, TX (Hybrid)

Mode: Contract

 

Description:

  • Hands on exp in constructing Real Time Event data consumption and transformation pipelines over the Google Cloud Platform that consumes data from Pubsub
  • Hands on exp in Streaming Data Flow jobs creation over Google Cloud Platform using Custom Templates,
  • Able to create Java based Data pipeline creation using Apache Beam (Python knowledge required)
  • Constructing the Apache Beam based templates that help to deploy over the Google Cloud Platform Data Flow
  • Knowing the Apache Flink is an added advantage.
  • Capturing metrics to measure the Pipelines’ throughput and peak capacity
  • Able to create the CI/CD pipelines to deploy over the Google Cloud Platform Composer(Airflow)
  • Knowledge about GCS, BigQuery, Cloud Functions

Read more here: Source link