Cloud Data Engineer

Viewed 0 times

Job Description

Cloud Data Engineer

Our client is looking for an experienced Cloud Data Engineer to help port the existing on-premise Hive code to GCP BigQuery and further automate the generation of their customer-facing reports.

Here’s what you’ll be doing:

  • Reviewing existing processes via documentation and with D&A team to gain full understanding of as-is requirements
  • Porting of Hadoop Hive code to GCP BigQuery environment
  • Creatively designing and developing ways to make variants of the reports configurable
  • Designing, building and optimizing database table structure and ETL around reporting generation and configuration
  • Building a configuration management system for the process as a whole and for controlling the parameters of each report submitted for processing
  • Development of audit, exception tracing, and completion/failure notifications for report generation process
  • Automating the visualizations for each report based on parameters within the configuration
  • Working with other departments to coordinate data transfer process from customer to usage within report generation

Here’s what our ideal candidate has:

  • 2+ years of experience with Google BigQuery
  • 3+ years of experience with Python
  • Experience building software systems within a highly security-focused corporate environment

Benefits: Our IT consultants enjoy a wide array of benefits including: medical, dental, 401K, life insurance, and much more.

Search Millions of Jobs
Jobs by undefined

Job Summary

Atlanta, Georgia Location
Permanent Job Type