Job Summary

Senior Data Engineer – (NYC) – Conduct technical design, development & implementation of applications using Amazon Web Services (AWS) platform. Identify & analyze data processing req’ts for subscriber, open market, & attribution data. Identify how data flows between different components, the security schemes to be applied, & apply data accessibility automation techniques to determine who can access data & in what detail. Research & prototype new data processing tools, frameworks & patterns to build sustainable big data platform. Create logical & physical data models & Entity Relationship (ER) diagrams, & design data flow diagrams, data pipe lines, state diagrams, & sequence diagrams. Design complex data models for real-time & offline analytics processing & integrate data from other sources for optimal data quality & accessibility standards. Analyze existing data flow routines. Develop & maintain production data pipelines in AWS. Develop & implement complex software solutions by integrating data from structured & semi-structured sources, web logs & streaming applications using HIVE, Hadoop, AWS-S3, AWS-Athena, Spark, Scala, & AWS Redshift. Develop & implement complex & large scale data models & data application pipelines in AWS-Athena, AWS-Redshift, MySQL, & Dynamo DB. Develop & build scalable infrastructure & platform for data ingestion, transformation & aggregation using data pipelines built w/ AirFlow, Java, & Python. Req’s: Bachelor’s degree in Computer Engineering or Computer Science, plus five yrs of post-Bachelor’s progressive exp in position offered or in a software development position. Six months of the req’d exp must have included developing & maintaining production data pipelines in AWS; developing & implementing software solutions by integrating data from structured & semi-structured sources, web logs, & streaming applications using HIVE, Hadoop, & AWS Big Data Stack (AWS-S3, AWS-Athena, Spark, Scala, & AWS Redshift); developing & implementing data models & data application pipelines in AWS-Athena, AWS-Redshift, MySQL, & Dynamo DB; developing & building scalable infrastructure & platform for data ingestion, transformation & aggregation using Java & Python; & researching & prototyping data processing tools, frameworks & patterns to build a sustainable big data platform. Mail resume to: Edward Stelz, Employer, 1100 Ave of the Americas, New York, NY 10036.

T Jobs. Keywords: Data Engineer, Location: New York, NY – 10036

Search for more jobs