Job Description

Lead Data Engineer (Senior Platform Engineer) Chicago, IL (Onsite)

Specialization

• 1. AWS Data Engineering Basic: Lead Data Engineer with Spark/Scala + Java + Kafka + AWS
  
  

Job requirements

• 1. Bachelor's in Computer Science, Engineering, or related technical discipline or equivalent combination of training and experience
  
  

• 1. 10+ years programming experience: building application frameworks, and back-end systems for high-volume pipelines using Go/Java/Python. Python/Java preferred.
  
  

• 1. 10+ years' experience building data frameworks, platforms and scaling them to large volume of data using message brokers. Kafka experience is must.
  
  

• 1. 5+ years' experience building streaming platform using Apache Kafka, Confluent Kafka, AWS Managed Kafka Service.
  
  

• 1. 5+ years' experience ingesting data from SQL Server/My SQL/Oracle using Change Data Capture, debezium, and Kafka Connect.
  
  

• 1. 2 years' experience using AWS Data Services: any combination of DMS, EMR, Glue, Athena, S3, CloudWatch, Lambda or IAM
  
  

• 1. 1-year exp. with data architecture, ETL and processing of structured and unstructured data
  
  

• 1. 2 years' experience with DevOps tools (any combination of GitHub, TravisCI or Jira) and methodologies (Lean, Agile, Scrum, Test Driven Development)
  
  

Employers have access to artificial intelligence language tools (“AI”) that help generate and enhance job descriptions and AI may have been used to create this description. The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

• Dice Id: 91128521
• Position Id: OOJ - 3194-2195-1733776832

Job Tags

Similar Jobs