This site uses cookies. To find out more, see our Cookies Policy

Lead DevOps Engineer with Data Science focus (EMR ,Hive, Scala, Spark) in Atlanta, GA at Thompson Technologies

Date Posted: 2/5/2018

Job Snapshot

Job Description



Thompson Technologies is looking for a Lead DevOps Engineer with a Data Science focus for a 6+ month contract engagement here in Atlanta.  In this role, you will report to the Director of DevOps and provide a subject matter expertise as a bridge between the DevOps Team and Data Science Team.   

What you'll do:

  • Play the role of the hands-on subject matter expert between the DevOps team and Data Science
  • Understand the DevOps side of EMR, Spark, Cloud, Data Mining and Data Lakes
  • Correctly analyze, provide feedback and work the Data Science team on putting their Data Models into production
  • Work closely with data analysts to design and optimize data models
  • Mentor a team of more junior DevOps professionals
  • Grow and scale our data warehouse and data pipelines
  • Collaborate with peers across the company to tackle data needs

We're looking for someone who has:

  • Expertise in data platforms such as Amazon EMR, Hive, Spark, DataBricks, Hadoop, Batch / Stream Processing
  • Conduct Spark streaming tests
  • The ability to do some Scala code review and analysis (and some code) within Spark to troubleshoot and put Data Models into production.
  • Possess strong ETL pipeline analysis and development
  • Create well designed pipelines and data models that are extensible 
  • Enjoy documenting your work clearly and meticulously

Desired skills:

  • Solid statistical knowledge and are skilled in “R” or Python
  • Get excited about logging infrastructure, instrumentation, monitoring, and job scheduling
  • Love the challenge of smoothly integrating real time streaming ETL with batch pipelines

Qualified applicants can send their resumes to awaller@thompsontechnologies.com

Thompson Technologies has been named several times as one of the fastest-growing companies in the country by Inc. 500. We have recently been selected as one of Atlanta's 50 fastest growing companies by the Atlanta Business Chronicle! Our growth is due mainly to a partnering approach with our Clients. We are focused on making Clients successful, and we do it with honesty and integrity.