Senior Spark & Python Developer Job at Mavens Guild, McLean, VA

K0ZFMHNVTWoxeWsvMkRJRVZ2WmxWRGthcHc9PQ==
  • Mavens Guild
  • McLean, VA

Job Description

What we would like to see:

In a senior developer role, you will design and build data flow and data integration processes to enhance loss prevention technologies for a leading financing firm. Drawing from your vast hands-on experience in Python (PySpark), Spark, REST, Java, and Scala, you will develop, test, and deploy end-to-end solutions using full-stack development tools within AWS (EMR, S3) cloud based infrastructure.

A typical day as a Senior Spark Programmer:

  • Develop fault tolerant, streaming as well as batch data integration processes using Spark/PySpark, Java and performance enhanced SQL

  • Develop and lead development efforts of application programming interfaces to enable integration of fraud detection systems with a host of new reporting and data mining tools

  • Design and develop automation of data flow tasks and end-to-end process testing

  • Design and develop scalable frameworks to ingest, transform, store, and present loss prevention information to downstream systems

  • Implement and lead implementation of Agile best practices and a continuous integration ecosystem

  • Implement and lead implementation efforts of Spark/Python based solution architecture, scalable process frameworks, advanced analytics, and responsive RESTful services

What you will need to bring to the table:

  • 5+ years experience with processing of structured, unstructured and semi-structured data using in-memory cluster computing technologies, specifically with Spark

  • 5+ years experience as a Java programmer

  • 3+ years experience programming in Python (PySpark API)

  • 3+ years experience with cloud services offered through AWE, like EMR, Redshift, or S3

  • 3+ years experience in developing, testing and deploying RESTful APIs for high volume data streams

  • Experience with continuous integration tools like Jenkins

  • Experience working in a distributed computing infrastructure like Hadoop and/or Spark

  • Critical and analytical approach to solving technical problems 

  • Excellent interpersonal skills and ability to clearly communicate highly technical concepts to business stakeholders and technical developers alike

Job Tags

Contract work,

Similar Jobs

Fujifilm

Product Owner Job at Fujifilm

**Position Overview**FUJIFILM North America Corporation is seeking a dynamic and experienced Product Owner to lead the development of a cutting-edge, multi-tenant web and mobile platform for photo e-commerce. This role will be a central figure, driving innovation with... 

HealthSource - America's Chiropractor

Associate Chiropractor Job at HealthSource - America's Chiropractor

 ...of pain and back to doing what they love through chiropractic, progressive rehab, spinal decompression, sports therapy, laser therapy, massage, orthotics, nutrition, and wellness products. If you are a new graduate, we want to meet you! You are a great fit for this role... 

Censeo Consulting Group

Deputy Chief Information Officer (CIO) for Data and AI - Department of State Job at Censeo Consulting Group

 ...Deputy Chief Information Officer (CIO) Lead - Department of State The Position: We are looking for eager, driven candidates with experience in people management, communication, facilitation, problem-solving, and analysis to guide our teams in developing impactful... 

Panhandle Cleaning & Restoration

Drywall Finisher and Painter Job at Panhandle Cleaning & Restoration

 ...~Competitive salary~Free uniforms~Paid time offExpanding disaster Restoration company is Seeking experienced drywall finishers and painters. Applicants must be professional at drywall finishing and be able to complete the task timely. At least 3 to 5... 

JG Custom Cabinetry & Design

Cabinet Builder Wood Worker Job at JG Custom Cabinetry & Design

 ...About the Job: We are looking to hire a skilled carpenter with knowledge of various carpentry techniques. You will be responsible for a variety of tasks including Building Cabinet components, finishing, cutting lumber, assembly of cabinets. Other duties will include assisting...