Senior Data Engineer

New York Permanent
  • Hybrid Work Environment
  • Strong Compensation Package

About Our Client

Our Client is the largest privacy-safe consumer search marketplace. They provide search advertising intergrations for mobile apps, browsers, browser applications, and consumer sites to connect directly to top brands once decision-making intent is expressed.

Job Description

MPI does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, disability, veteran status, marital status, or based on an individual's status in any group or class protected by applicable federal, state or local law. MPI encourages applications from minorities, women, the disabled, protected veterans and all other qualified applicants.

Description

  • Hands-on development and maintenance of ad-tech related data systems and system components using Java and other software technologies
    • Data streaming, processing, and aggregation solutions
    • Data-driven applications
    • 24/7 low latency large-scale distributed systems
    • Cloud migration and containerization projects
    • Clients integration automation components (Google, Amazon, LiveRamp)
  • Work with team for technical implementation of Data Engineering projects, including data streaming and aggregation pipelines
  • Work closely with QA, DevOps, and other engineering teams to integrate, test and release different system components (all stages of SDLC)
  • Solve complex technical challenges related to low latency large scale distributed systems
  • Work closely with business stakeholders and other engineers on understanding and translating business requirements into technical solutions

The Successful Applicant

  • 3+ years hands-on development experience using Java (Java 8+ preferred)
  • Experience with big data and streaming technologies like Apache Kafka, Apache Spark, Confluent Platform, Apache Storm, Hadoop and Zookeeper
  • Experience developing, delivering and maintaining scalable data streaming and aggregation pipelines
  • Experience with relational SQL and NoSQL databases
  • Ability to collaborate with multiple teams and understanding testing, hardware and deployment methodologies
  • Good understanding of object-oriented design patterns and effective use of data structures
  • Familiarity and hands-on experience with profiling, code efficiency, and testing/release concepts
  • Experience working in a Linux environment
  • Experience building software in continuous integration and delivery fashion in an automated way
  • Excellent documentation, communication, and troubleshooting skills

Nice to Haves:

  • Experience with data pipeline and workflow management tools (Airflow, Luigi, Azkaban, etc.)
  • Experience with AWS, RabbitMQ, MySQL, Vertica, and Aerospike
  • Experience with Spring or another dependency injection framework
  • Familiarity with Docker, CI/CD and Microservices
  • Scala and/or Python development experience
  • Experiences working in an Agile Software Development team using Jira
  • Digital advertising industry experience

This Candidate must be located in New York and be able to go into NYC office on a hybrid schedule

What's on Offer

  • Hybrid Work environment
  • 401k Match
  • Commuted Benefits
  • Competitive Health Benefits
Contact
Valerie Monsen
Quote job ref
JN-012022-4564795

Job summary

Sector
Information Technology
Sub Sector
IT Development
Industry
Media & Agency
Location
New York
Contract Type
Permanent
Consultant name
Valerie Monsen
Job Reference
JN-012022-4564795