Engineering Manager, Big Data Real-time Platform

Job Description

Groupon’s mission is to become the daily habit in local commerce and fulfill our purpose of building strong communities through thriving small businesses by connecting people to a vibrant, global marketplace for local services, experiences and goods. In the process, we’re positively impacting the lives of millions of customers and merchants globally. Even with thousands of employees spread across multiple continents, we still maintain a culture that inspires innovation, rewards risk-taking and celebrates success. If you want to take more ownership of your career, then you're ready to be part of Groupon.

The Real-time Platform Team is responsible for the shared data streaming pipeline that generates operational and business metrics in real time at Groupon. We work primarily on open source tech stacks to design and build out features in one or more open source projects including (but not limited to) Kafka, Storm, Elastic Search, Hadoop, Mesos, ZooKeeper, Redis, HBase, Cassandra, and Spark.

As the manager of the team, you'll get to work on pushing Groupon’s real-time platform infrastructure to the next level. Our team's work will be used not only by other teams throughout the Groupon engineering and business communities but you will have the opportunity to lead a team of phenomenal engineers. In this management position, you will lead the design, implementation, and administration of large scale real-time streaming infrastructure and related technologies. The engineers on this team work on a wide ranging feature set: self service capabilities for provisioning data streams, register source types, metadata instrumentation, dynamic query framework, streaming analytics as service, RESTful APIs, metrics caching, and consolidating disparate real-time pipelines to a common scalable architecture that's used for streaming business metrics currently. The real-time platform at Groupon helps our business customers as well as the Engineering teams to solve for real-time analytics problem space, business intelligence, machine learning and many other challenges we tackle in surfacing relevant content and offers to our consumers.

You will spend your time on the following:

• To be successful, you will demonstrate leadership, technical and teamwork skills to deliver and maintain the Real-time infrastructure, enhancing existing infrastructure, and sustaining operations. And also:
• Define unified streaming strategy for on-prem and Cloud-agnostic deployments. Formulate a sound technical and operational strategy for balancing on-prem vs. Cloud footprint to get the best of both worlds.
• Work cooperatively with product management, business teams, Data Science, Search and Relevance teams to drive customer engagement, requirements and roadmap formulation, define and deliver successful technical solutions, architecture improvements and technical reviews.
• Lead the development team of highly capable engineers with expertise in delivering big data analytics in real-time.
• Define the Operational Excellence and develop the Operational Readiness to be reviewed in the areas of the big data platform.
• Development and architecture knowledge of the overall Kafka, Storm, Spark Streaming, Redis and Hadoop eco-system we use at scale.

We are excited to talk to you if you have:

• 6 or more years of experience in engineering, distributed real-time data processing at scale.
• At least 4 years of experience in designing, implementing and operationalizing real-time big data analytics systems.
• Proven ability to adapt to a dynamic project environment and lead multiple projects at a time.
• Proven ability to collaborate with application development and other cross functional teams.
• Ability to coach and provide mentorship to junior team members.
• Ability to evaluate the risks and have strong decision-making skills in a dynamic environment.
• BS in Computer Science or other technical field.

Key leadership skillset needed in the following areas:

• Hands-on experience in Kafka, Storm and Spark Streaming at scale (preferably Petabyte scale).
• Hands-on experience in Hadoop ecosystem.
• Excellent leadership and interpersonal skills.
• Strong analytical and interpersonal skills.
• Involvement on Open source products/technologies development is an excellent plus.

Groupon provides a global marketplace where people can buy just about anything, anywhere, anytime. We’re enabling real-time commerce across an expanding range of categories including local businesses, travel destinations, consumer products, and live or lively events. At the same time, we are providing advertising options and tools that merchants can use to grow and manage their businesses. Culturally, we believe that great people make great companies and that starting with the customer and working backward moves us forward. Community matters to us on an internal, local and global scale—it’s fundamental to our company’s growth and to the well-being of the world at large. We also value self-awareness, candor, lunch and WiFi. If we match with you, please apply to join us.