AI/ML - Senior Software Engineer, ML Systems Evaluation Engineering

Job Description

Summary

Posted: Jun 20, 2022 Weekly Hours: 40 Role Number: 200379978 High-quality software and complex ML models require dynamic and sophisticated automation to evaluate them. The ML Systems Evaluation Engineering (ML SEE) team, within the AI/ML org at Apple, is looking for an exceptional Software Engineer to evaluate our systems and deliver the best experience for our customers across the world. This exciting role will bridge knowledge, and experience from software engineering to the ML world, combining the best of both to build robust, extensible and efficient systems to evaluate ML products at scale. In this role, you will have the opportunity to shape the vision of end-to-end automated systems evaluation methodology, for all Siri supported languages. You will have the opportunity to influence the design of Apple ML products, and ensure it is flexible to evaluate them at scale through high levels of automation. You will operate in a highly cross-functional environment to keep pushing the boundaries of existing tests automation and ML evaluation. If you are committed in delivering a first-class customer experience, and are a skilled and passionate software engineer, this role will give you an exciting opportunity to apply your expertise to an entirely new problem space.

Key Qualifications

Key Qualifications

• Proven track record in software development
• Strong experience developing applications using languages such as NodeJS and Python.
• Experience with Data services, Database Schema Creation (SQL, NoSql) and Databases like PostgreSQL, MySql and Redis.
• Experience with REST APIs.
• Solid experience with CI/CD using containers and tools like TeamCity or Jenkins.
• Experience with Cloud platforms such as AWS, GCP or Azure.
• Proven ability to define/design/develop/maintain end-to-end advanced engineering systems to support automation.
• Hands-on experience in defining evaluation plans with clear understanding of quality gates and metrics.
• Experience with quality assurance methodologies and automation frameworks.
• Experience with Agile Development methodologies.
• Fluent in English.

Description

Description In this role, you will develop solutions to deliver successful ML products for all Siri supported languages. These include design of automation frameworks and methodologies for simulation and evaluation of user experiences for ML based products; evaluation of personalization and scalability of the frameworks across locales. The role spans from AIML product qualification, implementation, feedback and iteration on systems, frameworks and evaluation methodologies, defining and tracking user impact and user success metrics. Equally, this role will participate in the AIML product specific roadmap decisions, contributing insights and recommendations derived from the in-depth understanding of the current success metrics of AIML products. Apple's most important resource, our soul, is our people. Apple benefits help further the well-being of our employees and their families in meaningful ways. No matter where you work at Apple, you can take advantage of our health and wellness resources and time-away programs. We’re proud to provide stock grants to employees at all levels of the company, and we also give employees the option to buy Apple stock at a discount — both offer everyone at Apple the chance to share in the company’s success. You’ll discover many more benefits of working at Apple, such as programs that match your charitable contributions, reimburse you for continuing your education and give you special employee pricing on Apple products. Apple benefits programs vary by country and are subject to eligibility requirements. Apple is an equal opportunity employer that is committed to inclusion and diversity. We take affirmative action to ensure equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Apple is committed to working with and providing reasonable accommodation to applicants with physical and mental disabilities. Apple is a drug-free workplace.

Education & Experience

Education & Experience B.S. or M.S. in Computer Science or related field

Additional Requirements

Additional Requirements

• Preferred
• Experience with Apple ecosystem.
• Experience working with Swift and XCTest.
• Experience with machine learning, NLP and NLU is a plus.
• Containers and Kubernetes.
• Experience with testing User Interfaces.
• Experience with logging and debugging tools i.e., Grafana, Splunk.
• Ability to debug issues specially in Unix base embedded software.