AI/ML- Senior System Evaluation Engineer, Siri

Job Description

Summary

Posted: May 5, 2022 Weekly Hours: 40 Role Number: 200354576 High-quality software and complex ML models require dynamic and sophisticated automation to evaluate and validate. The ML System Evaluation Engineering (ML SEE) team within the AI/ML org at Apple is looking for an exceptional engineer to evaluate our Machine Learning systems and deliver the best customer experience. This exciting role will bring best practices, knowledge, and experience from traditional software engineering to the machine learning world, and combine the best of both to build robust, extensible and efficient systems and processes to evaluate ML at scale. In this role, you will have the opportunity to design, plan and implement the evaluation strategy of cutting-edge client based ML products. You will work closely with software engineers to enhance evaluation methodology to build fast and secure client based ML products. You will operate in a highly cross-functional environment to keep pushing the boundaries of existing automation and ML evaluation. If you are committed in delivering first class customer experience, and you have a background in both traditional software and machine learning, this role will give you an exciting opportunity to apply your skills to an entirely new problem space.

Key Qualifications

Key Qualifications

• 7+ years of proven ability to define/design/develop/maintain test automation using any combinations of Swift (XCTest), Objective-C, Python or Java
• Experience in defining evaluation plan with clear sign off quality gates and metrics
• Solid experience with CI/CD automation tools such as TeamCity or Jenkins
• Ability to think out of box in solving problems and logically explain proposal to stakeholders
• You are self-motivated, adaptable and results oriented with positive attitude

Description

Description We are looking for a motivated and results-oriented individual with positive attitude who has excellent communication and problem-solving skills. You must enjoy working on multiple concurrent projects in a fast-paced environment that nurtures growth, collaboration, and innovation. Some of your responsibilities may include: *Using xCode in daily basis to write XCTest in achieving optimal automation coverage *Drive projects and learn about the new features in order to define evaluation strategy *Implement evaluation strategy with maximum level of automation to achieve high efficiencies and sustainability *Through our CI/CD platform to create and maintain stable automation pipelines for regular release sign off cadence *Involve in hands on evaluation work in early development cycle follow by automation *Escalate issues to engineering team for quick turn around fixes *Lean resource planning in meeting project requirements and execute timely

Education & Experience

Education & Experience B.Sc. or M.Sc. in Computer Science, Computer Engineering or related field.

Additional Requirements

Additional Requirements

• Experience with Apple ecosystem is a plus
• Experience in statistical evaluation for machine learning models and features
• Experience with troubleshooting automation runs in 24/7 lab environment
• Experience with logging and debugging tools i.e Splunk
• Ability to debug issues specially in Unix base embedded software