Experimentation Program Manager -- A/B Testing, Product Analytics

Job Description

Requisition Number: SS-16726
Area of Interest: Information Technology
Organization: Corporate
Brand/Division: Shared Services
Position Type: Full-time
JOB DESCRIPTION
Williams-Sonoma, Inc.
Experimentation Program Manager -- A/B Testing, Product Analytics
A Little Bit About Us...
You will be a key part of the Product team that is responsible for conceptualizing, designing and optimizing the customer experience and business technology innovations that drive Williams-Sonoma Inc.'s industry-leading multi-channel retail business. You'll be working with amazing peers, cutting-edge technologies and deep resources to help push the boundaries of product innovation. To learn more about our team, our values and our culture please check out our team site.
About The Job...
The Program Manager, Experimentation, will conceptualize and execute digital A/B and multivariate testing strategies designed to improve site performance and the relevancy of our on-site experience to customers. This person will define both the long-term roadmap and manage day to day strategy and execution of our A/B testing efforts with significant opportunities to drive positive KPI growth. This role reports to the Director of Product Analytics and Experimentation.
Responsibilities Include:
* Drive the strategic vision of all facets of the A/B Testing program for the West Elm brand to increase company ROI. Collaborate with a cross functional team of analysts, site management, creative and IT to ensure roadmap aligns with business strategies and goals.
* Create and execute test and campaigns using Adobe Target and homegrown A/B testing solution, enlisting IT development resources for more complicated functional test treatments.
* Identify testing opportunities using test results analysis and other data touchpoints (user experience, analytics reporting, behavioral tools, etc.). Drive stakeholders to ideate about site opportunities and future test plans.
* Define KPIs and metrics for tests as well as developing performance analysis that drives action. Ensure test results drive future optimization ideas.
* Monitor all metrics related to test results. Provide recurring performance reporting and postmortem test analysis to executives and stakeholders on a timely basis. Drive action, as needed, based on test results and that are aligned with the business mission.
* Develop and document testing processes and best practices to further improve campaign creating quality and efficiency.
* Work with the rest of the web analytics team to foster a culture of data-driven decision making across e-commerce that encourages validating or disproving assumptions about how we believe customers may react to various site experience scenarios.
* Size and scope testing opportunities, which should include a business case, an execution plan, and stakeholder buy-in.
* Regular, dependable attendance & punctuality.
* Manage test ideas, ideates tests and roadmap prioritization.
* Ensure Campaign Integrity lifecycle.
* Utilize Confluence to maintain a brand aligned test calendar, test log and reporting.
REQUIREMENTS AND QUALIFICATIONS
Qualifications
* 5+ years working in an A/B testing related function including campaign implementation and analysis.
* Experienced in utilizing statistical concepts for A/B test analysis: Statistical significance, confidence intervals, and establishing variance thresholds are a must.
* Relevant experience working with web analytics, personalization and testing tools: Experience with at least one web analytics tool (Adobe Analytics, Google Analytics, or similar) and one testing tool (Target, Optimizely, or similar) required.
* Understands behavioral segmentation concepts and can dig into test results via Adobe Analytics and clickstream data with guidance from the analytics team.
* Self-starter who can ramp up quickly and thrive in a fast-paced environment.
* Strong attention to detail and organizational skills to manage multiple work requests.
* Excellent communication skills and ability to interact with all levels of end users and technical resources. Comfortable presenting program strategy and results to senior management.
* Strong problem-solving capabilities and a curious nature.
* High energy and results oriented with a passion for the role. Looking to drive improvements and change.
* Bachelor's Degree in Business Management, Marketing, Math, economics or equivalent.
* Retail e-Commerce experience preferred.
Williams-Sonoma Inc. is an Equal Opportunity Employer
Williams-Sonoma, Inc. is an Equal Opportunity Employer.
Williams-Sonoma, Inc. will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance, or other applicable state or local laws and ordinances.