Comfrt CRO Specialist at Comfrt responsible for executing and managing the testing roadmap including A/B and multivariate tests. Collaborate with cross-functional teams to ensure quality and timely test launches.
Responsibilities
Experimentation Execution
Build and launch A/B and multivariate tests across web and mobile within our testing platform and CMS
Define what you’re measuring for each test before launch, understanding what metrics matter for that specific hypothesis.
Set up audience targeting and segmentation for each test based on test design requirements
Own test monitoring: ensure tests run cleanly, flag obvious data issues, validate test is hitting your sample size targets
Report test results to the CRO Manager with clear findings and action plan (raw data, what won/lost/was inconclusive)
Roadmap Execution & Health
Maintain the testing roadmap: keep it updated, track progress, and flag delays or blockers
Ensure tests launch on schedule and meet quality standards
Identify risks to the roadmap early (vendor delays, technical blockers, launch issues) and surface them immediately
Collaborate with design and development to keep test implementations on track
Experimentation Ideation
Qualification
2-3+ years in ecommerce CRO (agencyTesting platform expertiseMetrics literacyAnalytics comfortCMS platform experienceFront-end technical fluencyProject management chopsYou see blockers earlyWhat Success Looks Like
Required
2-3+ years in ecommerce CRO (agency, in-house, or DTC brand)
Testing platform expertise: you’ve owned, designed, and launched A/B tests, understand how to structure experiments
Metrics literacy: you know what metrics matter for different test types (CVR for conversion tests, AOV for pricing tests, etc.) and can read test results
Analytics comfort: you can read dashboards, spot obvious anomalies, ask clarifying questions about data
CMS platform experience: you can navigate and build tests in a modern CMS or testing tool
Front-end technical fluency: you can read HTML/CSS/JavaScript, communicate clearly with developers, spot implementation issues
Project management chops: you keep roadmaps tight, flag blockers early, coordinate across teams
Strong familiarity with Shopify ecosystem: You have a deep understanding of which vendor provides and it’s impact on an eCommerce business
Familiarity within key workflow tools such as Asana, Jira, & Clickup
Proactive and self-directed in fast-paced environments; eager to learn and grow the eCommerce function as the business scales
You see blockers early: Problem-solve autonomously, and view every experience as a learning opportunity
