Principal Quality Automation Architect

<h3>This is a remote position.</h3><div><b><b>Principal Quality Automation Architect</b></b><p>Reporting to Manager, Quality Engineering &amp; AI Validation, designs and scales Accordion's automated quality framework across products, services, and AI-enabled workflows. Owns the architecture behind automated validation, test harnesses, evaluation pipelines, test data strategy, and cross-pod tooling standards.</p><h3><b>Key Responsibilities</b><div>Automation Architecture<ul><li>Design and implement the core automation framework for functional, API, integration, regression, and workflow testing.</li> <li>Define standards for reusable test assets, environment usage, data setup, and evidence capture.</li> <li>Create scalable approaches to testing complex, multi-system workflows.</li> </ul><h3>AI Evaluation Infrastructure</h3><ul><li>Build and maintain regression harnesses for AI-enabled features, including prompt and workflow comparisons, scored evaluation runs, and benchmark execution.</li> <li>Partner with AI quality analysts to support rubric-based testing and measurable release criteria.</li> </ul><h3>Test Data &amp; Environment Strategy</h3><ul><li>Define approaches for test data, synthetic data, masked data, and scenario generation.</li> <li>Improve reliability and repeatability of validation environments.</li> </ul><h3>Engineering Partnership</h3><ul><li>Work closely with software engineers to improve testability, observability, CI/CD integration, and defect prevention.</li> <li>Help pods move quality checks earlier in the development lifecycle.</li> </ul><br><h3>Requirements</h3><h3><b>Required Qualifications</b><ul><li>7+ years of experience in QA automation, SDET, or quality engineering roles.</li> <li>Strong experience with test automation frameworks, API testing, CI/CD, and integration validation.</li> </ul></h3><h3>·Strong scripting or coding skills.</h3><ul><li>Experience working with data-intensive or workflow-heavy applications.</li> <li>Exposure to AI or LLM validation tooling or strong interest in building in that space.</li> <li>Ability to design frameworks, not just individual tests.</li> </ul><h3>·Bachelor's degree preferred.</h3><h3><b>Key Traits for Success</b></h3><h3>·Systems-minded and deeply technical.</h3><ul><li>Focused on scale, repeatability, and leverage.</li> <li>Comfortable setting standards others adopt.</li> <li>Practical about balancing sophistication with delivery pace.</li> </ul><br><h3>Benefits</h3><div>Base salary plus performance-based bonus.<div>Actual compensation packages are determined by evaluating a wide array of factors unique to each candidate, including but not limited to skill set, years and depth of experience, education, certifications, cost of labor, and internal equity.<br></div></div></div></h3></div><p>Originally posted on <a href="https://himalayas.app">Himalayas</a></p>