Join Cognition as a QA Engineer to ensure product quality across AI workflows and contribute to innovative AI solutions.
Posted by employer 8 months ago
First seen on Joblaze 1 month ago
Last verified on the company career page 1 day ago
Skills & Technologies
What you'll build
Must have
Nice to have
Practical constraints
AI in the day-to-day
Building AI that can reason on real-world tasks.
Requirements
Not disclosed in this posting: compensation, work arrangement, visa sponsorship.
Joblaze summary
The QA Engineer at Cognition is responsible for ensuring the quality of AI workflows by testing various product features, including onboarding and multi-file edits. This role requires a strong foundation in testing methodologies and programming skills, particularly in Python or TypeScript, to effectively identify and document issues. Ideal candidates have over five years of experience in QA, with a user-centric approach to testing and a background in complex product workflows. The team is composed of highly skilled professionals from leading AI companies, fostering a challenging and innovative environment.
Joblaze insights
Quick facts
From the original posting
Own end-to-end product quality across AI workflows: Test Windsurf and Devin across onboarding flows, chat interactions, multi-file edits, agentic task execution, and autonomous workflows—thinking like a developer and testing like a user.
Design and execute comprehensive test strategies: Build and run functional, regression, integration, exploratory, and E2E test plans across product surfaces and releases.
Break down complex flows into testable scenarios: Identify edge cases, race conditions, state recovery failures, and real-world usage patterns that only emerge in production-like behavior.
Issue reproduction, documentation, and debugging: Reproduce, document, and debug issues across layers—distinguishing between UI defects, orchestration/system issues, and unexpected AI behavior; work with engineering and product to drive resolution.
Release readiness and quality bar ownership: Partner with engineering and product to define “done,” set quality standards, and ensure releases meet the expectations of real developers.
Build scalable QA processes and automation: Establish QA playbooks, test processes, and automation where it has leverage; help evolve CI/CD and testing practices as the product scales.
5+ years of QA/Test Engineering experience testing complex product workflows (multi-step user journeys, cross-surface interactions, and E2E behavior).
Deep expertise in functional, regression, exploratory, integration, and end-to-end testing methodologies.
Strong developer mindset: comfortable reading/writing code (Python, TypeScript, or similar), navigating codebases, and reasoning about systems.
User-first testing approach: you test from the perspective of real users, not just against a spec.
Exceptional attention to detail and strong debugging instincts; able to communicate clearly and precisely in bug reports and triage.
Familiarity with CI/CD and test automation frameworks; comfort working in fast-moving, release-driven environments.
Schedule flexibility: overlap with US time zones required; release cycles may require weekend availability.
Experience testing AI-powered products with non-deterministic outputs; ability to evaluate quality when responses vary.
Experience testing IDE plugins/extensions or developer tools (VS Code extensions, CLIs, code review systems).
Familiarity with AI coding tools (Windsurf, Copilot, Cursor, Devin, etc.) and informed opinions on what “good” looks like.
Prior software engineering background with shipped production code.
Standard company text repeated across Cognition's postings is omitted here.
Explore more