Overseas Contractor
Department Data Insights Group MOPS 5024
Location HybridRemote
Overview Responsibilities
Data plays a central role at Paramount Streaming and as part of the Data Insights Group DIG our Measurement Operations MOPS team plays a crucial part in the success of our streaming products It drives business product and operational decisions by providing rich data strategic insights and analytical products We are looking for an Analytics QA Engineer for Paramount Streaming who is passionate about data and entertainment and who thrives in a dynamic and fastpaced environment
Responsibilities
Execute functional regression exploratory and release validation testing on Roku applications across multiple Roku device models and OS versions
Conduct certification and compliance testing against Roku platform guidelines and publishing requirements
Validate video playback ad insertion DRM authentication subscription journeys and content discovery experiences
Verify analytics implementation and data tracking accuracy across Roku devices ensuring complete and reliable reporting
Perform regression testing and auditsdata integrity checks on a regular basis to have better control over the tags deployed across the sites
Conduct QA cycles and data audits to identify tracking gapsinconsistencies
Ensure test builds are delivered to collaborators and vendors needing to perform testing
Assist team in meeting established objectives and key results around data quality
Perform QA and signoff on new or updated implementations Prioritize tickets and call out blockers
Document sequence of QA steps and anticipated output on all tracking devices
Represent the Measurement Operations team in meetings as a domain specialist on data quality assurance
Open bugs as needed and shepherd them through resolution
Participate with product and engineering in sprint planning and bug triage efforts
Develop and maintain a robust library of test cases for both contemporaneous and newly introduced features of Paramount Streaming platforms
Work with SCRUM and Product leads to secure release timelines
Gen AI
Hands on experience to rewrite enrich and maintain manual test cases coverage clarity reusability using Claude or relevant data modle
Use GenAI to generate functional test cases from user storiesrequirements and expand edgenegative scenarios
Drive manual QA enrichment by adopting AI tools for test design scenario generation and test data suggestions
Ensure AI outputs are grounded using project context requirements past defects known issues via RAG concepts
Familiarity with Agentic AI frameworks task planning tool usage iterative refinement to improve test workflows
Basic familiarity with Docker to runvalidate AI utilities or test tooling in a containerized setup
Basic Qualifications
5 years of experience in Software Quality Assurance preferably in OTT Streaming Media Roku or Connected TV platforms
Handson experience testing Roku applications and Connected TV ecosystems
Strong understanding of Roku architecture SceneGraph framework and Roku device ecosystem
Experience validating video streaming adtech workflows DRM authentication and subscription models
Bug writing and ticket creation skills that result in comprehensive and accurate information for developers
Knowledge of how to monitor network traffic using proxying tools Charles Proxy Wireshark Chrome DevTools
Experience with QA in mobile applications andor CTV and Native platforms
AgileScrum experience and familiarity with JIRA and Confluence
Curiosity about learning about measurement tools eg Adobe Analytics Comscore Nielsen
Good Knowledge in Gen AI and latest tools which give tangible benefits
Additional Qualifications
STEM undergraduate degree
Attention to detail paired with a passion for achieving the utmost data integrity for our tracking
Ability to keep and maintain accurate notes and documentation
Testing experience with mobile applications and CTV and Native platforms using debugging tools eg ADBXcode
Knowledge of release and regression testing
Job Segment:
Testing, Quality Assurance, QA Engineer, Consulting, Engineer, Technology, Engineering, Service