- They are seeking a detail-oriented Freelance Coding QA Analyst to manage testing and onboarding processes, ensuring quality standards in technical data annotation projects and providing insights for optimizing annotation pipelines
- Coordinate quality standards, guideline updates, and feedback loops across QAs, experts, and vendors to ensure consistent interpretation and execution
- Coordinate coding pilot projects for new potential partners
- Design unique pilot pipelines to test potential partners
- Assign coding tasks ensuring alignment with agreed languages (primarily Python, Java, or JavaScript)
- Create and manage collaboration platform spaces for partners during pilots and handle task-related queries
- Ensure task designs allow for comparison of model-generated answers and prompt engineering assessment (when needed)
- Prepare reports and recommendations to inform vendor and partnership decisions
Serve as the primary point of contact for partner and expert queries during pilot and production phases