AI Model Evaluator Jobs
AI Model Evaluator jobs are open across technology, research, and professional services, from entry-level contractor roles to senior and staff positions, with specializations in RLHF annotation, safety evaluation, and instruction-following assessment. See the openings below and apply to the ones that match your experience.
Find AI Model Evaluator JobsLooking for remote work? View remote AI model evaluator jobs →Overview
Showing 5 of 138+ AI Model Evaluator jobs
Wyetech is a small business founded in June 2007, built on a simple vision that hasn’t changed since day one: hire awesome people, compensate them well, and channel their enthusiasm into making customers happy. That commitment shows up in our benefits, including a best-in-class retirement plan: Wyetech contributes the equivalent of 20% of your salary to your SEP IRA, helping you build real long-term financial security. Our mission is to give employees the best possible environment to thrive while delivering stellar services and solutions for our customers and their missions. We call it engineering happiness: for our customers, and shared by the talented team that makes it happen.
Principal Network Evaluator – Computer Network Defense
Job Description
Wyetech is seeking a motivated Principal Network Evaluator with strong networking knowledge to support a Computer Network Defense mission. The Evaluator will work closely with Government stakeholders to identify network vulnerabilities, investigate cyber threats, conduct network defense operations, and provide actionable recommendations that strengthen enterprise security and mission capabilities.
Job Responsibilities
Mission Focus
Conduct proactive computer network defense activities by analyzing systems and networks to identify vulnerabilities.
Detect network intrusions and monitor security events.
Assess attack surfaces and develop operational courses of action to mitigate cyber threats.
Technical Proficiency
Perform vulnerability assessments using industry-standard tools and techniques.
Analyze network routing devices, traffic, and audit logs.
Conduct packet analysis.
Research emerging technologies and vulnerabilities.
Support digital forensics and exploitation analysis.
Document analytic findings and produce comprehensive reports and recommendations for Government stakeholders.
Required Skills/Qualifications
Bachelor's degree plus eleven (11) years of relevant experience, or equivalent.
Strong networking knowledge, including Cisco, Juniper, and Arista devices and protocols.
Strong analytical and problem-solving skills.
Experience with computer network defense, vulnerability assessment, incident response, packet analysis, SIEM technologies, and cybersecurity analysis.
Experience researching system vulnerabilities and developing mitigation strategies.
Practical experience with Splunk and Elastic.
Desired Skills
Previous Hunt/Blue Team experience.
Knowledge of Network Defense Integrity (NDI) Methodology.
Knowledge of digital forensics, intrusion detection systems, and vulnerability scanning technologies.
Knowledge of MITRE ATT&CK and NIST cybersecurity frameworks.
Knowledge of scripting languages.
Experience with Wireshark, tcpdump, or similar network analysis and SIEM tools.
Relevant cybersecurity certifications (Security+, CySA+, GCIH, GCIA, GCFA, CISSP, or equivalent).
Clearance Requirements
TS Clearance with Customer Appropriate Polygraph
Due to federal contract requirements, United States Citizenship and position-appropriate security clearance are required.
Benefits
Wyetech provides a generous PTO plan of up to 200 hours annually, aligned with applicable state leave regulations. Employees have the flexibility to adjust their PTO allocation at the start of each calendar year, ensuring it meets their evolving needs.
Full-time employees have the option to participate in a variety of voluntary benefit plans including:
A Choice of Medical Plan Options, some with Health Savings Account (HSA)
Vision and Dental
Life and AD&D Benefits
Short and Long-Term Disability
Hospital Indemnity, Accident, and Critical Illness Insurances
Optional Identity Theft and Legal Protection Services
Employee Referral Bonus Eligibility up to $10,000
Mobility Among Wyetech-supported Contracts
Various contract and work locations throughout Maryland, Virginia, Colorado, Texas, Utah, Alaska, Hawaii and OCONUS
Various team-building events throughout the year such as: monthly lunches, summer company picnic, and an annual holiday party.
Employees receive two complementary branded clothing orders annually.
Salary Range
$86.66–$117.35 USD Hourly
Hourly pay rates listed for this position serve as a general guideline and are not a guarantee of compensation. Compensation will vary dependent upon factors including but not limited to: Government contract rates; education; relevant prior work experience, knowledge, skills, and competencies; certifications, and geographic location. Hourly pay rates reflect the pre-benefit gross wage amounts.
Wyetech, LLC is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Affirmative Action Statement:
Wyetech, LLC is committed to the principles of affirmative action in all hiring and employment for minorities, women, individuals with disabilities, and protected veterans.
Accommodations:
Wyetech, LLC is committed to providing an inclusive and accessible hiring process. If you need any accommodations during the application or interview process, please contact Brittney Wood at 844-WYETECH x727 or staffing@wyetech.com. We are happy to provide reasonable accommodations to ensure equal access to all candidates.
Wyetech, LLC is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Affirmative Action Statement:
Wyetech, LLC is committed to the principles of affirmative action in all hiring and employment for minorities, women, individuals with disabilities, and protected veterans.
Accommodations:
Wyetech, LLC is committed to providing an inclusive and accessible hiring process. If you need any accommodations during the application or interview process, please contact Brittney Wood. at 844-WYETECH x727 or staffing@wyetech.com. We are happy to provide reasonable accommodations to ensure equal access to all candidates.
Wyetech Terms and Conditions:
1. Wyetech may reach out to you via SMS messages during the course of your Wyetech candidacy.
2. You can cancel the SMS service at any time. Just text "STOP" to the short code. After you send the SMS message "STOP" to us, we will send you an SMS message to confirm that you have been unsubscribed. After this, you will no longer receive SMS messages from us. If you want to join again, just sign up as you did the first time and we will start sending SMS messages to you again.
3. If you are experiencing issues with the messaging program you can reply with the keyword HELP for more assistance, or you can get help directly at IT@wyetech.com, 844-WYETECH (844-993-8324).
4. Carriers are not liable for delayed or undelivered messages
5. As always, message and data rates may apply for any messages sent to you from us and to us from you. If you have any questions about your text plan or data plan, it is best to contact your wireless provider.
6. If you have any questions regarding privacy, please read our privacy policy below.
Privacy Policy:
We collect your mobile number and related opt-in data for the delivery of SMS messages. Your mobile opt-in data and consent will not be shared with third parties or affiliates for marketing or promotional purposes.
gDCpRhnnxz
See All 138+ AI Model Evaluator Jobs
Find roles that match your experience and apply in just a few clicks.
Find AI Model Evaluator JobsAI Model Evaluator Job Market
Who's Hiring
- MRG EXAMS11
- Family of Kidz9
- DATA QUEST INVESTIGATIONS8D
- JPMorganChase6
- Grand Canyon University6
Top Industries Hiring
- Technology & Software
- Healthcare & Medical Services
What Employers Look For
The qualifications that appear most often in AI model evaluator jobs.
- Strong written communication skills and ability to produce clear, structured analytical rationales
- Experience with human feedback collection, preference ranking, or comparative evaluation tasks
- Familiarity with large language model outputs and common failure modes such as hallucination or refusal errors
- Bachelor's degree or equivalent experience in a relevant field such as linguistics, computer science, or a domain specialty
- Ability to follow detailed annotation guidelines consistently and flag ambiguous cases accurately
- Comfort working independently on asynchronous tasks with high attention to detail and low error rates
Tips for Your AI Model Evaluator Job Search
Tailor your resume to evaluation tasks
Highlight specific types of content you've rated or ranked, such as code, long-form text, or multimodal outputs. Generic 'data annotation' language undersells your fit. Name the evaluation frameworks or rubrics you've applied, even if the project was freelance or contract.
Show your reasoning process clearly
Many ai model evaluator job postings require a sample task or written rationale during screening. Practice articulating why one model response is better than another using concrete criteria, not gut instinct. Interviewers want to see structured comparative judgment, not vague preferences.
Target postings by domain specialty
If your background is in medicine, law, or software engineering, filter openings for those domain-specific evaluator roles. Companies building vertical AI products actively seek subject-matter evaluators who can catch factual errors a generalist would miss.
Apply early to roles that fit
Migrate Mate lists ai model evaluator openings from across the United States in one place, so you can find roles that match and apply directly to each listing.
Prepare for calibration-style interview tasks
Expect to receive a live or take-home evaluation exercise where you rate or rewrite model outputs. Interviewers check whether your scores align with internal guidelines. Review any publicly available evaluation rubrics from AI labs before your interview to sharpen your calibration.
Negotiate rate and scope before accepting contracts
Many ai model evaluator roles start as hourly contracts with variable task volume. Before accepting, ask about the guaranteed weekly task load, rate review schedule, and whether full-time conversion is a realistic path so you don't underestimate the commitment.
AI Model Evaluator Jobs: Frequently Asked Questions
Which companies are hiring the most ai model evaluators?
The companies hiring the most ai model evaluators right now include MRG EXAMS, Family of Kidz, and DATA QUEST INVESTIGATIONS, with the largest share of openings in New York, Texas, and Ohio, based on current listings on Migrate Mate as of November 2026. Demand is concentrated at AI labs, cloud platform providers, and specialized data annotation vendors.
How many ai model evaluator jobs are remote?
About 33% of ai model evaluator openings are fully remote or hybrid as of November 2026, making it one of the more remote-accessible roles in the AI sector. Fully asynchronous evaluation work, such as preference ranking and instruction-following assessment, tends to be the most location-independent subset of the role.
How do you become an ai model evaluator?
Start by building familiarity with how large language models respond to prompts and where they commonly fail. Take on freelance annotation or evaluation contracts to develop hands-on experience with rubric-based rating tasks. Document your reasoning process carefully in every project, because demonstrating calibrated judgment is the core hiring signal for this role.
Can you get hired as an ai model evaluator with little experience?
Yes, many entry-level ai model evaluator roles prioritize clear analytical writing and domain knowledge over prior AI experience. A strong writing sample that walks through why one response is better than another can substitute for a formal portfolio. Contract and project-based roles are common entry points that convert to longer engagements once you demonstrate reliable calibration.
What does the ai model evaluator interview process look like?
Most ai model evaluator interviews include a written screening task where you rate or compare model outputs using provided guidelines. This is followed by a calibration review where a hiring team member checks whether your scores align with internal benchmarks. Some roles add a short video or async call to discuss your reasoning before an offer is extended.
Where can I find and apply to ai model evaluator jobs?
You can find and apply to ai model evaluator jobs on Migrate Mate, which lists current openings from across the United States. Search for roles that match your domain background and seniority level, then apply directly to each listing that fits.
See All 138+ AI Model Evaluator Jobs
Find roles that match your experience and apply in just a few clicks.
Find AI Model Evaluator Jobs