LLM Model Response Evaluation Job at Lifted, an Upwork Company™, Maryland

S2ZtSmxCOGFNNUM4UTFHWm9IUHlUem5USkE9PQ==
  • Lifted, an Upwork Company™
  • Maryland

Job Description



Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required 
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information



Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours:  Workload may vary weekly

Job Tags

Contract work, Remote work, Flexible hours

Similar Jobs

Talentgrator

Game Designer Job at Talentgrator

 ...looking for talented professionals to join us on our exciting growth journey. Key Responsibilities Create and develop slot game concepts from the initial idea through to successful release. Design game mechanics, bonus features, user flows, and the overall player exper...

Synergy Senior Management

Child & Play Therapist Job at Synergy Senior Management

Join a Growing Trauma-Informed Group PracticeCedar & Sage Therapy Group is seeking a compassionate, engaging, and clinically strong Child & Play Therapist to join our collaborative and supportive team.This role offers the opportunity to provide therapy in both outpatient... 

My Remote Jobz

Senior Social Media Account Manager Job at My Remote Jobz

 ...Our client, a leading Digital Marketing Agency is seeking a Senior Social Media Account Manager to join them on a full-time, permanent basis. Due to an exciting period of growth our client is looking to add a knowledgeable, experienced and driven Social Media professional... 

All Saints Insurance Agency

Front Office Coordinator - Be the Heart of Our Team Job at All Saints Insurance Agency

 ...based on performance~Competitive salary~Free food & snacks~Free uniforms~Opportunity for advancement~Paid time offEntry-Level Position No Insurance Experience Required (But a Plus!). Prior office experience is required.Important: Make sure you... 

Casa de Fruta

Amusement Train Conductor Job at Casa de Fruta

 ...safety of all passengers at all times, remain alert for safety issues and resolve any safety concerns before operating rides Operate train and carousel according to procedure at all times Provide a fun family atmosphere for all the visitors Maintain knowledge of...