Theorem Proving Model Evaluator Job at AuraOne Human Data, Remote

MnJDUHJ0NDg2YTZsaTFaei9iWFh3YmJET0E9PQ==
  • AuraOne Human Data
  • Remote

Job Description

Theorem Proving Model Evaluator is a remote review track for evaluating AI outputs across theorem proving model research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Theorem Proving Model research review models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities

  • Review AI outputs against current theorem proving model research review methods, conventions, and prior work for Theorem Proving Model Evaluator assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Graduate-level training or equivalent applied experience in theorem proving model research review or a closely related field for Theorem Proving Model Evaluator work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Reproduce a theorem proving model research review derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Theorem Proving Model research review
  • Formal reasoning
  • Proof review
  • Theorem
  • Proving

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Job Tags

Remote job, Hourly pay, For contractors, 10 hours per week

Similar Jobs

Dress A Med

Dress A Med - Fashion Marketing & Advertising - Paid Internship Job at Dress A Med

 ...seeking PAID interns. The Dress A Med Studio internship is a significant opportunity to learn...  ..., promotions, visual presentation and marketing are streamlined through the department....  ...Film & New Media Majors IMPORTANT!Our summer internship program is highly competitive... 

Portland Utilities Construction Co., LLC

Dump Truck Driver - CDL Job at Portland Utilities Construction Co., LLC

 ...customers throughout the world. We are currently looking for a Dump Truck Driver with a Valid Class A CDL license to join our team in...  ...to advance water and sewer pipe installation. Candidates with experience driving commercial motor trucks with different trailer... 

ICON plc

Clinical Research Associate Job at ICON plc

 ...Clinical Research Associate - Multi Therapeutic Area (Early Development) - West Region ICON plc is a world-leading healthcare intelligence and clinical research organization. Were proud to foster an inclusive environment driving innovation and excellence, and we welcome... 

Programmers.io

ServiceNow Developer Job at Programmers.io

ROLE_DESCRIPTION "Responsibilities: ServiceNow Configuration: Perform hands-on configuration and customization of the ServiceNow...  ..., project, and upgrade. Integration Development: Design, develop, and maintain integrations using ServiceNow Workflow Data... 

HackerOne

Global Benefits Senior Manager Job at HackerOne

 ...HackerOne is a global leader in Continuous Threat Exposure Management (CTEM). The HackerOne Platform unites agentic AI solutions with the ingenuity of the worlds largest community of security researchers to continuously discover, validate, prioritize, and remediate...