Theorem Proving Model Evaluator Job at AuraOne Human Data, Remote

cGhQeTRXVEE1eEJVdFdRZTgyNjBPOGljTXc9PQ==
  • AuraOne Human Data
  • Remote

Job Description

Theorem Proving Model Evaluator is a remote review track for evaluating AI outputs across theorem proving model research review reasoning, calculations, and research workflows. Reviewers grade derivations and assumptions, reproduce key results, and document the correct method so the modeling team can train on it.

Why this role matters

Theorem Proving Model research review models live or die on whether their derivations actually hold up under scrutiny. AuraOne uses scientific specialists to grade outputs the way a peer reviewer would — checking assumptions, reproducing key steps, and capturing the right method alongside the wrong one.

Responsibilities

  • Review AI outputs against current theorem proving model research review methods, conventions, and prior work for Theorem Proving Model Evaluator assignments.
  • Reproduce or sanity-check key derivations, calculations, or experimental claims.
  • Flag dimensional, methodological, and citation errors with structured severity tags.
  • Capture the corrected reasoning or worked example so the modeling team can train on it.
  • Adjudicate disputed answers against textbooks, papers, or community standards.
  • Maintain reviewer-quality scores in inter-rater calibration cycles.

Qualifications

  • Graduate-level training or equivalent applied experience in theorem proving model research review or a closely related field for Theorem Proving Model Evaluator work.
  • Hands-on experience publishing, teaching, or advising on the topic at a professional level.
  • Comfort applying multi-page rubrics consistently across long batches.
  • Clear written reasoning that cites methods, papers, or worked examples.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Reproduce a theorem proving model research review derivation from a model output and flag any algebraic or dimensional errors.
  • Grade a model's literature summary against the cited papers and rate the citation quality.
  • Adjudicate a disputed answer between two reviewers using textbook methods.
  • Audit a 25-row batch for rubric consistency and report drift to the program lead.

Nice to have

  • PhD, postdoc, or industry research experience in the topic area.
  • Prior work reviewing AI-assisted research tooling and its failure modes.
  • Multilingual fluency for non-English papers and corpora.

Skills

  • Scientific reasoning
  • Method validation
  • Citation review
  • Quantitative analysis
  • Theorem Proving Model research review
  • Formal reasoning
  • Proof review
  • Theorem
  • Proving

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Job Tags

Remote job, Hourly pay, For contractors, 10 hours per week

Similar Jobs

State of Illinois

CONSENT AUTHORIZED AGENT Job at State of Illinois

 ...Illinois. Essential Functions Serves as Consent Authorized Agent. Serves as an advocate for children in DCFS care, making...  ...posting to begin the application process. If you are not already signed in, you will be prompted to do so. State employees should sign... 

ATC Columbia

Emergency Department (ER) Nurse PRN Job at ATC Columbia

ABOUT USFor more than 40 years, ATC Healthcare, a Joint Commission Certified Company, has provided leading nurses and healthcare professionals to hospitals and facilities nationwide. Healthcare systems around the U.S., including municipal health systems, multi-unit... 

Confidential

Managing Editor Job at Confidential

 ...Journal in beautiful Trinity County (far Northern California) is seeking a managing editor for its weekly newspaper, website and associated products. Working with two reporters, copy-editing and page production will take up 80-90% of your week. Wow us with what you can... 

HouseholdStaffing

Kid-Friendly Housekeeper in Miami, FL Job at HouseholdStaffing

 ...effectively with us about schedules, household needs, the children, and anything else important. 5. Dog walking There is a 12-pound, 10-year-old Cavapoo in the home who is very easygoing. She is not aggressive, loud, or rough and is easy to care for. They would need... 

College of the Holy Cross

Tenure-Track Faculty Position in Molecular Biology Job at College of the Holy Cross

 ...The Department of Biology at the College of the Holy Cross invites applications for a full-time tenure-track Assistant Professor or an untenured Associate Professor specializing in molecular biology to begin in August 2027. We are interested in candidates who can contribute...