Remote Full-Stack Software Engineer (LLM Code Evaluation)

TURING ENTERPRISES, INC.

14m ago • Remote

Mid

Remote

200 - 300 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Potential salary for Remote Full-Stack Software Engineer (LLM Code Evaluation) role

Improve your resume now

$200 – $300/year

Quick Facts

  • Role: Software Engineering evaluator (datasets and LLM code evaluation)

  • Work model: Remote (United States-based)

  • Availability: Minimum 10 hrs/week, up to 40 hrs/week

  • Contract duration: 1 month (possible extensions)

Description

As a Software Engineering evaluator, you will create datasets for training, benchmarking, and advancing large language models in close collaboration with researchers. You will curate code examples, provide precise solutions, and correct AI-generated code with an emphasis on systems-level correctness, performance, scalability, and reliability. You will also help design verification mechanisms and build agents that can assess software engineering task quality against benchmarks.

Responsibilities

  • Curate code examples and correct solutions in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS)

  • Evaluate and refine AI-generated code for systems-level correctness, performance, and reliability

  • Collaborate with cross-functional teams to improve AI-driven coding solutions using industry benchmarks

  • Build agents to verify systems-level and infrastructure code and detect error patterns

  • Evaluate model capabilities across the software engineering cycle (prototyping, architecture/API design, production implementation, launch, experiments, monitoring, operational maintenance)

  • Design automated verification mechanisms for software engineering tasks

Requirements

  • 3+ years of software engineering experience

  • Strong expertise in systems programming, infrastructure, or backend development (Python, C/C++, Rust, Go)

  • Experience building and deploying scalable, production-grade software with modern languages and tools

  • Deep understanding of software architecture, design, development, debugging, and code quality/review assessment

  • Excellent oral and written communication skills for clear evaluation rationales

  • United States-based

  • Flexible contractor commitment: minimum 10 hrs/week, up to 40 hrs/week

  • Completion of an AI video interview as part of the assessment process

Benefits

  • Flexible contractor engagement (no medical/paid leave)

  • Potential contract extension based on performance and fit

  • 1-month initial duration

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report