Remote Full Stack Software Engineer (LLM Code Evaluation)

TURING ENTERPRISES, INC.

37m ago • Remote

Mid

Remote

200 - 300 USD/yr

  1. Select offer
  2. Add resume
  3. Analyze
  4. Improve
  5. Apply
  6. Auto-send · soon

Match your resume with similar open roles

Upload your resume to automatically match with active openings similar to this role.

PDF up to 10 MB

Your resume is private & secure

Or go to the original job offer

Potential salary for Remote Full Stack Software Engineer (LLM Code Evaluation) role

Improve your resume now

$200 – $300/year

Quick Facts

  • Role: Software Engineering evaluator (datasets for training/benchmarking LLMs)

  • Location: US-based (remote)

  • Engagement: Contractor, minimum 10 hrs/week up to 40 hrs/week

  • Duration: 1 month (potential extensions)

Description

You will create cutting-edge datasets for training, benchmarking, and improving large language models in close collaboration with researchers. The work includes curating code examples, providing precise solutions, and correcting AI-generated code with an emphasis on systems-level correctness, performance, scalability, and reliability. You will also help design verification mechanisms and evaluate model capabilities across the software engineering lifecycle.

Responsibilities

  • Curate code examples and provide/correct solutions in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS)

  • Evaluate and refine AI-generated code for systems-level correctness, performance, and reliability

  • Collaborate with cross-functional teams to improve AI-driven coding solutions against benchmarks

  • Build agents to verify the quality of systems-level and infrastructure code and identify error patterns

  • Evaluate model capabilities across the software engineering cycle (prototyping, architecture/API design, production implementation, launch, experiments, monitoring, operational maintenance)

  • Design automated verification mechanisms for software engineering tasks

Requirements

  • Several years of software engineering experience (3+ years)

  • Strong systems programming/infrastructure/backend expertise (Python, C/C++, Rust, Go)

  • Experience building and deploying scalable, production-grade software

  • Deep understanding of software architecture, design, development, debugging, and code quality/review assessment

  • Excellent oral and written communication skills

  • US-based; available as a contractor for at least 10 hrs/week

  • Completion of an AI video interview is required

Benefits

  • Flexible engagement (minimum 10 hrs/week, up to 40 hrs/week)

  • Contractor role with an initial 1-month duration and possible extensions based on performance and fit

See similar jobs

Explore similar jobs and use your resume score to choose where to apply next

See more

Unlock Full Resume Report