
Remote Full Stack Software Engineer (LLM Code Evaluation)
TURING ENTERPRISES, INC.
37m ago • Remote
Mid
Remote
200 - 300 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Remote Full Stack Software Engineer (LLM Code Evaluation) role
Improve your resume now
$200 – $300/year
Quick Facts
Role: Software Engineering evaluator (datasets for training/benchmarking LLMs)
Location: US-based (remote)
Engagement: Contractor, minimum 10 hrs/week up to 40 hrs/week
Duration: 1 month (potential extensions)
Description
You will create cutting-edge datasets for training, benchmarking, and improving large language models in close collaboration with researchers. The work includes curating code examples, providing precise solutions, and correcting AI-generated code with an emphasis on systems-level correctness, performance, scalability, and reliability. You will also help design verification mechanisms and evaluate model capabilities across the software engineering lifecycle.
Responsibilities
Curate code examples and provide/correct solutions in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS)
Evaluate and refine AI-generated code for systems-level correctness, performance, and reliability
Collaborate with cross-functional teams to improve AI-driven coding solutions against benchmarks
Build agents to verify the quality of systems-level and infrastructure code and identify error patterns
Evaluate model capabilities across the software engineering cycle (prototyping, architecture/API design, production implementation, launch, experiments, monitoring, operational maintenance)
Design automated verification mechanisms for software engineering tasks
Requirements
Several years of software engineering experience (3+ years)
Strong systems programming/infrastructure/backend expertise (Python, C/C++, Rust, Go)
Experience building and deploying scalable, production-grade software
Deep understanding of software architecture, design, development, debugging, and code quality/review assessment
Excellent oral and written communication skills
US-based; available as a contractor for at least 10 hrs/week
Completion of an AI video interview is required
Benefits
Flexible engagement (minimum 10 hrs/week, up to 40 hrs/week)
Contractor role with an initial 1-month duration and possible extensions based on performance and fit
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Remote Full Stack Engineer (Software Engineering Evaluator for LLM Code Tasks)
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
3 days ago

Remote Full-Stack Software Engineer (AI Code Evaluator)
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
5 days ago

Remote Full-Stack Software Engineer (LLM Code Evaluation)
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
4 days ago

Remote Full Stack Engineer
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
1 days ago

Remote Full Stack Developer
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
4 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Remote Full Stack Developer
TURING ENTERPRISES, INC.
Senior
Technology
Remote
N/A
4 days ago

Remote Backend Engineer (Python/FastAPI)
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
4 days ago

Remote Full-Stack Software Engineer (AI Code Evaluator)
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
39m ago

Remote Full Stack Developer (AI Code Evaluator)
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
39m ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights