
Remote Full-Stack Software Engineer (LLM Code Evaluation)
TURING ENTERPRISES, INC.
14m ago • Remote
Mid
Remote
200 - 300 USD/yr
Match your resume with similar open roles
Upload your resume to automatically match with active openings similar to this role.
Potential salary for Remote Full-Stack Software Engineer (LLM Code Evaluation) role
Improve your resume now
$200 – $300/year
Quick Facts
Role: Software Engineering evaluator (datasets and LLM code evaluation)
Work model: Remote (United States-based)
Availability: Minimum 10 hrs/week, up to 40 hrs/week
Contract duration: 1 month (possible extensions)
Description
As a Software Engineering evaluator, you will create datasets for training, benchmarking, and advancing large language models in close collaboration with researchers. You will curate code examples, provide precise solutions, and correct AI-generated code with an emphasis on systems-level correctness, performance, scalability, and reliability. You will also help design verification mechanisms and build agents that can assess software engineering task quality against benchmarks.
Responsibilities
Curate code examples and correct solutions in Python, C/C++, Rust, Go, Java, and JavaScript (including ReactJS)
Evaluate and refine AI-generated code for systems-level correctness, performance, and reliability
Collaborate with cross-functional teams to improve AI-driven coding solutions using industry benchmarks
Build agents to verify systems-level and infrastructure code and detect error patterns
Evaluate model capabilities across the software engineering cycle (prototyping, architecture/API design, production implementation, launch, experiments, monitoring, operational maintenance)
Design automated verification mechanisms for software engineering tasks
Requirements
3+ years of software engineering experience
Strong expertise in systems programming, infrastructure, or backend development (Python, C/C++, Rust, Go)
Experience building and deploying scalable, production-grade software with modern languages and tools
Deep understanding of software architecture, design, development, debugging, and code quality/review assessment
Excellent oral and written communication skills for clear evaluation rationales
United States-based
Flexible contractor commitment: minimum 10 hrs/week, up to 40 hrs/week
Completion of an AI video interview as part of the assessment process
Benefits
Flexible contractor engagement (no medical/paid leave)
Potential contract extension based on performance and fit
1-month initial duration
See similar jobs
Explore similar jobs and use your resume score to choose where to apply next
See more
Remote Full Stack Developer
TURING ENTERPRISES, INC.
Senior
Technology
Remote
N/A
15m ago

Remote Full-Stack Software Engineer (AI Code Evaluator)
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
1 days ago

Remote Full Stack Developer
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
15m ago

Remote Full Stack Developer
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
15m ago

Remote Full Stack Developer
TURING ENTERPRISES, INC.
Senior
Technology
Remote
N/A
1 days ago
Tailor Resume to fit the Job Offer
Use AI to find out how well the skills on your resume fit this job description.

Remote Full Stack Software Engineer
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
1 days ago

Remote Senior Software Developer
TURING ENTERPRISES, INC.
Senior
Technology
Remote
N/A
14m ago

Remote Backend Engineer (Python/FastAPI)
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
19m ago

Remote Full Stack Engineer
TURING ENTERPRISES, INC.
Mid
Technology
Remote
N/A
1 days ago
Unlock Full Resume Report
ATS Pass
Missing keywords
Tailored AI suggestions
Job match analysis
Interview-focused insights