AI Engineer/ML Engineer - Senior Developers - AI Training - Louisville, US

About Prolific

Prolific is building a large pool of quality human data used by AI developers, researchers, and organizations to gather data from paid study participants with a wide variety of experiences, knowledge, and skills.

The Role

We're looking for AI and Machine Learning Engineers to join our Expert Network to help train and evaluate the next generation of LLMs using deep technical expertise. If you have the necessary experience, you'll complete a short assessment to evaluate your skills and suitability for AI tasks. Successful candidates will join as participants to help train and evaluate AI models through paid tasks.

Researchers looking for these skills tend to pay up to $80 per hour. Tasks may require one hour of uninterrupted work, though many are shorter.

What You'll Bring

• BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with a focus on Machine Learning
• Experience building, deploying, or fine-tuning ML models in a production environment
• Professional-level understanding of neural network architectures including Transformers, CNNs, and RNNs, as well as optimization techniques
• Hands-on experience with Prompt Engineering, RLHF (Reinforcement Learning from Human Feedback), or RAG (Retrieval-Augmented Generation) workflows
• Ability to audit complex model logic, identify training data contamination, and evaluate mathematical proofs behind ML algorithms
• High attention to detail in spotting hallucinations, biased outputs, or logical failures in AI-generated technical content

What You'll Be Doing in the Role

• Review AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy
• Validate ML-specific code such as training loops, preprocessing scripts, and model evaluations for efficiency and correctness
• Provide high-quality human feedback to improve alignment, safety, and helpfulness of AI models
• Assess how AI models handle complex chain-of-thought prompts and identify reasoning failures
• Conduct comparative testing between model outputs using technical taxonomies and performance metrics

Key Technologies

• PyTorch
• TensorFlow
• Keras
• Python
• NumPy
• Pandas
• Scikit-learn
• Hugging Face Transformers
• AWS SageMaker
• Google Cloud Vertex AI
• Weights & Biases
• LangChain
• Pinecone
• Milvus
• Weaviate

Why Join as a Participant

• Opportunity to influence future AI models using professional expertise
• Competitive pay rates
• Flexible hours
• Remote work opportunities
• Quick onboarding after passing the assessment

By submitting your application, you agree that Prolific may collect and process personal data for recruiting and organizational planning purposes.