New offer - be the first one to apply!
July 15, 2026
AI Trainer – Visual & Graphic Design Expert (Remote)
Mid • Remote
30 - 30 USD/hr
New York City, NY
Prolific is building a large pool of quality human data used by AI developers, researchers, and organizations to gather feedback from paid study participants.
The role
We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout, typography, and information density.
We need experts who can judge the professional utility, readability, and structural integrity of design outputs. This is a flexible, ad hoc project where your professional eye directly influences how AI understands design principles.
Researchers looking for your skills tend to pay up to 30 USD. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter.
What you'll bring
- Formal education in Graphic/Visual Design plus at least 1 year of professional experience OR 5+ years of high-level experience working with professional clients
- Familiarity with industry-standard tools including Figma, Adobe Photoshop, and Adobe Illustrator
- Ability to distinguish between consumer-grade and enterprise-ready content
- Portfolio or work samples required during screening
Bonus points
- Experience in Interaction Design or Motion Graphics
- Background in Brand Building, Advertising, or Marketing
What you'll be doing in the role
- Evaluate two candidate designs such as Google Slides, posters, or advertisements and determine which better meets professional standards
- Judge designs based on readability, text density, information hierarchy, and professionalism
- Review before-and-after edit request tasks to determine which AI output better satisfied a design change request
- Participate in experimental tasks focused on concise visual communication
Why join this project?
This project allows you to contribute expert design judgment to improve how AI systems understand visual communication and professional design standards.
Important
The use of LLMs or other generative AI tools to complete onboarding studies or evaluation tasks is strictly prohibited and will result in disqualification.
By submitting your application, you agree that Prolific may collect your personal data for recruiting and organizational planning purposes.
Similar jobs you might like
Technology
New offer

Prolific
AI Trainer – Visual & Graphic Design Expert (Remote) - San Francisco
Mid
Remote
San Francisco, CA
30 - 30 USD/hr
🏢 Summary: Remote AI evaluation project for experienced graphic and visual designers to assess and compare AI-generated design outputs based on professional design standards. The role involves analyzing readability, layout, typography, and information hierarchy in flexible, paid tasks. Candidates must have professional design experience and strong familiarity with industry-standard design tools. 🗂️ Requirements: Formal education in Graphic/Visual Design and at least 1 year of professional experience or 5+ years of professional client experience, Experience with Figma, Experience with Adobe Photoshop, Experience with Adobe Illustrator, Ability to evaluate professional design quality and readability, Portfolio or work samples required, Ability to complete focused evaluation tasks independently, Compliance with prohibition on generative AI tools during onboarding and evaluations 📃 Skills: Figma, Photoshop, Illustrator, Typography, Layout, Branding, Advertising, Marketing, Motion, Interaction 🏢 Description: About Prolific Prolific is building a global pool of high-quality human data used by AI developers, researchers, and organizations. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout, typography, and information density. We need experts who can evaluate the professional utility, readability, and structural integrity of design outputs. This is a flexible, ad hoc project where your professional expertise directly influences how AI understands design principles. Researchers looking for your skills tend to pay up to 30 USD. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter. What you'll bring - Professional design credentials: Formal education in Graphic/Visual Design plus at least 1 year of professional experience OR 5+ years of high-level experience working with professional clients - Technical literacy: Familiarity with industry-standard tools including Figma, Adobe Photoshop, and Adobe Illustrator - Ability to assess professional-grade readability, information hierarchy, and overall quality - Portfolio or work samples required during screening Bonus points: - Experience in Interaction Design or Motion Graphics - Background in Brand Building, Advertising, or Marketing What you'll be doing in the role - Evaluate two candidate designs and determine which better meets professional standards - Judge outputs based on readability, text density, information hierarchy, and professionalism - Review before-and-after design edit tasks to determine which output better satisfies requested changes - Participate in experimental tasks focused on concise visual communication Why join this project? This project provides an opportunity to contribute professional design expertise to the development of AI systems and visual communication standards. Important: The use of LLMs or other generative AI tools to complete onboarding studies or evaluation tasks is strictly prohibited and will result in disqualification. By submitting your application, you agree that Prolific may collect your personal data for recruiting and organizational planning purposes.
Technology
New offer

Prolific
AI Trainer – Visual & Graphic Design Expert (Remote) - Los Angeles
Mid
Remote
30 - 30 USD/hr
🏢 Summary: Remote AI evaluation project for experienced graphic and visual designers to assess AI-generated design outputs, including layouts, typography, readability, and professionalism. The role involves comparing design candidates, verifying design edits, and contributing expert feedback to improve AI understanding of design principles. Flexible, task-based work with paid one-hour evaluation tasks. 🗂️ Requirements: Formal education in Graphic/Visual Design and 1+ year professional experience or 5+ years high-level client experience, Portfolio or work samples, Experience with professional design standards, Familiarity with Figma, Familiarity with Adobe Photoshop, Familiarity with Adobe Illustrator, Ability to evaluate readability, information hierarchy, and professionalism, Availability for uninterrupted one-hour evaluation tasks 📃 Skills: Figma, Photoshop, Illustrator, Typography, Layout, Branding, Advertising, Marketing, Interaction, Motion 🏢 Description: About Prolific Prolific is building a global pool of high-quality human data used by AI developers, researchers, and organizations. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout, typography, and information density. We need experts who can judge the professional utility, readability, and structural integrity of design outputs. This is a flexible, ad hoc project where your professional expertise directly influences how AI understands design principles. Researchers looking for your skills tend to pay up to 30 USD. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter. What you'll bring - Formal education in Graphic/Visual Design plus at least 1 year of professional experience OR 5+ years of high-level experience working with professional clients - Familiarity with industry-standard tools including Figma, Adobe Photoshop, and Adobe Illustrator - Ability to distinguish between consumer-grade and enterprise-ready design content - Valid portfolio link or work samples required during screening Bonus points - Experience in Interaction Design or Motion Graphics - Background in Brand Building, Advertising, or Marketing What you'll be doing in the role - Evaluate two candidate designs such as Google Slides, posters, or advertisements and determine which better meets professional standards - Judge designs based on readability, text density, information hierarchy, and professionalism - Review before-and-after edit request tasks to determine which AI output better satisfied a design change request - Participate in experimental tasks focused on concise visual communication Why join this project? This project offers the opportunity to contribute expert insight to the development of AI systems for visual design. Important - The use of LLMs or other generative AI tools to complete onboarding studies or evaluation tasks is strictly prohibited and will result in disqualification. By submitting your application, you agree that Prolific may collect and process your personal data for recruiting and organizational planning purposes.
Technology
New offer

Prolific
AI Trainer – Visual & Graphic Design Expert (Remote) - San Francisco
Mid
Remote
30 - 30 USD/hr
🏢 Summary: Remote AI evaluation project for experienced graphic and visual designers to assess AI-generated design outputs, including layouts, typography, and readability. The role involves comparing design candidates, validating edit requests, and providing expert analysis to improve AI understanding of professional design standards. Flexible paid tasks are offered on an ad hoc basis. 🗂️ Requirements: Formal education in Graphic/Visual Design and 1+ year professional experience or 5+ years high-level client experience, Portfolio or work samples required, Familiarity with Figma, Familiarity with Adobe Photoshop, Familiarity with Adobe Illustrator, Ability to evaluate readability, typography, information hierarchy, and professionalism, Availability for tasks requiring up to one hour of uninterrupted work, No use of generative AI tools during onboarding or evaluation tasks 📃 Skills: Figma, Photoshop, Illustrator, Typography, Layout, Branding, Advertising, Marketing, Motion, Interaction 🏢 Description: About Prolific Prolific is building a large pool of quality human data used by AI developers, researchers, and organizations to gather insights from paid study participants. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout, typography, and information density. Experts are needed to judge the professional utility, readability, and structural integrity of design outputs. This is a flexible, ad hoc project where professional design expertise directly influences how AI understands design principles. Researchers looking for these skills tend to pay up to 30 USD. Tasks may require one hour of uninterrupted work, though many are shorter. What you'll bring - Professional design credentials: Formal education in Graphic/Visual Design plus at least 1 year of professional experience OR 5+ years of high-level experience working with professional clients - Technical literacy: Familiarity with industry-standard tools including Figma, Adobe Photoshop, and Adobe Illustrator - A critical eye for distinguishing between consumer-grade and enterprise-ready content - Portfolio: A valid portfolio or work samples are required during screening Bonus points - Experience in Interaction Design or Motion Graphics - Background in Brand Building, Advertising, or Marketing What you'll be doing in the role - Evaluate two candidate designs such as Google Slides, posters, or advertisements and determine which better meets professional standards - Judge designs based on readability, text density, information hierarchy, and professionalism - Review before-and-after edit request tasks to determine which AI output better satisfies requested changes - Participate in experimental tasks focused on concise visual communication Why join this project? This project offers an opportunity to contribute expert visual design knowledge to AI development by helping models understand the reasoning behind effective design. Important: The use of LLMs or other generative AI tools to complete onboarding studies or evaluation tasks is strictly prohibited and will result in disqualification. Joining the platform provides opportunities for competitive pay rates, flexible hours, and remote work. By submitting an application, candidates agree that personal data may be collected for recruiting and organizational planning purposes as described in the Candidate Privacy Notice.
Technology
New offer

Prolific
AI Trainer – Visual & Graphic Design Expert (Remote) - Boston
Mid
Remote
30 - 30 USD/hr
🏢 Summary: Remote AI evaluation project for experienced graphic and visual designers to assess AI-generated design outputs, including layouts, typography, readability, and professionalism. The role involves comparing and reviewing design candidates, verifying edit requests, and contributing expert feedback to improve AI visual communication capabilities. Flexible, task-based work with paid assignments requiring strong professional design judgment. 🗂️ Requirements: Formal education in Graphic/Visual Design and at least 1 year of professional experience or 5+ years of high-level client experience, Experience with professional design clients, Familiarity with Figma, Familiarity with Adobe Photoshop, Familiarity with Adobe Illustrator, Ability to evaluate readability, information hierarchy, and professionalism in designs, Portfolio or work samples required, Ability to complete tasks requiring one hour of uninterrupted work, No use of generative AI tools during onboarding or evaluation tasks 📃 Skills: Figma, Photoshop, Illustrator, Typography, Layout, Branding, Advertising, Marketing, Interaction, Motion 🏢 Description: About Prolific Prolific is building a large pool of quality human data used by AI developers, researchers, and organizations to gather feedback from participants with diverse experiences and skills. Description We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout, typography, and information density. Experts are needed to evaluate the professional utility, readability, and structural integrity of design outputs. This is a flexible, ad hoc project where professional feedback directly influences how AI understands design principles. Researchers looking for these skills tend to pay up to 30 USD. Tasks may require one hour of uninterrupted work, though many are shorter. What you'll bring - Formal education in Graphic/Visual Design plus at least 1 year of professional experience OR 5+ years of high-level experience working with professional clients - Familiarity with industry-standard tools including Figma, Adobe Photoshop, and Adobe Illustrator - Ability to distinguish between consumer-grade and enterprise-ready design content - Strong understanding of readability, text density, information hierarchy, and professionalism - Portfolio or work samples required during screening Bonus points - Experience in Interaction Design or Motion Graphics - Background in Brand Building, Advertising, or Marketing What you'll be doing in the role - Evaluate two candidate designs on the same topic and determine which better meets professional standards - Judge designs based on readability, text density, information hierarchy, and professionalism - Review before-and-after design edits to determine which output better satisfied a requested change - Participate in experimental tasks refining AI visual communication capabilities Why join this project? This project offers the opportunity to contribute expert insight into how AI understands and applies good design principles. Important - The use of LLMs or other generative AI tools to complete onboarding studies or evaluation tasks is strictly prohibited and will result in disqualification Privacy Notice By submitting an application, you agree that personal data may be collected for recruiting and organizational planning purposes as described in the Candidate Privacy Notice.
Technology
New offer

Prolific
AI Trainer – Visual & Graphic Design Expert (Remote)
Mid
Remote
30 - 30 USD/hr
🏢 Summary: Remote AI evaluation project for experienced graphic and visual designers to assess AI-generated design outputs for readability, hierarchy, professionalism, and usability. The role involves comparing and reviewing visual content, validating design edits, and contributing expert feedback to improve AI understanding of design principles. Flexible, paid tasks are offered on an ad hoc basis. 🗂️ Requirements: Formal education in Graphic/Visual Design and at least 1 year professional experience or 5+ years of high-level client experience, Experience with professional design clients, Familiarity with Figma, Familiarity with Adobe Photoshop, Familiarity with Adobe Illustrator, Ability to evaluate readability, typography, information hierarchy, and professionalism, Portfolio or work samples required, Ability to complete tasks requiring up to one uninterrupted hour, No use of generative AI tools during onboarding or evaluation tasks 📃 Skills: Figma, Photoshop, Illustrator, Typography, Layout, Branding, Advertising, Marketing, Motion, Interaction 🏢 Description: About Prolific Prolific is building a global pool of quality human data used by AI developers, researchers, and organizations. The role We are seeking Professional Graphic and Visual Designers to act as Domain Experts for a high-level AI evaluation project. AI models are evolving beyond simple image generation and now tackle complex design tasks such as layout, typography, and information density. We need experts who can judge the professional utility, readability, and structural integrity of design outputs. This is a flexible, ad hoc project where your professional expertise directly influences how AI understands design principles. Researchers looking for your skills tend to pay up to 30 USD. You must be prepared to complete paid tasks that require one hour of uninterrupted work, though many are shorter. What you'll bring - Professional design credentials: Formal education in Graphic/Visual Design plus at least 1 year of professional experience OR 5+ years of high-level experience working with professional clients - Technical literacy: Familiarity with industry-standard tools including Figma, Adobe Photoshop, and Adobe Illustrator - Ability to distinguish between consumer-grade and enterprise-ready content - Portfolio or work samples required during the screening process Bonus points: - Experience in Interaction Design or Motion Graphics - Background in Brand Building, Advertising, or Marketing What you'll be doing in the role - Evaluate two candidate designs such as Google Slides, posters, or advertisements and determine which better meets professional standards - Judge designs based on readability, text density, information hierarchy, and professionalism - Review before-and-after design edits to determine which AI output better satisfies a requested change - Participate in experimental tasks focused on concise visual communication Why join this project? This project offers an opportunity to contribute expert design judgment to the development of advanced visual AI systems. Important: The use of LLMs or other generative AI tools to complete onboarding studies or evaluation tasks is strictly prohibited and will result in disqualification. By submitting your application, you agree that Prolific may collect your personal data for recruiting and organizational planning purposes.
Technology
New offer

Prolific
Data Science & Analysis - AI Training - Fort Worth, US
Mid
On-site
Fort Worth, TX
🏢 Summary: Opportunity for experienced Data Scientists and Data Analysts to train and evaluate AI models through paid technical tasks focused on statistical analysis, machine learning, and LLM evaluation. Participants complete assessments and, if accepted, work flexibly on AI-related data tasks with compensation up to $80 per hour. 🗂️ Requirements: BS, MS, or PhD in Data Science, Statistics, Mathematics, or related quantitative field, Professional experience in data analysis, predictive modeling, or machine learning engineering, Ability to solve complex statistical problems independently, Experience interpreting advanced data visualizations, Strong attention to detail in statistical reasoning and data interpretation, Experience using LLMs in data workflows, Ability to explain mathematical concepts and data insights clearly, PayPal account for payment processing, Proficiency in Python or R, Advanced SQL skills 📃 Skills: Python, R, SQL, Pandas, NumPy, Scikit-learn, Tableau, PowerBI, Matplotlib, Seaborn, PyTorch, TensorFlow, MachineLearning, Statistics, LLMs 🏢 Description: About Prolific Prolific is building a large pool of quality human data for AI development. Over 35,000 AI developers, researchers, and organizations use the platform to gather data from paid study participants with a wide variety of experiences, knowledge, and skills. The role We're looking for Data Scientists and Data Analysts to join the Expert Network to help train and evaluate cutting-edge AI models using real technical expertise. Candidates complete a 10- to 15-minute assessment to evaluate their suitability for AI tasks. Successful participants are invited to join the platform and get paid to train and evaluate AI models. Researchers looking for these skills tend to pay up to $80 per hour. Participants must be prepared to complete paid tasks that require one hour of uninterrupted work, though many tasks are shorter. What you'll bring - BS, MS, or PhD in Data Science, Statistics, Mathematics, or a closely related quantitative field - Real-world experience in data analysis, predictive modeling, or machine learning engineering - Ability to solve complex statistical problems and interpret high-level data visualizations independently - Strong attention to detail and ability to identify subtle logical fallacies in statistical reasoning or data interpretations - Significant experience using LLMs to assist with data workflows and understanding of model hallucinations or failures - Ability to explain complex mathematical concepts or data insights clearly and concisely - PayPal account to receive payments What you'll be doing in the role - Review AI-generated data insights and statistical analysis for accuracy, clarity, and completeness - Validate mathematical proofs, statistical formulas, and data-driven conclusions using authoritative references - Execute Python or R scripts to verify correct outputs and edge-case handling - Identify strengths and weaknesses in AI reasoning through data problems and predictive models - Verify that model responses follow system guidelines and maintain professional technical standards Key Technologies - Python (Pandas, NumPy, Scikit-learn) or R - Advanced SQL for data extraction and manipulation - Tableau, PowerBI, Matplotlib, or Seaborn - Machine learning frameworks including PyTorch and TensorFlow - Statistical modeling techniques Why join as a participant Participants can help influence future AI models using professional expertise while benefiting from competitive pay rates, flexible hours, and remote work opportunities. By submitting an application, candidates agree that personal data may be collected for recruiting and organizational planning purposes as outlined in the Candidate Privacy Notice.
Technology
New offer

Prolific
Data Science & Analysis - AI Training - Seattle, US
Mid
On-site
Seattle, WA
🏢 Summary: Opportunity for Data Scientists and Data Analysts to evaluate and train AI models using statistical analysis, machine learning, and data validation expertise. The role involves reviewing AI-generated outputs, validating code and technical claims, and annotating model performance on a flexible, paid task basis. 🗂️ Requirements: BS, MS, or PhD in Data Science, Statistics, Mathematics, or related quantitative field, Professional experience in data analysis, predictive modeling, or machine learning engineering, Ability to solve complex statistical problems independently, Experience interpreting high-level data visualizations, Strong analytical and attention-to-detail skills, Experience using LLMs in data workflows, Ability to explain mathematical concepts and data insights clearly, PayPal account for payment processing, Proficiency in Python or R, Advanced SQL skills, Experience with data visualization tools, Knowledge of machine learning frameworks and statistical modeling 📃 Skills: Python, R, SQL, Pandas, NumPy, Scikit-learn, Tableau, PowerBI, Matplotlib, Seaborn, PyTorch, TensorFlow, MachineLearning, Statistics, LLMs 🏢 Description: About Prolific Prolific is building a global pool of high-quality human data used by AI developers, researchers, and organizations. The role We're looking for Data Scientists and Data Analysts to join an Expert Network to help train and evaluate cutting-edge AI models using real technical expertise. Candidates complete a 10- to 15-minute assessment to evaluate their skills and suitability for AI tasks. Successful participants are invited to complete paid tasks related to AI model training and evaluation. Researchers looking for these skills tend to pay up to $80 per hour. Tasks may require one hour of uninterrupted work, though many are shorter. What you'll bring - BS, MS, or PhD in Data Science, Statistics, Mathematics, or a closely related quantitative field - Real-world experience in data analysis, predictive modeling, or machine learning engineering - Ability to solve complex statistical problems and interpret high-level data visualizations independently - Strong attention to detail and ability to identify logical fallacies in statistical reasoning or data interpretation - Significant experience using LLMs to assist with data workflows and understanding of model limitations - Ability to explain complex mathematical concepts and data insights clearly and concisely - PayPal account to receive payments What you'll be doing in the role - Review AI-generated data insights and statistical analysis for accuracy, clarity, and completeness - Validate mathematical proofs, statistical formulas, and data-driven conclusions using authoritative references - Execute data-related scripts such as Python or R to verify correct outputs and edge-case handling - Identify strengths and weaknesses in model reasoning and predictive modeling approaches - Verify that AI model responses follow system guidelines and maintain professional technical standards Key Technologies - Python (Pandas, NumPy, Scikit-learn) - R - SQL - Tableau - PowerBI - Matplotlib - Seaborn - PyTorch - TensorFlow - Statistical modeling techniques Why join as a participant - Flexible hours and remote work - Competitive pay rates - Opportunity to contribute to future AI model development using professional expertise - Fast onboarding after passing the assessment By submitting your application, you agree that personal data may be collected for recruiting and organizational planning purposes as described in the Candidate Privacy Notice.
Technology
New offer

Prolific
Data Science & Analysis - AI Training - Oklahoma City, US
Mid
On-site
Oklahoma City, OK
🏢 Summary: Opportunity for Data Scientists and Data Analysts to train and evaluate AI models through technical review, validation, and annotation tasks. The role involves analyzing AI-generated outputs, validating statistical and machine learning results, and working with data-related code using Python, R, SQL, and ML frameworks. Flexible remote work with paid AI training tasks and competitive hourly compensation. 🗂️ Requirements: BS, MS, or PhD in Data Science, Statistics, Mathematics, or related quantitative field, Professional experience in data analysis, predictive modeling, or machine learning engineering, Ability to solve complex statistical problems and interpret data visualizations independently, Strong attention to detail and analytical reasoning, Experience using LLMs in data workflows, Ability to explain mathematical concepts and data insights clearly, PayPal account for payments, Proficiency in Python or R, Advanced SQL skills, Experience with data visualization tools, Understanding of machine learning frameworks and statistical modeling 📃 Skills: Python, R, SQL, Pandas, NumPy, Scikit-learn, Tableau, PowerBI, Matplotlib, Seaborn, PyTorch, TensorFlow, MachineLearning, Statistics 🏢 Description: About Prolific Prolific is building a large pool of quality human data for AI development. Over 35,000 AI developers, researchers, and organizations use the platform to gather data from paid study participants with diverse experiences and skills. The Role We're looking for Data Scientists and Data Analysts to join the Expert Network to help train and evaluate AI models using technical expertise. Candidates who meet the experience requirements will complete a short assessment to evaluate their suitability for AI tasks. Successful applicants will join as participants and get paid to train and evaluate AI models. Researchers seeking these skills may pay up to $80 per hour. Participants must be prepared to complete paid tasks that may require one hour of uninterrupted work, although many tasks are shorter. What You'll Bring - BS, MS, or PhD in Data Science, Statistics, Mathematics, or a related quantitative field - Real-world experience in data analysis, predictive modeling, or machine learning engineering - Ability to solve complex statistical problems and interpret high-level data visualizations independently - Strong attention to detail and ability to identify logical fallacies in statistical reasoning or data interpretation - Significant experience using LLMs in data workflows and understanding of common model hallucinations or failures - Ability to explain complex mathematical concepts and data insights clearly and concisely - PayPal account to receive payments What You'll Be Doing - Review AI-generated data insights and statistical analysis for accuracy, clarity, and completeness - Validate mathematical proofs, statistical formulas, and data-driven conclusions using authoritative references - Execute Python or R scripts to verify outputs and edge case handling - Identify strengths and weaknesses in AI reasoning for data problems and predictive modeling - Ensure model responses follow system guidelines and maintain professional technical standards Key Technologies - Python (Pandas, NumPy, Scikit-learn) or R - Advanced SQL for data extraction and manipulation - Tableau, PowerBI, Matplotlib, or Seaborn for visualization - PyTorch, TensorFlow, and statistical modeling techniques Benefits - Flexible remote work - Competitive pay rates - Opportunity to contribute to AI model development - Fast onboarding process after assessment
Technology
New offer

Prolific
Data Science & Analysis - AI Training - Jacksonville, US
Mid
On-site
Jacksonville, FL
🏢 Summary: Opportunity for Data Scientists and Data Analysts to train and evaluate AI models through technical review, statistical validation, and machine learning analysis tasks. The role involves assessing LLM outputs, validating code and data insights, and contributing expertise on a flexible paid basis with rates up to $80 per hour. 🗂️ Requirements: BS, MS, or PhD in Data Science, Statistics, Mathematics, or related quantitative field, Professional experience in data analysis, predictive modeling, or machine learning engineering, Ability to solve complex statistical problems independently, Experience interpreting high-level data visualizations, Strong attention to detail in statistical reasoning and data interpretation, Significant experience using LLMs in data workflows, Ability to explain mathematical concepts and data insights clearly, PayPal account for receiving payments, Proficiency in Python or R, Advanced SQL skills, Experience with data visualization tools, Knowledge of machine learning frameworks and statistical modeling 📃 Skills: Python, R, Pandas, NumPy, Scikit-learn, SQL, Tableau, PowerBI, Matplotlib, Seaborn, PyTorch, TensorFlow 🏢 Description: About Prolific Prolific is building a large pool of quality human data for AI development. Over 35,000 AI developers, researchers, and organizations use the platform to gather data from paid study participants with a wide variety of experiences, knowledge, and skills. The role We're looking for Data Scientists and Data Analysts to join the Expert Network to help train and evaluate cutting-edge AI models using real technical expertise. Candidates complete a 10- to 15-minute test to assess skills and suitability for AI tasks. Successful applicants are invited to participate in paid AI training and evaluation projects. Researchers looking for these skills tend to pay up to $80 per hour. Tasks may require one hour of uninterrupted work, though many are shorter. What you'll bring - Education: a BS, MS, or PhD in Data Science, Statistics, Mathematics, or a closely related quantitative field. - Professional Experience: real-world experience in data analysis, predictive modeling, or machine learning engineering. - Technical Rigor: ability to solve complex statistical problems and interpret high-level data visualizations independently. - Analytical Mindset: strong attention to detail with the ability to identify subtle logical fallacies in statistical reasoning or data interpretations. - LLM Fluency: significant experience using LLMs to assist with data workflows, with a clear understanding of where these models typically hallucinate or fail. - Communication: ability to explain complex mathematical concepts or data insights clearly and concisely. - A PayPal account to receive payment from clients. What you'll be doing in the role - Evaluate LLM Responses: review AI-generated data insights and statistical analysis for accuracy, clarity, and completeness. - Fact-Check Technical Claims: use authoritative references to validate mathematical proofs, statistical formulas, and data-driven conclusions. - Validate Code & Outputs: execute data-related scripts (e.g., Python/R) to ensure they produce correct results and handle edge cases properly. - Annotate Model Performance: identify strengths and weaknesses in how a model reasons through data problems or builds predictive models. - Ensure Alignment: verify that model responses follow specific system guidelines and maintain a high standard of professional technical behavior. Key Technologies - Programming: proficiency in Python (Pandas, NumPy, Scikit-learn) or R. - Data Querying: advanced SQL for complex data extraction and manipulation. - Visualization: experience with tools like Tableau, PowerBI, or Matplotlib/Seaborn. - Modeling: understanding of machine learning frameworks (PyTorch, TensorFlow) and statistical modeling techniques. Why join as a participant Joining the platform gives participants the chance to influence future AI models using professional expertise. After passing the assessment, participants can start working with flexible hours, remote work options, and competitive pay rates. The platform connects researchers and companies with a global pool of participants to collect ethically sourced human behavioral data and feedback for AI system development. By submitting an application, applicants agree that personal data may be collected for recruiting and organizational planning purposes as described in the Candidate Privacy Notice.
Technology
New offer

Prolific
Data Science & Analysis - AI Training - San Francisco, US
Mid
On-site
San Francisco, CA
🏢 Summary: Opportunity for Data Scientists and Data Analysts to train and evaluate AI models through paid remote tasks focused on statistical analysis, machine learning, and LLM evaluation. Participants complete technical assessments and contribute to validating AI-generated insights, code, and predictive modeling outputs. Flexible work with compensation up to $80 per hour. 🗂️ Requirements: BS, MS, or PhD in Data Science, Statistics, Mathematics, or related quantitative field, Professional experience in data analysis, predictive modeling, or machine learning engineering, Ability to solve complex statistical problems independently, Experience interpreting high-level data visualizations, Experience using LLMs in data workflows, Ability to explain mathematical concepts and data insights clearly, Proficiency in Python or R, Advanced SQL skills, Experience with data visualization tools, Understanding of machine learning frameworks and statistical modeling, PayPal account for payments 📃 Skills: Python, Pandas, NumPy, Scikit-learn, R, SQL, Tableau, PowerBI, Matplotlib, Seaborn, PyTorch, TensorFlow 🏢 Description: About Prolific Prolific is building a large pool of quality human data used by AI developers, researchers, and organizations to train and evaluate AI systems. The role We're looking for Data Scientists and Data Analysts to join an Expert Network to help train and evaluate cutting-edge AI models using real technical expertise. Candidates complete a short skills assessment and, if successful, join as paid participants to train and evaluate AI models. Researchers looking for these skills tend to pay up to $80 per hour. Tasks may require one hour of uninterrupted work, though many are shorter. What you'll bring - BS, MS, or PhD in Data Science, Statistics, Mathematics, or a closely related quantitative field - Real-world experience in data analysis, predictive modeling, or machine learning engineering - Ability to solve complex statistical problems and interpret high-level data visualizations independently - Strong attention to detail and ability to identify logical fallacies in statistical reasoning or data interpretations - Significant experience using LLMs to assist with data workflows and understanding model limitations - Ability to explain complex mathematical concepts or data insights clearly and concisely - PayPal account to receive payment What you'll be doing in the role - Review AI-generated data insights and statistical analysis for accuracy, clarity, and completeness - Validate mathematical proofs, statistical formulas, and data-driven conclusions using authoritative references - Execute data-related scripts such as Python or R to verify correct outputs and edge case handling - Identify strengths and weaknesses in model reasoning and predictive modeling - Verify model responses follow system guidelines and professional technical standards Key Technologies Programming: - Python - Pandas - NumPy - Scikit-learn - R Data Querying: - SQL Visualization: - Tableau - PowerBI - Matplotlib - Seaborn Modeling: - PyTorch - TensorFlow - Statistical modeling techniques Benefits - Competitive pay rates up to $80 per hour - Flexible hours - Remote work from home - Opportunity to contribute to the development of future AI systems Privacy Statement By submitting your application, you agree that Prolific may collect your personal data for recruiting and organizational planning purposes. Prolific's Candidate Privacy Notice explains how personal information may be processed and your rights regarding that information.