Internet-Native Bilingual Evaluator Expert (French)

Mercor is seeking Internet-Native Bilingual Evaluator Experts (French–English) to contribute to cutting-edge AI research focused on multilingual communication, internet culture, and real-world language use. This role is ideal for individuals who actively participate in both French- and English-language online communities and understand how internet culture, slang, humour, and social norms differ across languages.

Job Responsibilities

Evaluate Internet-Native Communication

• Analyse content from French- and English-speaking online communities.

• Evaluate AI outputs for linguistic accuracy, cultural relevance, and internet authenticity.

• Identify errors involving slang, memes, cultural references, sarcasm, and code-switching.

Develop Evaluation Standards

• Build evaluation rubrics for bilingual internet communication.

• Define expectations for culturally appropriate and platform-native language.

• Document linguistic and cultural edge cases.

Conduct Model Testing and Feedback

• Test language models using real-world bilingual prompts.

• Evaluate outputs in English and French.

• Provide detailed feedback to improve performance.

Support Quality Assurance

• Participate in QA reviews and benchmark creation.

• Ensure consistency across evaluators and datasets.

Minimum Qualifications

• Native or near-native fluency in French and professional fluency in English.

• Strong familiarity with online communities across France, Québec, Belgium, Switzerland, or other French-speaking regions.

• Active participation in internet culture across both languages.

• Strong writing, analytical, and critical thinking skills.

• Available to commit 10–20 hours per week.

Preferred Qualifications

• Background in linguistics, translation, localisation, social media, journalism, humanities, or AI evaluation.

• Familiarity with differences between European French, Québec French, and other French varieties.

• Experience evaluating online content and internet-native communication.

• Interest in AI and multilingual language technologies.

Compensation

• Pay: $50/hour
• Type: Hourly contract
• Location: Remote