Bilingual Japanese STEM Expert

Mercor is looking for a Bilingual Japanese STEM Expert with experience in biology / physics / chemistry theory and problem-solving to develop and refine high-quality reasoning questions that evaluate AI models. Your knowledge in biology / physics / chemistry will ensure the accuracy, rigor, and instructional quality of these test items. You will create and evaluate Japanese/English prompts and responses, ensuring scientific precision while maintaining clear, natural Japanese phrasing and alignment with English where needed.

*

Job Details

• Design and Optimize STEM-Based Prompts (Bilingual): Create detailed prompts in Japanese and/or English with multiple constraints and scientific instructions.

• Define and Document Evaluation Standards: Establish high-level expectations for correct responses in STEM contexts, and develop comprehensive rubrics that account for scientific rigor and—when in Japanese—linguistic clarity and appropriate academic tone.

• Conduct Model Testing and Grading (Bilingual): Run prompts through models and assess preliminary outputs against expectations for scientific accuracy, reasoning quality, and clarity, comparing Japanese vs. English where needed.

• Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific rigor, maintaining consistency and reliability across Japanese-language benchmarks before integration into official benchmarks.

*

Minimum Qualifications

• Native-level fluency in Japanese (written) with strong reading/writing ability in English

• BS or BA in Biology / Physics / Chemistry

• Familiarity with undergraduate-level biology / physics / chemistry topics

• Strong writing and critical thinking skills

• Ability to work independently and meet deadlines

*

Preferred Qualifications

• 2+ years of experience in teaching, research, or an applied STEM discipline field

*

Application & Onboarding Process

• Complete an AI-led interview (around 15 minutes)

• If approved, complete a paid assessment focused on writing and rubric creation

• Then, if selected, you will be invited to work on the project.

*

More Details About This Role

• Expect to contribute at least 20 hours per week

• Expect a commitment of around 1 month

• You’ll be working in a structured project environment with clear goals and tools

Compensation

• Pay: $38 – $43/hour
• Type: Hourly contract
• Location: Remote