Data Scientist (Part-Time | Remote | $100 $120/hr ) (San Francisco) Job at Call For Referral, San Francisco, CA

M3hldTczM0pOSHd6K0tHQ1NzcTZBOXRT
  • Call For Referral
  • San Francisco, CA

Job Description

Data Scientist (Part-Time | Remote | $100 $120/hr )

Join to apply for the Data Scientist (Part-Time | Remote | $100 $120/hr ) role at Call For Referral

Base pay range

$100.00/hr - $120.00/hr

Mercor Partnership

Mercor is partnering with a leading AI research lab to hire experienced Data Scientists specializing in AI task evaluation and statistical analysis .

In this role, you will conduct comprehensive failure analysis on AI agent performance across finance-sector tasks identifying systemic patterns, diagnosing performance bottlenecks, and improving model evaluation frameworks.

Youll work closely with AI engineers and research analysts to transform raw evaluation data into actionable insights, strengthening the quality, fairness, and reliability of large-scale AI systems.

Key Responsibilities

  • Statistical Failure Analysis: Identify recurring patterns in AI agent failures across task components (prompts, rubrics, file types, tags, etc.).
  • Root Cause Analysis: Determine whether issues stem from task design , rubric clarity , file complexity , or agent limitations .
  • Dimensional Analysis: Examine performance variations across finance sub-domains , file structures, and evaluation criteria.
  • Visualization & Reporting: Build dashboards and analytical reports that highlight edge cases, performance clusters, and opportunities for improvement.
  • Framework Enhancement: Recommend refinements to rubric design, evaluation metrics, and task structures based on empirical findings.
  • Stakeholder Communication: Present key insights to data labeling teams, ML engineers, and research collaborators .

Required Qualifications

  • Strong foundation in statistical analysis, hypothesis testing, and pattern recognition .
  • Proficiency in Python (pandas, scipy, matplotlib/seaborn) or R for data analysis.
  • Handson experience with exploratory data analysis (EDA) and feature interpretation .
  • Understanding of AI/ML evaluation methodologies and LLM performance metrics .
  • Skilled in using Excel , SQL , and data visualization tools (e.g., Tableau, Looker).

Preferred Qualifications

  • Experience with AI/ML model evaluation or quality assurance pipelines .
  • Background in finance or interest in learning financial domain structures.
  • Familiarity with benchmark datasets , failure mode analysis , and evaluation frameworks .
  • 24 years of relevant professional experience in data science, analytics, or applied statistics.

More About the Opportunity

  • Commitment: Parttime, 2025 hours/week
  • Schedule: Fully remote and asynchronous work on your own time
  • Duration: 12 months, with strong potential for extension
  • Start Date: Immediate

Compensation & Contract Terms

  • Hourly Rate: $100$120/hour (based on experience and region)
  • Payments: Weekly via Stripe Connect for approved work

PS: Mercor reviews applications daily. Please complete your interview and onboarding steps to be considered for this opportunity.

Seniority level

  • Mid-Senior level

Employment type

  • Parttime

Job function

  • Engineering, Information Technology, and Finance
  • Internet Publishing

Referrals increase your chances of interviewing at Call For Referral by 2x

#J-18808-Ljbffr

Job Tags

Hourly pay, Contract work, Immediate start, Remote work,

Similar Jobs

Endress+Hauser Group

Business Associate - NEXUS Job at Endress+Hauser Group

What is the role about?Join Endress+Hausers NEXUS program as a Business Associate and embark on a transformative journey to develop essential business skills and gain exposure across departments and functions. Through a personalized 612month program designed for new... 

Sterling Engineering

Food Scientist (Addison) Job at Sterling Engineering

 ...Title: R&D Specialist (Food) Location: Addison, IL Hire Type: Direct Hire Compensation: $65k - $80k Job Summary The...  ...The ideal candidate brings strong hands-on experience in food manufacturing, meat processing, and recipe development for scalable production... 

Boston Proper

Assistant Merchant Job at Boston Proper

We hold our people, our customers, and our brand in the highest regard. Our people drive our businesses, so we strive to attract the best in our industry. They have different life experiences, educational and cultural backgrounds, but they share many things in common: ...

AthletiCo

Front Office Coordinator Job at AthletiCo

 ...Patient Experience Coordinator Reporting to the Clinic Manager, the Patient Experience Coordinator is the owner of the patient's first and last impression and front-office experience and delivers first-class customer service throughout the patient's physical therapy... 

Chick-fil-A

Miembro del Equipo de Recepcin (Dias y Noches) at Chick-fil-A Edwardsville, IL Job at Chick-fil-A

OverviewMiembro del Equipo de Recepcin (Das y Noches) en Chick-fil-A Edwardsville, IL. Descripcin: Estamos buscando miembros del equipo de recepcin para dar la bienvenida y saludar a los invitados, tomar y preparar los pedidos en el mostrador o en autoservicio, mantener...