Back to jobs

In-House Counsel (United Kingdom)

Weekday (YC W21)
Remote (United Kingdom)Contract

Upload your resume once and Scout applies for you

Apply with Scout
Share this job:LinkedInXSave image

Full description

This role is for one of our clients

Compensation: $150-$160 per hour

We are seeking experienced in-house legal counsel based in the United Kingdom to support a legal AI benchmarking initiative focused on evaluating how effectively AI systems handle real-world questions involving UK law.

As an expert reviewer, you will assess responses generated by two AI platforms, compare their legal reasoning and conclusions, and evaluate each response against a standardized rubric. Your professional expertise will help establish reliable benchmarks for the quality, accuracy, and practical relevance of AI-generated legal work.

Requirements

Key Responsibilities

• Run identical legal prompts across two AI/LLM platforms.

• Review and compare AI-generated legal responses side by side.

• Evaluate each response against a standardized assessment rubric.

• Assess legal accuracy, reasoning quality, completeness, relevance, and practical applicability.

• Identify material differences, omissions, inconsistencies, and potential legal inaccuracies.

• Provide concise, precise, and well-reasoned written feedback for every evaluation.

• Apply evaluation criteria consistently and objectively across assigned tasks.

• Complete assignments independently while adhering to project guidelines and deadlines.

Requirements

• 5+ years of experience as in-house legal counsel practicing in the United Kingdom.

• Strong command of UK law, particularly commercial and contract matters.

• Practical experience advising businesses and assessing real-world legal and commercial risks.

• Excellent attention to detail and strong analytical judgment.

• Exceptional written English and the ability to communicate complex legal concepts clearly and concisely.

• Ability to distinguish legally accurate analysis from plausible but incorrect or incomplete reasoning.

• Comfortable working independently with structured evaluation rubrics.

• Strong ability to manage deadlines and consistently deliver high-quality assessments.

Engagement Details

• Initial Commitment: Approximately 10 hours

• Potential: Strong possibility of additional work based on project requirements and performance

• Work Arrangement: Fully remote

• Confidentiality: All project work will be subject to applicable confidentiality requirements and NDA obligations.

• Engagement Type: Independent contractor

Equal Employment Opportunity

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Contract and Payment Terms

• This is a fully remote engagement that can be completed on a flexible schedule.

• Projects may be extended, shortened, or concluded early depending on project requirements and performance.

• Work will not require access to confidential or proprietary information belonging to any employer, client, or institution.

• Payments are made weekly based on services rendered through supported payment platforms.

Upload your resume once and Scout applies for you

Apply with Scout