About Us
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role overview
We are looking for an AI Evaluation Engineer with a strong research background to design and evaluate complex, multi-agent tasks used to benchmark next-generation AI systems.
In this role, you will work at the intersection of research, data structuring, and AI evaluation, building high-quality tasks that require deep document understanding, structured reasoning, and multi-step synthesis. You will create datasets and evaluation frameworks that test whether AI agents can truly read, reason, and extract knowledge from large-scale unstructured data.
This is a high-precision, detail-oriented role requiring strong analytical thinking, structured problem decomposition, and the ability to translate research content into measurable evaluation tasks.
Commitments Required: 8 hours per day with an overlap of 4 hours with PST.
Employment type: Contractor assignment (no medical/paid leave)
Duration of contract: 5 weeks+
Location: Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Indonesia, Kenya, Nigeria,Turkey, Vietnam
Interview: take home assessment (60min)
Requirements
AI Evaluation Engineer (Knowledge & Research) • KE
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions.With a strong background in software engineering and leadership, we help comp... Show more
About Digital Green Digital Green is a global development organization that empowers smallholder farmers through digital solutions, data, and partnerships.We work at the intersection of technology ... Show more
The Operations Specialist will leverage advanced technical skills to optimize internal processes and deliver innovative solutions within the Operations Department.This role combines programming exp... Show more
Full-time contractor (hours negotiable).Remote - Africa/Europe time zones (strong preference for candidates based in Africa).Our platform automates data exchange and digital workflows so that gover... Show more
Principal Statistical Programmer.ICON plc is a world-leading healthcare intelligence and clinical research organization.We’re proud to foster an inclusive environment driving innovation and excelle... Show more
ICON plc is a world-leading healthcare intelligence and clinical research organization.We’re proud to foster an inclusive environment driving innovation and excellence, and we welcome you to join u... Show more
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions.With a strong background in software engineering and leadership, we help comp... Show more
ICON plc is a world-leading healthcare intelligence and clinical research organization.We’re proud to foster an inclusive environment driving innovation and excellence, and we welcome you to join u... Show more
The Power BI Analyst & Dashboard Developer integrates data from company’s Electronic Medical Record (EMR), CRM, survey platforms, and outcome tracking tools into clean, validated dash... Show more
ICON plc is a world-leading healthcare intelligence and clinical research organization.We’re proud to foster an inclusive environment driving innovation and excellence, and we welcome you to join u... Show more
We are seeking a highly skilled and compliance-minded AI Specialist to design, build, and deploy artificial intelligence and machine learning solutions that drive automation, operational ... Show more
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions.With a strong background in software engineering and leadership, we help comp... Show more
ICON plc is a world-leading healthcare intelligence and clinical research organization.We’re proud to foster an inclusive environment driving innovation and excellence, and we welcome you to join u... Show more
Job Title: Full-Stack AI Engineer.Our client is seeking a Full-Stack AI Engineer to design, build, and deploy AI-powered applications that bridge modern software engineering with applied machine le... Show more
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions.With a strong background in software engineering and leadership, we help comp... Show more
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions.With a strong background in software engineering and leadership, we help comp... Show more
AI Automation Specialist (Zapier, APIs, ChatGPT, Workflow Automation) – Remote | U.Deploying workflows that drive measurable impact.If you’ve actually built automations end-to-end and can connect s... Show more
Principal Statistical Programmer.ICON plc is a world-leading healthcare intelligence and clinical research organization.We’re proud to foster an inclusive environment driving innovation and excelle... Show more
