LATAM Software Engineers: Coding Tasks for AI Evaluation
Terac
About the role
What We're Researching We're running a paid study on the effectiveness of coding tasks used to evaluate AI agents. Our team is building a comprehensive suite of programming environments designed to test complex software capabilities. We want to ensure these evaluation frameworks are realistic, accurate, and properly calibrated. How It Works You will review a series of proposed coding tasks and assess their suitability for testing AI agents. We will ask you to verify the logic of the evaluation harnesses and provide feedback on their realistic application. You will share your screen to walk…
This is a preview. Sign in to read the full posting and apply.
Sign in to like this job and keep private notes on it.