This role is for one of our clients Pay: 150–200/hour Role Type: Contractor Location: Remote We are seeking a motivated and detail-oriented Junior Software Engineer to contribute to the evaluation and improvement of advanced artificial intelligence systems. This opportunity is ideal for early-career software engineers with strong programming fundamentals, analytical thinking, and practical experience developing and reviewing software applications. In this role, you will evaluate AI-generated code for correctness, quality, efficiency, and design. You will create challenging programming problems, develop reference solutions and test cases, and assess AI models' ability to solve real-world software engineering challenges. You will also review technical reasoning related to debugging, architecture, and system design, providing structured feedback to improve the reliability and performance of AI-generated solutions. The ideal candidate has professional software engineering experience, a solid understanding of programming principles, and the ability to explain technical decisions clearly. Prior experience in artificial intelligence is not required. Requirements Key Responsibilities • AI-Generated Code Evaluation: Review AI-generated code for functional correctness, readability, maintainability, efficiency, and adherence to software engineering best practices. • Coding Problem Development: Design challenging programming problems that assess algorithmic thinking, debugging skills, implementation quality, and practical engineering judgment. • Reference Solution Creation: Develop accurate, well-structured reference solutions that demonstrate effective approaches to solving software engineering problems. • Test Case Development: Create comprehensive test cases to validate functionality, identify edge cases, and detect incomplete or incorrect implementations. • Technical Reasoning Assessment: Evaluate AI-generated explanations and decisions involving software architecture, system design, debugging, and implementation strategies. • Code Quality Analysis: Identify bugs, inefficient algorithms, poor design choices, security concerns, and violations of established coding standards. • Technical Feedback: Provide detailed, actionable feedback explaining errors, weaknesses, and opportunities to improve code quality and model performance. • Documentation: Clearly document problem requirements, expected behavior, solution approaches, testing procedures, and technical evaluation findings. • Quality Assurance: Ensure that coding tasks, reference solutions, and evaluation criteria are accurate, consistent, and reproducible. Required Qualifications • At least one year of professional experience as a software engineer at a well-established technology company. • At least part of the relevant professional experience should have been gained within the past three years. • Strong understanding of programming fundamentals, data structures, algorithms, and object-oriented programming. • Practical experience writing, debugging, testing, and reviewing code. • Familiarity with software development practices, including version control, code reviews, testing, and debugging. • Ability to assess code for correctness, performance, readability, and maintainability. • Foundational understanding of software architecture and system design principles. • Strong analytical and problem-solving skills. • Excellent written communication skills, with the ability to explain technical decisions and complex engineering concepts clearly. • Ability to work independently and deliver accurate, high-quality technical assessments. Must-Have Skills • Software Engineering Fundamentals • Programming and Coding • Data Structures and Algorithms • Code Review and Quality Assessment • Debugging and Troubleshooting • Automated Testing and Test Case Development • Problem-Solving and Logical Reasoning • Technical Documentation and Written Communication Good-to-Have Skills • Python, Java, C++, JavaScript, TypeScript, Go, or similar programming languages • Object-Oriented Programming and Design Patterns • API Development and Backend Engineering • Software Architecture and System Design • Performance Optimization and Profiling • Git and Version Control • Unit Testing and Integration Testing • CI/CD and Software Development Workflows • AI-Generated Code Evaluation • Familiarity with AI coding assistants and model benchmarking Preferred Qualifications • Professional software engineering experience at a recognized technology company. • Experience developing and maintaining production-quality applications, services, or APIs. • Familiarity with reviewing complex codebases and identifying implementation weaknesses. • Experience designing coding exercises, technical assessments, or automated evaluation tests. • Candidates based in English-speaking countries are preferred. • Ability to communicate technical findings in clear, structured, and concise English.