Crossing Hurdles is seeking a Senior Software Engineer specializing in Java for a contractor assignment. The role involves designing and developing software engineering tasks, analyzing GitHub issues, and collaborating with research teams to evaluate LLM performance.
Responsibilities:
- Design and develop verifiable software engineering tasks using public repository data
- Analyze and triage GitHub issues across widely-used open-source repositories
- Set up, configure, and manage development environments including Dockerization
- Evaluate unit test coverage, code quality, and repository robustness
- Run, modify, and test real-world Java codebases to assess LLM performance
- Identify incorrect outputs, weak reasoning, and grounding issues in model responses
- Collaborate with research teams to identify challenging datasets for LLM training
- Expand dataset coverage across different programming complexities and use cases
- Lead or support junior engineers in repository evaluation and task execution
Requirements:
- Strong proficiency in Java is mandatory
- Hands-on experience with Git and Docker
- Minimum 3 years of software engineering experience
- Ability to understand and navigate complex, large-scale codebases
- Experience working with high-quality public repositories (5000+ stars preferred)
- Strong analytical thinking and debugging skills
- Familiarity with testing frameworks and software pipeline setup
- Ability to work independently in a remote environment
- Reliable system setup with stable internet connection