- 経験
- 5+ yrs
- 給料
- USD 80 – USD 80 / hour
- 求人情報
- 1
- 投稿済み
- 2時間前
- Work mode
- 在宅勤務
- 教育
- Bachelor's degree
- Eligibility
- U.S.-based information technology professionals with at least 5 years of enterprise IT experience, strong documentation and technical analysis skills, and the ability to work independently on remote project-based consulting assignments.
- Resume
- Required to apply
仕事内容
Role overview
This contract-based opportunity is for seasoned information technology professionals who want to support the improvement of large language models by bringing real enterprise IT judgment into the evaluation process. The work focuses on assessing AI-generated outputs, building realistic business and technical scenarios, and helping create benchmark data that reflects how modern IT organizations operate.
This is not a full-time role. Engagements are project-based and part-time, and you will act as an independent expert consultant rather than an employee. The opportunity is limited to U.S.-based specialists working remotely.
Project focus
The assignment is centered on creating strong evaluation datasets for enterprise IT workflows. Consultants will use authentic business and technical materials from information technology environments to design tasks that test AI systems on accuracy, reasoning, and document understanding.
Work may include developing or curating source materials, writing prompts, preparing expert benchmark answers, building scoring rubrics, and reviewing model outputs against professional standards. The goal is to capture the complexity of real IT decision-making, terminology, and operational practices.
Example subject areas
- Enterprise IT operations
- Infrastructure and systems administration
- Cloud architecture and cloud services
- Network operations
- Cybersecurity and information security
- IT service management
- Software development lifecycle
- Enterprise software deployment
- IT project and program leadership
- Technology strategy and digital transformation
- Identity and access management
- Business continuity and disaster recovery
- IT governance, risk, and compliance
- Software licensing and asset administration
- Help desk and technical support
Consulting terms
This engagement is structured as a project-based consulting arrangement. Compensation is handled on a per-project basis, with the stated hourly rate serving only as an estimate of expected completion time. Consultants set their own schedules, use their own tools, and may work with other clients or employers where permitted by those arrangements.
Responsibilities
- Build realistic enterprise IT scenarios drawn from your own professional background.
- Create or assemble business and technical reference materials such as Word, Excel, or PowerPoint files that mirror authentic IT workflows.
- Write prompts that require document interpretation, technical analysis, and business judgment.
- Draft high-quality expert reference answers.
- Develop detailed evaluation rubrics for judging accuracy, completeness, reasoning quality, and domain expertise.
- Review AI-generated answers from leading models and provide structured critique.
- Spot factual mistakes, technical flaws, unsupported assumptions, security issues, and reasoning gaps.
- Make sure all outputs align with real enterprise IT practices and industry norms.
Expected deliverables
- Enterprise source document(s)
- Business or technical prompt
- Expert reference response
- Evaluation rubric
- Side-by-side assessment of AI model responses
Qualifications
Applicants should bring deep enterprise IT experience and the ability to assess complex technical material with precision. A bachelor’s degree is preferred, or equivalent professional experience in a relevant field.
- Bachelor’s degree or equivalent experience in Information Technology, Computer Science, Information Systems, Software Engineering, Cybersecurity, or a related discipline.
- At least 5 years of professional enterprise IT experience.
- Hands-on exposure to enterprise documentation, technical specifications, operational reporting, architecture diagrams, project materials, or executive presentations.
- Strong understanding of enterprise technology environments and IT operations.
- Excellent written communication skills.
- Careful attention to detail when reviewing complex technical and business content.
Preferred background
- Enterprise infrastructure
- Cloud platforms such as Azure, AWS, or Google Cloud
- Systems administration
- Network engineering
- Cybersecurity
- Identity and access management
- IT service management and ITIL
- DevOps
- Site reliability engineering
- Enterprise applications
- Software development
- Database administration
- IT project or program management
- Technology consulting
- Digital transformation
- IT governance, risk, and compliance
Preferred documentation experience
- Technical design documents
- Solution architecture documents
- Standard operating procedures
- Incident and post-incident reports
- Security assessments
- IT strategy documents
- Implementation plans
- Technical project documentation
- Executive technology presentations
- Business continuity and disaster recovery plans
Additional information
Only U.S.-based experts are being considered for this remote consulting work.
The organization notes that consultants will be paid per project, even though the compensation is presented with an estimated hourly equivalent of $80/hour.
All deliverables should reflect genuine enterprise IT workflows and professional standards.