Assess AI and human-produced pre-sales and solutions engineering deliverables by developing task-specific grading criteria, evaluating outputs, and providing evidence-based written justifications. Define standards across discovery, demos, POCs, RFPs, architecture, and risk assessments. Refine frameworks with senior feedback and ensure reproducible, defensible evaluations.
This role is for one of our clients
Compensation: $100-$150 per hour
1. OverviewWe are seeking experienced Sales Engineering and Solutions Engineering professionals to contribute to a research initiative focused on evaluating how effectively advanced AI systems perform real-world technical sales and pre-sales work.
In this role, you will bring your professional expertise to define what excellent technical sales work looks like. Rather than simply producing deliverables, you will develop task-specific evaluation criteria, assess AI-generated and human work samples, and provide rigorous written reasoning behind your assessments.
Your practical experience working with customers, technical teams, and complex B2B products will help establish realistic standards for evaluating AI performance across the sales engineering lifecycle.
Requirements2. Key Responsibilities
- Develop precise, task-specific grading criteria for real-world pre-sales and solutions engineering deliverables, including:
- Technical discovery plans
- Tailored product demonstrations
- Proof-of-concept and technical evaluation plans
- Security questionnaires and RFP responses
- Integration, API, and architecture explanations
- Product-fit and technical-risk assessments
- Evaluate AI-generated and human-produced work against defined criteria and provide detailed written justifications for each assessment.
- Assess whether technical recommendations accurately address customer requirements and business objectives.
- Evaluate the quality of technical discovery, solution design, product positioning, and objection handling.
- Apply consistent, evidence-based judgment to ensure evaluation results are reproducible and defensible.
- Identify gaps, inaccuracies, unclear assumptions, and technical risks in proposed solutions.
- Incorporate structured feedback from senior reviewers and continuously refine evaluation standards.
- Translate practical sales engineering judgment into clear, structured evaluation frameworks.
- 4+ years of professional experience as a:
- Sales Engineer
- Solutions Engineer
- Solutions Consultant
- Pre-Sales Consultant
- Technical Sales Consultant
- Or in a closely related technical customer-facing role
- Deep understanding of the end-to-end pre-sales process, including:
- Technical discovery
- Requirements gathering
- Solution design
- Tailored product demonstrations
- Technical objection handling
- Proof-of-concept development
- Product-fit analysis
- Technical risk assessment
- Hands-on experience working with technically complex B2B software and technology products, such as:
- SaaS platforms
- Cloud infrastructure
- Cybersecurity solutions
- Data platforms
- Developer tools
- Enterprise applications
- Strong ability to translate customer requirements into practical technical solutions.
- Exceptional written communication skills, with the ability to clearly explain why a technical solution would or would not meet the expectations of both technical and business stakeholders.
- Highly detail-oriented and consistent, with strong analytical and evaluation skills.
- Comfortable receiving feedback and calibrating professional judgment against experienced peers.
- Prior experience with AI training, model evaluation, human-data projects, or AI-assisted workflows is a strong plus.
- Submit your resume or relevant professional background to begin the application process.
- Qualified candidates may be asked to complete a brief technical or domain-specific assessment.
- Additional information about your sales engineering experience may be requested during the evaluation process.
- You will be engaged as an independent contractor.
- This is a fully remote opportunity with flexible scheduling.
- Projects may be extended, shortened, or concluded early depending on project requirements and performance.
- The engagement will not require access to confidential or proprietary information belonging to any employer, client, or institution.
- Payments are made weekly based on services rendered through available payment platforms.
- H-1B and STEM OPT candidates are not currently supported.
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Similar Jobs
Insurance
The Sales Engineering Expert discovers prospective customers’ technical and business requirements, designs and executes evaluations and pilots, and presents tailored solution designs. Responsibilities include building trusted customer relationships, authoring RFI/RFP documents, supporting proposals and statements of work, demonstrating Arity products, advising product teams on roadmap needs, conducting competitive research, and creating presentations and interactive demonstrations for customer engagements, conferences, and events.
Fintech • HR Tech
Own CX data infrastructure, including pipelines, data models, governance, monitoring systems, and Streamlit dashboards. Apply advanced statistics and AI-assisted anomaly detection to identify customer experience opportunities and performance issues. Partner with CX leaders, data science, engineering, and Salesforce teams to define metrics, answer causal questions, and guide operational decisions. Establish data quality standards, validate AI-generated outputs, communicate insights clearly, and mentor data practitioners.
Top Skills:
DatabricksDbtPythonSalesforceSnowflakeSQLStreamlit
.png)
Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Manage marketplace business operations and day-to-day functions while delivering strategic transformation projects. Build scalable systems to replace manual processes, establish operational rigor across teams, oversee billing and fulfillment programs for key accounts, and use AI to automate workflows. The role requires strong organization, analytical problem-solving, project management, communication, and cross-functional collaboration skills.
Top Skills:
AI
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
