Lead system design for AI/ML services, develop prompting strategies, mentor junior engineers, and ensure code quality while improving product delivery.
Who You Are:
You have 6+ years of software development experience under your belt and are looking for your next challenge in a hyper-growth, fast-paced, industry disrupting, SaaS company. You are excited to work with emerging technologies and modern tech stack with a collaborative engineering team, where you will have a direct impact in the delivery of first class software products. Your experience mentoring others, working with distributed systems, relational databases, and all things software development has prepared you to take your career to the next level.
Does this sound like you? If so, keep reading and apply today!
What you’ll do:
- Lead and contribute to the system design for our AI/ML-based services
- Develop, implement, and test prompting strategies for a variety of products over various LLMs
- Analyze internal and external feedback and behaviors to continuously improve the quality of prompts and language output
- Research and adopt best practices based on experience, analysis, and input from the broader software team.
- Develop code that is highly readable, maintainable, and testable including documentation, excellent architecture, and automated testing
- Actively participate in interviewing and evaluating new team members
- Mentor junior members of the software engineering team in all aspects of software development across multiple projects with multiple customers
- Prioritize your work and the work of others with a sense of urgency to ship products in time to have the desired business impact while balancing a quality mindset
- Review code, help drive technical excellence through best practices and latest tools
What you have:
- Bachelor's degree in Computer Science or a related field
- 6+ years of professional experience
- Foundational knowledge of Natural Language Processing (NLP) and Machine Learning tailored to a specific business need
- Senior level experience working with Large Language Models such as GPT-3/4, ChatGPT, Claude, or CoHere
- Proficiency in Python, Javascript, SQL, C#
- Knowledge of cloud computing platforms and AI deployment tools
- A strong background in AI product development
- Ability to define and execute on strategic and visionary goals
- Excellent communication skills
- Ability to work in a team environment
Extras you bring to the table:
- Deploying into a public cloud service (AWS, GCP, etc.)
- Experience with containerization (Docker/Kubernetes)
- Experience in deploying AI tools
- Ability to gather and preprocess data for use in ML and AI
- Experience with service monitoring, metrics, alerting, log aggregation, and tracing
- Experience with functional/acceptance testing
- Experience with popular AI frameworks and libraries such as TensorFlow, PyTorch, huggingface, Amazon Bedrock, or Anthropic
Why join Polly?
- We are attacking a trillion-dollar market with gross inefficiencies and seeking to transform the way an entire industry operates
- We have an experienced leadership team that previously built large and impactful platforms
- Outstanding opportunity for professional growth and upward mobility
- Direct engagement with the decision makers and senior business leaders
- Competitive salaries
- 100% paid medical/vision/dental/disability/life insurance
- Flexible vacation
Let's get to know each other.
Polly has pioneered the next generation of mortgage capital markets technology with its cutting-edge, data-driven platform. Its enterprise-grade solutions, including the industry's only cloud-native, commercially scalable product, pricing, and eligibility (PPE) engine and first-of-its-kind Polly/™ AI platform, empower the nation's top banks, credit unions, and mortgage lenders to increase profitability, automate workflows, and revolutionize the loan officer and broker experiences. As a mortgage technology trailblazer, Polly is committed to driving meaningful value and ROI through best-in-class innovation that enables unlimited configurability, flexibility, granularity, and scalability. Polly was founded by a seasoned team of mortgage capital markets and technology experts and is headquartered in San Francisco, California. Recognized as a pioneer in mortgage capital markets, as well as in culture and career development, Polly was named to Forbes' America's Best Startup Employers in 2025. This evaluation was based on three key criteria: Employer Reputation, Employee Satisfaction, and Company Growth.
To learn more, follow Polly on LinkedIn or visit www.polly.io. Polly is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, age, color, national origin, religion, sex, gender identity, sexual orientation, marital status, pregnancy status, disability status, veteran status, or any other legally protected status. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Beware of recruitment scams impersonating the Polly brand or our employees. Our team communicates only through official Polly channels, and we will never ask for sensitive information over text or conduct text-only interviews. If you are ever suspicious or in doubt, reach out to us directly at [email protected]. We care deeply about this network and your experience.
Top Skills
Amazon Bedrock
Anthropic
AWS
C#
Docker
GCP
Huggingface
JavaScript
Kubernetes
Python
PyTorch
SQL
TensorFlow
Similar Jobs
Security • Software • Cybersecurity • Automation
The Software Engineering Manager oversees software application development, manages a team, ensures effective delivery, and drives technical decisions while practicing agile methodologies.
Top Skills:
AWSGitJavaScriptMySQLNode.jsOopReactTerraformTypeormTypescript
Automotive • Professional Services • Software • Consulting • Energy • Chemical • Renewable Energy
The Senior Electrical Engineer will review and assess electrical engineering design documentation and oversee construction compliance for solar PV projects, managing multiple projects and supporting investor services.
Top Skills:
DigsilentEmtpEtapMS OfficeSkm Powertools
Artificial Intelligence • eCommerce • Information Technology • Internet of Things • Automation
Lead implementation of complex Azure Databricks solutions, collaborate on architecture, mentor junior staff, and support customer data strategies.
Top Skills:
AzureAzure Analysis ServicesAzure Data LakeAzure FunctionsAzure Synapse AnalyticsCosmos DbData FactoryDatabricksDaxEltETLPower BIPower QueryPythonRSnowflakeSQLSQL ServerT-Sql
What you need to know about the Boston Tech Scene
Boston is a powerhouse for technology innovation thanks to world-class research universities like MIT and Harvard and a robust pipeline of venture capital investment. Host to the first telephone call and one of the first general-purpose computers ever put into use, Boston is now a hub for biotechnology, robotics and artificial intelligence — though it’s also home to several B2B software giants. So it’s no surprise that the city consistently ranks among the greatest startup ecosystems in the world.
Key Facts About Boston Tech
- Number of Tech Workers: 269,000; 9.4% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Thermo Fisher Scientific, Toast, Klaviyo, HubSpot, DraftKings
- Key Industries: Artificial intelligence, biotechnology, robotics, software, aerospace
- Funding Landscape: $15.7 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Summit Partners, Volition Capital, Bain Capital Ventures, MassVentures, Highland Capital Partners
- Research Centers and Universities: MIT, Harvard University, Boston College, Tufts University, Boston University, Northeastern University, Smithsonian Astrophysical Observatory, National Bureau of Economic Research, Broad Institute, Lowell Center for Space Science & Technology, National Emerging Infectious Diseases Laboratories
