Gen AI Integration Engineer
Cloudpermit is a fully multi-tenant SaaS platform hosted on Google Cloud. Our technology stack includes Clojure, ClojureScript, Datomic, and Elasticsearch. This position demands a blend of specialized AI technical skills, strong engineering practices, and knowledge of maintaining AI systems that are consistent, compliant, and cost-efficient across various business applications.
About Cloudpermit
Cloudpermit is the fastest-growing community development, SaaS (software-as-a-service) company in North America. We provide local governments and their citizens with cloud-based software products for all land management processes, including permitting, code/zone enforcement, business licensing, city planning, and more. Headquartered in Reston, VA, Cloudpermit was founded 15 years ago and is growing rapidly across North America. Cloudpermit is committed to delivering efficient, accessible, and smart land management software for agencies and citizens nationwide.
Key Responsibilities
- Transform our applications with cutting-edge generative AI by bridging powerful LLMs with practical business solutions.
- Architect and implement comprehensive AI integration strategies across our product suite.
- Evaluate and select appropriate models (Gemini, OpenAI, Claude, etc.) based on performance benchmarks, use case requirements, and cost efficiency.
- Create robust RAG frameworks that ensure factual accuracy and domain relevance.
- Develop sophisticated prompt management systems that maintain output consistency across deployments.
- Establish comprehensive compliance guardrails to ensure AI outputs meet regulatory and ethical standards.
- Design evaluation methodologies for model performance metrics, hallucination detection, and business impact measurement.
- Implement cost optimization strategies through intelligent caching, token management, and model routing.
Technical Focus Areas
- Model Integration & Selection: Strategic integration of third-party LLMs with application-specific evaluation criteria.
- Retrieval Systems: Vector database design, embedding optimization, and hybrid search methodologies.
- Consistency & Compliance: Implementation of validation layers, output standardization, and regulatory alignment checks.
- Prompt Engineering: Development of reusable prompt templates, version control systems, and testing frameworks.
- Performance Optimization: Token usage analytics, response streaming, and intelligent model selection.
Your Background
- Engineering background with demonstrable experience building and shipping AI-powered products.
- Practical expertise integrating commercial LLMs via APIs into production environments.
- Technical proficiency with vector databases and RAG architectures.
- Autonomous Agent & MCP Integration: Proven expertise in developing autonomous AI agents utilizing the Model Context Protocol (MCP) standard to enable secure, standardized integration with external payment solutions and government platforms, supporting streamlined data exchange and sophisticated workflow automation.
- Demonstrated ability to implement systems that ensure consistent and compliant AI outputs.
- Experience with prompt engineering and LLM optimization techniques.
- Strong collaboration skills with cross-functional teams, including product, design, and compliance.
Requirements
- 5+ years of software engineering experience.
- 1+ years' experience implementing LLM-based solutions in production environments.
- Proficiency with AI frameworks like LangChain, LlamaIndex, or equivalent custom solutions.
- Experience with vector databases such as Pinecone, Chroma, Weaviate, and Elastic.
- Understanding of compliance requirements in AI systems, including data privacy considerations.
- Ability to build monitoring and validation systems for AI outputs.
Company Culture
Focus - We are focused on our passion, work ethic, and goals, so we can continue to push forward and create innovative software.
Collaboration - We work and succeed as a team at Cloudpermit because we're stronger together. We accept each other’s strengths so we can learn from one another and become better.
Respect - Respecting our customers, and respecting each other, is of the utmost importance. We trust our team to do great work and stay open to new ideas.
The Cloudpermit team is comprised of motivated, positive, and tech-savvy team members. We enjoy working as a team to solve problems and thrive on collective and personal success. At Cloudpermit, you will be assigned engaging and challenging projects and will have opportunities to give input and direction. The Cloudpermit work environment is inclusive, challenging, and rewarding.