Principal responsibilities:
• Design develop platform capabilities that span AWS, GCP, Azure, Alibaba Cloud (Ali) environments, enabling seamless cloud on-premise AI deployments.
• Design development of a core platform component—AI Gateway—delivering high-concurrency, low-latency AI gateway services.
• Ensure strict adherence to architectural principles, technical standards, security requirements, the software development life cycle (SDLC).
• Troubleshoot complex platform issues, ensuring successful, high-quality, resilient AI services in production.
• Establish best practices fengineering, including CI/CD, automated testing, service monitoring, etc., drive continual improvement of engineering processes.
Qualifications:
• Bachelor’s Master’s degree in Computer Science, Software Engineering, a related field; equivalent experience will be considered.
• 6+ years of experience in software engineering, with at least 3 years in engineering role focusing on large scale platform projects.
• Proven hands-on experience with AI gateway solutions; familiarity with one more AI gateway platforms such as Portkey-AI, APISIX, Kong AI Gateway, Higress, similar.
• Proven expertise in cloud platforms (AWS, GCP, Azure, Alibaba Cloud/ Ali) containerchestration technologies (e.g., Kubernetes, Docker).
• Experience implementing Responsible AI controls, data governance, compliance frameworks is highly desirable.
• Proficiency in programming languages commonly used in AI (e.g., Python) cloud micro-services (e.g., Golang / Java)
• Excellent problem-solving, communication, stakeholder management skills, with a proven ability to deliver large-scale, mission-critical platforms from concept to production.