About SoftBank: SoftBank is making significant investments in infrastructure for AI. SoftBank Corp. has recently established a new US center in Sunnyvale CA, focused on infrastructure software for AI and AI foundations for mobile networks. As an AI Infrastructure Engineering Intern, you will contribute to developing and optimizing infrastructure software for supporting state-of-the-art GenAI training, fine-tuning and inferencing workloads models, working in the Infrinia team.
You will work closely with a team of experts to push the boundaries of AI infrastructure and applications, helping to shape products that redefine AI for modern data center and edge use cases. We offer SOTA large-scale GPU infrastructure, high-quality data and a collaborative environment for cutting-edge research & development.
This internship is suitable for graduate students. We will consider exceptional upper division
undergraduate students. Timing of these internships is flexible and some can also be made available round the year.
Qualifications:
• Enrolled in the graduate degree or upper division of bachelor’s degree in Computer Science,
Electrical Engineering, or a related field.
• Coursework and proficiency in Cloud/Distributed Systems, Operating Systems and Networking.
• Familiarity/Experience with Kubernetes and container orchestration.
• Familiarity/Experience with AI frameworks, LLMs, workflows and cutting-edge research.
• Hands-on projects demonstrating experience with building systems, cloud software and solutions, especially for GenAI would be a plus.
Responsibilities Include:
• Research and design intelligent workload placement strategies for AI/ML workloads.
• Implement strategies as part of systems software on large-scale GPU systems.
• Contribute to developing control plane for workloads including scheduling and orchestration.
• Design and implement innovative Observability dashboards for AI/ML workloads.
• Design and implement APIs for Observability portal to interact with the infrastructure.
• Stay current with advancements in AI/ML infrastructure, contribute to cutting-edge research,
implement findings to improve performance and author papers.
Salary and Benefits:
Competitive base salary, relocation. Great Sunnyvale downtown location with access to Caltrain,
restaurants and facilities.
